Jul 17 21:01:47.128329 ip-10-0-131-37 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 17 21:01:47.128343 ip-10-0-131-37 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 17 21:01:47.128353 ip-10-0-131-37 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 17 21:01:47.128668 ip-10-0-131-37 systemd[1]: Failed to start Kubernetes Kubelet. Jul 17 21:01:57.377415 ip-10-0-131-37 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 17 21:01:57.377433 ip-10-0-131-37 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 86b3be3b9ab5432990abcb07a2ed5e55 -- Jul 17 21:03:39.645866 ip-10-0-131-37 systemd[1]: Starting Kubernetes Kubelet... Jul 17 21:03:40.064669 ip-10-0-131-37 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 21:03:40.064669 ip-10-0-131-37 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 17 21:03:40.064669 ip-10-0-131-37 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 21:03:40.064669 ip-10-0-131-37 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 17 21:03:40.064669 ip-10-0-131-37 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 21:03:40.064669 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.063070 2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 17 21:03:40.072569 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069331 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 21:03:40.072569 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069343 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 21:03:40.072569 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069347 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 21:03:40.072569 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069350 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 21:03:40.072569 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069353 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 21:03:40.072569 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069356 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 21:03:40.072569 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069359 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 17 21:03:40.072569 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069362 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 21:03:40.072569 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069365 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 21:03:40.072569 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069368 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 21:03:40.072569 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069370 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 21:03:40.072569 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069374 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 21:03:40.072569 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069377 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 21:03:40.072569 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069380 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 21:03:40.072569 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069383 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 21:03:40.072569 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069386 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 21:03:40.072569 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069389 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 21:03:40.072569 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069392 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 21:03:40.072569 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069394 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 21:03:40.072569 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069401 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 21:03:40.100913 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069403 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 21:03:40.100913 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069406 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 21:03:40.100913 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069409 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 21:03:40.100913 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069412 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 21:03:40.100913 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069414 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 21:03:40.100913 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069417 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 21:03:40.100913 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069422 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 21:03:40.100913 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069425 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 21:03:40.100913 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069428 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 21:03:40.100913 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069431 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 21:03:40.100913 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069434 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 21:03:40.100913 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069436 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 21:03:40.100913 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069439 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 21:03:40.100913 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069444 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 21:03:40.100913 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069447 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 21:03:40.100913 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069450 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 21:03:40.100913 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069452 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 21:03:40.100913 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069455 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 21:03:40.100913 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069458 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 21:03:40.118118 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069461 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 21:03:40.118118 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069464 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 21:03:40.118118 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069467 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 21:03:40.118118 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069469 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 21:03:40.118118 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069472 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 21:03:40.118118 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069474 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 21:03:40.118118 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069477 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 21:03:40.118118 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069480 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 21:03:40.118118 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069482 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 21:03:40.118118 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069485 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 21:03:40.118118 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069488 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 21:03:40.118118 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069490 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 21:03:40.118118 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069493 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 21:03:40.118118 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069496 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 21:03:40.118118 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069499 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 21:03:40.118118 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069502 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 21:03:40.118118 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069504 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 21:03:40.118118 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069507 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 21:03:40.118118 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069509 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 21:03:40.118118 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069512 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 21:03:40.328184 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069515 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 21:03:40.328184 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069517 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 21:03:40.328184 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069520 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 21:03:40.328184 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069522 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 21:03:40.328184 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069525 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 21:03:40.328184 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069528 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 21:03:40.328184 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069530 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 21:03:40.328184 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069533 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 21:03:40.328184 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069535 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 21:03:40.328184 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069538 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 21:03:40.328184 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069541 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 21:03:40.328184 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069546 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 21:03:40.328184 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069548 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 21:03:40.328184 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069552 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 21:03:40.328184 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069554 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 21:03:40.328184 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069557 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 21:03:40.328184 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069560 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 21:03:40.328184 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069562 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 21:03:40.328184 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069565 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 21:03:40.138910 ip-10-0-131-37 systemd[1]: Started Kubernetes Kubelet. Jul 17 21:03:40.338640 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069568 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 21:03:40.338640 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069573 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 21:03:40.338640 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069577 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 21:03:40.338640 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069580 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 21:03:40.338640 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069583 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 21:03:40.338640 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069586 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 21:03:40.338640 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069589 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 21:03:40.338640 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069592 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 21:03:40.338640 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069594 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 21:03:40.338640 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069597 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 21:03:40.338640 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069600 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 21:03:40.338640 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069618 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 21:03:40.338640 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069621 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 21:03:40.338640 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069623 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 21:03:40.338640 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069626 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 21:03:40.338640 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069628 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 21:03:40.338640 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069631 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 21:03:40.338640 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069634 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 21:03:40.338640 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069636 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 21:03:40.338640 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069639 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 21:03:40.340931 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.069641 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 21:03:40.340931 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070365 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 21:03:40.340931 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070374 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 21:03:40.340931 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070378 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 21:03:40.340931 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070382 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 21:03:40.340931 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070385 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 21:03:40.340931 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070387 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 21:03:40.340931 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070390 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 21:03:40.340931 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070394 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 21:03:40.340931 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070397 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 21:03:40.340931 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070400 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 21:03:40.340931 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070403 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 21:03:40.340931 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070405 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 21:03:40.340931 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070409 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 21:03:40.340931 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070412 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 21:03:40.340931 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070416 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 21:03:40.340931 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070420 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 21:03:40.340931 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070424 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 21:03:40.340931 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070427 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 21:03:40.340931 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070430 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 21:03:40.342057 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070433 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 21:03:40.342057 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070435 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 21:03:40.342057 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070438 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 21:03:40.342057 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070440 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 21:03:40.342057 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070443 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 21:03:40.342057 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070446 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 21:03:40.342057 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070449 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 21:03:40.342057 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070451 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 17 21:03:40.342057 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070453 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 21:03:40.342057 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070456 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 21:03:40.342057 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070458 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 21:03:40.342057 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070461 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 21:03:40.342057 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070463 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 21:03:40.342057 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070466 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 21:03:40.342057 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070468 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 21:03:40.342057 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070471 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 21:03:40.342057 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070474 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 21:03:40.342057 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070476 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 21:03:40.342057 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070479 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 21:03:40.342057 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070482 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 21:03:40.342678 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070484 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 21:03:40.342678 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070487 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 21:03:40.342678 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070490 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 21:03:40.342678 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070492 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 21:03:40.342678 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070495 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 21:03:40.342678 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070497 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 21:03:40.342678 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070502 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 21:03:40.342678 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070505 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 21:03:40.342678 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070507 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 21:03:40.342678 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070509 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 21:03:40.342678 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070515 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 21:03:40.342678 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070518 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 21:03:40.342678 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070522 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 21:03:40.342678 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070524 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 21:03:40.342678 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070527 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 21:03:40.342678 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070529 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 21:03:40.342678 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070532 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 21:03:40.342678 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070534 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 21:03:40.342678 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070537 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 21:03:40.342678 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070539 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 21:03:40.343474 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070542 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 21:03:40.343474 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070545 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 21:03:40.343474 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070547 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 21:03:40.343474 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070550 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 21:03:40.343474 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070552 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 21:03:40.343474 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070555 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 21:03:40.343474 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070558 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 21:03:40.343474 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070560 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 21:03:40.343474 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070563 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 21:03:40.343474 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070565 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 21:03:40.343474 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070568 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 21:03:40.343474 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070570 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 21:03:40.343474 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070573 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 21:03:40.343474 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070575 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 21:03:40.343474 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070577 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 21:03:40.343474 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070581 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 21:03:40.343474 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070585 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 21:03:40.343474 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070588 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 21:03:40.343474 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070594 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 21:03:40.344086 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070596 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 21:03:40.344086 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070599 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 21:03:40.344086 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070601 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 21:03:40.344086 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070624 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 21:03:40.344086 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070635 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 21:03:40.344086 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070642 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 21:03:40.344086 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070646 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 21:03:40.344086 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070649 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 21:03:40.344086 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070651 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 21:03:40.344086 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070654 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 21:03:40.344086 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070657 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 21:03:40.344086 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070660 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 21:03:40.344086 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070662 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 21:03:40.344086 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070665 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 21:03:40.344086 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070668 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 21:03:40.344086 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070670 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 21:03:40.344086 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070673 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 21:03:40.344086 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070675 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 21:03:40.344086 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070679 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 21:03:40.344900 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070681 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 21:03:40.344900 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.070683 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 21:03:40.344900 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071077 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 21:03:40.344900 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071081 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 21:03:40.344900 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071084 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 21:03:40.344900 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071087 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 21:03:40.344900 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071090 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 21:03:40.344900 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071092 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 21:03:40.344900 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071095 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 21:03:40.344900 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071097 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 21:03:40.344900 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071100 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 21:03:40.344900 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071102 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 21:03:40.344900 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071107 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 21:03:40.344900 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071110 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 21:03:40.344900 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071112 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 21:03:40.344900 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071115 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 21:03:40.344900 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071117 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 21:03:40.344900 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071124 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 21:03:40.344900 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071128 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 21:03:40.345440 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071131 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 21:03:40.345440 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071134 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 21:03:40.345440 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071136 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 21:03:40.345440 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071139 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 21:03:40.345440 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071141 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 17 21:03:40.345440 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071145 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 21:03:40.345440 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071147 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 21:03:40.345440 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071150 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 21:03:40.345440 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071152 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 21:03:40.345440 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071156 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 21:03:40.345440 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071160 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 21:03:40.345440 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071164 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 21:03:40.345440 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071167 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 21:03:40.345440 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071170 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 21:03:40.345440 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071173 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 21:03:40.345440 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071177 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 21:03:40.345440 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071180 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 21:03:40.345440 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071183 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 21:03:40.345440 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071186 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 21:03:40.346186 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071189 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 21:03:40.346186 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071192 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 21:03:40.346186 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071195 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 21:03:40.346186 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071197 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 21:03:40.346186 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071200 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 21:03:40.346186 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071202 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 21:03:40.346186 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071207 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 21:03:40.346186 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071209 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 21:03:40.346186 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071212 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 21:03:40.346186 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071214 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 21:03:40.346186 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071217 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 21:03:40.346186 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071219 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 21:03:40.346186 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071229 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 21:03:40.346186 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071232 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 21:03:40.346186 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071235 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 21:03:40.346186 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071237 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 21:03:40.346186 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071240 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 21:03:40.346186 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071242 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 21:03:40.346186 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071245 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 21:03:40.346186 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071247 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 21:03:40.346793 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071250 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 21:03:40.346793 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071252 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 21:03:40.346793 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071255 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 21:03:40.346793 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071257 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 21:03:40.346793 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071260 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 21:03:40.346793 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071262 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 21:03:40.346793 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071265 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 21:03:40.346793 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071270 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 21:03:40.346793 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071272 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 21:03:40.346793 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071275 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 21:03:40.346793 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071277 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 21:03:40.346793 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071280 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 21:03:40.346793 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071282 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 21:03:40.346793 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071285 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 21:03:40.346793 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071287 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 21:03:40.346793 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071290 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 21:03:40.346793 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071292 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 21:03:40.346793 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071295 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 21:03:40.346793 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071298 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 21:03:40.346793 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071301 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 21:03:40.347451 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071304 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 21:03:40.347451 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071307 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 21:03:40.347451 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071309 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 21:03:40.347451 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071312 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 21:03:40.347451 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071316 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 21:03:40.347451 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071323 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 21:03:40.347451 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071326 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 21:03:40.347451 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071329 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 21:03:40.347451 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071332 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 21:03:40.347451 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071334 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 21:03:40.347451 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071337 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 21:03:40.347451 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071339 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 21:03:40.347451 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071342 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 21:03:40.347451 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071345 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 21:03:40.347451 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071348 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 21:03:40.347451 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071351 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 21:03:40.347451 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071353 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 21:03:40.347451 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071356 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 21:03:40.347451 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071359 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 21:03:40.347451 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071361 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 21:03:40.348112 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071364 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 21:03:40.348112 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071366 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 21:03:40.348112 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.071368 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 21:03:40.348112 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071458 2568 flags.go:64] FLAG: --address="0.0.0.0" Jul 17 21:03:40.348112 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071476 2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 17 21:03:40.348112 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071487 2568 flags.go:64] FLAG: --anonymous-auth="true" Jul 17 21:03:40.348112 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071491 2568 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 17 21:03:40.348112 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071495 2568 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 17 21:03:40.348112 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071498 2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 17 21:03:40.348112 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071502 2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 17 21:03:40.348112 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071507 2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 17 21:03:40.348112 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071510 2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 17 21:03:40.348112 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071513 2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 17 21:03:40.348112 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071516 2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 17 21:03:40.348112 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071520 2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 17 21:03:40.348112 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071522 2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 17 21:03:40.348112 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071527 2568 flags.go:64] FLAG: --cgroup-root="" Jul 17 21:03:40.348112 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071530 2568 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 17 21:03:40.348112 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071538 2568 flags.go:64] FLAG: --client-ca-file="" Jul 17 21:03:40.348112 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071542 2568 flags.go:64] FLAG: --cloud-provider="external" Jul 17 21:03:40.348112 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071544 2568 flags.go:64] FLAG: --cluster-dns="[]" Jul 17 21:03:40.348112 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071551 2568 flags.go:64] FLAG: --cluster-domain="" Jul 17 21:03:40.348112 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071553 2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 17 21:03:40.348112 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071557 2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 17 21:03:40.349900 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071560 2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 17 21:03:40.349900 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071563 2568 flags.go:64] FLAG: --container-log-max-files="5" Jul 17 21:03:40.349900 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071566 2568 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 17 21:03:40.349900 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071569 2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 17 21:03:40.349900 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071572 2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 17 21:03:40.349900 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071576 2568 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 17 21:03:40.349900 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071579 2568 flags.go:64] FLAG: --contention-profiling="false" Jul 17 21:03:40.349900 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071582 2568 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 17 21:03:40.349900 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071585 2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 17 21:03:40.349900 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071588 2568 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 17 21:03:40.349900 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071591 2568 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 17 21:03:40.349900 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071595 2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 17 21:03:40.349900 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071598 2568 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 17 21:03:40.349900 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071600 2568 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 17 21:03:40.349900 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071617 2568 flags.go:64] FLAG: --enable-load-reader="false" Jul 17 21:03:40.349900 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071620 2568 flags.go:64] FLAG: --enable-server="true" Jul 17 21:03:40.349900 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071623 2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 17 21:03:40.349900 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071632 2568 flags.go:64] FLAG: --event-burst="100" Jul 17 21:03:40.349900 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071637 2568 flags.go:64] FLAG: --event-qps="50" Jul 17 21:03:40.349900 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071639 2568 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 17 21:03:40.349900 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071642 2568 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 17 21:03:40.349900 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071645 2568 flags.go:64] FLAG: --eviction-hard="" Jul 17 21:03:40.349900 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071649 2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 17 21:03:40.349900 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071652 2568 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 17 21:03:40.351247 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071656 2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 17 21:03:40.351247 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071659 2568 flags.go:64] FLAG: --eviction-soft="" Jul 17 21:03:40.351247 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071662 2568 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 17 21:03:40.351247 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071670 2568 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 17 21:03:40.351247 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071674 2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 17 21:03:40.351247 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071677 2568 flags.go:64] FLAG: --experimental-mounter-path="" Jul 17 21:03:40.351247 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071679 2568 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 17 21:03:40.351247 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071682 2568 flags.go:64] FLAG: --fail-swap-on="true" Jul 17 21:03:40.351247 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071685 2568 flags.go:64] FLAG: --feature-gates="" Jul 17 21:03:40.351247 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071689 2568 flags.go:64] FLAG: --file-check-frequency="20s" Jul 17 21:03:40.351247 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071692 2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 17 21:03:40.351247 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071695 2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 17 21:03:40.351247 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071698 2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 17 21:03:40.351247 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071701 2568 flags.go:64] FLAG: --healthz-port="10248" Jul 17 21:03:40.351247 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071704 2568 flags.go:64] FLAG: --help="false" Jul 17 21:03:40.351247 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071707 2568 flags.go:64] FLAG: --hostname-override="ip-10-0-131-37.ec2.internal" Jul 17 21:03:40.351247 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071710 2568 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 17 21:03:40.351247 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071713 2568 flags.go:64] FLAG: --http-check-frequency="20s" Jul 17 21:03:40.351247 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071715 2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 17 21:03:40.351247 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071719 2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 17 21:03:40.351247 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071722 2568 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 17 21:03:40.351247 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071724 2568 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 17 21:03:40.351247 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071727 2568 flags.go:64] FLAG: --image-service-endpoint="" Jul 17 21:03:40.353522 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071730 2568 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 17 21:03:40.353522 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071733 2568 flags.go:64] FLAG: --kube-api-burst="100" Jul 17 21:03:40.353522 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071736 2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 17 21:03:40.353522 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071740 2568 flags.go:64] FLAG: --kube-api-qps="50" Jul 17 21:03:40.353522 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071743 2568 flags.go:64] FLAG: --kube-reserved="" Jul 17 21:03:40.353522 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071746 2568 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 17 21:03:40.353522 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071748 2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 17 21:03:40.353522 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071751 2568 flags.go:64] FLAG: --kubelet-cgroups="" Jul 17 21:03:40.353522 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071754 2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 17 21:03:40.353522 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071758 2568 flags.go:64] FLAG: --lock-file="" Jul 17 21:03:40.353522 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071760 2568 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 17 21:03:40.353522 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071763 2568 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 17 21:03:40.353522 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071766 2568 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 17 21:03:40.353522 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071777 2568 flags.go:64] FLAG: --log-json-split-stream="false" Jul 17 21:03:40.353522 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071780 2568 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 17 21:03:40.353522 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071783 2568 flags.go:64] FLAG: --log-text-split-stream="false" Jul 17 21:03:40.353522 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071785 2568 flags.go:64] FLAG: --logging-format="text" Jul 17 21:03:40.353522 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071788 2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 17 21:03:40.353522 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071791 2568 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 17 21:03:40.353522 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071794 2568 flags.go:64] FLAG: --manifest-url="" Jul 17 21:03:40.353522 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071797 2568 flags.go:64] FLAG: --manifest-url-header="" Jul 17 21:03:40.353522 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071801 2568 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 17 21:03:40.353522 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071804 2568 flags.go:64] FLAG: --max-open-files="1000000" Jul 17 21:03:40.353522 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071808 2568 flags.go:64] FLAG: --max-pods="110" Jul 17 21:03:40.353522 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071810 2568 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 17 21:03:40.355440 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071813 2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 17 21:03:40.355440 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071816 2568 flags.go:64] FLAG: --memory-manager-policy="None" Jul 17 21:03:40.355440 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071819 2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 17 21:03:40.355440 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071822 2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 17 21:03:40.355440 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071825 2568 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 17 21:03:40.355440 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071828 2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 17 21:03:40.355440 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071834 2568 flags.go:64] FLAG: --node-status-max-images="50" Jul 17 21:03:40.355440 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071837 2568 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 17 21:03:40.355440 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071840 2568 flags.go:64] FLAG: --oom-score-adj="-999" Jul 17 21:03:40.355440 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071843 2568 flags.go:64] FLAG: --pod-cidr="" Jul 17 21:03:40.355440 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071849 2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 17 21:03:40.355440 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071855 2568 flags.go:64] FLAG: --pod-manifest-path="" Jul 17 21:03:40.355440 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071857 2568 flags.go:64] FLAG: --pod-max-pids="-1" Jul 17 21:03:40.355440 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071860 2568 flags.go:64] FLAG: --pods-per-core="0" Jul 17 21:03:40.355440 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071863 2568 flags.go:64] FLAG: --port="10250" Jul 17 21:03:40.355440 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071866 2568 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 17 21:03:40.355440 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071869 2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f5663a836f33f327" Jul 17 21:03:40.355440 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071873 2568 flags.go:64] FLAG: --qos-reserved="" Jul 17 21:03:40.355440 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071877 2568 flags.go:64] FLAG: --read-only-port="10255" Jul 17 21:03:40.355440 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071880 2568 flags.go:64] FLAG: --register-node="true" Jul 17 21:03:40.355440 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071882 2568 flags.go:64] FLAG: --register-with-taints="" Jul 17 21:03:40.355440 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071893 2568 flags.go:64] FLAG: --registry-burst="10" Jul 17 21:03:40.355440 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071896 2568 flags.go:64] FLAG: --registry-qps="5" Jul 17 21:03:40.355440 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071899 2568 flags.go:64] FLAG: --reserved-cpus="" Jul 17 21:03:40.357331 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071902 2568 flags.go:64] FLAG: --reserved-memory="" Jul 17 21:03:40.357331 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071905 2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 17 21:03:40.357331 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071908 2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 17 21:03:40.357331 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071911 2568 flags.go:64] FLAG: --rotate-certificates="false" Jul 17 21:03:40.357331 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071914 2568 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 17 21:03:40.357331 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071917 2568 flags.go:64] FLAG: --runonce="false" Jul 17 21:03:40.357331 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071920 2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 17 21:03:40.357331 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071922 2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 17 21:03:40.357331 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071925 2568 flags.go:64] FLAG: --seccomp-default="false" Jul 17 21:03:40.357331 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071928 2568 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 17 21:03:40.357331 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071931 2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 17 21:03:40.357331 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071934 2568 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 17 21:03:40.357331 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071936 2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 17 21:03:40.357331 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071939 2568 flags.go:64] FLAG: --storage-driver-password="root" Jul 17 21:03:40.357331 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071942 2568 flags.go:64] FLAG: --storage-driver-secure="false" Jul 17 21:03:40.357331 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071945 2568 flags.go:64] FLAG: --storage-driver-table="stats" Jul 17 21:03:40.357331 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071948 2568 flags.go:64] FLAG: --storage-driver-user="root" Jul 17 21:03:40.357331 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071950 2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 17 21:03:40.357331 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071955 2568 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 17 21:03:40.357331 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071958 2568 flags.go:64] FLAG: --system-cgroups="" Jul 17 21:03:40.357331 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071961 2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 17 21:03:40.357331 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071966 2568 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 17 21:03:40.357331 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071969 2568 flags.go:64] FLAG: --tls-cert-file="" Jul 17 21:03:40.357331 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071971 2568 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 17 21:03:40.357331 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071977 2568 flags.go:64] FLAG: --tls-min-version="" Jul 17 21:03:40.358021 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071981 2568 flags.go:64] FLAG: --tls-private-key-file="" Jul 17 21:03:40.358021 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071984 2568 flags.go:64] FLAG: --topology-manager-policy="none" Jul 17 21:03:40.358021 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071987 2568 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 17 21:03:40.358021 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071990 2568 flags.go:64] FLAG: --topology-manager-scope="container" Jul 17 21:03:40.358021 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.071992 2568 flags.go:64] FLAG: --v="2" Jul 17 21:03:40.358021 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.072002 2568 flags.go:64] FLAG: --version="false" Jul 17 21:03:40.358021 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.072006 2568 flags.go:64] FLAG: --vmodule="" Jul 17 21:03:40.358021 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.072009 2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 17 21:03:40.358021 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.072012 2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 17 21:03:40.358021 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072156 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 21:03:40.358021 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072160 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 21:03:40.358021 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072163 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 21:03:40.358021 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072166 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 21:03:40.358021 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072169 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 21:03:40.358021 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072171 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 21:03:40.358021 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072174 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 21:03:40.358021 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072177 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 21:03:40.358021 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072179 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 21:03:40.358021 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072182 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 21:03:40.358021 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072184 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 21:03:40.358021 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072187 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 17 21:03:40.360058 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072189 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 21:03:40.360058 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072192 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 21:03:40.360058 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072194 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 21:03:40.360058 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072197 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 21:03:40.360058 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072201 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 21:03:40.360058 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072203 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 21:03:40.360058 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072206 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 21:03:40.360058 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072208 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 21:03:40.360058 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072211 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 21:03:40.360058 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072214 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 21:03:40.360058 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072218 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 21:03:40.360058 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072223 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 21:03:40.360058 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072226 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 21:03:40.360058 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072229 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 21:03:40.360058 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072231 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 21:03:40.360058 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072234 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 21:03:40.360058 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072237 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 21:03:40.360058 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072245 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 21:03:40.360058 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072247 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 21:03:40.360058 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072250 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 21:03:40.363922 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072252 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 21:03:40.363922 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072255 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 21:03:40.363922 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072258 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 21:03:40.363922 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072260 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 21:03:40.363922 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072263 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 21:03:40.363922 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072265 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 21:03:40.363922 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072268 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 21:03:40.363922 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072270 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 21:03:40.363922 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072273 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 21:03:40.363922 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072275 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 21:03:40.363922 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072278 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 21:03:40.363922 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072280 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 21:03:40.363922 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072283 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 21:03:40.363922 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072285 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 21:03:40.363922 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072289 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 21:03:40.363922 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072292 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 21:03:40.363922 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072297 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 21:03:40.363922 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072299 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 21:03:40.363922 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072302 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 21:03:40.364944 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072305 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 21:03:40.364944 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072307 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 21:03:40.364944 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072310 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 21:03:40.364944 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072312 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 21:03:40.364944 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072316 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 21:03:40.364944 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072319 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 21:03:40.364944 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072321 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 21:03:40.364944 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072324 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 21:03:40.364944 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072326 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 21:03:40.364944 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072330 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 21:03:40.364944 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072332 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 21:03:40.364944 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072340 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 21:03:40.364944 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072343 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 21:03:40.364944 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072346 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 21:03:40.364944 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072349 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 21:03:40.364944 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072351 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 21:03:40.364944 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072353 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 21:03:40.364944 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072356 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 21:03:40.364944 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072358 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 21:03:40.549160 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072361 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 21:03:40.549160 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072363 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 21:03:40.549160 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072366 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 21:03:40.549160 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072368 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 21:03:40.549160 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072372 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 21:03:40.549160 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072375 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 21:03:40.549160 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072378 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 21:03:40.549160 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072380 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 21:03:40.549160 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072383 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 21:03:40.549160 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072385 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 21:03:40.549160 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072389 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 21:03:40.549160 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072392 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 21:03:40.549160 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072394 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 21:03:40.549160 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072397 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 21:03:40.549160 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072399 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 21:03:40.549160 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072402 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 21:03:40.549160 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072404 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 21:03:40.549160 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072408 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 21:03:40.549160 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072411 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 21:03:40.549160 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072414 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 21:03:40.549924 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072416 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 21:03:40.549924 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072419 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 21:03:40.549924 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072422 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 21:03:40.549924 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072424 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 21:03:40.549924 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072427 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 21:03:40.549924 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072435 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 21:03:40.549924 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072438 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 21:03:40.549924 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072440 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 21:03:40.549924 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.072443 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 21:03:40.549924 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.072448 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 21:03:40.549924 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.081522 2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 17 21:03:40.549924 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.081539 2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 17 21:03:40.549924 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.081558 2568 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 17 21:03:40.549924 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.081567 2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 17 21:03:40.549924 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081644 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 21:03:40.550399 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081650 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 21:03:40.550399 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081654 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 21:03:40.550399 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081657 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 21:03:40.550399 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081660 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 21:03:40.550399 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081662 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 21:03:40.550399 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081665 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 21:03:40.550399 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081667 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 21:03:40.550399 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081670 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 21:03:40.550399 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081673 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 21:03:40.550399 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081675 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 21:03:40.550399 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081678 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 21:03:40.550399 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081680 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 21:03:40.550399 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081684 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 21:03:40.550399 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081687 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 21:03:40.550399 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081690 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 21:03:40.550399 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081693 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 21:03:40.550399 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081695 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 21:03:40.550399 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081699 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 21:03:40.550399 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081702 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 21:03:40.550399 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081704 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 21:03:40.550986 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081707 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 21:03:40.550986 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081710 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 21:03:40.550986 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081712 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 17 21:03:40.550986 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081715 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 21:03:40.550986 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081718 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 21:03:40.550986 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081721 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 21:03:40.550986 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081725 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 21:03:40.550986 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081728 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 21:03:40.550986 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081731 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 21:03:40.550986 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081733 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 21:03:40.550986 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081736 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 21:03:40.550986 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081739 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 21:03:40.550986 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081741 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 21:03:40.550986 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081744 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 21:03:40.550986 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081747 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 21:03:40.550986 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081750 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 21:03:40.550986 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081752 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 21:03:40.550986 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081755 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 21:03:40.550986 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081758 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 21:03:40.550986 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081760 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 21:03:40.551536 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081763 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 21:03:40.551536 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081765 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 21:03:40.551536 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081768 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 21:03:40.551536 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081771 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 21:03:40.551536 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081773 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 21:03:40.551536 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081776 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 21:03:40.551536 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081779 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 21:03:40.551536 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081781 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 21:03:40.551536 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081784 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 21:03:40.551536 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081788 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 21:03:40.551536 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081792 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 21:03:40.551536 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081795 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 21:03:40.551536 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081798 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 21:03:40.551536 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081801 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 21:03:40.551536 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081804 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 21:03:40.551536 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081806 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 21:03:40.551536 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081809 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 21:03:40.551536 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081811 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 21:03:40.551536 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081814 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 21:03:40.552091 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081816 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 21:03:40.552091 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081819 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 21:03:40.552091 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081821 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 21:03:40.552091 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081824 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 21:03:40.552091 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081826 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 21:03:40.552091 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081829 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 21:03:40.552091 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081832 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 21:03:40.552091 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081836 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 21:03:40.552091 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081839 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 21:03:40.552091 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081841 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 21:03:40.552091 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081844 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 21:03:40.552091 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081847 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 21:03:40.552091 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081849 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 21:03:40.552091 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081852 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 21:03:40.552091 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081855 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 21:03:40.552091 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081857 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 21:03:40.552091 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081861 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 21:03:40.552091 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081864 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 21:03:40.552091 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081867 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 21:03:40.552599 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081871 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 21:03:40.552599 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081874 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 21:03:40.552599 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081877 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 21:03:40.552599 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081880 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 21:03:40.552599 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081882 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 21:03:40.552599 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081885 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 21:03:40.552599 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081905 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 21:03:40.552599 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081909 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 21:03:40.552599 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081912 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 21:03:40.552599 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081914 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 21:03:40.552599 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081917 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 21:03:40.552599 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081920 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 21:03:40.552599 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081923 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 21:03:40.552599 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081926 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 21:03:40.552599 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081928 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 21:03:40.552599 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081931 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 21:03:40.552599 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081934 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 21:03:40.552599 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081936 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 21:03:40.552599 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081939 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 21:03:40.552599 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.081942 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 21:03:40.553210 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.081948 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 21:03:40.553210 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082069 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 21:03:40.553210 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082075 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 21:03:40.553210 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082078 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 21:03:40.553210 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082081 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 21:03:40.553210 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082083 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 21:03:40.553210 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082086 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 21:03:40.553210 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082089 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 21:03:40.553210 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082094 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 21:03:40.553210 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082097 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 21:03:40.553210 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082114 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 21:03:40.553210 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082118 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 21:03:40.553210 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082121 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 21:03:40.553210 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082125 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 21:03:40.553210 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082128 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 21:03:40.553637 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082131 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 21:03:40.553637 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082134 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 21:03:40.553637 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082137 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 21:03:40.553637 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082140 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 21:03:40.553637 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082142 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 21:03:40.553637 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082145 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 21:03:40.553637 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082148 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 21:03:40.553637 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082150 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 21:03:40.553637 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082153 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 21:03:40.553637 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082155 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 21:03:40.553637 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082158 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 21:03:40.553637 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082161 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 21:03:40.553637 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082163 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 21:03:40.553637 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082166 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 21:03:40.553637 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082169 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 21:03:40.553637 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082171 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 21:03:40.553637 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082174 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 21:03:40.553637 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082176 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 21:03:40.553637 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082180 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 21:03:40.553637 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082183 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 21:03:40.554204 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082186 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 21:03:40.554204 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082188 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 21:03:40.554204 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082191 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 21:03:40.554204 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082193 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 21:03:40.554204 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082196 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 21:03:40.554204 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082200 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 21:03:40.554204 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082202 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 21:03:40.554204 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082205 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 21:03:40.554204 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082208 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 21:03:40.554204 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082210 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 21:03:40.554204 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082212 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 21:03:40.554204 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082216 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 21:03:40.554204 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082218 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 21:03:40.554204 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082221 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 21:03:40.554204 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082233 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 21:03:40.554204 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082237 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 21:03:40.554204 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082242 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 21:03:40.554204 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082245 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 21:03:40.554204 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082247 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 21:03:40.554764 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082250 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 21:03:40.554764 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082252 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 21:03:40.554764 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082255 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 21:03:40.554764 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082257 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 21:03:40.554764 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082260 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 21:03:40.554764 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082262 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 21:03:40.554764 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082265 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 21:03:40.554764 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082267 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 21:03:40.554764 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082270 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 21:03:40.554764 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082274 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 21:03:40.554764 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082278 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 21:03:40.554764 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082282 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 21:03:40.554764 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082285 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 21:03:40.554764 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082289 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 21:03:40.554764 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082292 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 21:03:40.554764 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082294 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 21:03:40.554764 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082298 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 21:03:40.554764 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082301 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 21:03:40.554764 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082306 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 21:03:40.555297 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082309 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 21:03:40.555297 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082312 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 21:03:40.555297 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082315 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 21:03:40.555297 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082318 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 21:03:40.555297 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082321 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 21:03:40.555297 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082323 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 21:03:40.555297 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082326 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 21:03:40.555297 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082329 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 17 21:03:40.555297 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082331 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 21:03:40.555297 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082334 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 21:03:40.555297 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082337 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 21:03:40.555297 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082339 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 21:03:40.555297 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082342 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 21:03:40.555297 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082344 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 21:03:40.555297 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082347 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 21:03:40.555297 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082349 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 21:03:40.555297 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082352 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 21:03:40.555297 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082354 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 21:03:40.555297 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082357 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 21:03:40.555297 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082360 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 21:03:40.555836 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082362 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 21:03:40.555836 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082365 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 21:03:40.555836 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082367 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 21:03:40.555836 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082370 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 21:03:40.555836 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082373 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 21:03:40.555836 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082376 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 21:03:40.555836 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.082378 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 21:03:40.555836 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.082383 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 21:03:40.555836 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.082485 2568 server.go:962] "Client rotation is on, will bootstrap in background" Jul 17 21:03:40.555836 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.086402 2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 17 21:03:40.555836 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.087624 2568 server.go:1019] "Starting client certificate rotation" Jul 17 21:03:40.555836 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.087736 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 17 21:03:40.555836 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.087770 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 17 21:03:40.556270 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.089927 2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 17 21:03:40.556270 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.091182 2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 17 21:03:40.556270 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.101835 2568 log.go:25] "Validated CRI v1 runtime API" Jul 17 21:03:40.556270 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.103979 2568 log.go:25] "Validated CRI v1 image API" Jul 17 21:03:40.556270 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.107987 2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 17 21:03:40.556270 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.112162 2568 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9ba55cbb-13e0-4ed0-92bb-7e8944c98c14:/dev/nvme0n1p4 ddf1af5e-74e8-4856-b668-4b82d727bcba:/dev/nvme0n1p3] Jul 17 21:03:40.556270 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.112183 2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 17 21:03:40.556566 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.117756 2568 manager.go:216] Machine: {Timestamp:2026-07-17 21:03:40.117034095 +0000 UTC m=+0.354909108 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099731 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2df76bb2693049bfb392d91dd5e795 SystemUUID:ec2df76b-b269-3049-bfb3-92d91dd5e795 BootID:86b3be3b-9ab5-4329-90ab-cb07a2ed5e55 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:12:cc:ce:cb:97 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:12:cc:ce:cb:97 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9a:c0:45:c1:80:54 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 17 21:03:40.556566 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.117887 2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 17 21:03:40.556566 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.117976 2568 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 17 21:03:40.556566 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.119016 2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 17 21:03:40.556566 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.119050 2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-37.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 17 21:03:40.556566 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.119285 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 17 21:03:40.556566 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.119717 2568 topology_manager.go:138] "Creating topology manager with none policy" Jul 17 21:03:40.556566 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.119730 2568 container_manager_linux.go:309] "Creating device plugin manager" Jul 17 21:03:40.556566 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.119737 2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 17 21:03:40.556566 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.120344 2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 17 21:03:40.556566 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.121497 2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 17 21:03:40.556566 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.124574 2568 state_mem.go:36] "Initialized new in-memory state store" Jul 17 21:03:40.556566 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.124704 2568 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 17 21:03:40.556566 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.124731 2568 kubelet.go:486] "Attempting to sync node with API server" Jul 17 21:03:40.556566 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.124741 2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 17 21:03:40.556566 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.124751 2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 17 21:03:40.556566 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.124759 2568 kubelet.go:398] "Adding apiserver pod source" Jul 17 21:03:40.557075 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.124768 2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 17 21:03:40.557075 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.125089 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 17 21:03:40.557075 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.125107 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 17 21:03:40.557075 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.129931 2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 17 21:03:40.557075 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.131933 2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 17 21:03:40.557075 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.131960 2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 17 21:03:40.557075 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.132924 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 17 21:03:40.557075 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.132943 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 17 21:03:40.557075 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.132952 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 17 21:03:40.557075 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.132961 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 17 21:03:40.557075 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.132974 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 17 21:03:40.557075 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.132981 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 17 21:03:40.557075 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.132994 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 17 21:03:40.557075 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.133001 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 17 21:03:40.557075 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.133011 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 17 21:03:40.557075 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.133020 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 17 21:03:40.557075 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.133047 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 17 21:03:40.557075 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.133055 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 17 21:03:40.557075 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.134675 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 17 21:03:40.557075 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.134689 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 17 21:03:40.557075 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.138117 2568 server.go:1268] "Started kubelet" Jul 17 21:03:40.557075 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.138317 2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 17 21:03:40.557075 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.138373 2568 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 17 21:03:40.557075 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.138679 2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 17 21:03:40.557075 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:40.139016 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 17 21:03:40.557075 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.139079 2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-37.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 17 21:03:40.557075 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:40.139262 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-37.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 17 21:03:40.557075 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.139748 2568 server.go:310] "Adding debug handlers to kubelet server" Jul 17 21:03:40.557075 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.139873 2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 17 21:03:40.557075 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:40.145254 2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 17 21:03:40.557075 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.150476 2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 17 21:03:40.557075 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.150491 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 17 21:03:40.557075 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:40.150547 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-37.ec2.internal\" not found" Jul 17 21:03:40.557075 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.150968 2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 17 21:03:40.557075 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.151012 2568 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 17 21:03:40.557075 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.151028 2568 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 17 21:03:40.557075 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:40.150052 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-37.ec2.internal.18c32f9b002acb9c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-37.ec2.internal,UID:ip-10-0-131-37.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-37.ec2.internal,},FirstTimestamp:2026-07-17 21:03:40.138089372 +0000 UTC m=+0.375964385,LastTimestamp:2026-07-17 21:03:40.138089372 +0000 UTC m=+0.375964385,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-37.ec2.internal,}" Jul 17 21:03:40.557075 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.151154 2568 reconstruct.go:97] "Volume reconstruction finished" Jul 17 21:03:40.557075 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.151164 2568 reconciler.go:29] "Reconciler: start to sync state" Jul 17 21:03:40.557075 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.151387 2568 factory.go:55] Registering systemd factory Jul 17 21:03:40.557075 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.151403 2568 factory.go:223] Registration of the systemd container factory successfully Jul 17 21:03:40.558207 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.151666 2568 factory.go:153] Registering CRI-O factory Jul 17 21:03:40.558207 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.151679 2568 factory.go:223] Registration of the crio container factory successfully Jul 17 21:03:40.558207 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.151726 2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 17 21:03:40.558207 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.151749 2568 factory.go:103] Registering Raw factory Jul 17 21:03:40.558207 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.151763 2568 manager.go:1196] Started watching for new ooms in manager Jul 17 21:03:40.558207 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.152199 2568 manager.go:349] Starting recovery of all containers Jul 17 21:03:40.558207 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.158766 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 17 21:03:40.558207 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:40.160292 2568 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-37.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 17 21:03:40.558207 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:40.160547 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 17 21:03:40.558207 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.162810 2568 manager.go:354] Recovery completed Jul 17 21:03:40.558207 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.167578 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 21:03:40.558207 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.170546 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-37.ec2.internal" event="NodeHasSufficientMemory" Jul 17 21:03:40.558207 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.170574 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-37.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 21:03:40.558207 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.170588 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-37.ec2.internal" event="NodeHasSufficientPID" Jul 17 21:03:40.558207 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.171077 2568 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 17 21:03:40.558207 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.171088 2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 17 21:03:40.558207 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.171106 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 21:03:40.558207 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.171113 2568 state_mem.go:36] "Initialized new in-memory state store" Jul 17 21:03:40.558207 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.172333 2568 policy_none.go:49] "None policy: Start" Jul 17 21:03:40.558207 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.172345 2568 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 17 21:03:40.558207 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.172353 2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 17 21:03:40.558207 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.172873 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cxh6q" Jul 17 21:03:40.558207 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.173070 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-37.ec2.internal" event="NodeHasSufficientMemory" Jul 17 21:03:40.558207 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.173093 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-37.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 21:03:40.558207 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.173106 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-37.ec2.internal" event="NodeHasSufficientPID" Jul 17 21:03:40.558207 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.173258 2568 policy_none.go:47] "Start" Jul 17 21:03:40.558207 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:40.182064 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-37.ec2.internal.18c32f9b021a3eb6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-37.ec2.internal,UID:ip-10-0-131-37.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-37.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-37.ec2.internal,},FirstTimestamp:2026-07-17 21:03:40.170559158 +0000 UTC m=+0.408434170,LastTimestamp:2026-07-17 21:03:40.170559158 +0000 UTC m=+0.408434170,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-37.ec2.internal,}" Jul 17 21:03:40.558207 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.186031 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cxh6q" Jul 17 21:03:40.558207 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.195189 2568 manager.go:337] "Starting Device Plugin manager" Jul 17 21:03:40.558207 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:40.195219 2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 17 21:03:40.558207 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.195228 2568 server.go:87] "Starting device plugin registration server" Jul 17 21:03:40.558207 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.195399 2568 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 17 21:03:40.558207 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.195412 2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 17 21:03:40.558207 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.195524 2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 17 21:03:40.558207 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.195699 2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 17 21:03:40.558207 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.195709 2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 17 21:03:40.558207 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:40.195949 2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 17 21:03:40.558207 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:40.195991 2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-37.ec2.internal\" not found" Jul 17 21:03:40.558207 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.291768 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 17 21:03:40.558207 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.291802 2568 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 17 21:03:40.559263 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.291819 2568 kubelet.go:2448] "Starting kubelet main sync loop" Jul 17 21:03:40.559263 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:40.291848 2568 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 17 21:03:40.559263 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.294328 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 21:03:40.559263 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.296288 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 21:03:40.559263 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.297024 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-37.ec2.internal" event="NodeHasSufficientMemory" Jul 17 21:03:40.559263 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.297049 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-37.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 21:03:40.559263 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.297059 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-37.ec2.internal" event="NodeHasSufficientPID" Jul 17 21:03:40.559263 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.297080 2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-37.ec2.internal" Jul 17 21:03:40.559263 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.305025 2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-37.ec2.internal" Jul 17 21:03:40.559263 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:40.305042 2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-37.ec2.internal\": node \"ip-10-0-131-37.ec2.internal\" not found" Jul 17 21:03:40.559263 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:40.332618 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-37.ec2.internal\" not found" Jul 17 21:03:40.559263 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.392635 2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-37.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-37.ec2.internal"] Jul 17 21:03:40.559263 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.392695 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 21:03:40.559263 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.393552 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-37.ec2.internal" event="NodeHasSufficientMemory" Jul 17 21:03:40.559263 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.393579 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-37.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 21:03:40.559263 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.393589 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-37.ec2.internal" event="NodeHasSufficientPID" Jul 17 21:03:40.559263 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.394756 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 21:03:40.559263 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.394887 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-37.ec2.internal" Jul 17 21:03:40.559263 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.394910 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 21:03:40.559263 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.395458 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-37.ec2.internal" event="NodeHasSufficientMemory" Jul 17 21:03:40.559263 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.395476 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-37.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 21:03:40.559263 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.395485 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-37.ec2.internal" event="NodeHasSufficientPID" Jul 17 21:03:40.559263 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.395683 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-37.ec2.internal" event="NodeHasSufficientMemory" Jul 17 21:03:40.559263 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.395693 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-37.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 21:03:40.559263 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.395702 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-37.ec2.internal" event="NodeHasSufficientPID" Jul 17 21:03:40.559263 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.396598 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-37.ec2.internal" Jul 17 21:03:40.559263 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.396632 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 21:03:40.559263 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.397208 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-37.ec2.internal" event="NodeHasSufficientMemory" Jul 17 21:03:40.559263 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.397222 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-37.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 21:03:40.559263 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.397231 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-37.ec2.internal" event="NodeHasSufficientPID" Jul 17 21:03:40.559263 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:40.402542 2568 helpers.go:245] readString: Failed to read "/sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd02f43dd4bf8de506722f80f7be8b04.slice/cpu.max": read /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd02f43dd4bf8de506722f80f7be8b04.slice/cpu.max: no such device Jul 17 21:03:40.559263 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:40.428327 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-37.ec2.internal\" not found" node="ip-10-0-131-37.ec2.internal" Jul 17 21:03:40.559263 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:40.432755 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-37.ec2.internal\" not found" Jul 17 21:03:40.559263 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:40.432830 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-37.ec2.internal\" not found" node="ip-10-0-131-37.ec2.internal" Jul 17 21:03:40.559263 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:40.533325 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-37.ec2.internal\" not found" Jul 17 21:03:40.559263 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.552667 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e02005bc23693b38a5a1b9ac40884898-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-37.ec2.internal\" (UID: \"e02005bc23693b38a5a1b9ac40884898\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-37.ec2.internal" Jul 17 21:03:40.560225 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.552691 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dd02f43dd4bf8de506722f80f7be8b04-config\") pod \"kube-apiserver-proxy-ip-10-0-131-37.ec2.internal\" (UID: \"dd02f43dd4bf8de506722f80f7be8b04\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-37.ec2.internal" Jul 17 21:03:40.560225 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.552708 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e02005bc23693b38a5a1b9ac40884898-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-37.ec2.internal\" (UID: \"e02005bc23693b38a5a1b9ac40884898\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-37.ec2.internal" Jul 17 21:03:40.741328 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:40.634008 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-37.ec2.internal\" not found" Jul 17 21:03:40.741328 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.653311 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dd02f43dd4bf8de506722f80f7be8b04-config\") pod \"kube-apiserver-proxy-ip-10-0-131-37.ec2.internal\" (UID: \"dd02f43dd4bf8de506722f80f7be8b04\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-37.ec2.internal" Jul 17 21:03:40.741328 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.653339 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e02005bc23693b38a5a1b9ac40884898-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-37.ec2.internal\" (UID: \"e02005bc23693b38a5a1b9ac40884898\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-37.ec2.internal" Jul 17 21:03:40.741328 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.653355 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e02005bc23693b38a5a1b9ac40884898-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-37.ec2.internal\" (UID: \"e02005bc23693b38a5a1b9ac40884898\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-37.ec2.internal" Jul 17 21:03:40.741328 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.653392 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e02005bc23693b38a5a1b9ac40884898-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-37.ec2.internal\" (UID: \"e02005bc23693b38a5a1b9ac40884898\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-37.ec2.internal" Jul 17 21:03:40.741328 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.653409 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dd02f43dd4bf8de506722f80f7be8b04-config\") pod \"kube-apiserver-proxy-ip-10-0-131-37.ec2.internal\" (UID: \"dd02f43dd4bf8de506722f80f7be8b04\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-37.ec2.internal" Jul 17 21:03:40.741328 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.653417 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e02005bc23693b38a5a1b9ac40884898-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-37.ec2.internal\" (UID: \"e02005bc23693b38a5a1b9ac40884898\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-37.ec2.internal" Jul 17 21:03:40.741328 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.733041 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-37.ec2.internal" Jul 17 21:03:40.741328 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:40.734093 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-37.ec2.internal\" not found" Jul 17 21:03:40.741328 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:40.735510 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-37.ec2.internal" Jul 17 21:03:40.921926 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:40.834882 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-37.ec2.internal\" not found" Jul 17 21:03:41.099766 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:40.935334 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-37.ec2.internal\" not found" Jul 17 21:03:41.099766 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:41.035786 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-37.ec2.internal\" not found" Jul 17 21:03:41.099766 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:41.079575 2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 21:03:41.099766 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:41.087237 2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 17 21:03:41.099766 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:41.087346 2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 17 21:03:41.099766 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:41.087383 2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 17 21:03:41.241985 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:41.136698 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-37.ec2.internal\" not found" Jul 17 21:03:41.241985 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:41.189863 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-16 20:58:41 +0000 UTC" deadline="2028-02-07 16:22:20.400153499 +0000 UTC" Jul 17 21:03:41.241985 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:41.189900 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13675h18m39.210257211s" Jul 17 21:03:41.241985 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:41.218154 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 21:03:41.241985 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:41.219791 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-37.ec2.internal" event="NodeHasSufficientMemory" Jul 17 21:03:41.241985 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:41.219821 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-37.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 21:03:41.241985 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:41.219836 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-37.ec2.internal" event="NodeHasSufficientPID" Jul 17 21:03:41.241985 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:41.237251 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-37.ec2.internal\" not found" Jul 17 21:03:42.842737 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:42.775631 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-37.ec2.internal\" not found" Jul 17 21:03:42.842737 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:42.785621 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode02005bc23693b38a5a1b9ac40884898.slice/crio-3d87dac2ce7775b56f045f160fd88849251edb5d2392c3e1910b926866964363 WatchSource:0}: Error finding container 3d87dac2ce7775b56f045f160fd88849251edb5d2392c3e1910b926866964363: Status 404 returned error can't find the container with id 3d87dac2ce7775b56f045f160fd88849251edb5d2392c3e1910b926866964363 Jul 17 21:03:42.842737 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:42.786033 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd02f43dd4bf8de506722f80f7be8b04.slice/crio-38df35ee0352392e10b94251f742359c836a6debfe838fe9bed63e1062b82042 WatchSource:0}: Error finding container 38df35ee0352392e10b94251f742359c836a6debfe838fe9bed63e1062b82042: Status 404 returned error can't find the container with id 38df35ee0352392e10b94251f742359c836a6debfe838fe9bed63e1062b82042 Jul 17 21:03:42.842737 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:42.792420 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 21:03:43.034031 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:42.864304 2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 21:03:43.034031 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:42.876542 2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 21:03:43.034031 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:42.889488 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-37.ec2.internal" Jul 17 21:03:43.034031 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:42.902304 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 17 21:03:43.034031 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:42.903307 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-37.ec2.internal" Jul 17 21:03:43.034031 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:42.917722 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 17 21:03:43.420594 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.339294 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 21:03:43.667870 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.563749 2568 apiserver.go:52] "Watching apiserver" Jul 17 21:03:43.667870 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.589956 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 17 21:03:43.789864 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.739475 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-37.ec2.internal" event={"ID":"dd02f43dd4bf8de506722f80f7be8b04","Type":"ContainerStarted","Data":"38df35ee0352392e10b94251f742359c836a6debfe838fe9bed63e1062b82042"} Jul 17 21:03:43.789864 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.741604 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-37.ec2.internal" event={"ID":"e02005bc23693b38a5a1b9ac40884898","Type":"ContainerStarted","Data":"3d87dac2ce7775b56f045f160fd88849251edb5d2392c3e1910b926866964363"} Jul 17 21:03:43.963188 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.963156 2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 17 21:03:43.964470 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.964437 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-q6fjb","openshift-image-registry/node-ca-c5f67","openshift-network-diagnostics/network-check-target-lvjx6","openshift-network-operator/iptables-alerter-mch2x","openshift-ovn-kubernetes/ovnkube-node-9vgps","kube-system/global-pull-secret-syncer-5mn75","kube-system/kube-apiserver-proxy-ip-10-0-131-37.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ql86b","openshift-cluster-node-tuning-operator/tuned-92jdw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-37.ec2.internal","openshift-multus/multus-2h6l9","openshift-multus/multus-additional-cni-plugins-px578","openshift-multus/network-metrics-daemon-6klsf","kube-system/konnectivity-agent-vjspr"] Jul 17 21:03:43.965490 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.965466 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 17 21:03:43.965594 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.965557 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-t9c8f" Jul 17 21:03:43.966495 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.966061 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ql86b" Jul 17 21:03:43.967499 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.967226 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c5f67" Jul 17 21:03:43.968904 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.968492 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vjspr" Jul 17 21:03:43.968904 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.968589 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zpw7v\"" Jul 17 21:03:43.968904 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.968765 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 17 21:03:43.969077 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.969066 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 17 21:03:43.969235 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.969215 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 17 21:03:43.969641 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.969621 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 17 21:03:43.969785 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.969769 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 17 21:03:43.969849 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.969782 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 17 21:03:43.969915 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.969898 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qbbjl\"" Jul 17 21:03:43.970509 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.970242 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6klsf" Jul 17 21:03:43.970509 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:43.970318 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6klsf" podUID="ff4b059f-6fba-47d3-b03e-e977255d54d3" Jul 17 21:03:43.970644 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.970575 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 17 21:03:43.971026 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.970858 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4xvxh\"" Jul 17 21:03:43.971026 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.970926 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 17 21:03:43.971732 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.971712 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-px578" Jul 17 21:03:43.973039 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.972973 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2h6l9" Jul 17 21:03:43.974389 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.974009 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 17 21:03:43.974389 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.974041 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 17 21:03:43.974389 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.974114 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 17 21:03:43.974389 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.974218 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 17 21:03:43.974389 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.974289 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vv8qv\"" Jul 17 21:03:43.974389 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.974332 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:43.974649 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.974411 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 17 21:03:43.975105 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.975090 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-m6vq6\"" Jul 17 21:03:43.975500 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.975309 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 17 21:03:43.976113 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.976094 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q6fjb" Jul 17 21:03:43.976667 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.976625 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 17 21:03:43.976971 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.976764 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4qxcd\"" Jul 17 21:03:43.976971 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.976787 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 17 21:03:43.977854 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.977308 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mn75" Jul 17 21:03:43.977854 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:43.977371 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mn75" podUID="a700256e-b4d4-4dde-ae89-4b322addf3ad" Jul 17 21:03:43.978159 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.978140 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5fbm9\"" Jul 17 21:03:43.978485 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.978232 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 17 21:03:43.978485 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.978382 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 17 21:03:43.978778 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.978708 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:43.980058 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.980040 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mch2x" Jul 17 21:03:43.981111 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.980992 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 17 21:03:43.981695 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.981663 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 17 21:03:43.981791 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.981730 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvjx6" Jul 17 21:03:43.981853 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:43.981789 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvjx6" podUID="e1e535a8-ccc1-499b-9e30-70e8bd966ea1" Jul 17 21:03:43.981853 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.981813 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 17 21:03:43.981954 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.981933 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 17 21:03:43.982280 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.982025 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 17 21:03:43.982280 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.982130 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qbj6k\"" Jul 17 21:03:43.982280 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.982227 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 17 21:03:43.982449 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.982340 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 17 21:03:43.982449 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.982419 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 17 21:03:43.982449 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.982442 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 17 21:03:43.982586 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.982508 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gptsd\"" Jul 17 21:03:43.991397 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:43.991329 2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 17 21:03:44.000359 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.000335 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ed3c0b17-7695-427f-bb4b-64033d738c20-hostroot\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.000449 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.000370 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2dv7\" (UniqueName: \"kubernetes.io/projected/ed3c0b17-7695-427f-bb4b-64033d738c20-kube-api-access-c2dv7\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.000449 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.000394 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b-tmp\") pod \"tuned-92jdw\" (UID: \"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.001941 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.001915 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-systemd-units\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.002022 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.001990 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-ovnkube-script-lib\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.002074 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.002058 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3a43e428-7f49-45c4-8b89-d2f2ae686978-konnectivity-ca\") pod \"konnectivity-agent-vjspr\" (UID: \"3a43e428-7f49-45c4-8b89-d2f2ae686978\") " pod="kube-system/konnectivity-agent-vjspr" Jul 17 21:03:44.002135 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.002096 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/df9f8578-e1aa-405f-8a8a-59f530e12761-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-px578\" (UID: \"df9f8578-e1aa-405f-8a8a-59f530e12761\") " pod="openshift-multus/multus-additional-cni-plugins-px578" Jul 17 21:03:44.002196 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.002160 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgmmd\" (UniqueName: \"kubernetes.io/projected/e1e535a8-ccc1-499b-9e30-70e8bd966ea1-kube-api-access-kgmmd\") pod \"network-check-target-lvjx6\" (UID: \"e1e535a8-ccc1-499b-9e30-70e8bd966ea1\") " pod="openshift-network-diagnostics/network-check-target-lvjx6" Jul 17 21:03:44.002249 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.002222 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b-sys\") pod \"tuned-92jdw\" (UID: \"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.004330 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.004308 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-run-ovn\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.004514 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.004486 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-node-log\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.004743 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.004721 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-env-overrides\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.004845 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.004767 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bvlf\" (UniqueName: \"kubernetes.io/projected/1bc30f77-9ff9-477d-9a8d-72ae85c5d399-kube-api-access-7bvlf\") pod \"node-ca-c5f67\" (UID: \"1bc30f77-9ff9-477d-9a8d-72ae85c5d399\") " pod="openshift-image-registry/node-ca-c5f67" Jul 17 21:03:44.004845 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.004801 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b-etc-modprobe-d\") pod \"tuned-92jdw\" (UID: \"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.004845 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.004832 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b-run\") pod \"tuned-92jdw\" (UID: \"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.004992 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.004860 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzzvg\" (UniqueName: \"kubernetes.io/projected/fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b-kube-api-access-jzzvg\") pod \"tuned-92jdw\" (UID: \"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.004992 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.004893 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-host-slash\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.004992 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.004927 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gb9k\" (UniqueName: \"kubernetes.io/projected/9a7adde6-ae57-40b7-aab8-2554e384766d-kube-api-access-6gb9k\") pod \"aws-ebs-csi-driver-node-ql86b\" (UID: \"9a7adde6-ae57-40b7-aab8-2554e384766d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ql86b" Jul 17 21:03:44.004992 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.004961 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/df9f8578-e1aa-405f-8a8a-59f530e12761-cnibin\") pod \"multus-additional-cni-plugins-px578\" (UID: \"df9f8578-e1aa-405f-8a8a-59f530e12761\") " pod="openshift-multus/multus-additional-cni-plugins-px578" Jul 17 21:03:44.005162 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.004993 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ed3c0b17-7695-427f-bb4b-64033d738c20-multus-daemon-config\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.005162 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.005022 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-run-openvswitch\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.005162 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.005048 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed3c0b17-7695-427f-bb4b-64033d738c20-os-release\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.005162 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.005082 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b-etc-systemd\") pod \"tuned-92jdw\" (UID: \"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.005326 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.005185 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b-lib-modules\") pod \"tuned-92jdw\" (UID: \"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.005326 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.005217 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b-etc-tuned\") pod \"tuned-92jdw\" (UID: \"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.005326 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.005241 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c272898b-56ad-4f67-96bb-1fda34e475f1-hosts-file\") pod \"node-resolver-q6fjb\" (UID: \"c272898b-56ad-4f67-96bb-1fda34e475f1\") " pod="openshift-dns/node-resolver-q6fjb" Jul 17 21:03:44.005326 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.005295 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-run-systemd\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.005473 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.005329 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzjrf\" (UniqueName: \"kubernetes.io/projected/ff4b059f-6fba-47d3-b03e-e977255d54d3-kube-api-access-pzjrf\") pod \"network-metrics-daemon-6klsf\" (UID: \"ff4b059f-6fba-47d3-b03e-e977255d54d3\") " pod="openshift-multus/network-metrics-daemon-6klsf" Jul 17 21:03:44.005473 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.005361 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed3c0b17-7695-427f-bb4b-64033d738c20-cni-binary-copy\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.005473 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.005394 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9a7adde6-ae57-40b7-aab8-2554e384766d-registration-dir\") pod \"aws-ebs-csi-driver-node-ql86b\" (UID: \"9a7adde6-ae57-40b7-aab8-2554e384766d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ql86b" Jul 17 21:03:44.005473 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.005438 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b-etc-kubernetes\") pod \"tuned-92jdw\" (UID: \"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.005631 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.005495 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lm98t\" (UniqueName: \"kubernetes.io/projected/c272898b-56ad-4f67-96bb-1fda34e475f1-kube-api-access-lm98t\") pod \"node-resolver-q6fjb\" (UID: \"c272898b-56ad-4f67-96bb-1fda34e475f1\") " pod="openshift-dns/node-resolver-q6fjb" Jul 17 21:03:44.005631 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.005525 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-ovnkube-config\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.005631 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.005550 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/df9f8578-e1aa-405f-8a8a-59f530e12761-system-cni-dir\") pod \"multus-additional-cni-plugins-px578\" (UID: \"df9f8578-e1aa-405f-8a8a-59f530e12761\") " pod="openshift-multus/multus-additional-cni-plugins-px578" Jul 17 21:03:44.005631 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.005584 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ed3c0b17-7695-427f-bb4b-64033d738c20-host-var-lib-cni-multus\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.005631 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.005612 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed3c0b17-7695-427f-bb4b-64033d738c20-multus-conf-dir\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.005896 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.005655 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed3c0b17-7695-427f-bb4b-64033d738c20-etc-kubernetes\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.005896 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.005701 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-ovn-node-metrics-cert\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.005896 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.005738 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9a7adde6-ae57-40b7-aab8-2554e384766d-etc-selinux\") pod \"aws-ebs-csi-driver-node-ql86b\" (UID: \"9a7adde6-ae57-40b7-aab8-2554e384766d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ql86b" Jul 17 21:03:44.006271 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.005831 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/df9f8578-e1aa-405f-8a8a-59f530e12761-os-release\") pod \"multus-additional-cni-plugins-px578\" (UID: \"df9f8578-e1aa-405f-8a8a-59f530e12761\") " pod="openshift-multus/multus-additional-cni-plugins-px578" Jul 17 21:03:44.006849 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.006693 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed3c0b17-7695-427f-bb4b-64033d738c20-system-cni-dir\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.006849 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.006727 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed3c0b17-7695-427f-bb4b-64033d738c20-multus-cni-dir\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.006849 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.006749 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ed3c0b17-7695-427f-bb4b-64033d738c20-host-run-multus-certs\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.006849 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.006773 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-host-kubelet\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.006849 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.006799 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sthjr\" (UniqueName: \"kubernetes.io/projected/0ec02634-d610-4017-8fb0-168bd1e9cb69-kube-api-access-sthjr\") pod \"iptables-alerter-mch2x\" (UID: \"0ec02634-d610-4017-8fb0-168bd1e9cb69\") " pod="openshift-network-operator/iptables-alerter-mch2x" Jul 17 21:03:44.006849 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.006826 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9a7adde6-ae57-40b7-aab8-2554e384766d-socket-dir\") pod \"aws-ebs-csi-driver-node-ql86b\" (UID: \"9a7adde6-ae57-40b7-aab8-2554e384766d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ql86b" Jul 17 21:03:44.007129 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.007085 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b-host\") pod \"tuned-92jdw\" (UID: \"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.007129 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.007120 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb2sf\" (UniqueName: \"kubernetes.io/projected/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-kube-api-access-gb2sf\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.007205 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.007151 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9a7adde6-ae57-40b7-aab8-2554e384766d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ql86b\" (UID: \"9a7adde6-ae57-40b7-aab8-2554e384766d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ql86b" Jul 17 21:03:44.007205 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.007195 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1bc30f77-9ff9-477d-9a8d-72ae85c5d399-serviceca\") pod \"node-ca-c5f67\" (UID: \"1bc30f77-9ff9-477d-9a8d-72ae85c5d399\") " pod="openshift-image-registry/node-ca-c5f67" Jul 17 21:03:44.007279 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.007238 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a700256e-b4d4-4dde-ae89-4b322addf3ad-dbus\") pod \"global-pull-secret-syncer-5mn75\" (UID: \"a700256e-b4d4-4dde-ae89-4b322addf3ad\") " pod="kube-system/global-pull-secret-syncer-5mn75" Jul 17 21:03:44.007309 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.007282 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff4b059f-6fba-47d3-b03e-e977255d54d3-metrics-certs\") pod \"network-metrics-daemon-6klsf\" (UID: \"ff4b059f-6fba-47d3-b03e-e977255d54d3\") " pod="openshift-multus/network-metrics-daemon-6klsf" Jul 17 21:03:44.007416 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.007309 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/df9f8578-e1aa-405f-8a8a-59f530e12761-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-px578\" (UID: \"df9f8578-e1aa-405f-8a8a-59f530e12761\") " pod="openshift-multus/multus-additional-cni-plugins-px578" Jul 17 21:03:44.007416 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.007335 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cq5z\" (UniqueName: \"kubernetes.io/projected/df9f8578-e1aa-405f-8a8a-59f530e12761-kube-api-access-4cq5z\") pod \"multus-additional-cni-plugins-px578\" (UID: \"df9f8578-e1aa-405f-8a8a-59f530e12761\") " pod="openshift-multus/multus-additional-cni-plugins-px578" Jul 17 21:03:44.007416 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.007379 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0ec02634-d610-4017-8fb0-168bd1e9cb69-iptables-alerter-script\") pod \"iptables-alerter-mch2x\" (UID: \"0ec02634-d610-4017-8fb0-168bd1e9cb69\") " pod="openshift-network-operator/iptables-alerter-mch2x" Jul 17 21:03:44.007416 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.007411 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a700256e-b4d4-4dde-ae89-4b322addf3ad-kubelet-config\") pod \"global-pull-secret-syncer-5mn75\" (UID: \"a700256e-b4d4-4dde-ae89-4b322addf3ad\") " pod="kube-system/global-pull-secret-syncer-5mn75" Jul 17 21:03:44.007544 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.007431 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.007544 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.007450 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/df9f8578-e1aa-405f-8a8a-59f530e12761-cni-binary-copy\") pod \"multus-additional-cni-plugins-px578\" (UID: \"df9f8578-e1aa-405f-8a8a-59f530e12761\") " pod="openshift-multus/multus-additional-cni-plugins-px578" Jul 17 21:03:44.007544 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.007467 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1bc30f77-9ff9-477d-9a8d-72ae85c5d399-host\") pod \"node-ca-c5f67\" (UID: \"1bc30f77-9ff9-477d-9a8d-72ae85c5d399\") " pod="openshift-image-registry/node-ca-c5f67" Jul 17 21:03:44.007544 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.007482 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3a43e428-7f49-45c4-8b89-d2f2ae686978-agent-certs\") pod \"konnectivity-agent-vjspr\" (UID: \"3a43e428-7f49-45c4-8b89-d2f2ae686978\") " pod="kube-system/konnectivity-agent-vjspr" Jul 17 21:03:44.007544 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.007499 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b-etc-sysctl-conf\") pod \"tuned-92jdw\" (UID: \"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.007544 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.007521 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a700256e-b4d4-4dde-ae89-4b322addf3ad-original-pull-secret\") pod \"global-pull-secret-syncer-5mn75\" (UID: \"a700256e-b4d4-4dde-ae89-4b322addf3ad\") " pod="kube-system/global-pull-secret-syncer-5mn75" Jul 17 21:03:44.007544 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.007536 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-var-lib-openvswitch\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.007792 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.007555 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-log-socket\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.007792 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.007568 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-host-run-ovn-kubernetes\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.007792 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.007585 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ed3c0b17-7695-427f-bb4b-64033d738c20-host-run-k8s-cni-cncf-io\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.007792 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.007599 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b-etc-sysctl-d\") pod \"tuned-92jdw\" (UID: \"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.007792 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.007613 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b-var-lib-kubelet\") pod \"tuned-92jdw\" (UID: \"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.007792 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.007626 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-host-run-netns\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.007792 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.007661 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-host-cni-netd\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.007792 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.007675 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed3c0b17-7695-427f-bb4b-64033d738c20-host-run-netns\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.007792 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.007710 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-etc-openvswitch\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.007792 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.007733 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-host-cni-bin\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.007792 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.007747 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9a7adde6-ae57-40b7-aab8-2554e384766d-sys-fs\") pod \"aws-ebs-csi-driver-node-ql86b\" (UID: \"9a7adde6-ae57-40b7-aab8-2554e384766d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ql86b" Jul 17 21:03:44.007792 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.007765 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ed3c0b17-7695-427f-bb4b-64033d738c20-multus-socket-dir-parent\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.007792 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.007795 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed3c0b17-7695-427f-bb4b-64033d738c20-host-var-lib-cni-bin\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.008266 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.007831 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed3c0b17-7695-427f-bb4b-64033d738c20-host-var-lib-kubelet\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.008266 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.007846 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b-etc-sysconfig\") pod \"tuned-92jdw\" (UID: \"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.008266 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.007868 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c272898b-56ad-4f67-96bb-1fda34e475f1-tmp-dir\") pod \"node-resolver-q6fjb\" (UID: \"c272898b-56ad-4f67-96bb-1fda34e475f1\") " pod="openshift-dns/node-resolver-q6fjb" Jul 17 21:03:44.008266 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.007888 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0ec02634-d610-4017-8fb0-168bd1e9cb69-host-slash\") pod \"iptables-alerter-mch2x\" (UID: \"0ec02634-d610-4017-8fb0-168bd1e9cb69\") " pod="openshift-network-operator/iptables-alerter-mch2x" Jul 17 21:03:44.008266 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.007904 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9a7adde6-ae57-40b7-aab8-2554e384766d-device-dir\") pod \"aws-ebs-csi-driver-node-ql86b\" (UID: \"9a7adde6-ae57-40b7-aab8-2554e384766d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ql86b" Jul 17 21:03:44.008266 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.007947 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/df9f8578-e1aa-405f-8a8a-59f530e12761-tuning-conf-dir\") pod \"multus-additional-cni-plugins-px578\" (UID: \"df9f8578-e1aa-405f-8a8a-59f530e12761\") " pod="openshift-multus/multus-additional-cni-plugins-px578" Jul 17 21:03:44.008266 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.007969 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed3c0b17-7695-427f-bb4b-64033d738c20-cnibin\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.108321 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.108242 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3a43e428-7f49-45c4-8b89-d2f2ae686978-konnectivity-ca\") pod \"konnectivity-agent-vjspr\" (UID: \"3a43e428-7f49-45c4-8b89-d2f2ae686978\") " pod="kube-system/konnectivity-agent-vjspr" Jul 17 21:03:44.108321 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.108285 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/df9f8578-e1aa-405f-8a8a-59f530e12761-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-px578\" (UID: \"df9f8578-e1aa-405f-8a8a-59f530e12761\") " pod="openshift-multus/multus-additional-cni-plugins-px578" Jul 17 21:03:44.108511 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.108334 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgmmd\" (UniqueName: \"kubernetes.io/projected/e1e535a8-ccc1-499b-9e30-70e8bd966ea1-kube-api-access-kgmmd\") pod \"network-check-target-lvjx6\" (UID: \"e1e535a8-ccc1-499b-9e30-70e8bd966ea1\") " pod="openshift-network-diagnostics/network-check-target-lvjx6" Jul 17 21:03:44.108511 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.108358 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b-sys\") pod \"tuned-92jdw\" (UID: \"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.108511 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.108379 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-run-ovn\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.108511 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.108398 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-node-log\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.108511 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.108421 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-env-overrides\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.108511 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.108444 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bvlf\" (UniqueName: \"kubernetes.io/projected/1bc30f77-9ff9-477d-9a8d-72ae85c5d399-kube-api-access-7bvlf\") pod \"node-ca-c5f67\" (UID: \"1bc30f77-9ff9-477d-9a8d-72ae85c5d399\") " pod="openshift-image-registry/node-ca-c5f67" Jul 17 21:03:44.108511 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.108463 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b-etc-modprobe-d\") pod \"tuned-92jdw\" (UID: \"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.108511 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.108484 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b-run\") pod \"tuned-92jdw\" (UID: \"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.108894 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.108515 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzzvg\" (UniqueName: \"kubernetes.io/projected/fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b-kube-api-access-jzzvg\") pod \"tuned-92jdw\" (UID: \"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.108894 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.108534 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-host-slash\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.108894 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.108549 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gb9k\" (UniqueName: \"kubernetes.io/projected/9a7adde6-ae57-40b7-aab8-2554e384766d-kube-api-access-6gb9k\") pod \"aws-ebs-csi-driver-node-ql86b\" (UID: \"9a7adde6-ae57-40b7-aab8-2554e384766d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ql86b" Jul 17 21:03:44.108894 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.108565 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/df9f8578-e1aa-405f-8a8a-59f530e12761-cnibin\") pod \"multus-additional-cni-plugins-px578\" (UID: \"df9f8578-e1aa-405f-8a8a-59f530e12761\") " pod="openshift-multus/multus-additional-cni-plugins-px578" Jul 17 21:03:44.108894 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.108589 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ed3c0b17-7695-427f-bb4b-64033d738c20-multus-daemon-config\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.108894 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.108610 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-run-openvswitch\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.108894 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.108635 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed3c0b17-7695-427f-bb4b-64033d738c20-os-release\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.108894 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.108658 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b-etc-systemd\") pod \"tuned-92jdw\" (UID: \"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.108894 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.108696 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b-lib-modules\") pod \"tuned-92jdw\" (UID: \"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.108894 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.108721 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b-etc-tuned\") pod \"tuned-92jdw\" (UID: \"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.108894 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.108768 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c272898b-56ad-4f67-96bb-1fda34e475f1-hosts-file\") pod \"node-resolver-q6fjb\" (UID: \"c272898b-56ad-4f67-96bb-1fda34e475f1\") " pod="openshift-dns/node-resolver-q6fjb" Jul 17 21:03:44.108894 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.108789 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-run-systemd\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.108894 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.108829 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzjrf\" (UniqueName: \"kubernetes.io/projected/ff4b059f-6fba-47d3-b03e-e977255d54d3-kube-api-access-pzjrf\") pod \"network-metrics-daemon-6klsf\" (UID: \"ff4b059f-6fba-47d3-b03e-e977255d54d3\") " pod="openshift-multus/network-metrics-daemon-6klsf" Jul 17 21:03:44.108894 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.108860 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed3c0b17-7695-427f-bb4b-64033d738c20-cni-binary-copy\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.108894 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.108890 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9a7adde6-ae57-40b7-aab8-2554e384766d-registration-dir\") pod \"aws-ebs-csi-driver-node-ql86b\" (UID: \"9a7adde6-ae57-40b7-aab8-2554e384766d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ql86b" Jul 17 21:03:44.108894 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.108896 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-run-openvswitch\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.109610 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.108908 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3a43e428-7f49-45c4-8b89-d2f2ae686978-konnectivity-ca\") pod \"konnectivity-agent-vjspr\" (UID: \"3a43e428-7f49-45c4-8b89-d2f2ae686978\") " pod="kube-system/konnectivity-agent-vjspr" Jul 17 21:03:44.109610 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.108941 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-run-ovn\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.109610 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.108976 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b-lib-modules\") pod \"tuned-92jdw\" (UID: \"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.109610 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109020 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c272898b-56ad-4f67-96bb-1fda34e475f1-hosts-file\") pod \"node-resolver-q6fjb\" (UID: \"c272898b-56ad-4f67-96bb-1fda34e475f1\") " pod="openshift-dns/node-resolver-q6fjb" Jul 17 21:03:44.109610 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109030 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b-run\") pod \"tuned-92jdw\" (UID: \"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.109610 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109050 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed3c0b17-7695-427f-bb4b-64033d738c20-os-release\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.109610 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109143 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b-etc-modprobe-d\") pod \"tuned-92jdw\" (UID: \"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.109610 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109148 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-run-systemd\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.109610 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.108914 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b-etc-kubernetes\") pod \"tuned-92jdw\" (UID: \"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.109610 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109204 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lm98t\" (UniqueName: \"kubernetes.io/projected/c272898b-56ad-4f67-96bb-1fda34e475f1-kube-api-access-lm98t\") pod \"node-resolver-q6fjb\" (UID: \"c272898b-56ad-4f67-96bb-1fda34e475f1\") " pod="openshift-dns/node-resolver-q6fjb" Jul 17 21:03:44.109610 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109209 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9a7adde6-ae57-40b7-aab8-2554e384766d-registration-dir\") pod \"aws-ebs-csi-driver-node-ql86b\" (UID: \"9a7adde6-ae57-40b7-aab8-2554e384766d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ql86b" Jul 17 21:03:44.109610 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109213 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/df9f8578-e1aa-405f-8a8a-59f530e12761-cnibin\") pod \"multus-additional-cni-plugins-px578\" (UID: \"df9f8578-e1aa-405f-8a8a-59f530e12761\") " pod="openshift-multus/multus-additional-cni-plugins-px578" Jul 17 21:03:44.109610 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109224 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-ovnkube-config\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.109610 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109266 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-env-overrides\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.109610 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109265 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/df9f8578-e1aa-405f-8a8a-59f530e12761-system-cni-dir\") pod \"multus-additional-cni-plugins-px578\" (UID: \"df9f8578-e1aa-405f-8a8a-59f530e12761\") " pod="openshift-multus/multus-additional-cni-plugins-px578" Jul 17 21:03:44.109610 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109312 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ed3c0b17-7695-427f-bb4b-64033d738c20-host-var-lib-cni-multus\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.109610 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109328 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed3c0b17-7695-427f-bb4b-64033d738c20-multus-conf-dir\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.109610 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109345 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed3c0b17-7695-427f-bb4b-64033d738c20-etc-kubernetes\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.110459 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109365 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-ovn-node-metrics-cert\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.110459 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109382 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9a7adde6-ae57-40b7-aab8-2554e384766d-etc-selinux\") pod \"aws-ebs-csi-driver-node-ql86b\" (UID: \"9a7adde6-ae57-40b7-aab8-2554e384766d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ql86b" Jul 17 21:03:44.110459 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109397 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/df9f8578-e1aa-405f-8a8a-59f530e12761-os-release\") pod \"multus-additional-cni-plugins-px578\" (UID: \"df9f8578-e1aa-405f-8a8a-59f530e12761\") " pod="openshift-multus/multus-additional-cni-plugins-px578" Jul 17 21:03:44.110459 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109411 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed3c0b17-7695-427f-bb4b-64033d738c20-system-cni-dir\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.110459 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109428 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed3c0b17-7695-427f-bb4b-64033d738c20-multus-cni-dir\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.110459 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109483 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b-sys\") pod \"tuned-92jdw\" (UID: \"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.110459 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109522 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ed3c0b17-7695-427f-bb4b-64033d738c20-host-run-multus-certs\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.110459 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109539 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed3c0b17-7695-427f-bb4b-64033d738c20-multus-cni-dir\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.110459 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109553 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-host-kubelet\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.110459 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109566 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-host-slash\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.110459 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109583 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sthjr\" (UniqueName: \"kubernetes.io/projected/0ec02634-d610-4017-8fb0-168bd1e9cb69-kube-api-access-sthjr\") pod \"iptables-alerter-mch2x\" (UID: \"0ec02634-d610-4017-8fb0-168bd1e9cb69\") " pod="openshift-network-operator/iptables-alerter-mch2x" Jul 17 21:03:44.110459 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109588 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-ovnkube-config\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.110459 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109611 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ed3c0b17-7695-427f-bb4b-64033d738c20-host-var-lib-cni-multus\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.110459 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109612 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9a7adde6-ae57-40b7-aab8-2554e384766d-socket-dir\") pod \"aws-ebs-csi-driver-node-ql86b\" (UID: \"9a7adde6-ae57-40b7-aab8-2554e384766d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ql86b" Jul 17 21:03:44.110459 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109637 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b-host\") pod \"tuned-92jdw\" (UID: \"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.110459 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109661 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb2sf\" (UniqueName: \"kubernetes.io/projected/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-kube-api-access-gb2sf\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.110459 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109676 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9a7adde6-ae57-40b7-aab8-2554e384766d-etc-selinux\") pod \"aws-ebs-csi-driver-node-ql86b\" (UID: \"9a7adde6-ae57-40b7-aab8-2554e384766d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ql86b" Jul 17 21:03:44.111269 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109709 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9a7adde6-ae57-40b7-aab8-2554e384766d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ql86b\" (UID: \"9a7adde6-ae57-40b7-aab8-2554e384766d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ql86b" Jul 17 21:03:44.111269 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109736 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1bc30f77-9ff9-477d-9a8d-72ae85c5d399-serviceca\") pod \"node-ca-c5f67\" (UID: \"1bc30f77-9ff9-477d-9a8d-72ae85c5d399\") " pod="openshift-image-registry/node-ca-c5f67" Jul 17 21:03:44.111269 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109741 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/df9f8578-e1aa-405f-8a8a-59f530e12761-os-release\") pod \"multus-additional-cni-plugins-px578\" (UID: \"df9f8578-e1aa-405f-8a8a-59f530e12761\") " pod="openshift-multus/multus-additional-cni-plugins-px578" Jul 17 21:03:44.111269 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109760 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a700256e-b4d4-4dde-ae89-4b322addf3ad-dbus\") pod \"global-pull-secret-syncer-5mn75\" (UID: \"a700256e-b4d4-4dde-ae89-4b322addf3ad\") " pod="kube-system/global-pull-secret-syncer-5mn75" Jul 17 21:03:44.111269 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109777 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b-etc-kubernetes\") pod \"tuned-92jdw\" (UID: \"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.111269 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109781 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ed3c0b17-7695-427f-bb4b-64033d738c20-host-run-multus-certs\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.111269 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109787 2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 17 21:03:44.111269 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109834 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed3c0b17-7695-427f-bb4b-64033d738c20-system-cni-dir\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.111269 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109886 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9a7adde6-ae57-40b7-aab8-2554e384766d-socket-dir\") pod \"aws-ebs-csi-driver-node-ql86b\" (UID: \"9a7adde6-ae57-40b7-aab8-2554e384766d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ql86b" Jul 17 21:03:44.111269 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109612 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed3c0b17-7695-427f-bb4b-64033d738c20-cni-binary-copy\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.111269 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:44.109909 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 21:03:44.111269 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109947 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b-host\") pod \"tuned-92jdw\" (UID: \"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.111269 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109979 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b-etc-systemd\") pod \"tuned-92jdw\" (UID: \"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.111269 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:44.109991 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff4b059f-6fba-47d3-b03e-e977255d54d3-metrics-certs podName:ff4b059f-6fba-47d3-b03e-e977255d54d3 nodeName:}" failed. No retries permitted until 2026-07-17 21:03:44.609955951 +0000 UTC m=+3.409755275 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff4b059f-6fba-47d3-b03e-e977255d54d3-metrics-certs") pod "network-metrics-daemon-6klsf" (UID: "ff4b059f-6fba-47d3-b03e-e977255d54d3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 21:03:44.111269 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.110011 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-host-kubelet\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.111269 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109785 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff4b059f-6fba-47d3-b03e-e977255d54d3-metrics-certs\") pod \"network-metrics-daemon-6klsf\" (UID: \"ff4b059f-6fba-47d3-b03e-e977255d54d3\") " pod="openshift-multus/network-metrics-daemon-6klsf" Jul 17 21:03:44.111269 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.110049 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/df9f8578-e1aa-405f-8a8a-59f530e12761-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-px578\" (UID: \"df9f8578-e1aa-405f-8a8a-59f530e12761\") " pod="openshift-multus/multus-additional-cni-plugins-px578" Jul 17 21:03:44.112080 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.110085 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cq5z\" (UniqueName: \"kubernetes.io/projected/df9f8578-e1aa-405f-8a8a-59f530e12761-kube-api-access-4cq5z\") pod \"multus-additional-cni-plugins-px578\" (UID: \"df9f8578-e1aa-405f-8a8a-59f530e12761\") " pod="openshift-multus/multus-additional-cni-plugins-px578" Jul 17 21:03:44.112080 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.110112 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0ec02634-d610-4017-8fb0-168bd1e9cb69-iptables-alerter-script\") pod \"iptables-alerter-mch2x\" (UID: \"0ec02634-d610-4017-8fb0-168bd1e9cb69\") " pod="openshift-network-operator/iptables-alerter-mch2x" Jul 17 21:03:44.112080 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.110139 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a700256e-b4d4-4dde-ae89-4b322addf3ad-kubelet-config\") pod \"global-pull-secret-syncer-5mn75\" (UID: \"a700256e-b4d4-4dde-ae89-4b322addf3ad\") " pod="kube-system/global-pull-secret-syncer-5mn75" Jul 17 21:03:44.112080 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.110167 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.112080 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.110168 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/df9f8578-e1aa-405f-8a8a-59f530e12761-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-px578\" (UID: \"df9f8578-e1aa-405f-8a8a-59f530e12761\") " pod="openshift-multus/multus-additional-cni-plugins-px578" Jul 17 21:03:44.112080 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.110175 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9a7adde6-ae57-40b7-aab8-2554e384766d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ql86b\" (UID: \"9a7adde6-ae57-40b7-aab8-2554e384766d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ql86b" Jul 17 21:03:44.112080 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.110192 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/df9f8578-e1aa-405f-8a8a-59f530e12761-cni-binary-copy\") pod \"multus-additional-cni-plugins-px578\" (UID: \"df9f8578-e1aa-405f-8a8a-59f530e12761\") " pod="openshift-multus/multus-additional-cni-plugins-px578" Jul 17 21:03:44.112080 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109734 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ed3c0b17-7695-427f-bb4b-64033d738c20-multus-daemon-config\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.112080 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.110218 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1bc30f77-9ff9-477d-9a8d-72ae85c5d399-host\") pod \"node-ca-c5f67\" (UID: \"1bc30f77-9ff9-477d-9a8d-72ae85c5d399\") " pod="openshift-image-registry/node-ca-c5f67" Jul 17 21:03:44.112080 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.110228 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-node-log\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.112080 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.110230 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed3c0b17-7695-427f-bb4b-64033d738c20-multus-conf-dir\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.112080 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.109587 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/df9f8578-e1aa-405f-8a8a-59f530e12761-system-cni-dir\") pod \"multus-additional-cni-plugins-px578\" (UID: \"df9f8578-e1aa-405f-8a8a-59f530e12761\") " pod="openshift-multus/multus-additional-cni-plugins-px578" Jul 17 21:03:44.112080 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.110564 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a700256e-b4d4-4dde-ae89-4b322addf3ad-dbus\") pod \"global-pull-secret-syncer-5mn75\" (UID: \"a700256e-b4d4-4dde-ae89-4b322addf3ad\") " pod="kube-system/global-pull-secret-syncer-5mn75" Jul 17 21:03:44.112080 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.110241 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3a43e428-7f49-45c4-8b89-d2f2ae686978-agent-certs\") pod \"konnectivity-agent-vjspr\" (UID: \"3a43e428-7f49-45c4-8b89-d2f2ae686978\") " pod="kube-system/konnectivity-agent-vjspr" Jul 17 21:03:44.112080 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.110612 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1bc30f77-9ff9-477d-9a8d-72ae85c5d399-serviceca\") pod \"node-ca-c5f67\" (UID: \"1bc30f77-9ff9-477d-9a8d-72ae85c5d399\") " pod="openshift-image-registry/node-ca-c5f67" Jul 17 21:03:44.112080 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.110620 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b-etc-sysctl-conf\") pod \"tuned-92jdw\" (UID: \"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.112080 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.110677 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed3c0b17-7695-427f-bb4b-64033d738c20-etc-kubernetes\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.112879 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.110747 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1bc30f77-9ff9-477d-9a8d-72ae85c5d399-host\") pod \"node-ca-c5f67\" (UID: \"1bc30f77-9ff9-477d-9a8d-72ae85c5d399\") " pod="openshift-image-registry/node-ca-c5f67" Jul 17 21:03:44.112879 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.110755 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a700256e-b4d4-4dde-ae89-4b322addf3ad-kubelet-config\") pod \"global-pull-secret-syncer-5mn75\" (UID: \"a700256e-b4d4-4dde-ae89-4b322addf3ad\") " pod="kube-system/global-pull-secret-syncer-5mn75" Jul 17 21:03:44.112879 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.110767 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b-etc-sysctl-conf\") pod \"tuned-92jdw\" (UID: \"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.112879 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.110786 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.112879 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.110802 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a700256e-b4d4-4dde-ae89-4b322addf3ad-original-pull-secret\") pod \"global-pull-secret-syncer-5mn75\" (UID: \"a700256e-b4d4-4dde-ae89-4b322addf3ad\") " pod="kube-system/global-pull-secret-syncer-5mn75" Jul 17 21:03:44.112879 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.110830 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-var-lib-openvswitch\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.112879 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.110837 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/df9f8578-e1aa-405f-8a8a-59f530e12761-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-px578\" (UID: \"df9f8578-e1aa-405f-8a8a-59f530e12761\") " pod="openshift-multus/multus-additional-cni-plugins-px578" Jul 17 21:03:44.112879 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.110856 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-log-socket\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.112879 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.110880 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-host-run-ovn-kubernetes\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.112879 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.110904 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ed3c0b17-7695-427f-bb4b-64033d738c20-host-run-k8s-cni-cncf-io\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.112879 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:44.110916 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 21:03:44.112879 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.110931 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b-etc-sysctl-d\") pod \"tuned-92jdw\" (UID: \"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.112879 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:44.110961 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a700256e-b4d4-4dde-ae89-4b322addf3ad-original-pull-secret podName:a700256e-b4d4-4dde-ae89-4b322addf3ad nodeName:}" failed. No retries permitted until 2026-07-17 21:03:44.610945941 +0000 UTC m=+3.410745247 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a700256e-b4d4-4dde-ae89-4b322addf3ad-original-pull-secret") pod "global-pull-secret-syncer-5mn75" (UID: "a700256e-b4d4-4dde-ae89-4b322addf3ad") : object "kube-system"/"original-pull-secret" not registered Jul 17 21:03:44.112879 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.110978 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b-var-lib-kubelet\") pod \"tuned-92jdw\" (UID: \"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.112879 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111000 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-host-run-netns\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.112879 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111024 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-host-cni-netd\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.112879 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111032 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b-etc-sysctl-d\") pod \"tuned-92jdw\" (UID: \"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.113841 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111050 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed3c0b17-7695-427f-bb4b-64033d738c20-host-run-netns\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.113841 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111069 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-var-lib-openvswitch\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.113841 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111075 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-etc-openvswitch\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.113841 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111090 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b-var-lib-kubelet\") pod \"tuned-92jdw\" (UID: \"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.113841 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111101 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-host-cni-bin\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.113841 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111105 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-log-socket\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.113841 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111118 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/df9f8578-e1aa-405f-8a8a-59f530e12761-cni-binary-copy\") pod \"multus-additional-cni-plugins-px578\" (UID: \"df9f8578-e1aa-405f-8a8a-59f530e12761\") " pod="openshift-multus/multus-additional-cni-plugins-px578" Jul 17 21:03:44.113841 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111127 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9a7adde6-ae57-40b7-aab8-2554e384766d-sys-fs\") pod \"aws-ebs-csi-driver-node-ql86b\" (UID: \"9a7adde6-ae57-40b7-aab8-2554e384766d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ql86b" Jul 17 21:03:44.113841 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111143 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-host-run-ovn-kubernetes\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.113841 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111153 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed3c0b17-7695-427f-bb4b-64033d738c20-host-run-netns\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.113841 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111153 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ed3c0b17-7695-427f-bb4b-64033d738c20-multus-socket-dir-parent\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.113841 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111183 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ed3c0b17-7695-427f-bb4b-64033d738c20-host-run-k8s-cni-cncf-io\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.113841 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111189 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-etc-openvswitch\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.113841 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111198 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-host-run-netns\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.113841 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111206 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed3c0b17-7695-427f-bb4b-64033d738c20-host-var-lib-cni-bin\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.113841 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111233 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed3c0b17-7695-427f-bb4b-64033d738c20-host-var-lib-kubelet\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.113841 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111235 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-host-cni-bin\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.113841 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111240 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ed3c0b17-7695-427f-bb4b-64033d738c20-multus-socket-dir-parent\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.114778 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111235 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9a7adde6-ae57-40b7-aab8-2554e384766d-sys-fs\") pod \"aws-ebs-csi-driver-node-ql86b\" (UID: \"9a7adde6-ae57-40b7-aab8-2554e384766d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ql86b" Jul 17 21:03:44.114778 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111259 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b-etc-sysconfig\") pod \"tuned-92jdw\" (UID: \"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.114778 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111269 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed3c0b17-7695-427f-bb4b-64033d738c20-host-var-lib-cni-bin\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.114778 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111280 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed3c0b17-7695-427f-bb4b-64033d738c20-host-var-lib-kubelet\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.114778 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111283 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-host-cni-netd\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.114778 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111284 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c272898b-56ad-4f67-96bb-1fda34e475f1-tmp-dir\") pod \"node-resolver-q6fjb\" (UID: \"c272898b-56ad-4f67-96bb-1fda34e475f1\") " pod="openshift-dns/node-resolver-q6fjb" Jul 17 21:03:44.114778 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111324 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0ec02634-d610-4017-8fb0-168bd1e9cb69-iptables-alerter-script\") pod \"iptables-alerter-mch2x\" (UID: \"0ec02634-d610-4017-8fb0-168bd1e9cb69\") " pod="openshift-network-operator/iptables-alerter-mch2x" Jul 17 21:03:44.114778 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111349 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0ec02634-d610-4017-8fb0-168bd1e9cb69-host-slash\") pod \"iptables-alerter-mch2x\" (UID: \"0ec02634-d610-4017-8fb0-168bd1e9cb69\") " pod="openshift-network-operator/iptables-alerter-mch2x" Jul 17 21:03:44.114778 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111374 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9a7adde6-ae57-40b7-aab8-2554e384766d-device-dir\") pod \"aws-ebs-csi-driver-node-ql86b\" (UID: \"9a7adde6-ae57-40b7-aab8-2554e384766d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ql86b" Jul 17 21:03:44.114778 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111397 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/df9f8578-e1aa-405f-8a8a-59f530e12761-tuning-conf-dir\") pod \"multus-additional-cni-plugins-px578\" (UID: \"df9f8578-e1aa-405f-8a8a-59f530e12761\") " pod="openshift-multus/multus-additional-cni-plugins-px578" Jul 17 21:03:44.114778 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111404 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0ec02634-d610-4017-8fb0-168bd1e9cb69-host-slash\") pod \"iptables-alerter-mch2x\" (UID: \"0ec02634-d610-4017-8fb0-168bd1e9cb69\") " pod="openshift-network-operator/iptables-alerter-mch2x" Jul 17 21:03:44.114778 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111409 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b-etc-sysconfig\") pod \"tuned-92jdw\" (UID: \"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.114778 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111418 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9a7adde6-ae57-40b7-aab8-2554e384766d-device-dir\") pod \"aws-ebs-csi-driver-node-ql86b\" (UID: \"9a7adde6-ae57-40b7-aab8-2554e384766d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ql86b" Jul 17 21:03:44.114778 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111422 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed3c0b17-7695-427f-bb4b-64033d738c20-cnibin\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.114778 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111480 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ed3c0b17-7695-427f-bb4b-64033d738c20-hostroot\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.114778 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111515 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2dv7\" (UniqueName: \"kubernetes.io/projected/ed3c0b17-7695-427f-bb4b-64033d738c20-kube-api-access-c2dv7\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.114778 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111536 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed3c0b17-7695-427f-bb4b-64033d738c20-cnibin\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.114778 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111550 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ed3c0b17-7695-427f-bb4b-64033d738c20-hostroot\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.115771 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111562 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c272898b-56ad-4f67-96bb-1fda34e475f1-tmp-dir\") pod \"node-resolver-q6fjb\" (UID: \"c272898b-56ad-4f67-96bb-1fda34e475f1\") " pod="openshift-dns/node-resolver-q6fjb" Jul 17 21:03:44.115771 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111567 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/df9f8578-e1aa-405f-8a8a-59f530e12761-tuning-conf-dir\") pod \"multus-additional-cni-plugins-px578\" (UID: \"df9f8578-e1aa-405f-8a8a-59f530e12761\") " pod="openshift-multus/multus-additional-cni-plugins-px578" Jul 17 21:03:44.115771 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111578 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b-tmp\") pod \"tuned-92jdw\" (UID: \"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.115771 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111617 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-systemd-units\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.115771 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111645 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-ovnkube-script-lib\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.115771 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.111653 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-systemd-units\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.115771 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.112201 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-ovnkube-script-lib\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.115771 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.113716 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b-etc-tuned\") pod \"tuned-92jdw\" (UID: \"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.115771 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.113736 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-ovn-node-metrics-cert\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.115771 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.114250 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b-tmp\") pod \"tuned-92jdw\" (UID: \"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.115771 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.114699 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3a43e428-7f49-45c4-8b89-d2f2ae686978-agent-certs\") pod \"konnectivity-agent-vjspr\" (UID: \"3a43e428-7f49-45c4-8b89-d2f2ae686978\") " pod="kube-system/konnectivity-agent-vjspr" Jul 17 21:03:44.115771 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:44.115390 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 21:03:44.115771 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:44.115411 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 21:03:44.115771 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:44.115424 2568 projected.go:196] Error preparing data for projected volume kube-api-access-kgmmd for pod openshift-network-diagnostics/network-check-target-lvjx6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 21:03:44.115771 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:44.115475 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1e535a8-ccc1-499b-9e30-70e8bd966ea1-kube-api-access-kgmmd podName:e1e535a8-ccc1-499b-9e30-70e8bd966ea1 nodeName:}" failed. No retries permitted until 2026-07-17 21:03:44.615461146 +0000 UTC m=+3.415260477 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kgmmd" (UniqueName: "kubernetes.io/projected/e1e535a8-ccc1-499b-9e30-70e8bd966ea1-kube-api-access-kgmmd") pod "network-check-target-lvjx6" (UID: "e1e535a8-ccc1-499b-9e30-70e8bd966ea1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 21:03:44.117470 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.117420 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzzvg\" (UniqueName: \"kubernetes.io/projected/fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b-kube-api-access-jzzvg\") pod \"tuned-92jdw\" (UID: \"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.117904 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.117848 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lm98t\" (UniqueName: \"kubernetes.io/projected/c272898b-56ad-4f67-96bb-1fda34e475f1-kube-api-access-lm98t\") pod \"node-resolver-q6fjb\" (UID: \"c272898b-56ad-4f67-96bb-1fda34e475f1\") " pod="openshift-dns/node-resolver-q6fjb" Jul 17 21:03:44.118311 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.118290 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gb9k\" (UniqueName: \"kubernetes.io/projected/9a7adde6-ae57-40b7-aab8-2554e384766d-kube-api-access-6gb9k\") pod \"aws-ebs-csi-driver-node-ql86b\" (UID: \"9a7adde6-ae57-40b7-aab8-2554e384766d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ql86b" Jul 17 21:03:44.119456 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.119436 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb2sf\" (UniqueName: \"kubernetes.io/projected/cdee1a8e-323d-4e8c-8336-d5e0fe3dae40-kube-api-access-gb2sf\") pod \"ovnkube-node-9vgps\" (UID: \"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40\") " pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.120265 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.120243 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bvlf\" (UniqueName: \"kubernetes.io/projected/1bc30f77-9ff9-477d-9a8d-72ae85c5d399-kube-api-access-7bvlf\") pod \"node-ca-c5f67\" (UID: \"1bc30f77-9ff9-477d-9a8d-72ae85c5d399\") " pod="openshift-image-registry/node-ca-c5f67" Jul 17 21:03:44.121018 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.120973 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sthjr\" (UniqueName: \"kubernetes.io/projected/0ec02634-d610-4017-8fb0-168bd1e9cb69-kube-api-access-sthjr\") pod \"iptables-alerter-mch2x\" (UID: \"0ec02634-d610-4017-8fb0-168bd1e9cb69\") " pod="openshift-network-operator/iptables-alerter-mch2x" Jul 17 21:03:44.121108 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.121037 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzjrf\" (UniqueName: \"kubernetes.io/projected/ff4b059f-6fba-47d3-b03e-e977255d54d3-kube-api-access-pzjrf\") pod \"network-metrics-daemon-6klsf\" (UID: \"ff4b059f-6fba-47d3-b03e-e977255d54d3\") " pod="openshift-multus/network-metrics-daemon-6klsf" Jul 17 21:03:44.127110 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.127079 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cq5z\" (UniqueName: \"kubernetes.io/projected/df9f8578-e1aa-405f-8a8a-59f530e12761-kube-api-access-4cq5z\") pod \"multus-additional-cni-plugins-px578\" (UID: \"df9f8578-e1aa-405f-8a8a-59f530e12761\") " pod="openshift-multus/multus-additional-cni-plugins-px578" Jul 17 21:03:44.127186 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.127110 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2dv7\" (UniqueName: \"kubernetes.io/projected/ed3c0b17-7695-427f-bb4b-64033d738c20-kube-api-access-c2dv7\") pod \"multus-2h6l9\" (UID: \"ed3c0b17-7695-427f-bb4b-64033d738c20\") " pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.279637 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.279598 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ql86b" Jul 17 21:03:44.289161 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.289132 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c5f67" Jul 17 21:03:44.297747 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.297719 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vjspr" Jul 17 21:03:44.306653 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.306635 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-px578" Jul 17 21:03:44.313102 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.313084 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2h6l9" Jul 17 21:03:44.319868 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.319849 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-92jdw" Jul 17 21:03:44.326458 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.326442 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q6fjb" Jul 17 21:03:44.333956 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.333940 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:03:44.341497 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.341480 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mch2x" Jul 17 21:03:44.615444 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.615414 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff4b059f-6fba-47d3-b03e-e977255d54d3-metrics-certs\") pod \"network-metrics-daemon-6klsf\" (UID: \"ff4b059f-6fba-47d3-b03e-e977255d54d3\") " pod="openshift-multus/network-metrics-daemon-6klsf" Jul 17 21:03:44.615605 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.615462 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a700256e-b4d4-4dde-ae89-4b322addf3ad-original-pull-secret\") pod \"global-pull-secret-syncer-5mn75\" (UID: \"a700256e-b4d4-4dde-ae89-4b322addf3ad\") " pod="kube-system/global-pull-secret-syncer-5mn75" Jul 17 21:03:44.615605 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.615509 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgmmd\" (UniqueName: \"kubernetes.io/projected/e1e535a8-ccc1-499b-9e30-70e8bd966ea1-kube-api-access-kgmmd\") pod \"network-check-target-lvjx6\" (UID: \"e1e535a8-ccc1-499b-9e30-70e8bd966ea1\") " pod="openshift-network-diagnostics/network-check-target-lvjx6" Jul 17 21:03:44.615605 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:44.615540 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 21:03:44.615605 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:44.615600 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff4b059f-6fba-47d3-b03e-e977255d54d3-metrics-certs podName:ff4b059f-6fba-47d3-b03e-e977255d54d3 nodeName:}" failed. No retries permitted until 2026-07-17 21:03:45.615581615 +0000 UTC m=+4.415380937 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff4b059f-6fba-47d3-b03e-e977255d54d3-metrics-certs") pod "network-metrics-daemon-6klsf" (UID: "ff4b059f-6fba-47d3-b03e-e977255d54d3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 21:03:44.615839 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:44.615620 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 21:03:44.615839 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:44.615668 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a700256e-b4d4-4dde-ae89-4b322addf3ad-original-pull-secret podName:a700256e-b4d4-4dde-ae89-4b322addf3ad nodeName:}" failed. No retries permitted until 2026-07-17 21:03:45.615655086 +0000 UTC m=+4.415454392 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a700256e-b4d4-4dde-ae89-4b322addf3ad-original-pull-secret") pod "global-pull-secret-syncer-5mn75" (UID: "a700256e-b4d4-4dde-ae89-4b322addf3ad") : object "kube-system"/"original-pull-secret" not registered Jul 17 21:03:44.615839 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:44.615625 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 21:03:44.615839 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:44.615712 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 21:03:44.615839 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:44.615722 2568 projected.go:196] Error preparing data for projected volume kube-api-access-kgmmd for pod openshift-network-diagnostics/network-check-target-lvjx6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 21:03:44.615839 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:44.615752 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1e535a8-ccc1-499b-9e30-70e8bd966ea1-kube-api-access-kgmmd podName:e1e535a8-ccc1-499b-9e30-70e8bd966ea1 nodeName:}" failed. No retries permitted until 2026-07-17 21:03:45.615744002 +0000 UTC m=+4.415543309 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kgmmd" (UniqueName: "kubernetes.io/projected/e1e535a8-ccc1-499b-9e30-70e8bd966ea1-kube-api-access-kgmmd") pod "network-check-target-lvjx6" (UID: "e1e535a8-ccc1-499b-9e30-70e8bd966ea1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 21:03:44.833255 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:44.833179 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc272898b_56ad_4f67_96bb_1fda34e475f1.slice/crio-486ba761e17f1698bb2b44454d9dbeb335cd8e0d6a8f99e3660f473f5d586513 WatchSource:0}: Error finding container 486ba761e17f1698bb2b44454d9dbeb335cd8e0d6a8f99e3660f473f5d586513: Status 404 returned error can't find the container with id 486ba761e17f1698bb2b44454d9dbeb335cd8e0d6a8f99e3660f473f5d586513 Jul 17 21:03:44.834341 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:44.834309 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ec02634_d610_4017_8fb0_168bd1e9cb69.slice/crio-ee9a995097aa1de08689ed39e567475857aa3a1947e9278fb7318cd616d1d83c WatchSource:0}: Error finding container ee9a995097aa1de08689ed39e567475857aa3a1947e9278fb7318cd616d1d83c: Status 404 returned error can't find the container with id ee9a995097aa1de08689ed39e567475857aa3a1947e9278fb7318cd616d1d83c Jul 17 21:03:44.837176 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:44.837153 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bc30f77_9ff9_477d_9a8d_72ae85c5d399.slice/crio-0ae26ac10b9d26c87e45378891a5a02f55914309893324349dc5956cab063dc9 WatchSource:0}: Error finding container 0ae26ac10b9d26c87e45378891a5a02f55914309893324349dc5956cab063dc9: Status 404 returned error can't find the container with id 0ae26ac10b9d26c87e45378891a5a02f55914309893324349dc5956cab063dc9 Jul 17 21:03:44.839484 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:44.839368 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a7adde6_ae57_40b7_aab8_2554e384766d.slice/crio-8f00cbf265c98cace314d32046cc360b4688429d3e80507713c639dc8c444a7d WatchSource:0}: Error finding container 8f00cbf265c98cace314d32046cc360b4688429d3e80507713c639dc8c444a7d: Status 404 returned error can't find the container with id 8f00cbf265c98cace314d32046cc360b4688429d3e80507713c639dc8c444a7d Jul 17 21:03:44.840262 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:44.840233 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a43e428_7f49_45c4_8b89_d2f2ae686978.slice/crio-38cc790214c4d596401c57cd565cfd4b6cab8e7807a3e6a52f98e4b06897bd56 WatchSource:0}: Error finding container 38cc790214c4d596401c57cd565cfd4b6cab8e7807a3e6a52f98e4b06897bd56: Status 404 returned error can't find the container with id 38cc790214c4d596401c57cd565cfd4b6cab8e7807a3e6a52f98e4b06897bd56 Jul 17 21:03:44.840788 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:44.840745 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbf446a4_a1b4_4b5b_bff9_9044f8cbcd7b.slice/crio-84740a1d5dcc89771454921c71e58fd663a9dfa566a144e08599e0bcb40f96a7 WatchSource:0}: Error finding container 84740a1d5dcc89771454921c71e58fd663a9dfa566a144e08599e0bcb40f96a7: Status 404 returned error can't find the container with id 84740a1d5dcc89771454921c71e58fd663a9dfa566a144e08599e0bcb40f96a7 Jul 17 21:03:44.842442 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:44.842181 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdee1a8e_323d_4e8c_8336_d5e0fe3dae40.slice/crio-91bfd01116b51ff026196e074dda831f66d63f1bac576bee609a3c86025c2909 WatchSource:0}: Error finding container 91bfd01116b51ff026196e074dda831f66d63f1bac576bee609a3c86025c2909: Status 404 returned error can't find the container with id 91bfd01116b51ff026196e074dda831f66d63f1bac576bee609a3c86025c2909 Jul 17 21:03:44.843989 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:44.843228 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf9f8578_e1aa_405f_8a8a_59f530e12761.slice/crio-a09f7d3797a7d5f24d0d301a2b112a077caf844fcf8586f55d758122cc750772 WatchSource:0}: Error finding container a09f7d3797a7d5f24d0d301a2b112a077caf844fcf8586f55d758122cc750772: Status 404 returned error can't find the container with id a09f7d3797a7d5f24d0d301a2b112a077caf844fcf8586f55d758122cc750772 Jul 17 21:03:44.844449 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:03:44.844095 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded3c0b17_7695_427f_bb4b_64033d738c20.slice/crio-62c7fc7e9fa0a7f5ee7deb39df13d703dada231d6e5e5aa1131b452f0858789e WatchSource:0}: Error finding container 62c7fc7e9fa0a7f5ee7deb39df13d703dada231d6e5e5aa1131b452f0858789e: Status 404 returned error can't find the container with id 62c7fc7e9fa0a7f5ee7deb39df13d703dada231d6e5e5aa1131b452f0858789e Jul 17 21:03:44.969511 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.969445 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 20:58:43 +0000 UTC" deadline="2028-04-03 21:10:25.175207782 +0000 UTC" Jul 17 21:03:44.969608 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:44.969514 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15024h6m40.205702358s" Jul 17 21:03:45.569210 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:45.568816 2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 21:03:45.625993 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:45.624925 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff4b059f-6fba-47d3-b03e-e977255d54d3-metrics-certs\") pod \"network-metrics-daemon-6klsf\" (UID: \"ff4b059f-6fba-47d3-b03e-e977255d54d3\") " pod="openshift-multus/network-metrics-daemon-6klsf" Jul 17 21:03:45.625993 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:45.624979 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a700256e-b4d4-4dde-ae89-4b322addf3ad-original-pull-secret\") pod \"global-pull-secret-syncer-5mn75\" (UID: \"a700256e-b4d4-4dde-ae89-4b322addf3ad\") " pod="kube-system/global-pull-secret-syncer-5mn75" Jul 17 21:03:45.625993 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:45.625023 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgmmd\" (UniqueName: \"kubernetes.io/projected/e1e535a8-ccc1-499b-9e30-70e8bd966ea1-kube-api-access-kgmmd\") pod \"network-check-target-lvjx6\" (UID: \"e1e535a8-ccc1-499b-9e30-70e8bd966ea1\") " pod="openshift-network-diagnostics/network-check-target-lvjx6" Jul 17 21:03:45.625993 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:45.625226 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 21:03:45.625993 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:45.625243 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 21:03:45.625993 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:45.625254 2568 projected.go:196] Error preparing data for projected volume kube-api-access-kgmmd for pod openshift-network-diagnostics/network-check-target-lvjx6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 21:03:45.625993 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:45.625440 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1e535a8-ccc1-499b-9e30-70e8bd966ea1-kube-api-access-kgmmd podName:e1e535a8-ccc1-499b-9e30-70e8bd966ea1 nodeName:}" failed. No retries permitted until 2026-07-17 21:03:47.625413918 +0000 UTC m=+6.425213226 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kgmmd" (UniqueName: "kubernetes.io/projected/e1e535a8-ccc1-499b-9e30-70e8bd966ea1-kube-api-access-kgmmd") pod "network-check-target-lvjx6" (UID: "e1e535a8-ccc1-499b-9e30-70e8bd966ea1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 21:03:45.625993 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:45.625786 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 21:03:45.625993 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:45.625835 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a700256e-b4d4-4dde-ae89-4b322addf3ad-original-pull-secret podName:a700256e-b4d4-4dde-ae89-4b322addf3ad nodeName:}" failed. No retries permitted until 2026-07-17 21:03:47.625820244 +0000 UTC m=+6.425619554 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a700256e-b4d4-4dde-ae89-4b322addf3ad-original-pull-secret") pod "global-pull-secret-syncer-5mn75" (UID: "a700256e-b4d4-4dde-ae89-4b322addf3ad") : object "kube-system"/"original-pull-secret" not registered Jul 17 21:03:45.625993 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:45.625891 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 21:03:45.625993 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:45.625925 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff4b059f-6fba-47d3-b03e-e977255d54d3-metrics-certs podName:ff4b059f-6fba-47d3-b03e-e977255d54d3 nodeName:}" failed. No retries permitted until 2026-07-17 21:03:47.625914274 +0000 UTC m=+6.425713588 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff4b059f-6fba-47d3-b03e-e977255d54d3-metrics-certs") pod "network-metrics-daemon-6klsf" (UID: "ff4b059f-6fba-47d3-b03e-e977255d54d3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 21:03:45.732317 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:45.731412 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mn75" Jul 17 21:03:45.732317 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:45.731557 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mn75" podUID="a700256e-b4d4-4dde-ae89-4b322addf3ad" Jul 17 21:03:45.732317 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:45.732009 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6klsf" Jul 17 21:03:45.732317 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:45.732112 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6klsf" podUID="ff4b059f-6fba-47d3-b03e-e977255d54d3" Jul 17 21:03:45.732317 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:45.732205 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvjx6" Jul 17 21:03:45.732317 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:45.732271 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvjx6" podUID="e1e535a8-ccc1-499b-9e30-70e8bd966ea1" Jul 17 21:03:45.751215 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:45.751184 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c5f67" event={"ID":"1bc30f77-9ff9-477d-9a8d-72ae85c5d399","Type":"ContainerStarted","Data":"0ae26ac10b9d26c87e45378891a5a02f55914309893324349dc5956cab063dc9"} Jul 17 21:03:45.753811 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:45.753785 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q6fjb" event={"ID":"c272898b-56ad-4f67-96bb-1fda34e475f1","Type":"ContainerStarted","Data":"486ba761e17f1698bb2b44454d9dbeb335cd8e0d6a8f99e3660f473f5d586513"} Jul 17 21:03:45.760490 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:45.760430 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-37.ec2.internal" event={"ID":"dd02f43dd4bf8de506722f80f7be8b04","Type":"ContainerStarted","Data":"06ff85396bfd77b1884f68375d5013a938fc6e60f36cb19ca1f5b2dd40f84114"} Jul 17 21:03:45.764366 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:45.763637 2568 generic.go:356] "Generic (PLEG): container finished" podID="e02005bc23693b38a5a1b9ac40884898" containerID="1c374c08f417204993bf01cb85eaffb14cd4ecb8e794a10dd022d46dee5e1cc1" exitCode=0 Jul 17 21:03:45.764366 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:45.763723 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-37.ec2.internal" event={"ID":"e02005bc23693b38a5a1b9ac40884898","Type":"ContainerDied","Data":"1c374c08f417204993bf01cb85eaffb14cd4ecb8e794a10dd022d46dee5e1cc1"} Jul 17 21:03:45.779287 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:45.779168 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-37.ec2.internal" podStartSLOduration=3.779151102 podStartE2EDuration="3.779151102s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:03:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:03:45.778091944 +0000 UTC m=+4.577891283" watchObservedRunningTime="2026-07-17 21:03:45.779151102 +0000 UTC m=+4.578950434" Jul 17 21:03:45.782730 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:45.782671 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" event={"ID":"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40","Type":"ContainerStarted","Data":"91bfd01116b51ff026196e074dda831f66d63f1bac576bee609a3c86025c2909"} Jul 17 21:03:45.789646 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:45.789536 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-92jdw" event={"ID":"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b","Type":"ContainerStarted","Data":"84740a1d5dcc89771454921c71e58fd663a9dfa566a144e08599e0bcb40f96a7"} Jul 17 21:03:45.792092 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:45.792072 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ql86b" event={"ID":"9a7adde6-ae57-40b7-aab8-2554e384766d","Type":"ContainerStarted","Data":"8f00cbf265c98cace314d32046cc360b4688429d3e80507713c639dc8c444a7d"} Jul 17 21:03:45.820213 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:45.819876 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mch2x" event={"ID":"0ec02634-d610-4017-8fb0-168bd1e9cb69","Type":"ContainerStarted","Data":"ee9a995097aa1de08689ed39e567475857aa3a1947e9278fb7318cd616d1d83c"} Jul 17 21:03:45.830812 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:45.830782 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2h6l9" event={"ID":"ed3c0b17-7695-427f-bb4b-64033d738c20","Type":"ContainerStarted","Data":"62c7fc7e9fa0a7f5ee7deb39df13d703dada231d6e5e5aa1131b452f0858789e"} Jul 17 21:03:45.841430 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:45.841395 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-px578" event={"ID":"df9f8578-e1aa-405f-8a8a-59f530e12761","Type":"ContainerStarted","Data":"a09f7d3797a7d5f24d0d301a2b112a077caf844fcf8586f55d758122cc750772"} Jul 17 21:03:45.845498 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:45.845434 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vjspr" event={"ID":"3a43e428-7f49-45c4-8b89-d2f2ae686978","Type":"ContainerStarted","Data":"38cc790214c4d596401c57cd565cfd4b6cab8e7807a3e6a52f98e4b06897bd56"} Jul 17 21:03:45.970271 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:45.970179 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 20:58:43 +0000 UTC" deadline="2028-03-01 08:22:11.385774346 +0000 UTC" Jul 17 21:03:45.970271 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:45.970238 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14219h18m25.415540447s" Jul 17 21:03:46.858209 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:46.858173 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-37.ec2.internal" event={"ID":"e02005bc23693b38a5a1b9ac40884898","Type":"ContainerStarted","Data":"dc2b2d73cfec6b98be70ba2c87e0595312a800295be3b7b5c222a1348370bd38"} Jul 17 21:03:47.641739 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:47.641699 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a700256e-b4d4-4dde-ae89-4b322addf3ad-original-pull-secret\") pod \"global-pull-secret-syncer-5mn75\" (UID: \"a700256e-b4d4-4dde-ae89-4b322addf3ad\") " pod="kube-system/global-pull-secret-syncer-5mn75" Jul 17 21:03:47.641900 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:47.641766 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgmmd\" (UniqueName: \"kubernetes.io/projected/e1e535a8-ccc1-499b-9e30-70e8bd966ea1-kube-api-access-kgmmd\") pod \"network-check-target-lvjx6\" (UID: \"e1e535a8-ccc1-499b-9e30-70e8bd966ea1\") " pod="openshift-network-diagnostics/network-check-target-lvjx6" Jul 17 21:03:47.641900 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:47.641814 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff4b059f-6fba-47d3-b03e-e977255d54d3-metrics-certs\") pod \"network-metrics-daemon-6klsf\" (UID: \"ff4b059f-6fba-47d3-b03e-e977255d54d3\") " pod="openshift-multus/network-metrics-daemon-6klsf" Jul 17 21:03:47.642016 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:47.641944 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 21:03:47.642016 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:47.642004 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff4b059f-6fba-47d3-b03e-e977255d54d3-metrics-certs podName:ff4b059f-6fba-47d3-b03e-e977255d54d3 nodeName:}" failed. No retries permitted until 2026-07-17 21:03:51.641986378 +0000 UTC m=+10.441785706 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff4b059f-6fba-47d3-b03e-e977255d54d3-metrics-certs") pod "network-metrics-daemon-6klsf" (UID: "ff4b059f-6fba-47d3-b03e-e977255d54d3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 21:03:47.642611 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:47.642394 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 21:03:47.642611 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:47.642447 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a700256e-b4d4-4dde-ae89-4b322addf3ad-original-pull-secret podName:a700256e-b4d4-4dde-ae89-4b322addf3ad nodeName:}" failed. No retries permitted until 2026-07-17 21:03:51.642430816 +0000 UTC m=+10.442230141 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a700256e-b4d4-4dde-ae89-4b322addf3ad-original-pull-secret") pod "global-pull-secret-syncer-5mn75" (UID: "a700256e-b4d4-4dde-ae89-4b322addf3ad") : object "kube-system"/"original-pull-secret" not registered Jul 17 21:03:47.642611 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:47.642525 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 21:03:47.642611 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:47.642539 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 21:03:47.642611 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:47.642553 2568 projected.go:196] Error preparing data for projected volume kube-api-access-kgmmd for pod openshift-network-diagnostics/network-check-target-lvjx6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 21:03:47.642611 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:47.642587 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1e535a8-ccc1-499b-9e30-70e8bd966ea1-kube-api-access-kgmmd podName:e1e535a8-ccc1-499b-9e30-70e8bd966ea1 nodeName:}" failed. No retries permitted until 2026-07-17 21:03:51.642576265 +0000 UTC m=+10.442375572 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kgmmd" (UniqueName: "kubernetes.io/projected/e1e535a8-ccc1-499b-9e30-70e8bd966ea1-kube-api-access-kgmmd") pod "network-check-target-lvjx6" (UID: "e1e535a8-ccc1-499b-9e30-70e8bd966ea1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 21:03:47.733418 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:47.733388 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6klsf" Jul 17 21:03:47.733583 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:47.733529 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6klsf" podUID="ff4b059f-6fba-47d3-b03e-e977255d54d3" Jul 17 21:03:47.733967 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:47.733933 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mn75" Jul 17 21:03:47.734069 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:47.734035 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mn75" podUID="a700256e-b4d4-4dde-ae89-4b322addf3ad" Jul 17 21:03:47.734130 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:47.734100 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvjx6" Jul 17 21:03:47.734202 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:47.734174 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvjx6" podUID="e1e535a8-ccc1-499b-9e30-70e8bd966ea1" Jul 17 21:03:49.730575 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:49.730543 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvjx6" Jul 17 21:03:49.730575 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:49.730558 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mn75" Jul 17 21:03:49.731096 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:49.730666 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvjx6" podUID="e1e535a8-ccc1-499b-9e30-70e8bd966ea1" Jul 17 21:03:49.731096 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:49.730754 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mn75" podUID="a700256e-b4d4-4dde-ae89-4b322addf3ad" Jul 17 21:03:49.731096 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:49.730811 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6klsf" Jul 17 21:03:49.731096 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:49.730892 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6klsf" podUID="ff4b059f-6fba-47d3-b03e-e977255d54d3" Jul 17 21:03:51.672469 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:51.672432 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff4b059f-6fba-47d3-b03e-e977255d54d3-metrics-certs\") pod \"network-metrics-daemon-6klsf\" (UID: \"ff4b059f-6fba-47d3-b03e-e977255d54d3\") " pod="openshift-multus/network-metrics-daemon-6klsf" Jul 17 21:03:51.673163 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:51.672487 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a700256e-b4d4-4dde-ae89-4b322addf3ad-original-pull-secret\") pod \"global-pull-secret-syncer-5mn75\" (UID: \"a700256e-b4d4-4dde-ae89-4b322addf3ad\") " pod="kube-system/global-pull-secret-syncer-5mn75" Jul 17 21:03:51.673163 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:51.672534 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgmmd\" (UniqueName: \"kubernetes.io/projected/e1e535a8-ccc1-499b-9e30-70e8bd966ea1-kube-api-access-kgmmd\") pod \"network-check-target-lvjx6\" (UID: \"e1e535a8-ccc1-499b-9e30-70e8bd966ea1\") " pod="openshift-network-diagnostics/network-check-target-lvjx6" Jul 17 21:03:51.673163 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:51.672559 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 21:03:51.673163 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:51.672612 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff4b059f-6fba-47d3-b03e-e977255d54d3-metrics-certs podName:ff4b059f-6fba-47d3-b03e-e977255d54d3 nodeName:}" failed. No retries permitted until 2026-07-17 21:03:59.672598789 +0000 UTC m=+18.472398099 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff4b059f-6fba-47d3-b03e-e977255d54d3-metrics-certs") pod "network-metrics-daemon-6klsf" (UID: "ff4b059f-6fba-47d3-b03e-e977255d54d3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 21:03:51.673163 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:51.672654 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 21:03:51.673163 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:51.672673 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 21:03:51.673163 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:51.672701 2568 projected.go:196] Error preparing data for projected volume kube-api-access-kgmmd for pod openshift-network-diagnostics/network-check-target-lvjx6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 21:03:51.673163 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:51.672749 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1e535a8-ccc1-499b-9e30-70e8bd966ea1-kube-api-access-kgmmd podName:e1e535a8-ccc1-499b-9e30-70e8bd966ea1 nodeName:}" failed. No retries permitted until 2026-07-17 21:03:59.67273468 +0000 UTC m=+18.472534015 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kgmmd" (UniqueName: "kubernetes.io/projected/e1e535a8-ccc1-499b-9e30-70e8bd966ea1-kube-api-access-kgmmd") pod "network-check-target-lvjx6" (UID: "e1e535a8-ccc1-499b-9e30-70e8bd966ea1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 21:03:51.673163 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:51.672782 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 21:03:51.673163 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:51.672846 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a700256e-b4d4-4dde-ae89-4b322addf3ad-original-pull-secret podName:a700256e-b4d4-4dde-ae89-4b322addf3ad nodeName:}" failed. No retries permitted until 2026-07-17 21:03:59.672821081 +0000 UTC m=+18.472620405 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a700256e-b4d4-4dde-ae89-4b322addf3ad-original-pull-secret") pod "global-pull-secret-syncer-5mn75" (UID: "a700256e-b4d4-4dde-ae89-4b322addf3ad") : object "kube-system"/"original-pull-secret" not registered Jul 17 21:03:51.732049 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:51.732016 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6klsf" Jul 17 21:03:51.732229 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:51.732123 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvjx6" Jul 17 21:03:51.732229 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:51.732129 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6klsf" podUID="ff4b059f-6fba-47d3-b03e-e977255d54d3" Jul 17 21:03:51.732229 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:51.732219 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvjx6" podUID="e1e535a8-ccc1-499b-9e30-70e8bd966ea1" Jul 17 21:03:51.732370 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:51.732244 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mn75" Jul 17 21:03:51.732370 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:51.732320 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mn75" podUID="a700256e-b4d4-4dde-ae89-4b322addf3ad" Jul 17 21:03:53.732407 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:53.732378 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6klsf" Jul 17 21:03:53.732883 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:53.732525 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6klsf" podUID="ff4b059f-6fba-47d3-b03e-e977255d54d3" Jul 17 21:03:53.732883 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:53.732811 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvjx6" Jul 17 21:03:53.732883 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:53.732864 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mn75" Jul 17 21:03:53.733051 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:53.732957 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mn75" podUID="a700256e-b4d4-4dde-ae89-4b322addf3ad" Jul 17 21:03:53.733051 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:53.733000 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvjx6" podUID="e1e535a8-ccc1-499b-9e30-70e8bd966ea1" Jul 17 21:03:55.730251 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:55.730194 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6klsf" Jul 17 21:03:55.730251 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:55.730213 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mn75" Jul 17 21:03:55.730633 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:55.730198 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvjx6" Jul 17 21:03:55.730633 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:55.730294 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6klsf" podUID="ff4b059f-6fba-47d3-b03e-e977255d54d3" Jul 17 21:03:55.730633 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:55.730374 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mn75" podUID="a700256e-b4d4-4dde-ae89-4b322addf3ad" Jul 17 21:03:55.730633 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:55.730514 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvjx6" podUID="e1e535a8-ccc1-499b-9e30-70e8bd966ea1" Jul 17 21:03:57.730899 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:57.730866 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6klsf" Jul 17 21:03:57.730899 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:57.730894 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mn75" Jul 17 21:03:57.731310 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:57.730866 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvjx6" Jul 17 21:03:57.731310 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:57.730982 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6klsf" podUID="ff4b059f-6fba-47d3-b03e-e977255d54d3" Jul 17 21:03:57.731310 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:57.731046 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mn75" podUID="a700256e-b4d4-4dde-ae89-4b322addf3ad" Jul 17 21:03:57.731310 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:57.731131 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvjx6" podUID="e1e535a8-ccc1-499b-9e30-70e8bd966ea1" Jul 17 21:03:59.730193 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:59.730099 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvjx6" Jul 17 21:03:59.730193 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:59.730107 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6klsf" Jul 17 21:03:59.730193 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:59.730177 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff4b059f-6fba-47d3-b03e-e977255d54d3-metrics-certs\") pod \"network-metrics-daemon-6klsf\" (UID: \"ff4b059f-6fba-47d3-b03e-e977255d54d3\") " pod="openshift-multus/network-metrics-daemon-6klsf" Jul 17 21:03:59.730820 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:59.730216 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a700256e-b4d4-4dde-ae89-4b322addf3ad-original-pull-secret\") pod \"global-pull-secret-syncer-5mn75\" (UID: \"a700256e-b4d4-4dde-ae89-4b322addf3ad\") " pod="kube-system/global-pull-secret-syncer-5mn75" Jul 17 21:03:59.730820 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:59.730256 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgmmd\" (UniqueName: \"kubernetes.io/projected/e1e535a8-ccc1-499b-9e30-70e8bd966ea1-kube-api-access-kgmmd\") pod \"network-check-target-lvjx6\" (UID: \"e1e535a8-ccc1-499b-9e30-70e8bd966ea1\") " pod="openshift-network-diagnostics/network-check-target-lvjx6" Jul 17 21:03:59.730820 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:59.730266 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6klsf" podUID="ff4b059f-6fba-47d3-b03e-e977255d54d3" Jul 17 21:03:59.730820 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:03:59.730397 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mn75" Jul 17 21:03:59.730820 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:59.730495 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 21:03:59.730820 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:59.730520 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 21:03:59.730820 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:59.730533 2568 projected.go:196] Error preparing data for projected volume kube-api-access-kgmmd for pod openshift-network-diagnostics/network-check-target-lvjx6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 21:03:59.730820 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:59.730536 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 21:03:59.730820 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:59.730583 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 21:03:59.730820 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:59.730592 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1e535a8-ccc1-499b-9e30-70e8bd966ea1-kube-api-access-kgmmd podName:e1e535a8-ccc1-499b-9e30-70e8bd966ea1 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:15.730571716 +0000 UTC m=+34.530371038 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kgmmd" (UniqueName: "kubernetes.io/projected/e1e535a8-ccc1-499b-9e30-70e8bd966ea1-kube-api-access-kgmmd") pod "network-check-target-lvjx6" (UID: "e1e535a8-ccc1-499b-9e30-70e8bd966ea1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 21:03:59.730820 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:59.730626 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvjx6" podUID="e1e535a8-ccc1-499b-9e30-70e8bd966ea1" Jul 17 21:03:59.730820 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:59.730667 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff4b059f-6fba-47d3-b03e-e977255d54d3-metrics-certs podName:ff4b059f-6fba-47d3-b03e-e977255d54d3 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:15.730646689 +0000 UTC m=+34.530446011 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff4b059f-6fba-47d3-b03e-e977255d54d3-metrics-certs") pod "network-metrics-daemon-6klsf" (UID: "ff4b059f-6fba-47d3-b03e-e977255d54d3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 21:03:59.730820 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:59.730706 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a700256e-b4d4-4dde-ae89-4b322addf3ad-original-pull-secret podName:a700256e-b4d4-4dde-ae89-4b322addf3ad nodeName:}" failed. No retries permitted until 2026-07-17 21:04:15.73067466 +0000 UTC m=+34.530473967 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a700256e-b4d4-4dde-ae89-4b322addf3ad-original-pull-secret") pod "global-pull-secret-syncer-5mn75" (UID: "a700256e-b4d4-4dde-ae89-4b322addf3ad") : object "kube-system"/"original-pull-secret" not registered Jul 17 21:03:59.730820 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:03:59.730780 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mn75" podUID="a700256e-b4d4-4dde-ae89-4b322addf3ad" Jul 17 21:04:01.731074 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:01.731038 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6klsf" Jul 17 21:04:01.731535 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:01.731162 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mn75" Jul 17 21:04:01.731535 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:01.731179 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6klsf" podUID="ff4b059f-6fba-47d3-b03e-e977255d54d3" Jul 17 21:04:01.731535 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:01.731280 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mn75" podUID="a700256e-b4d4-4dde-ae89-4b322addf3ad" Jul 17 21:04:01.731535 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:01.731344 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvjx6" Jul 17 21:04:01.731535 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:01.731446 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvjx6" podUID="e1e535a8-ccc1-499b-9e30-70e8bd966ea1" Jul 17 21:04:03.730987 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:03.730946 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mn75" Jul 17 21:04:03.730987 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:03.730988 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvjx6" Jul 17 21:04:03.731471 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:03.730957 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6klsf" Jul 17 21:04:03.731471 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:03.731104 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mn75" podUID="a700256e-b4d4-4dde-ae89-4b322addf3ad" Jul 17 21:04:03.731471 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:03.731240 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6klsf" podUID="ff4b059f-6fba-47d3-b03e-e977255d54d3" Jul 17 21:04:03.731471 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:03.731318 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvjx6" podUID="e1e535a8-ccc1-499b-9e30-70e8bd966ea1" Jul 17 21:04:04.897804 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:04.897399 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ql86b" event={"ID":"9a7adde6-ae57-40b7-aab8-2554e384766d","Type":"ContainerStarted","Data":"687d9fc735e194f52af199f7aaacf1c2589baefaa4a52ca11fa47ced4cb44e13"} Jul 17 21:04:04.899053 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:04.899028 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2h6l9" event={"ID":"ed3c0b17-7695-427f-bb4b-64033d738c20","Type":"ContainerStarted","Data":"e178e5fc6ef7c4e9cc3b925325e8202a29f221fa55fedfa7198710b0cac32d55"} Jul 17 21:04:04.900727 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:04.900704 2568 generic.go:356] "Generic (PLEG): container finished" podID="df9f8578-e1aa-405f-8a8a-59f530e12761" containerID="be0e47fc8690cfc579208ea70b720ee3e35ad39fe9903e5410ee1fdb7a67fcad" exitCode=0 Jul 17 21:04:04.900835 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:04.900792 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-px578" event={"ID":"df9f8578-e1aa-405f-8a8a-59f530e12761","Type":"ContainerDied","Data":"be0e47fc8690cfc579208ea70b720ee3e35ad39fe9903e5410ee1fdb7a67fcad"} Jul 17 21:04:04.902312 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:04.902277 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vjspr" event={"ID":"3a43e428-7f49-45c4-8b89-d2f2ae686978","Type":"ContainerStarted","Data":"19ca5addd90ab6cb324de4b6421009e431c561c88669be84dde95d524b478822"} Jul 17 21:04:04.903921 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:04.903897 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c5f67" event={"ID":"1bc30f77-9ff9-477d-9a8d-72ae85c5d399","Type":"ContainerStarted","Data":"114bc2a1a3edd2ea8686f7e89c3a2d844e9b250c0c9264c5a596cfd3fe0ff32b"} Jul 17 21:04:04.905507 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:04.905474 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q6fjb" event={"ID":"c272898b-56ad-4f67-96bb-1fda34e475f1","Type":"ContainerStarted","Data":"904a8f9bfcf8a1f6dcb7cad982ef12ad53eeb6bc4a3eea2582456472faad0d5a"} Jul 17 21:04:04.909272 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:04.909249 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" event={"ID":"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40","Type":"ContainerStarted","Data":"f2fbe608ddea2be432b11dcdac97f09dbd73b3889021f61aa2bf927a8690f5be"} Jul 17 21:04:04.909375 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:04.909323 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" event={"ID":"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40","Type":"ContainerStarted","Data":"d8bd61c173cf6fefb3f0a74187ab86e259cf990682c7d34542b6fdbdce0b0247"} Jul 17 21:04:04.909436 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:04.909374 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" event={"ID":"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40","Type":"ContainerStarted","Data":"a2d7782d98b81e8fc19a836747de4e8db7d501be69e15aaeaf0897655d8c6ce4"} Jul 17 21:04:04.909436 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:04.909422 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" event={"ID":"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40","Type":"ContainerStarted","Data":"cd5248191d0b0debd4209342e2b5a2da35ca42d38302a860323c9220061c6cbf"} Jul 17 21:04:04.909537 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:04.909468 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" event={"ID":"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40","Type":"ContainerStarted","Data":"d3e2e4b9def80c78b035eefc852ea0e1d8ed3e68f361c6215aa73a5c5352bafd"} Jul 17 21:04:04.909537 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:04.909507 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" event={"ID":"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40","Type":"ContainerStarted","Data":"8efced8134149e605e1e1fa09afa2ad76ec57efde347b009e9f57b5037bd14a4"} Jul 17 21:04:04.910742 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:04.910720 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-92jdw" event={"ID":"fbf446a4-a1b4-4b5b-bff9-9044f8cbcd7b","Type":"ContainerStarted","Data":"960e2a82e4216666015d67bb78387f65ca2ea528e1bf0595766cfeefe5bc23c9"} Jul 17 21:04:04.919542 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:04.919506 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-37.ec2.internal" podStartSLOduration=22.919494743 podStartE2EDuration="22.919494743s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:03:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:03:46.894971176 +0000 UTC m=+5.694770507" watchObservedRunningTime="2026-07-17 21:04:04.919494743 +0000 UTC m=+23.719294073" Jul 17 21:04:04.919649 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:04.919571 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2h6l9" podStartSLOduration=4.880927067 podStartE2EDuration="23.919565238s" totalImagesPullingTime="19.038638171s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:03:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:04.919150456 +0000 UTC m=+23.718949782" watchObservedRunningTime="2026-07-17 21:04:04.919565238 +0000 UTC m=+23.719364566" Jul 17 21:04:04.938870 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:04.938829 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vjspr" podStartSLOduration=4.951682146 podStartE2EDuration="23.938816595s" totalImagesPullingTime="18.987134449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:03:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:04.93820579 +0000 UTC m=+23.738005115" watchObservedRunningTime="2026-07-17 21:04:04.938816595 +0000 UTC m=+23.738615923" Jul 17 21:04:04.981094 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:04.981040 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-92jdw" podStartSLOduration=4.995124143 podStartE2EDuration="23.981022692s" totalImagesPullingTime="18.985898549s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:03:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:04.98049346 +0000 UTC m=+23.780292789" watchObservedRunningTime="2026-07-17 21:04:04.981022692 +0000 UTC m=+23.780822021" Jul 17 21:04:05.013888 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:05.013848 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-q6fjb" podStartSLOduration=4.020474537 podStartE2EDuration="23.013834859s" totalImagesPullingTime="18.993360322s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:03:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:04.99796809 +0000 UTC m=+23.797767419" watchObservedRunningTime="2026-07-17 21:04:05.013834859 +0000 UTC m=+23.813634187" Jul 17 21:04:05.014101 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:05.013915 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-c5f67" podStartSLOduration=5.024249935 podStartE2EDuration="24.013910882s" totalImagesPullingTime="18.989660947s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:03:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:05.013320192 +0000 UTC m=+23.813119521" watchObservedRunningTime="2026-07-17 21:04:05.013910882 +0000 UTC m=+23.813710211" Jul 17 21:04:05.442811 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:05.442792 2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 17 21:04:05.647391 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:05.647254 2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-17T21:04:05.442807711Z","UUID":"0d63be3c-328b-49d6-82e3-33e58dfad208","Handler":null,"Name":"","Endpoint":""} Jul 17 21:04:05.648936 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:05.648887 2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 17 21:04:05.648936 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:05.648932 2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 17 21:04:05.731104 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:05.731079 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvjx6" Jul 17 21:04:05.731255 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:05.731079 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6klsf" Jul 17 21:04:05.731299 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:05.731251 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6klsf" podUID="ff4b059f-6fba-47d3-b03e-e977255d54d3" Jul 17 21:04:05.731299 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:05.731170 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvjx6" podUID="e1e535a8-ccc1-499b-9e30-70e8bd966ea1" Jul 17 21:04:05.731299 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:05.731086 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mn75" Jul 17 21:04:05.731451 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:05.731308 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mn75" podUID="a700256e-b4d4-4dde-ae89-4b322addf3ad" Jul 17 21:04:05.915073 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:05.914998 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ql86b" event={"ID":"9a7adde6-ae57-40b7-aab8-2554e384766d","Type":"ContainerStarted","Data":"9233844ac8e927889bc7b5a4107d6c06b986261a81d2bd88a242eab1f0cc2048"} Jul 17 21:04:05.916600 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:05.916542 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mch2x" event={"ID":"0ec02634-d610-4017-8fb0-168bd1e9cb69","Type":"ContainerStarted","Data":"4ed1a72b3ee34da732d63602757119f575aa82fecda625ae2b5d83475221ead8"} Jul 17 21:04:05.933448 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:05.933404 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mch2x" podStartSLOduration=4.9408731790000004 podStartE2EDuration="23.933390201s" totalImagesPullingTime="18.992517022s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:03:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:05.933325876 +0000 UTC m=+24.733125208" watchObservedRunningTime="2026-07-17 21:04:05.933390201 +0000 UTC m=+24.733189529" Jul 17 21:04:06.923251 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:06.923210 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" event={"ID":"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40","Type":"ContainerStarted","Data":"94acc45dfc79d687abfbe3583533248a647f281ffdc75379899787d0f150962f"} Jul 17 21:04:06.925644 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:06.925613 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ql86b" event={"ID":"9a7adde6-ae57-40b7-aab8-2554e384766d","Type":"ContainerStarted","Data":"8dd236fe3fe99614ddacf2be64558dd8aac5f07edb6b4ea1e647347f7b78d100"} Jul 17 21:04:06.945922 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:06.945868 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ql86b" podStartSLOduration=8.68467541 podStartE2EDuration="25.945855178s" totalImagesPullingTime="17.261179768s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:03:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:06.944821753 +0000 UTC m=+25.744621081" watchObservedRunningTime="2026-07-17 21:04:06.945855178 +0000 UTC m=+25.745654504" Jul 17 21:04:07.386058 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:07.386020 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vjspr" Jul 17 21:04:07.386545 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:07.386524 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vjspr" Jul 17 21:04:07.730998 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:07.730917 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mn75" Jul 17 21:04:07.731164 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:07.730927 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6klsf" Jul 17 21:04:07.731164 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:07.731052 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvjx6" Jul 17 21:04:07.731164 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:07.731051 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mn75" podUID="a700256e-b4d4-4dde-ae89-4b322addf3ad" Jul 17 21:04:07.731296 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:07.731195 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6klsf" podUID="ff4b059f-6fba-47d3-b03e-e977255d54d3" Jul 17 21:04:07.731296 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:07.731253 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvjx6" podUID="e1e535a8-ccc1-499b-9e30-70e8bd966ea1" Jul 17 21:04:09.457487 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:09.457308 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vjspr" Jul 17 21:04:09.458268 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:09.457563 2568 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 17 21:04:09.458268 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:09.458055 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vjspr" Jul 17 21:04:09.730174 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:09.730089 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mn75" Jul 17 21:04:09.730174 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:09.730106 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6klsf" Jul 17 21:04:09.730356 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:09.730216 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mn75" podUID="a700256e-b4d4-4dde-ae89-4b322addf3ad" Jul 17 21:04:09.730356 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:09.730274 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6klsf" podUID="ff4b059f-6fba-47d3-b03e-e977255d54d3" Jul 17 21:04:09.730356 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:09.730314 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvjx6" Jul 17 21:04:09.730469 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:09.730377 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvjx6" podUID="e1e535a8-ccc1-499b-9e30-70e8bd966ea1" Jul 17 21:04:09.940532 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:09.940498 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" event={"ID":"cdee1a8e-323d-4e8c-8336-d5e0fe3dae40","Type":"ContainerStarted","Data":"01c710471ab8a5ffe6a81d43a5461c86e045039e7164c7227b471b0d77bbdd37"} Jul 17 21:04:09.978504 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:09.978458 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" podStartSLOduration=8.938001312 podStartE2EDuration="27.978444811s" totalImagesPullingTime="19.040443499s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:03:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:09.977977416 +0000 UTC m=+28.777776748" watchObservedRunningTime="2026-07-17 21:04:09.978444811 +0000 UTC m=+28.778244141" Jul 17 21:04:10.944013 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:10.943776 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:04:10.944470 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:10.944106 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:04:10.944470 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:10.944146 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:04:10.962024 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:10.961998 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:04:10.962170 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:10.962124 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:04:11.154183 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:11.154154 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5mn75"] Jul 17 21:04:11.154359 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:11.154278 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mn75" Jul 17 21:04:11.154418 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:11.154366 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mn75" podUID="a700256e-b4d4-4dde-ae89-4b322addf3ad" Jul 17 21:04:11.154864 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:11.154842 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lvjx6"] Jul 17 21:04:11.154957 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:11.154943 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvjx6" Jul 17 21:04:11.155043 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:11.155025 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvjx6" podUID="e1e535a8-ccc1-499b-9e30-70e8bd966ea1" Jul 17 21:04:11.156274 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:11.156239 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6klsf"] Jul 17 21:04:11.156412 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:11.156358 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6klsf" Jul 17 21:04:11.156543 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:11.156453 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6klsf" podUID="ff4b059f-6fba-47d3-b03e-e977255d54d3" Jul 17 21:04:12.730157 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:12.730072 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvjx6" Jul 17 21:04:12.730530 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:12.730181 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mn75" Jul 17 21:04:12.730530 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:12.730289 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mn75" podUID="a700256e-b4d4-4dde-ae89-4b322addf3ad" Jul 17 21:04:12.730530 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:12.730186 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvjx6" podUID="e1e535a8-ccc1-499b-9e30-70e8bd966ea1" Jul 17 21:04:12.730530 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:12.730187 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6klsf" Jul 17 21:04:12.730530 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:12.730380 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6klsf" podUID="ff4b059f-6fba-47d3-b03e-e977255d54d3" Jul 17 21:04:12.949487 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:12.949460 2568 generic.go:356] "Generic (PLEG): container finished" podID="df9f8578-e1aa-405f-8a8a-59f530e12761" containerID="2919e97d892dcf2a152db16fa1f7a3bef7bf7641923f7395e54f23558d8bfc28" exitCode=0 Jul 17 21:04:12.949591 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:12.949538 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-px578" event={"ID":"df9f8578-e1aa-405f-8a8a-59f530e12761","Type":"ContainerDied","Data":"2919e97d892dcf2a152db16fa1f7a3bef7bf7641923f7395e54f23558d8bfc28"} Jul 17 21:04:14.731128 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:14.730892 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6klsf" Jul 17 21:04:14.731495 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:14.730918 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mn75" Jul 17 21:04:14.731495 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:14.731175 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6klsf" podUID="ff4b059f-6fba-47d3-b03e-e977255d54d3" Jul 17 21:04:14.731495 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:14.731224 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mn75" podUID="a700256e-b4d4-4dde-ae89-4b322addf3ad" Jul 17 21:04:14.731495 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:14.730921 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvjx6" Jul 17 21:04:14.731495 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:14.731306 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvjx6" podUID="e1e535a8-ccc1-499b-9e30-70e8bd966ea1" Jul 17 21:04:14.956795 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:14.956759 2568 generic.go:356] "Generic (PLEG): container finished" podID="df9f8578-e1aa-405f-8a8a-59f530e12761" containerID="06b14bc4ab60650b0e9d161f05c60985b5769d4ab3d1ee6b5b53845e27a412c0" exitCode=0 Jul 17 21:04:14.956919 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:14.956801 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-px578" event={"ID":"df9f8578-e1aa-405f-8a8a-59f530e12761","Type":"ContainerDied","Data":"06b14bc4ab60650b0e9d161f05c60985b5769d4ab3d1ee6b5b53845e27a412c0"} Jul 17 21:04:15.751940 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:15.751899 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff4b059f-6fba-47d3-b03e-e977255d54d3-metrics-certs\") pod \"network-metrics-daemon-6klsf\" (UID: \"ff4b059f-6fba-47d3-b03e-e977255d54d3\") " pod="openshift-multus/network-metrics-daemon-6klsf" Jul 17 21:04:15.752348 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:15.751954 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a700256e-b4d4-4dde-ae89-4b322addf3ad-original-pull-secret\") pod \"global-pull-secret-syncer-5mn75\" (UID: \"a700256e-b4d4-4dde-ae89-4b322addf3ad\") " pod="kube-system/global-pull-secret-syncer-5mn75" Jul 17 21:04:15.752348 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:15.751996 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgmmd\" (UniqueName: \"kubernetes.io/projected/e1e535a8-ccc1-499b-9e30-70e8bd966ea1-kube-api-access-kgmmd\") pod \"network-check-target-lvjx6\" (UID: \"e1e535a8-ccc1-499b-9e30-70e8bd966ea1\") " pod="openshift-network-diagnostics/network-check-target-lvjx6" Jul 17 21:04:15.752348 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:15.752043 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 21:04:15.752348 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:15.752108 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff4b059f-6fba-47d3-b03e-e977255d54d3-metrics-certs podName:ff4b059f-6fba-47d3-b03e-e977255d54d3 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:47.752091095 +0000 UTC m=+66.551890405 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff4b059f-6fba-47d3-b03e-e977255d54d3-metrics-certs") pod "network-metrics-daemon-6klsf" (UID: "ff4b059f-6fba-47d3-b03e-e977255d54d3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 21:04:15.752348 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:15.752113 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 21:04:15.752348 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:15.752125 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 21:04:15.752348 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:15.752140 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 21:04:15.752348 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:15.752154 2568 projected.go:196] Error preparing data for projected volume kube-api-access-kgmmd for pod openshift-network-diagnostics/network-check-target-lvjx6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 21:04:15.752348 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:15.752171 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a700256e-b4d4-4dde-ae89-4b322addf3ad-original-pull-secret podName:a700256e-b4d4-4dde-ae89-4b322addf3ad nodeName:}" failed. No retries permitted until 2026-07-17 21:04:47.752154617 +0000 UTC m=+66.551953936 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a700256e-b4d4-4dde-ae89-4b322addf3ad-original-pull-secret") pod "global-pull-secret-syncer-5mn75" (UID: "a700256e-b4d4-4dde-ae89-4b322addf3ad") : object "kube-system"/"original-pull-secret" not registered Jul 17 21:04:15.752348 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:15.752197 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1e535a8-ccc1-499b-9e30-70e8bd966ea1-kube-api-access-kgmmd podName:e1e535a8-ccc1-499b-9e30-70e8bd966ea1 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:47.752184736 +0000 UTC m=+66.551984047 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kgmmd" (UniqueName: "kubernetes.io/projected/e1e535a8-ccc1-499b-9e30-70e8bd966ea1-kube-api-access-kgmmd") pod "network-check-target-lvjx6" (UID: "e1e535a8-ccc1-499b-9e30-70e8bd966ea1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 21:04:16.532794 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.532717 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-37.ec2.internal" event="NodeReady" Jul 17 21:04:16.532958 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.532835 2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 17 21:04:16.593139 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.593106 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-578cf8bcff-26v2c"] Jul 17 21:04:16.606997 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.606974 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" Jul 17 21:04:16.613871 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.613847 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 17 21:04:16.613984 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.613847 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 17 21:04:16.614037 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.614008 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gp6nq\"" Jul 17 21:04:16.614666 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.614648 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 17 21:04:16.620096 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.620074 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-578cf8bcff-26v2c"] Jul 17 21:04:16.629593 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.629573 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 17 21:04:16.631833 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.631815 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tlgcs"] Jul 17 21:04:16.641824 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.641807 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7nb8k"] Jul 17 21:04:16.641954 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.641936 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tlgcs" Jul 17 21:04:16.645241 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.645225 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 17 21:04:16.645334 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.645243 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 17 21:04:16.645500 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.645485 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nzpb7\"" Jul 17 21:04:16.656581 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.656559 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7nb8k" Jul 17 21:04:16.657295 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.657278 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7nb8k"] Jul 17 21:04:16.659535 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.659518 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4hvk8\"" Jul 17 21:04:16.659535 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.659523 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 17 21:04:16.659714 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.659563 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 17 21:04:16.659714 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.659640 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 17 21:04:16.663005 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.662987 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tlgcs"] Jul 17 21:04:16.730838 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.730804 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mn75" Jul 17 21:04:16.731051 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.730871 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6klsf" Jul 17 21:04:16.731051 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.730953 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvjx6" Jul 17 21:04:16.735959 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.735940 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 17 21:04:16.736088 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.735963 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 17 21:04:16.736088 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.736022 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 17 21:04:16.736219 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.736203 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 17 21:04:16.736274 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.736204 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pkggp\"" Jul 17 21:04:16.738167 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.738146 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5j5fp\"" Jul 17 21:04:16.759333 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.759314 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02b0f677-12f3-4a7e-bb15-d10c6257534d-metrics-tls\") pod \"dns-default-tlgcs\" (UID: \"02b0f677-12f3-4a7e-bb15-d10c6257534d\") " pod="openshift-dns/dns-default-tlgcs" Jul 17 21:04:16.759599 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.759347 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7shnz\" (UniqueName: \"kubernetes.io/projected/02b0f677-12f3-4a7e-bb15-d10c6257534d-kube-api-access-7shnz\") pod \"dns-default-tlgcs\" (UID: \"02b0f677-12f3-4a7e-bb15-d10c6257534d\") " pod="openshift-dns/dns-default-tlgcs" Jul 17 21:04:16.759599 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.759366 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/512e4197-ce1e-465a-b519-3eaf1a327192-ca-trust-extracted\") pod \"image-registry-578cf8bcff-26v2c\" (UID: \"512e4197-ce1e-465a-b519-3eaf1a327192\") " pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" Jul 17 21:04:16.759599 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.759415 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/02b0f677-12f3-4a7e-bb15-d10c6257534d-config-volume\") pod \"dns-default-tlgcs\" (UID: \"02b0f677-12f3-4a7e-bb15-d10c6257534d\") " pod="openshift-dns/dns-default-tlgcs" Jul 17 21:04:16.759599 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.759430 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02b0f677-12f3-4a7e-bb15-d10c6257534d-tmp-dir\") pod \"dns-default-tlgcs\" (UID: \"02b0f677-12f3-4a7e-bb15-d10c6257534d\") " pod="openshift-dns/dns-default-tlgcs" Jul 17 21:04:16.759599 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.759445 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/512e4197-ce1e-465a-b519-3eaf1a327192-installation-pull-secrets\") pod \"image-registry-578cf8bcff-26v2c\" (UID: \"512e4197-ce1e-465a-b519-3eaf1a327192\") " pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" Jul 17 21:04:16.759599 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.759466 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx7x2\" (UniqueName: \"kubernetes.io/projected/512e4197-ce1e-465a-b519-3eaf1a327192-kube-api-access-cx7x2\") pod \"image-registry-578cf8bcff-26v2c\" (UID: \"512e4197-ce1e-465a-b519-3eaf1a327192\") " pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" Jul 17 21:04:16.759599 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.759500 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/512e4197-ce1e-465a-b519-3eaf1a327192-image-registry-private-configuration\") pod \"image-registry-578cf8bcff-26v2c\" (UID: \"512e4197-ce1e-465a-b519-3eaf1a327192\") " pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" Jul 17 21:04:16.759599 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.759563 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrj4q\" (UniqueName: \"kubernetes.io/projected/a00219cb-5630-43c0-a6cc-37d9dcd8a73f-kube-api-access-mrj4q\") pod \"ingress-canary-7nb8k\" (UID: \"a00219cb-5630-43c0-a6cc-37d9dcd8a73f\") " pod="openshift-ingress-canary/ingress-canary-7nb8k" Jul 17 21:04:16.759599 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.759577 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/512e4197-ce1e-465a-b519-3eaf1a327192-registry-tls\") pod \"image-registry-578cf8bcff-26v2c\" (UID: \"512e4197-ce1e-465a-b519-3eaf1a327192\") " pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" Jul 17 21:04:16.759599 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.759591 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/512e4197-ce1e-465a-b519-3eaf1a327192-trusted-ca\") pod \"image-registry-578cf8bcff-26v2c\" (UID: \"512e4197-ce1e-465a-b519-3eaf1a327192\") " pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" Jul 17 21:04:16.759919 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.759629 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a00219cb-5630-43c0-a6cc-37d9dcd8a73f-cert\") pod \"ingress-canary-7nb8k\" (UID: \"a00219cb-5630-43c0-a6cc-37d9dcd8a73f\") " pod="openshift-ingress-canary/ingress-canary-7nb8k" Jul 17 21:04:16.759919 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.759649 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/512e4197-ce1e-465a-b519-3eaf1a327192-registry-certificates\") pod \"image-registry-578cf8bcff-26v2c\" (UID: \"512e4197-ce1e-465a-b519-3eaf1a327192\") " pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" Jul 17 21:04:16.759919 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.759699 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/512e4197-ce1e-465a-b519-3eaf1a327192-bound-sa-token\") pod \"image-registry-578cf8bcff-26v2c\" (UID: \"512e4197-ce1e-465a-b519-3eaf1a327192\") " pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" Jul 17 21:04:16.860677 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.860648 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrj4q\" (UniqueName: \"kubernetes.io/projected/a00219cb-5630-43c0-a6cc-37d9dcd8a73f-kube-api-access-mrj4q\") pod \"ingress-canary-7nb8k\" (UID: \"a00219cb-5630-43c0-a6cc-37d9dcd8a73f\") " pod="openshift-ingress-canary/ingress-canary-7nb8k" Jul 17 21:04:16.860677 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.860677 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/512e4197-ce1e-465a-b519-3eaf1a327192-registry-tls\") pod \"image-registry-578cf8bcff-26v2c\" (UID: \"512e4197-ce1e-465a-b519-3eaf1a327192\") " pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" Jul 17 21:04:16.860891 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.860712 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/512e4197-ce1e-465a-b519-3eaf1a327192-trusted-ca\") pod \"image-registry-578cf8bcff-26v2c\" (UID: \"512e4197-ce1e-465a-b519-3eaf1a327192\") " pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" Jul 17 21:04:16.860891 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.860736 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a00219cb-5630-43c0-a6cc-37d9dcd8a73f-cert\") pod \"ingress-canary-7nb8k\" (UID: \"a00219cb-5630-43c0-a6cc-37d9dcd8a73f\") " pod="openshift-ingress-canary/ingress-canary-7nb8k" Jul 17 21:04:16.860891 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.860759 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/512e4197-ce1e-465a-b519-3eaf1a327192-registry-certificates\") pod \"image-registry-578cf8bcff-26v2c\" (UID: \"512e4197-ce1e-465a-b519-3eaf1a327192\") " pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" Jul 17 21:04:16.860891 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.860785 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/512e4197-ce1e-465a-b519-3eaf1a327192-bound-sa-token\") pod \"image-registry-578cf8bcff-26v2c\" (UID: \"512e4197-ce1e-465a-b519-3eaf1a327192\") " pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" Jul 17 21:04:16.860891 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.860810 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02b0f677-12f3-4a7e-bb15-d10c6257534d-metrics-tls\") pod \"dns-default-tlgcs\" (UID: \"02b0f677-12f3-4a7e-bb15-d10c6257534d\") " pod="openshift-dns/dns-default-tlgcs" Jul 17 21:04:16.860891 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:16.860829 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 21:04:16.860891 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:16.860851 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-578cf8bcff-26v2c: secret "image-registry-tls" not found Jul 17 21:04:16.861200 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:16.861008 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 21:04:16.861200 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:16.861080 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/512e4197-ce1e-465a-b519-3eaf1a327192-registry-tls podName:512e4197-ce1e-465a-b519-3eaf1a327192 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:17.361050672 +0000 UTC m=+36.160849979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/512e4197-ce1e-465a-b519-3eaf1a327192-registry-tls") pod "image-registry-578cf8bcff-26v2c" (UID: "512e4197-ce1e-465a-b519-3eaf1a327192") : secret "image-registry-tls" not found Jul 17 21:04:16.861200 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:16.861102 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02b0f677-12f3-4a7e-bb15-d10c6257534d-metrics-tls podName:02b0f677-12f3-4a7e-bb15-d10c6257534d nodeName:}" failed. No retries permitted until 2026-07-17 21:04:17.361091663 +0000 UTC m=+36.160890970 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/02b0f677-12f3-4a7e-bb15-d10c6257534d-metrics-tls") pod "dns-default-tlgcs" (UID: "02b0f677-12f3-4a7e-bb15-d10c6257534d") : secret "dns-default-metrics-tls" not found Jul 17 21:04:16.861200 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.861035 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7shnz\" (UniqueName: \"kubernetes.io/projected/02b0f677-12f3-4a7e-bb15-d10c6257534d-kube-api-access-7shnz\") pod \"dns-default-tlgcs\" (UID: \"02b0f677-12f3-4a7e-bb15-d10c6257534d\") " pod="openshift-dns/dns-default-tlgcs" Jul 17 21:04:16.861200 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.861144 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/512e4197-ce1e-465a-b519-3eaf1a327192-ca-trust-extracted\") pod \"image-registry-578cf8bcff-26v2c\" (UID: \"512e4197-ce1e-465a-b519-3eaf1a327192\") " pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" Jul 17 21:04:16.861200 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.861188 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/02b0f677-12f3-4a7e-bb15-d10c6257534d-config-volume\") pod \"dns-default-tlgcs\" (UID: \"02b0f677-12f3-4a7e-bb15-d10c6257534d\") " pod="openshift-dns/dns-default-tlgcs" Jul 17 21:04:16.861498 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.861212 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02b0f677-12f3-4a7e-bb15-d10c6257534d-tmp-dir\") pod \"dns-default-tlgcs\" (UID: \"02b0f677-12f3-4a7e-bb15-d10c6257534d\") " pod="openshift-dns/dns-default-tlgcs" Jul 17 21:04:16.861551 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.861495 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/512e4197-ce1e-465a-b519-3eaf1a327192-registry-certificates\") pod \"image-registry-578cf8bcff-26v2c\" (UID: \"512e4197-ce1e-465a-b519-3eaf1a327192\") " pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" Jul 17 21:04:16.861551 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.861521 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/512e4197-ce1e-465a-b519-3eaf1a327192-ca-trust-extracted\") pod \"image-registry-578cf8bcff-26v2c\" (UID: \"512e4197-ce1e-465a-b519-3eaf1a327192\") " pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" Jul 17 21:04:16.861657 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.861565 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/512e4197-ce1e-465a-b519-3eaf1a327192-installation-pull-secrets\") pod \"image-registry-578cf8bcff-26v2c\" (UID: \"512e4197-ce1e-465a-b519-3eaf1a327192\") " pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" Jul 17 21:04:16.861657 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.861620 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx7x2\" (UniqueName: \"kubernetes.io/projected/512e4197-ce1e-465a-b519-3eaf1a327192-kube-api-access-cx7x2\") pod \"image-registry-578cf8bcff-26v2c\" (UID: \"512e4197-ce1e-465a-b519-3eaf1a327192\") " pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" Jul 17 21:04:16.861657 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.861621 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02b0f677-12f3-4a7e-bb15-d10c6257534d-tmp-dir\") pod \"dns-default-tlgcs\" (UID: \"02b0f677-12f3-4a7e-bb15-d10c6257534d\") " pod="openshift-dns/dns-default-tlgcs" Jul 17 21:04:16.861836 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.861727 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/512e4197-ce1e-465a-b519-3eaf1a327192-image-registry-private-configuration\") pod \"image-registry-578cf8bcff-26v2c\" (UID: \"512e4197-ce1e-465a-b519-3eaf1a327192\") " pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" Jul 17 21:04:16.861889 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.861849 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/02b0f677-12f3-4a7e-bb15-d10c6257534d-config-volume\") pod \"dns-default-tlgcs\" (UID: \"02b0f677-12f3-4a7e-bb15-d10c6257534d\") " pod="openshift-dns/dns-default-tlgcs" Jul 17 21:04:16.861889 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.861865 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/512e4197-ce1e-465a-b519-3eaf1a327192-trusted-ca\") pod \"image-registry-578cf8bcff-26v2c\" (UID: \"512e4197-ce1e-465a-b519-3eaf1a327192\") " pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" Jul 17 21:04:16.865090 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.865062 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/512e4197-ce1e-465a-b519-3eaf1a327192-installation-pull-secrets\") pod \"image-registry-578cf8bcff-26v2c\" (UID: \"512e4197-ce1e-465a-b519-3eaf1a327192\") " pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" Jul 17 21:04:16.865196 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.865104 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/512e4197-ce1e-465a-b519-3eaf1a327192-image-registry-private-configuration\") pod \"image-registry-578cf8bcff-26v2c\" (UID: \"512e4197-ce1e-465a-b519-3eaf1a327192\") " pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" Jul 17 21:04:16.865196 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.865131 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a00219cb-5630-43c0-a6cc-37d9dcd8a73f-cert\") pod \"ingress-canary-7nb8k\" (UID: \"a00219cb-5630-43c0-a6cc-37d9dcd8a73f\") " pod="openshift-ingress-canary/ingress-canary-7nb8k" Jul 17 21:04:16.871025 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.871002 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrj4q\" (UniqueName: \"kubernetes.io/projected/a00219cb-5630-43c0-a6cc-37d9dcd8a73f-kube-api-access-mrj4q\") pod \"ingress-canary-7nb8k\" (UID: \"a00219cb-5630-43c0-a6cc-37d9dcd8a73f\") " pod="openshift-ingress-canary/ingress-canary-7nb8k" Jul 17 21:04:16.871276 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.871253 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7shnz\" (UniqueName: \"kubernetes.io/projected/02b0f677-12f3-4a7e-bb15-d10c6257534d-kube-api-access-7shnz\") pod \"dns-default-tlgcs\" (UID: \"02b0f677-12f3-4a7e-bb15-d10c6257534d\") " pod="openshift-dns/dns-default-tlgcs" Jul 17 21:04:16.876349 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.876328 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx7x2\" (UniqueName: \"kubernetes.io/projected/512e4197-ce1e-465a-b519-3eaf1a327192-kube-api-access-cx7x2\") pod \"image-registry-578cf8bcff-26v2c\" (UID: \"512e4197-ce1e-465a-b519-3eaf1a327192\") " pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" Jul 17 21:04:16.876504 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.876486 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/512e4197-ce1e-465a-b519-3eaf1a327192-bound-sa-token\") pod \"image-registry-578cf8bcff-26v2c\" (UID: \"512e4197-ce1e-465a-b519-3eaf1a327192\") " pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" Jul 17 21:04:16.962826 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.962792 2568 generic.go:356] "Generic (PLEG): container finished" podID="df9f8578-e1aa-405f-8a8a-59f530e12761" containerID="98d96e705e0b0919bfc13ac34a59552871791e5bb16a4441b004191f5e1acfbc" exitCode=0 Jul 17 21:04:16.962962 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.962852 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-px578" event={"ID":"df9f8578-e1aa-405f-8a8a-59f530e12761","Type":"ContainerDied","Data":"98d96e705e0b0919bfc13ac34a59552871791e5bb16a4441b004191f5e1acfbc"} Jul 17 21:04:16.969253 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:16.969235 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7nb8k" Jul 17 21:04:17.173821 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:17.173758 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7nb8k"] Jul 17 21:04:17.177590 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:04:17.177559 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda00219cb_5630_43c0_a6cc_37d9dcd8a73f.slice/crio-89d7c510080a4e44e2bec50ecc9b4bd825b46f81fed57b52f9db09129371ea12 WatchSource:0}: Error finding container 89d7c510080a4e44e2bec50ecc9b4bd825b46f81fed57b52f9db09129371ea12: Status 404 returned error can't find the container with id 89d7c510080a4e44e2bec50ecc9b4bd825b46f81fed57b52f9db09129371ea12 Jul 17 21:04:17.364642 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:17.364611 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02b0f677-12f3-4a7e-bb15-d10c6257534d-metrics-tls\") pod \"dns-default-tlgcs\" (UID: \"02b0f677-12f3-4a7e-bb15-d10c6257534d\") " pod="openshift-dns/dns-default-tlgcs" Jul 17 21:04:17.364798 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:17.364718 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/512e4197-ce1e-465a-b519-3eaf1a327192-registry-tls\") pod \"image-registry-578cf8bcff-26v2c\" (UID: \"512e4197-ce1e-465a-b519-3eaf1a327192\") " pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" Jul 17 21:04:17.364798 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:17.364785 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 21:04:17.364907 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:17.364839 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 21:04:17.364907 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:17.364848 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02b0f677-12f3-4a7e-bb15-d10c6257534d-metrics-tls podName:02b0f677-12f3-4a7e-bb15-d10c6257534d nodeName:}" failed. No retries permitted until 2026-07-17 21:04:18.364831045 +0000 UTC m=+37.164630353 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/02b0f677-12f3-4a7e-bb15-d10c6257534d-metrics-tls") pod "dns-default-tlgcs" (UID: "02b0f677-12f3-4a7e-bb15-d10c6257534d") : secret "dns-default-metrics-tls" not found Jul 17 21:04:17.364907 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:17.364854 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-578cf8bcff-26v2c: secret "image-registry-tls" not found Jul 17 21:04:17.364907 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:17.364903 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/512e4197-ce1e-465a-b519-3eaf1a327192-registry-tls podName:512e4197-ce1e-465a-b519-3eaf1a327192 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:18.364888468 +0000 UTC m=+37.164687790 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/512e4197-ce1e-465a-b519-3eaf1a327192-registry-tls") pod "image-registry-578cf8bcff-26v2c" (UID: "512e4197-ce1e-465a-b519-3eaf1a327192") : secret "image-registry-tls" not found Jul 17 21:04:17.967231 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:17.967036 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7nb8k" event={"ID":"a00219cb-5630-43c0-a6cc-37d9dcd8a73f","Type":"ContainerStarted","Data":"89d7c510080a4e44e2bec50ecc9b4bd825b46f81fed57b52f9db09129371ea12"} Jul 17 21:04:18.374268 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:18.374222 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02b0f677-12f3-4a7e-bb15-d10c6257534d-metrics-tls\") pod \"dns-default-tlgcs\" (UID: \"02b0f677-12f3-4a7e-bb15-d10c6257534d\") " pod="openshift-dns/dns-default-tlgcs" Jul 17 21:04:18.374458 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:18.374327 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/512e4197-ce1e-465a-b519-3eaf1a327192-registry-tls\") pod \"image-registry-578cf8bcff-26v2c\" (UID: \"512e4197-ce1e-465a-b519-3eaf1a327192\") " pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" Jul 17 21:04:18.374458 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:18.374396 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 21:04:18.374458 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:18.374452 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 21:04:18.374619 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:18.374466 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-578cf8bcff-26v2c: secret "image-registry-tls" not found Jul 17 21:04:18.374619 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:18.374476 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02b0f677-12f3-4a7e-bb15-d10c6257534d-metrics-tls podName:02b0f677-12f3-4a7e-bb15-d10c6257534d nodeName:}" failed. No retries permitted until 2026-07-17 21:04:20.374454193 +0000 UTC m=+39.174253515 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/02b0f677-12f3-4a7e-bb15-d10c6257534d-metrics-tls") pod "dns-default-tlgcs" (UID: "02b0f677-12f3-4a7e-bb15-d10c6257534d") : secret "dns-default-metrics-tls" not found Jul 17 21:04:18.374619 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:18.374515 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/512e4197-ce1e-465a-b519-3eaf1a327192-registry-tls podName:512e4197-ce1e-465a-b519-3eaf1a327192 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:20.374500114 +0000 UTC m=+39.174299424 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/512e4197-ce1e-465a-b519-3eaf1a327192-registry-tls") pod "image-registry-578cf8bcff-26v2c" (UID: "512e4197-ce1e-465a-b519-3eaf1a327192") : secret "image-registry-tls" not found Jul 17 21:04:20.390483 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:20.390423 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/512e4197-ce1e-465a-b519-3eaf1a327192-registry-tls\") pod \"image-registry-578cf8bcff-26v2c\" (UID: \"512e4197-ce1e-465a-b519-3eaf1a327192\") " pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" Jul 17 21:04:20.391015 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:20.390522 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02b0f677-12f3-4a7e-bb15-d10c6257534d-metrics-tls\") pod \"dns-default-tlgcs\" (UID: \"02b0f677-12f3-4a7e-bb15-d10c6257534d\") " pod="openshift-dns/dns-default-tlgcs" Jul 17 21:04:20.391015 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:20.390716 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 21:04:20.391015 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:20.390777 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02b0f677-12f3-4a7e-bb15-d10c6257534d-metrics-tls podName:02b0f677-12f3-4a7e-bb15-d10c6257534d nodeName:}" failed. No retries permitted until 2026-07-17 21:04:24.390758662 +0000 UTC m=+43.190557973 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/02b0f677-12f3-4a7e-bb15-d10c6257534d-metrics-tls") pod "dns-default-tlgcs" (UID: "02b0f677-12f3-4a7e-bb15-d10c6257534d") : secret "dns-default-metrics-tls" not found Jul 17 21:04:20.391015 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:20.390844 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 21:04:20.391015 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:20.390854 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-578cf8bcff-26v2c: secret "image-registry-tls" not found Jul 17 21:04:20.391015 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:20.390885 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/512e4197-ce1e-465a-b519-3eaf1a327192-registry-tls podName:512e4197-ce1e-465a-b519-3eaf1a327192 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:24.390875555 +0000 UTC m=+43.190674875 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/512e4197-ce1e-465a-b519-3eaf1a327192-registry-tls") pod "image-registry-578cf8bcff-26v2c" (UID: "512e4197-ce1e-465a-b519-3eaf1a327192") : secret "image-registry-tls" not found Jul 17 21:04:20.976141 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:20.976111 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7nb8k" event={"ID":"a00219cb-5630-43c0-a6cc-37d9dcd8a73f","Type":"ContainerStarted","Data":"9c0de53cd4ffe7c8f612da4d26c317989fd96215aeae7fc3996687f9413c4c64"} Jul 17 21:04:21.011175 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:21.011125 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7nb8k" podStartSLOduration=2.035973444 podStartE2EDuration="5.011110832s" totalImagesPullingTime="2.975137388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:04:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:21.010321055 +0000 UTC m=+39.810120401" watchObservedRunningTime="2026-07-17 21:04:21.011110832 +0000 UTC m=+39.810910161" Jul 17 21:04:23.985591 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:23.985563 2568 generic.go:356] "Generic (PLEG): container finished" podID="df9f8578-e1aa-405f-8a8a-59f530e12761" containerID="0b01b74f162c48020f10ab97419193dfe2f6245382d2aa169b8af9e329e03a8d" exitCode=0 Jul 17 21:04:23.985917 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:23.985603 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-px578" event={"ID":"df9f8578-e1aa-405f-8a8a-59f530e12761","Type":"ContainerDied","Data":"0b01b74f162c48020f10ab97419193dfe2f6245382d2aa169b8af9e329e03a8d"} Jul 17 21:04:24.423904 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:24.423859 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/512e4197-ce1e-465a-b519-3eaf1a327192-registry-tls\") pod \"image-registry-578cf8bcff-26v2c\" (UID: \"512e4197-ce1e-465a-b519-3eaf1a327192\") " pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" Jul 17 21:04:24.424108 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:24.424018 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02b0f677-12f3-4a7e-bb15-d10c6257534d-metrics-tls\") pod \"dns-default-tlgcs\" (UID: \"02b0f677-12f3-4a7e-bb15-d10c6257534d\") " pod="openshift-dns/dns-default-tlgcs" Jul 17 21:04:24.424108 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:24.424031 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 21:04:24.424108 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:24.424057 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-578cf8bcff-26v2c: secret "image-registry-tls" not found Jul 17 21:04:24.424108 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:24.424106 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 21:04:24.424320 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:24.424130 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/512e4197-ce1e-465a-b519-3eaf1a327192-registry-tls podName:512e4197-ce1e-465a-b519-3eaf1a327192 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:32.424108079 +0000 UTC m=+51.223907387 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/512e4197-ce1e-465a-b519-3eaf1a327192-registry-tls") pod "image-registry-578cf8bcff-26v2c" (UID: "512e4197-ce1e-465a-b519-3eaf1a327192") : secret "image-registry-tls" not found Jul 17 21:04:24.424320 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:24.424156 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02b0f677-12f3-4a7e-bb15-d10c6257534d-metrics-tls podName:02b0f677-12f3-4a7e-bb15-d10c6257534d nodeName:}" failed. No retries permitted until 2026-07-17 21:04:32.424144227 +0000 UTC m=+51.223943535 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/02b0f677-12f3-4a7e-bb15-d10c6257534d-metrics-tls") pod "dns-default-tlgcs" (UID: "02b0f677-12f3-4a7e-bb15-d10c6257534d") : secret "dns-default-metrics-tls" not found Jul 17 21:04:24.990898 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:24.990867 2568 generic.go:356] "Generic (PLEG): container finished" podID="df9f8578-e1aa-405f-8a8a-59f530e12761" containerID="406cfd50e7305ecd4b0a4d48c0a62680901d3756cf077fd71d35bb9dabbdb546" exitCode=0 Jul 17 21:04:24.991355 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:24.990941 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-px578" event={"ID":"df9f8578-e1aa-405f-8a8a-59f530e12761","Type":"ContainerDied","Data":"406cfd50e7305ecd4b0a4d48c0a62680901d3756cf077fd71d35bb9dabbdb546"} Jul 17 21:04:25.996834 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:25.996796 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-px578" event={"ID":"df9f8578-e1aa-405f-8a8a-59f530e12761","Type":"ContainerStarted","Data":"756d4e1062dc59c68b006d270064aff3b0f79e55fff4ff69b64298dae254241f"} Jul 17 21:04:26.023887 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:26.023838 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-px578" podStartSLOduration=9.108488499 podStartE2EDuration="45.023817315s" totalImagesPullingTime="35.915328816s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:03:41 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:26.022649634 +0000 UTC m=+44.822448963" watchObservedRunningTime="2026-07-17 21:04:26.023817315 +0000 UTC m=+44.823616643" Jul 17 21:04:32.324010 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:32.323975 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-b2vzg"] Jul 17 21:04:32.333964 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:32.333941 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-b2vzg" Jul 17 21:04:32.336884 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:32.336861 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5qfmp\"" Jul 17 21:04:32.337034 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:32.337013 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 17 21:04:32.337838 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:32.337815 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 17 21:04:32.337938 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:32.337815 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 17 21:04:32.340858 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:32.340584 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-b2vzg"] Jul 17 21:04:32.477801 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:32.477761 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02b0f677-12f3-4a7e-bb15-d10c6257534d-metrics-tls\") pod \"dns-default-tlgcs\" (UID: \"02b0f677-12f3-4a7e-bb15-d10c6257534d\") " pod="openshift-dns/dns-default-tlgcs" Jul 17 21:04:32.478015 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:32.477814 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8fcdc69f-e417-4945-a31e-c34472a2039e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-b2vzg\" (UID: \"8fcdc69f-e417-4945-a31e-c34472a2039e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-b2vzg" Jul 17 21:04:32.478015 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:32.477865 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znd5z\" (UniqueName: \"kubernetes.io/projected/8fcdc69f-e417-4945-a31e-c34472a2039e-kube-api-access-znd5z\") pod \"cluster-samples-operator-79b7c55f87-b2vzg\" (UID: \"8fcdc69f-e417-4945-a31e-c34472a2039e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-b2vzg" Jul 17 21:04:32.478015 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:32.477868 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 21:04:32.478015 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:32.477931 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02b0f677-12f3-4a7e-bb15-d10c6257534d-metrics-tls podName:02b0f677-12f3-4a7e-bb15-d10c6257534d nodeName:}" failed. No retries permitted until 2026-07-17 21:04:48.477916072 +0000 UTC m=+67.277715380 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/02b0f677-12f3-4a7e-bb15-d10c6257534d-metrics-tls") pod "dns-default-tlgcs" (UID: "02b0f677-12f3-4a7e-bb15-d10c6257534d") : secret "dns-default-metrics-tls" not found Jul 17 21:04:32.478015 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:32.477997 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/512e4197-ce1e-465a-b519-3eaf1a327192-registry-tls\") pod \"image-registry-578cf8bcff-26v2c\" (UID: \"512e4197-ce1e-465a-b519-3eaf1a327192\") " pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" Jul 17 21:04:32.478295 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:32.478110 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 21:04:32.478295 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:32.478122 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-578cf8bcff-26v2c: secret "image-registry-tls" not found Jul 17 21:04:32.478295 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:32.478156 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/512e4197-ce1e-465a-b519-3eaf1a327192-registry-tls podName:512e4197-ce1e-465a-b519-3eaf1a327192 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:48.478145514 +0000 UTC m=+67.277944821 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/512e4197-ce1e-465a-b519-3eaf1a327192-registry-tls") pod "image-registry-578cf8bcff-26v2c" (UID: "512e4197-ce1e-465a-b519-3eaf1a327192") : secret "image-registry-tls" not found Jul 17 21:04:32.578881 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:32.578805 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8fcdc69f-e417-4945-a31e-c34472a2039e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-b2vzg\" (UID: \"8fcdc69f-e417-4945-a31e-c34472a2039e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-b2vzg" Jul 17 21:04:32.578881 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:32.578860 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znd5z\" (UniqueName: \"kubernetes.io/projected/8fcdc69f-e417-4945-a31e-c34472a2039e-kube-api-access-znd5z\") pod \"cluster-samples-operator-79b7c55f87-b2vzg\" (UID: \"8fcdc69f-e417-4945-a31e-c34472a2039e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-b2vzg" Jul 17 21:04:32.579099 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:32.578971 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 21:04:32.579099 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:32.579041 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fcdc69f-e417-4945-a31e-c34472a2039e-samples-operator-tls podName:8fcdc69f-e417-4945-a31e-c34472a2039e nodeName:}" failed. No retries permitted until 2026-07-17 21:04:33.079021327 +0000 UTC m=+51.878820634 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8fcdc69f-e417-4945-a31e-c34472a2039e-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-b2vzg" (UID: "8fcdc69f-e417-4945-a31e-c34472a2039e") : secret "samples-operator-tls" not found Jul 17 21:04:32.592096 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:32.592062 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znd5z\" (UniqueName: \"kubernetes.io/projected/8fcdc69f-e417-4945-a31e-c34472a2039e-kube-api-access-znd5z\") pod \"cluster-samples-operator-79b7c55f87-b2vzg\" (UID: \"8fcdc69f-e417-4945-a31e-c34472a2039e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-b2vzg" Jul 17 21:04:33.084074 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:33.084023 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8fcdc69f-e417-4945-a31e-c34472a2039e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-b2vzg\" (UID: \"8fcdc69f-e417-4945-a31e-c34472a2039e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-b2vzg" Jul 17 21:04:33.084255 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:33.084178 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 21:04:33.084255 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:33.084246 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fcdc69f-e417-4945-a31e-c34472a2039e-samples-operator-tls podName:8fcdc69f-e417-4945-a31e-c34472a2039e nodeName:}" failed. No retries permitted until 2026-07-17 21:04:34.084231088 +0000 UTC m=+52.884030398 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8fcdc69f-e417-4945-a31e-c34472a2039e-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-b2vzg" (UID: "8fcdc69f-e417-4945-a31e-c34472a2039e") : secret "samples-operator-tls" not found Jul 17 21:04:34.090365 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:34.090313 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8fcdc69f-e417-4945-a31e-c34472a2039e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-b2vzg\" (UID: \"8fcdc69f-e417-4945-a31e-c34472a2039e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-b2vzg" Jul 17 21:04:34.090773 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:34.090463 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 21:04:34.090773 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:34.090529 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fcdc69f-e417-4945-a31e-c34472a2039e-samples-operator-tls podName:8fcdc69f-e417-4945-a31e-c34472a2039e nodeName:}" failed. No retries permitted until 2026-07-17 21:04:36.090510926 +0000 UTC m=+54.890310233 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8fcdc69f-e417-4945-a31e-c34472a2039e-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-b2vzg" (UID: "8fcdc69f-e417-4945-a31e-c34472a2039e") : secret "samples-operator-tls" not found Jul 17 21:04:36.107991 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:36.107963 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8fcdc69f-e417-4945-a31e-c34472a2039e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-b2vzg\" (UID: \"8fcdc69f-e417-4945-a31e-c34472a2039e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-b2vzg" Jul 17 21:04:36.108314 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:36.108119 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 21:04:36.108314 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:36.108188 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fcdc69f-e417-4945-a31e-c34472a2039e-samples-operator-tls podName:8fcdc69f-e417-4945-a31e-c34472a2039e nodeName:}" failed. No retries permitted until 2026-07-17 21:04:40.108173463 +0000 UTC m=+58.907972776 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8fcdc69f-e417-4945-a31e-c34472a2039e-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-b2vzg" (UID: "8fcdc69f-e417-4945-a31e-c34472a2039e") : secret "samples-operator-tls" not found Jul 17 21:04:38.624412 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:38.624373 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qs9sk"] Jul 17 21:04:38.626609 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:38.626592 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qs9sk" Jul 17 21:04:38.639491 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:38.639467 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 17 21:04:38.651289 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:38.651268 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 17 21:04:38.702548 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:38.702514 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 17 21:04:38.702851 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:38.702832 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 17 21:04:38.715616 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:38.715592 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8lg9w\"" Jul 17 21:04:38.716721 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:38.716702 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qs9sk"] Jul 17 21:04:38.725459 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:38.725437 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2d3c44a-60a5-4624-a39f-d73ff62fda74-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qs9sk\" (UID: \"e2d3c44a-60a5-4624-a39f-d73ff62fda74\") " pod="openshift-insights/insights-runtime-extractor-qs9sk" Jul 17 21:04:38.725536 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:38.725479 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e2d3c44a-60a5-4624-a39f-d73ff62fda74-crio-socket\") pod \"insights-runtime-extractor-qs9sk\" (UID: \"e2d3c44a-60a5-4624-a39f-d73ff62fda74\") " pod="openshift-insights/insights-runtime-extractor-qs9sk" Jul 17 21:04:38.725536 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:38.725499 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcmnl\" (UniqueName: \"kubernetes.io/projected/e2d3c44a-60a5-4624-a39f-d73ff62fda74-kube-api-access-kcmnl\") pod \"insights-runtime-extractor-qs9sk\" (UID: \"e2d3c44a-60a5-4624-a39f-d73ff62fda74\") " pod="openshift-insights/insights-runtime-extractor-qs9sk" Jul 17 21:04:38.725603 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:38.725557 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2d3c44a-60a5-4624-a39f-d73ff62fda74-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qs9sk\" (UID: \"e2d3c44a-60a5-4624-a39f-d73ff62fda74\") " pod="openshift-insights/insights-runtime-extractor-qs9sk" Jul 17 21:04:38.725636 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:38.725608 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2d3c44a-60a5-4624-a39f-d73ff62fda74-data-volume\") pod \"insights-runtime-extractor-qs9sk\" (UID: \"e2d3c44a-60a5-4624-a39f-d73ff62fda74\") " pod="openshift-insights/insights-runtime-extractor-qs9sk" Jul 17 21:04:38.826645 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:38.826607 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e2d3c44a-60a5-4624-a39f-d73ff62fda74-crio-socket\") pod \"insights-runtime-extractor-qs9sk\" (UID: \"e2d3c44a-60a5-4624-a39f-d73ff62fda74\") " pod="openshift-insights/insights-runtime-extractor-qs9sk" Jul 17 21:04:38.826645 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:38.826645 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcmnl\" (UniqueName: \"kubernetes.io/projected/e2d3c44a-60a5-4624-a39f-d73ff62fda74-kube-api-access-kcmnl\") pod \"insights-runtime-extractor-qs9sk\" (UID: \"e2d3c44a-60a5-4624-a39f-d73ff62fda74\") " pod="openshift-insights/insights-runtime-extractor-qs9sk" Jul 17 21:04:38.826860 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:38.826732 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2d3c44a-60a5-4624-a39f-d73ff62fda74-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qs9sk\" (UID: \"e2d3c44a-60a5-4624-a39f-d73ff62fda74\") " pod="openshift-insights/insights-runtime-extractor-qs9sk" Jul 17 21:04:38.826860 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:38.826835 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 21:04:38.826860 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:38.826753 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e2d3c44a-60a5-4624-a39f-d73ff62fda74-crio-socket\") pod \"insights-runtime-extractor-qs9sk\" (UID: \"e2d3c44a-60a5-4624-a39f-d73ff62fda74\") " pod="openshift-insights/insights-runtime-extractor-qs9sk" Jul 17 21:04:38.826860 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:38.826847 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2d3c44a-60a5-4624-a39f-d73ff62fda74-data-volume\") pod \"insights-runtime-extractor-qs9sk\" (UID: \"e2d3c44a-60a5-4624-a39f-d73ff62fda74\") " pod="openshift-insights/insights-runtime-extractor-qs9sk" Jul 17 21:04:38.826998 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:38.826900 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2d3c44a-60a5-4624-a39f-d73ff62fda74-insights-runtime-extractor-tls podName:e2d3c44a-60a5-4624-a39f-d73ff62fda74 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:39.326881372 +0000 UTC m=+58.126680698 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e2d3c44a-60a5-4624-a39f-d73ff62fda74-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qs9sk" (UID: "e2d3c44a-60a5-4624-a39f-d73ff62fda74") : secret "insights-runtime-extractor-tls" not found Jul 17 21:04:38.826998 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:38.826953 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2d3c44a-60a5-4624-a39f-d73ff62fda74-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qs9sk\" (UID: \"e2d3c44a-60a5-4624-a39f-d73ff62fda74\") " pod="openshift-insights/insights-runtime-extractor-qs9sk" Jul 17 21:04:38.827076 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:38.827025 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 21:04:38.827109 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:38.827077 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e2d3c44a-60a5-4624-a39f-d73ff62fda74-kube-rbac-proxy-cm podName:e2d3c44a-60a5-4624-a39f-d73ff62fda74 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:39.327063774 +0000 UTC m=+58.126863095 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e2d3c44a-60a5-4624-a39f-d73ff62fda74-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qs9sk" (UID: "e2d3c44a-60a5-4624-a39f-d73ff62fda74") : configmap "kube-rbac-proxy" not found Jul 17 21:04:38.827191 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:38.827176 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2d3c44a-60a5-4624-a39f-d73ff62fda74-data-volume\") pod \"insights-runtime-extractor-qs9sk\" (UID: \"e2d3c44a-60a5-4624-a39f-d73ff62fda74\") " pod="openshift-insights/insights-runtime-extractor-qs9sk" Jul 17 21:04:38.836164 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:38.836132 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcmnl\" (UniqueName: \"kubernetes.io/projected/e2d3c44a-60a5-4624-a39f-d73ff62fda74-kube-api-access-kcmnl\") pod \"insights-runtime-extractor-qs9sk\" (UID: \"e2d3c44a-60a5-4624-a39f-d73ff62fda74\") " pod="openshift-insights/insights-runtime-extractor-qs9sk" Jul 17 21:04:39.329639 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:39.329594 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2d3c44a-60a5-4624-a39f-d73ff62fda74-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qs9sk\" (UID: \"e2d3c44a-60a5-4624-a39f-d73ff62fda74\") " pod="openshift-insights/insights-runtime-extractor-qs9sk" Jul 17 21:04:39.329863 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:39.329737 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2d3c44a-60a5-4624-a39f-d73ff62fda74-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qs9sk\" (UID: \"e2d3c44a-60a5-4624-a39f-d73ff62fda74\") " pod="openshift-insights/insights-runtime-extractor-qs9sk" Jul 17 21:04:39.329863 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:39.329752 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 21:04:39.329863 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:39.329811 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2d3c44a-60a5-4624-a39f-d73ff62fda74-insights-runtime-extractor-tls podName:e2d3c44a-60a5-4624-a39f-d73ff62fda74 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:40.329798229 +0000 UTC m=+59.129597536 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e2d3c44a-60a5-4624-a39f-d73ff62fda74-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qs9sk" (UID: "e2d3c44a-60a5-4624-a39f-d73ff62fda74") : secret "insights-runtime-extractor-tls" not found Jul 17 21:04:39.329863 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:39.329827 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 21:04:39.330037 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:39.329894 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e2d3c44a-60a5-4624-a39f-d73ff62fda74-kube-rbac-proxy-cm podName:e2d3c44a-60a5-4624-a39f-d73ff62fda74 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:40.329878735 +0000 UTC m=+59.129678062 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e2d3c44a-60a5-4624-a39f-d73ff62fda74-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qs9sk" (UID: "e2d3c44a-60a5-4624-a39f-d73ff62fda74") : configmap "kube-rbac-proxy" not found Jul 17 21:04:40.135763 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:40.135725 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8fcdc69f-e417-4945-a31e-c34472a2039e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-b2vzg\" (UID: \"8fcdc69f-e417-4945-a31e-c34472a2039e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-b2vzg" Jul 17 21:04:40.136132 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:40.135865 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 21:04:40.136132 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:40.135929 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fcdc69f-e417-4945-a31e-c34472a2039e-samples-operator-tls podName:8fcdc69f-e417-4945-a31e-c34472a2039e nodeName:}" failed. No retries permitted until 2026-07-17 21:04:48.13591313 +0000 UTC m=+66.935712437 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8fcdc69f-e417-4945-a31e-c34472a2039e-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-b2vzg" (UID: "8fcdc69f-e417-4945-a31e-c34472a2039e") : secret "samples-operator-tls" not found Jul 17 21:04:40.337371 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:40.337319 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2d3c44a-60a5-4624-a39f-d73ff62fda74-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qs9sk\" (UID: \"e2d3c44a-60a5-4624-a39f-d73ff62fda74\") " pod="openshift-insights/insights-runtime-extractor-qs9sk" Jul 17 21:04:40.337550 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:40.337417 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2d3c44a-60a5-4624-a39f-d73ff62fda74-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qs9sk\" (UID: \"e2d3c44a-60a5-4624-a39f-d73ff62fda74\") " pod="openshift-insights/insights-runtime-extractor-qs9sk" Jul 17 21:04:40.337550 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:40.337445 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 21:04:40.337550 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:40.337512 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e2d3c44a-60a5-4624-a39f-d73ff62fda74-kube-rbac-proxy-cm podName:e2d3c44a-60a5-4624-a39f-d73ff62fda74 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:42.337495835 +0000 UTC m=+61.137295165 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e2d3c44a-60a5-4624-a39f-d73ff62fda74-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qs9sk" (UID: "e2d3c44a-60a5-4624-a39f-d73ff62fda74") : configmap "kube-rbac-proxy" not found Jul 17 21:04:40.337653 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:40.337559 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 21:04:40.337653 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:40.337615 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2d3c44a-60a5-4624-a39f-d73ff62fda74-insights-runtime-extractor-tls podName:e2d3c44a-60a5-4624-a39f-d73ff62fda74 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:42.337599263 +0000 UTC m=+61.137398571 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e2d3c44a-60a5-4624-a39f-d73ff62fda74-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qs9sk" (UID: "e2d3c44a-60a5-4624-a39f-d73ff62fda74") : secret "insights-runtime-extractor-tls" not found Jul 17 21:04:40.826392 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:40.826364 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q6fjb_c272898b-56ad-4f67-96bb-1fda34e475f1/dns-node-resolver/0.log" Jul 17 21:04:41.436791 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:41.436761 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c5f67_1bc30f77-9ff9-477d-9a8d-72ae85c5d399/node-ca/0.log" Jul 17 21:04:41.537000 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:41.536968 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-tvn5g"] Jul 17 21:04:41.538941 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:41.538926 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-tvn5g" Jul 17 21:04:41.541455 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:41.541432 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-5b7wc\"" Jul 17 21:04:41.541666 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:41.541652 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 17 21:04:41.542291 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:41.542278 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 17 21:04:41.547852 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:41.547832 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5dj7\" (UniqueName: \"kubernetes.io/projected/7550fa51-e259-4b3d-915a-17296892410b-kube-api-access-n5dj7\") pod \"migrator-7cc9c7ffd7-tvn5g\" (UID: \"7550fa51-e259-4b3d-915a-17296892410b\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-tvn5g" Jul 17 21:04:41.551090 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:41.551066 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-tvn5g"] Jul 17 21:04:41.648307 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:41.648272 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5dj7\" (UniqueName: \"kubernetes.io/projected/7550fa51-e259-4b3d-915a-17296892410b-kube-api-access-n5dj7\") pod \"migrator-7cc9c7ffd7-tvn5g\" (UID: \"7550fa51-e259-4b3d-915a-17296892410b\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-tvn5g" Jul 17 21:04:41.657156 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:41.657136 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 17 21:04:41.667691 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:41.667664 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 17 21:04:41.677981 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:41.677954 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5dj7\" (UniqueName: \"kubernetes.io/projected/7550fa51-e259-4b3d-915a-17296892410b-kube-api-access-n5dj7\") pod \"migrator-7cc9c7ffd7-tvn5g\" (UID: \"7550fa51-e259-4b3d-915a-17296892410b\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-tvn5g" Jul 17 21:04:41.850294 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:41.850269 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-5b7wc\"" Jul 17 21:04:41.858092 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:41.858074 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-tvn5g" Jul 17 21:04:41.975243 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:41.975213 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-tvn5g"] Jul 17 21:04:41.977973 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:04:41.977949 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7550fa51_e259_4b3d_915a_17296892410b.slice/crio-446229d3efd0c1adc8fdbba9ae68b58ed3bbb862d2c63c6d0ccc98c3c9e7f0c4 WatchSource:0}: Error finding container 446229d3efd0c1adc8fdbba9ae68b58ed3bbb862d2c63c6d0ccc98c3c9e7f0c4: Status 404 returned error can't find the container with id 446229d3efd0c1adc8fdbba9ae68b58ed3bbb862d2c63c6d0ccc98c3c9e7f0c4 Jul 17 21:04:42.036997 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:42.036964 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-tvn5g" event={"ID":"7550fa51-e259-4b3d-915a-17296892410b","Type":"ContainerStarted","Data":"446229d3efd0c1adc8fdbba9ae68b58ed3bbb862d2c63c6d0ccc98c3c9e7f0c4"} Jul 17 21:04:42.226788 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:42.226711 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7nb8k_a00219cb-5630-43c0-a6cc-37d9dcd8a73f/serve-healthcheck-canary/0.log" Jul 17 21:04:42.353639 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:42.353597 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2d3c44a-60a5-4624-a39f-d73ff62fda74-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qs9sk\" (UID: \"e2d3c44a-60a5-4624-a39f-d73ff62fda74\") " pod="openshift-insights/insights-runtime-extractor-qs9sk" Jul 17 21:04:42.353819 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:42.353677 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 21:04:42.353819 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:42.353752 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e2d3c44a-60a5-4624-a39f-d73ff62fda74-kube-rbac-proxy-cm podName:e2d3c44a-60a5-4624-a39f-d73ff62fda74 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:46.353737415 +0000 UTC m=+65.153536725 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e2d3c44a-60a5-4624-a39f-d73ff62fda74-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qs9sk" (UID: "e2d3c44a-60a5-4624-a39f-d73ff62fda74") : configmap "kube-rbac-proxy" not found Jul 17 21:04:42.353819 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:42.353675 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2d3c44a-60a5-4624-a39f-d73ff62fda74-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qs9sk\" (UID: \"e2d3c44a-60a5-4624-a39f-d73ff62fda74\") " pod="openshift-insights/insights-runtime-extractor-qs9sk" Jul 17 21:04:42.353819 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:42.353769 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 21:04:42.353819 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:42.353814 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2d3c44a-60a5-4624-a39f-d73ff62fda74-insights-runtime-extractor-tls podName:e2d3c44a-60a5-4624-a39f-d73ff62fda74 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:46.353803172 +0000 UTC m=+65.153602481 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e2d3c44a-60a5-4624-a39f-d73ff62fda74-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qs9sk" (UID: "e2d3c44a-60a5-4624-a39f-d73ff62fda74") : secret "insights-runtime-extractor-tls" not found Jul 17 21:04:42.961223 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:42.961193 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9vgps" Jul 17 21:04:44.043656 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:44.043624 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-tvn5g" event={"ID":"7550fa51-e259-4b3d-915a-17296892410b","Type":"ContainerStarted","Data":"ed68214d4166b9582f480944df476d4f3e6d46b3e868b0a621531ced49a6094b"} Jul 17 21:04:44.044026 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:44.043673 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-tvn5g" event={"ID":"7550fa51-e259-4b3d-915a-17296892410b","Type":"ContainerStarted","Data":"2d6870a701d00f746eeaf15d0682096472150db12850661f275c2bec63914581"} Jul 17 21:04:44.065438 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:44.065389 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-tvn5g" podStartSLOduration=1.645209553 podStartE2EDuration="3.065374765s" totalImagesPullingTime="1.420165212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:04:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:44.064721499 +0000 UTC m=+62.864520824" watchObservedRunningTime="2026-07-17 21:04:44.065374765 +0000 UTC m=+62.865174094" Jul 17 21:04:46.385358 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:46.385312 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2d3c44a-60a5-4624-a39f-d73ff62fda74-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qs9sk\" (UID: \"e2d3c44a-60a5-4624-a39f-d73ff62fda74\") " pod="openshift-insights/insights-runtime-extractor-qs9sk" Jul 17 21:04:46.385831 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:46.385436 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2d3c44a-60a5-4624-a39f-d73ff62fda74-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qs9sk\" (UID: \"e2d3c44a-60a5-4624-a39f-d73ff62fda74\") " pod="openshift-insights/insights-runtime-extractor-qs9sk" Jul 17 21:04:46.385831 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:46.385458 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 21:04:46.385831 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:46.385515 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 21:04:46.385831 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:46.385533 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2d3c44a-60a5-4624-a39f-d73ff62fda74-insights-runtime-extractor-tls podName:e2d3c44a-60a5-4624-a39f-d73ff62fda74 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:54.38551824 +0000 UTC m=+73.185317547 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e2d3c44a-60a5-4624-a39f-d73ff62fda74-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qs9sk" (UID: "e2d3c44a-60a5-4624-a39f-d73ff62fda74") : secret "insights-runtime-extractor-tls" not found Jul 17 21:04:46.385831 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:46.385568 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e2d3c44a-60a5-4624-a39f-d73ff62fda74-kube-rbac-proxy-cm podName:e2d3c44a-60a5-4624-a39f-d73ff62fda74 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:54.385552876 +0000 UTC m=+73.185352187 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e2d3c44a-60a5-4624-a39f-d73ff62fda74-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qs9sk" (UID: "e2d3c44a-60a5-4624-a39f-d73ff62fda74") : configmap "kube-rbac-proxy" not found Jul 17 21:04:47.303453 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:47.301556 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9ccfddc7-n765c"] Jul 17 21:04:47.304354 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:47.304334 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9ccfddc7-n765c" Jul 17 21:04:47.307959 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:47.307934 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 17 21:04:47.308086 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:47.307988 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 17 21:04:47.308086 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:47.308019 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 17 21:04:47.308086 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:47.307988 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 17 21:04:47.316472 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:47.316452 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9ccfddc7-n765c"] Jul 17 21:04:47.391352 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:47.391314 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d8ccf88a-e36e-47c6-988f-15ffc22aafc5-klusterlet-config\") pod \"klusterlet-addon-workmgr-7b9ccfddc7-n765c\" (UID: \"d8ccf88a-e36e-47c6-988f-15ffc22aafc5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9ccfddc7-n765c" Jul 17 21:04:47.391352 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:47.391350 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjcxp\" (UniqueName: \"kubernetes.io/projected/d8ccf88a-e36e-47c6-988f-15ffc22aafc5-kube-api-access-gjcxp\") pod \"klusterlet-addon-workmgr-7b9ccfddc7-n765c\" (UID: \"d8ccf88a-e36e-47c6-988f-15ffc22aafc5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9ccfddc7-n765c" Jul 17 21:04:47.391773 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:47.391370 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8ccf88a-e36e-47c6-988f-15ffc22aafc5-tmp\") pod \"klusterlet-addon-workmgr-7b9ccfddc7-n765c\" (UID: \"d8ccf88a-e36e-47c6-988f-15ffc22aafc5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9ccfddc7-n765c" Jul 17 21:04:47.492670 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:47.492624 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjcxp\" (UniqueName: \"kubernetes.io/projected/d8ccf88a-e36e-47c6-988f-15ffc22aafc5-kube-api-access-gjcxp\") pod \"klusterlet-addon-workmgr-7b9ccfddc7-n765c\" (UID: \"d8ccf88a-e36e-47c6-988f-15ffc22aafc5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9ccfddc7-n765c" Jul 17 21:04:47.492670 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:47.492676 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8ccf88a-e36e-47c6-988f-15ffc22aafc5-tmp\") pod \"klusterlet-addon-workmgr-7b9ccfddc7-n765c\" (UID: \"d8ccf88a-e36e-47c6-988f-15ffc22aafc5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9ccfddc7-n765c" Jul 17 21:04:47.492826 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:47.492813 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d8ccf88a-e36e-47c6-988f-15ffc22aafc5-klusterlet-config\") pod \"klusterlet-addon-workmgr-7b9ccfddc7-n765c\" (UID: \"d8ccf88a-e36e-47c6-988f-15ffc22aafc5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9ccfddc7-n765c" Jul 17 21:04:47.493072 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:47.493053 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8ccf88a-e36e-47c6-988f-15ffc22aafc5-tmp\") pod \"klusterlet-addon-workmgr-7b9ccfddc7-n765c\" (UID: \"d8ccf88a-e36e-47c6-988f-15ffc22aafc5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9ccfddc7-n765c" Jul 17 21:04:47.495087 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:47.495062 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d8ccf88a-e36e-47c6-988f-15ffc22aafc5-klusterlet-config\") pod \"klusterlet-addon-workmgr-7b9ccfddc7-n765c\" (UID: \"d8ccf88a-e36e-47c6-988f-15ffc22aafc5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9ccfddc7-n765c" Jul 17 21:04:47.507410 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:47.507388 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjcxp\" (UniqueName: \"kubernetes.io/projected/d8ccf88a-e36e-47c6-988f-15ffc22aafc5-kube-api-access-gjcxp\") pod \"klusterlet-addon-workmgr-7b9ccfddc7-n765c\" (UID: \"d8ccf88a-e36e-47c6-988f-15ffc22aafc5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9ccfddc7-n765c" Jul 17 21:04:47.613851 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:47.613748 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9ccfddc7-n765c" Jul 17 21:04:47.748990 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:47.748963 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9ccfddc7-n765c"] Jul 17 21:04:47.751601 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:04:47.751570 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8ccf88a_e36e_47c6_988f_15ffc22aafc5.slice/crio-4b8dea3c986afbd8e616ec220532a90c7fa61357990e2f548f9fdb7878393529 WatchSource:0}: Error finding container 4b8dea3c986afbd8e616ec220532a90c7fa61357990e2f548f9fdb7878393529: Status 404 returned error can't find the container with id 4b8dea3c986afbd8e616ec220532a90c7fa61357990e2f548f9fdb7878393529 Jul 17 21:04:47.794598 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:47.794573 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgmmd\" (UniqueName: \"kubernetes.io/projected/e1e535a8-ccc1-499b-9e30-70e8bd966ea1-kube-api-access-kgmmd\") pod \"network-check-target-lvjx6\" (UID: \"e1e535a8-ccc1-499b-9e30-70e8bd966ea1\") " pod="openshift-network-diagnostics/network-check-target-lvjx6" Jul 17 21:04:47.794746 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:47.794704 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff4b059f-6fba-47d3-b03e-e977255d54d3-metrics-certs\") pod \"network-metrics-daemon-6klsf\" (UID: \"ff4b059f-6fba-47d3-b03e-e977255d54d3\") " pod="openshift-multus/network-metrics-daemon-6klsf" Jul 17 21:04:47.794824 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:47.794752 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a700256e-b4d4-4dde-ae89-4b322addf3ad-original-pull-secret\") pod \"global-pull-secret-syncer-5mn75\" (UID: \"a700256e-b4d4-4dde-ae89-4b322addf3ad\") " pod="kube-system/global-pull-secret-syncer-5mn75" Jul 17 21:04:47.798084 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:47.798066 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 17 21:04:47.798133 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:47.798087 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 17 21:04:47.798176 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:47.798086 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 17 21:04:47.805193 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:47.805174 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 17 21:04:47.805239 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:47.805221 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff4b059f-6fba-47d3-b03e-e977255d54d3-metrics-certs podName:ff4b059f-6fba-47d3-b03e-e977255d54d3 nodeName:}" failed. No retries permitted until 2026-07-17 21:05:51.805207662 +0000 UTC m=+130.605006969 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff4b059f-6fba-47d3-b03e-e977255d54d3-metrics-certs") pod "network-metrics-daemon-6klsf" (UID: "ff4b059f-6fba-47d3-b03e-e977255d54d3") : secret "metrics-daemon-secret" not found Jul 17 21:04:47.807162 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:47.807145 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a700256e-b4d4-4dde-ae89-4b322addf3ad-original-pull-secret\") pod \"global-pull-secret-syncer-5mn75\" (UID: \"a700256e-b4d4-4dde-ae89-4b322addf3ad\") " pod="kube-system/global-pull-secret-syncer-5mn75" Jul 17 21:04:47.807573 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:47.807558 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 17 21:04:47.817345 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:47.817324 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgmmd\" (UniqueName: \"kubernetes.io/projected/e1e535a8-ccc1-499b-9e30-70e8bd966ea1-kube-api-access-kgmmd\") pod \"network-check-target-lvjx6\" (UID: \"e1e535a8-ccc1-499b-9e30-70e8bd966ea1\") " pod="openshift-network-diagnostics/network-check-target-lvjx6" Jul 17 21:04:47.940802 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:47.940709 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mn75" Jul 17 21:04:47.948753 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:47.948731 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5j5fp\"" Jul 17 21:04:47.957030 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:47.957008 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvjx6" Jul 17 21:04:48.055552 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:48.055493 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9ccfddc7-n765c" event={"ID":"d8ccf88a-e36e-47c6-988f-15ffc22aafc5","Type":"ContainerStarted","Data":"4b8dea3c986afbd8e616ec220532a90c7fa61357990e2f548f9fdb7878393529"} Jul 17 21:04:48.080419 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:48.080382 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5mn75"] Jul 17 21:04:48.083906 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:04:48.083881 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda700256e_b4d4_4dde_ae89_4b322addf3ad.slice/crio-a19a6010c4b2d92331fdd284419d5f5ceabeb2606f52b1dfe5929e172e5f243f WatchSource:0}: Error finding container a19a6010c4b2d92331fdd284419d5f5ceabeb2606f52b1dfe5929e172e5f243f: Status 404 returned error can't find the container with id a19a6010c4b2d92331fdd284419d5f5ceabeb2606f52b1dfe5929e172e5f243f Jul 17 21:04:48.094414 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:48.094390 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lvjx6"] Jul 17 21:04:48.097152 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:04:48.097129 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1e535a8_ccc1_499b_9e30_70e8bd966ea1.slice/crio-18396e3419eadbdc40d093726fe011466c8e64b9dfd82b4fb3264525b3928d1d WatchSource:0}: Error finding container 18396e3419eadbdc40d093726fe011466c8e64b9dfd82b4fb3264525b3928d1d: Status 404 returned error can't find the container with id 18396e3419eadbdc40d093726fe011466c8e64b9dfd82b4fb3264525b3928d1d Jul 17 21:04:48.197741 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:48.197649 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8fcdc69f-e417-4945-a31e-c34472a2039e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-b2vzg\" (UID: \"8fcdc69f-e417-4945-a31e-c34472a2039e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-b2vzg" Jul 17 21:04:48.197881 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:48.197802 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 21:04:48.197881 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:48.197863 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fcdc69f-e417-4945-a31e-c34472a2039e-samples-operator-tls podName:8fcdc69f-e417-4945-a31e-c34472a2039e nodeName:}" failed. No retries permitted until 2026-07-17 21:05:04.197848679 +0000 UTC m=+82.997647987 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8fcdc69f-e417-4945-a31e-c34472a2039e-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-b2vzg" (UID: "8fcdc69f-e417-4945-a31e-c34472a2039e") : secret "samples-operator-tls" not found Jul 17 21:04:48.500489 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:48.499866 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/512e4197-ce1e-465a-b519-3eaf1a327192-registry-tls\") pod \"image-registry-578cf8bcff-26v2c\" (UID: \"512e4197-ce1e-465a-b519-3eaf1a327192\") " pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" Jul 17 21:04:48.500489 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:48.500028 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 21:04:48.500489 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:48.500043 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-578cf8bcff-26v2c: secret "image-registry-tls" not found Jul 17 21:04:48.500489 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:48.500100 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/512e4197-ce1e-465a-b519-3eaf1a327192-registry-tls podName:512e4197-ce1e-465a-b519-3eaf1a327192 nodeName:}" failed. No retries permitted until 2026-07-17 21:05:20.500082149 +0000 UTC m=+99.299881459 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/512e4197-ce1e-465a-b519-3eaf1a327192-registry-tls") pod "image-registry-578cf8bcff-26v2c" (UID: "512e4197-ce1e-465a-b519-3eaf1a327192") : secret "image-registry-tls" not found Jul 17 21:04:48.500489 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:48.500343 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02b0f677-12f3-4a7e-bb15-d10c6257534d-metrics-tls\") pod \"dns-default-tlgcs\" (UID: \"02b0f677-12f3-4a7e-bb15-d10c6257534d\") " pod="openshift-dns/dns-default-tlgcs" Jul 17 21:04:48.501135 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:48.500541 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 21:04:48.501135 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:48.500602 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02b0f677-12f3-4a7e-bb15-d10c6257534d-metrics-tls podName:02b0f677-12f3-4a7e-bb15-d10c6257534d nodeName:}" failed. No retries permitted until 2026-07-17 21:05:20.500584051 +0000 UTC m=+99.300383366 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/02b0f677-12f3-4a7e-bb15-d10c6257534d-metrics-tls") pod "dns-default-tlgcs" (UID: "02b0f677-12f3-4a7e-bb15-d10c6257534d") : secret "dns-default-metrics-tls" not found Jul 17 21:04:49.062060 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:49.062018 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5mn75" event={"ID":"a700256e-b4d4-4dde-ae89-4b322addf3ad","Type":"ContainerStarted","Data":"a19a6010c4b2d92331fdd284419d5f5ceabeb2606f52b1dfe5929e172e5f243f"} Jul 17 21:04:49.064060 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:49.064030 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lvjx6" event={"ID":"e1e535a8-ccc1-499b-9e30-70e8bd966ea1","Type":"ContainerStarted","Data":"18396e3419eadbdc40d093726fe011466c8e64b9dfd82b4fb3264525b3928d1d"} Jul 17 21:04:54.457957 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:54.457910 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2d3c44a-60a5-4624-a39f-d73ff62fda74-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qs9sk\" (UID: \"e2d3c44a-60a5-4624-a39f-d73ff62fda74\") " pod="openshift-insights/insights-runtime-extractor-qs9sk" Jul 17 21:04:54.458470 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:54.457977 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2d3c44a-60a5-4624-a39f-d73ff62fda74-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qs9sk\" (UID: \"e2d3c44a-60a5-4624-a39f-d73ff62fda74\") " pod="openshift-insights/insights-runtime-extractor-qs9sk" Jul 17 21:04:54.458470 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:54.458096 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 21:04:54.458470 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:04:54.458154 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2d3c44a-60a5-4624-a39f-d73ff62fda74-insights-runtime-extractor-tls podName:e2d3c44a-60a5-4624-a39f-d73ff62fda74 nodeName:}" failed. No retries permitted until 2026-07-17 21:05:10.458137315 +0000 UTC m=+89.257936625 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e2d3c44a-60a5-4624-a39f-d73ff62fda74-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qs9sk" (UID: "e2d3c44a-60a5-4624-a39f-d73ff62fda74") : secret "insights-runtime-extractor-tls" not found Jul 17 21:04:54.458470 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:54.458391 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2d3c44a-60a5-4624-a39f-d73ff62fda74-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qs9sk\" (UID: \"e2d3c44a-60a5-4624-a39f-d73ff62fda74\") " pod="openshift-insights/insights-runtime-extractor-qs9sk" Jul 17 21:04:55.082805 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:55.082763 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5mn75" event={"ID":"a700256e-b4d4-4dde-ae89-4b322addf3ad","Type":"ContainerStarted","Data":"9d48ba5550c56ee47745dc085bf8a5ebc3aba418b723029d81928332c7bc754f"} Jul 17 21:04:55.084256 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:55.084227 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lvjx6" event={"ID":"e1e535a8-ccc1-499b-9e30-70e8bd966ea1","Type":"ContainerStarted","Data":"14edf09f5124293371ec408abdc99e9aa8a17fa163eedf5f38e47322ac006400"} Jul 17 21:04:55.084400 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:55.084331 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lvjx6" Jul 17 21:04:55.085544 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:55.085523 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9ccfddc7-n765c" event={"ID":"d8ccf88a-e36e-47c6-988f-15ffc22aafc5","Type":"ContainerStarted","Data":"224763efbebabd820cebb9666d40f9baf45ce7baa0dd8311f404860fea6b1cdf"} Jul 17 21:04:55.085729 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:55.085714 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9ccfddc7-n765c" Jul 17 21:04:55.087193 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:55.087170 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9ccfddc7-n765c" Jul 17 21:04:55.121253 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:55.121213 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lvjx6" podStartSLOduration=66.953262122 podStartE2EDuration="1m13.121200332s" totalImagesPullingTime="6.16793821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:03:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:55.120791754 +0000 UTC m=+73.920591082" watchObservedRunningTime="2026-07-17 21:04:55.121200332 +0000 UTC m=+73.920999661" Jul 17 21:04:55.121474 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:55.121437 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5mn75" podStartSLOduration=66.922352934 podStartE2EDuration="1m13.121432769s" totalImagesPullingTime="6.199079835s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:03:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:55.102989266 +0000 UTC m=+73.902788596" watchObservedRunningTime="2026-07-17 21:04:55.121432769 +0000 UTC m=+73.921232102" Jul 17 21:04:55.141989 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:04:55.141953 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9ccfddc7-n765c" podStartSLOduration=1.609289362 podStartE2EDuration="8.141940876s" totalImagesPullingTime="6.532651514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:04:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:55.14120335 +0000 UTC m=+73.941002682" watchObservedRunningTime="2026-07-17 21:04:55.141940876 +0000 UTC m=+73.941740242" Jul 17 21:05:04.235811 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:04.235675 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8fcdc69f-e417-4945-a31e-c34472a2039e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-b2vzg\" (UID: \"8fcdc69f-e417-4945-a31e-c34472a2039e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-b2vzg" Jul 17 21:05:04.237873 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:04.237853 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8fcdc69f-e417-4945-a31e-c34472a2039e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-b2vzg\" (UID: \"8fcdc69f-e417-4945-a31e-c34472a2039e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-b2vzg" Jul 17 21:05:04.446384 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:04.446353 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5qfmp\"" Jul 17 21:05:04.454530 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:04.454507 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-b2vzg" Jul 17 21:05:04.576276 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:04.576242 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-b2vzg"] Jul 17 21:05:05.115295 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:05.115259 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-b2vzg" event={"ID":"8fcdc69f-e417-4945-a31e-c34472a2039e","Type":"ContainerStarted","Data":"6fb74288061ab2c4ed85fb51879d8ee22d48bfeae67b7a3a44678db7622a2717"} Jul 17 21:05:07.124351 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:07.124310 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-b2vzg" event={"ID":"8fcdc69f-e417-4945-a31e-c34472a2039e","Type":"ContainerStarted","Data":"9c6bc79ac6c54a6e6966b9bd44f5b43e421af6d8446a4d6e27e0f5b1257844af"} Jul 17 21:05:07.124826 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:07.124372 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-b2vzg" event={"ID":"8fcdc69f-e417-4945-a31e-c34472a2039e","Type":"ContainerStarted","Data":"b4e621d3b436c85fd875ec67b29606716dceef28d9733fc66375fa12ef5f4ff6"} Jul 17 21:05:07.159736 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:07.159671 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-b2vzg" podStartSLOduration=33.544969499 podStartE2EDuration="35.159653786s" totalImagesPullingTime="1.614684287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:04:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:05:07.158630613 +0000 UTC m=+85.958429943" watchObservedRunningTime="2026-07-17 21:05:07.159653786 +0000 UTC m=+85.959453177" Jul 17 21:05:07.753230 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:07.753196 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-mslsb"] Jul 17 21:05:07.756185 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:07.756164 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-mslsb" Jul 17 21:05:07.763126 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:05:07.763099 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"prometheus-operator-admission-webhook-85574b5f49-mslsb\" is forbidden: User \"system:node:ip-10-0-131-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-131-37.ec2.internal' and this object" podUID="b10c40a3-26aa-47cf-ae7a-83c9605b4306" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-mslsb" Jul 17 21:05:07.763225 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:05:07.763156 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"prometheus-operator-admission-webhook-dockercfg-xrst2\" is forbidden: User \"system:node:ip-10-0-131-37.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-131-37.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-xrst2\"" type="*v1.Secret" Jul 17 21:05:07.763705 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:07.763669 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 17 21:05:07.798970 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:07.798940 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-mslsb"] Jul 17 21:05:07.862809 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:07.862769 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b10c40a3-26aa-47cf-ae7a-83c9605b4306-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-mslsb\" (UID: \"b10c40a3-26aa-47cf-ae7a-83c9605b4306\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-mslsb" Jul 17 21:05:07.963583 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:07.963544 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b10c40a3-26aa-47cf-ae7a-83c9605b4306-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-mslsb\" (UID: \"b10c40a3-26aa-47cf-ae7a-83c9605b4306\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-mslsb" Jul 17 21:05:07.965927 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:07.965908 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b10c40a3-26aa-47cf-ae7a-83c9605b4306-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-mslsb\" (UID: \"b10c40a3-26aa-47cf-ae7a-83c9605b4306\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-mslsb" Jul 17 21:05:08.313451 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:08.313421 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85f78f69-vqp4v"] Jul 17 21:05:08.316357 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:08.316341 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85f78f69-vqp4v" Jul 17 21:05:08.319367 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:08.319342 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 17 21:05:08.319464 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:08.319393 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qjgd8\"" Jul 17 21:05:08.320229 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:08.320213 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 17 21:05:08.320409 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:08.320395 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 17 21:05:08.320518 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:08.320502 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 17 21:05:08.320693 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:08.320666 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 17 21:05:08.321167 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:08.321150 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 17 21:05:08.321702 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:08.321668 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 17 21:05:08.329210 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:08.329189 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85f78f69-vqp4v"] Jul 17 21:05:08.467325 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:08.467295 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad8ee5ec-c65d-4cb8-995c-73b4c632ab04-console-config\") pod \"console-85f78f69-vqp4v\" (UID: \"ad8ee5ec-c65d-4cb8-995c-73b4c632ab04\") " pod="openshift-console/console-85f78f69-vqp4v" Jul 17 21:05:08.467465 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:08.467333 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb8b8\" (UniqueName: \"kubernetes.io/projected/ad8ee5ec-c65d-4cb8-995c-73b4c632ab04-kube-api-access-xb8b8\") pod \"console-85f78f69-vqp4v\" (UID: \"ad8ee5ec-c65d-4cb8-995c-73b4c632ab04\") " pod="openshift-console/console-85f78f69-vqp4v" Jul 17 21:05:08.467465 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:08.467355 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad8ee5ec-c65d-4cb8-995c-73b4c632ab04-console-serving-cert\") pod \"console-85f78f69-vqp4v\" (UID: \"ad8ee5ec-c65d-4cb8-995c-73b4c632ab04\") " pod="openshift-console/console-85f78f69-vqp4v" Jul 17 21:05:08.467465 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:08.467372 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad8ee5ec-c65d-4cb8-995c-73b4c632ab04-oauth-serving-cert\") pod \"console-85f78f69-vqp4v\" (UID: \"ad8ee5ec-c65d-4cb8-995c-73b4c632ab04\") " pod="openshift-console/console-85f78f69-vqp4v" Jul 17 21:05:08.467465 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:08.467448 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad8ee5ec-c65d-4cb8-995c-73b4c632ab04-console-oauth-config\") pod \"console-85f78f69-vqp4v\" (UID: \"ad8ee5ec-c65d-4cb8-995c-73b4c632ab04\") " pod="openshift-console/console-85f78f69-vqp4v" Jul 17 21:05:08.467608 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:08.467497 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad8ee5ec-c65d-4cb8-995c-73b4c632ab04-service-ca\") pod \"console-85f78f69-vqp4v\" (UID: \"ad8ee5ec-c65d-4cb8-995c-73b4c632ab04\") " pod="openshift-console/console-85f78f69-vqp4v" Jul 17 21:05:08.568432 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:08.568372 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad8ee5ec-c65d-4cb8-995c-73b4c632ab04-console-serving-cert\") pod \"console-85f78f69-vqp4v\" (UID: \"ad8ee5ec-c65d-4cb8-995c-73b4c632ab04\") " pod="openshift-console/console-85f78f69-vqp4v" Jul 17 21:05:08.568432 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:08.568405 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad8ee5ec-c65d-4cb8-995c-73b4c632ab04-oauth-serving-cert\") pod \"console-85f78f69-vqp4v\" (UID: \"ad8ee5ec-c65d-4cb8-995c-73b4c632ab04\") " pod="openshift-console/console-85f78f69-vqp4v" Jul 17 21:05:08.568588 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:08.568440 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad8ee5ec-c65d-4cb8-995c-73b4c632ab04-console-oauth-config\") pod \"console-85f78f69-vqp4v\" (UID: \"ad8ee5ec-c65d-4cb8-995c-73b4c632ab04\") " pod="openshift-console/console-85f78f69-vqp4v" Jul 17 21:05:08.568588 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:08.568533 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad8ee5ec-c65d-4cb8-995c-73b4c632ab04-service-ca\") pod \"console-85f78f69-vqp4v\" (UID: \"ad8ee5ec-c65d-4cb8-995c-73b4c632ab04\") " pod="openshift-console/console-85f78f69-vqp4v" Jul 17 21:05:08.568588 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:08.568579 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad8ee5ec-c65d-4cb8-995c-73b4c632ab04-console-config\") pod \"console-85f78f69-vqp4v\" (UID: \"ad8ee5ec-c65d-4cb8-995c-73b4c632ab04\") " pod="openshift-console/console-85f78f69-vqp4v" Jul 17 21:05:08.568765 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:08.568627 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb8b8\" (UniqueName: \"kubernetes.io/projected/ad8ee5ec-c65d-4cb8-995c-73b4c632ab04-kube-api-access-xb8b8\") pod \"console-85f78f69-vqp4v\" (UID: \"ad8ee5ec-c65d-4cb8-995c-73b4c632ab04\") " pod="openshift-console/console-85f78f69-vqp4v" Jul 17 21:05:08.569242 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:08.569213 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad8ee5ec-c65d-4cb8-995c-73b4c632ab04-service-ca\") pod \"console-85f78f69-vqp4v\" (UID: \"ad8ee5ec-c65d-4cb8-995c-73b4c632ab04\") " pod="openshift-console/console-85f78f69-vqp4v" Jul 17 21:05:08.569360 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:08.569314 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad8ee5ec-c65d-4cb8-995c-73b4c632ab04-console-config\") pod \"console-85f78f69-vqp4v\" (UID: \"ad8ee5ec-c65d-4cb8-995c-73b4c632ab04\") " pod="openshift-console/console-85f78f69-vqp4v" Jul 17 21:05:08.569360 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:08.569314 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad8ee5ec-c65d-4cb8-995c-73b4c632ab04-oauth-serving-cert\") pod \"console-85f78f69-vqp4v\" (UID: \"ad8ee5ec-c65d-4cb8-995c-73b4c632ab04\") " pod="openshift-console/console-85f78f69-vqp4v" Jul 17 21:05:08.570651 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:08.570619 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad8ee5ec-c65d-4cb8-995c-73b4c632ab04-console-serving-cert\") pod \"console-85f78f69-vqp4v\" (UID: \"ad8ee5ec-c65d-4cb8-995c-73b4c632ab04\") " pod="openshift-console/console-85f78f69-vqp4v" Jul 17 21:05:08.570781 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:08.570746 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad8ee5ec-c65d-4cb8-995c-73b4c632ab04-console-oauth-config\") pod \"console-85f78f69-vqp4v\" (UID: \"ad8ee5ec-c65d-4cb8-995c-73b4c632ab04\") " pod="openshift-console/console-85f78f69-vqp4v" Jul 17 21:05:08.581793 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:08.581771 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb8b8\" (UniqueName: \"kubernetes.io/projected/ad8ee5ec-c65d-4cb8-995c-73b4c632ab04-kube-api-access-xb8b8\") pod \"console-85f78f69-vqp4v\" (UID: \"ad8ee5ec-c65d-4cb8-995c-73b4c632ab04\") " pod="openshift-console/console-85f78f69-vqp4v" Jul 17 21:05:08.626120 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:08.626081 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85f78f69-vqp4v" Jul 17 21:05:08.648406 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:08.648381 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-xrst2\"" Jul 17 21:05:08.654662 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:08.654637 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-mslsb" Jul 17 21:05:08.769308 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:08.769279 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85f78f69-vqp4v"] Jul 17 21:05:08.772987 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:05:08.772953 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad8ee5ec_c65d_4cb8_995c_73b4c632ab04.slice/crio-71339ea7560087d700439074a4f660476e3b36f95d0a3797ed70752dd2e7fc65 WatchSource:0}: Error finding container 71339ea7560087d700439074a4f660476e3b36f95d0a3797ed70752dd2e7fc65: Status 404 returned error can't find the container with id 71339ea7560087d700439074a4f660476e3b36f95d0a3797ed70752dd2e7fc65 Jul 17 21:05:08.789508 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:08.789445 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-mslsb"] Jul 17 21:05:08.793643 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:05:08.793622 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb10c40a3_26aa_47cf_ae7a_83c9605b4306.slice/crio-c8bcefc1caa7cee029264bcc987ecfcdab5cd74614c01f1d631e3819f8a7e147 WatchSource:0}: Error finding container c8bcefc1caa7cee029264bcc987ecfcdab5cd74614c01f1d631e3819f8a7e147: Status 404 returned error can't find the container with id c8bcefc1caa7cee029264bcc987ecfcdab5cd74614c01f1d631e3819f8a7e147 Jul 17 21:05:09.131451 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:09.131418 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-mslsb" event={"ID":"b10c40a3-26aa-47cf-ae7a-83c9605b4306","Type":"ContainerStarted","Data":"c8bcefc1caa7cee029264bcc987ecfcdab5cd74614c01f1d631e3819f8a7e147"} Jul 17 21:05:09.132490 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:09.132463 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85f78f69-vqp4v" event={"ID":"ad8ee5ec-c65d-4cb8-995c-73b4c632ab04","Type":"ContainerStarted","Data":"71339ea7560087d700439074a4f660476e3b36f95d0a3797ed70752dd2e7fc65"} Jul 17 21:05:10.485176 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:10.485146 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2d3c44a-60a5-4624-a39f-d73ff62fda74-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qs9sk\" (UID: \"e2d3c44a-60a5-4624-a39f-d73ff62fda74\") " pod="openshift-insights/insights-runtime-extractor-qs9sk" Jul 17 21:05:10.487539 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:10.487514 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2d3c44a-60a5-4624-a39f-d73ff62fda74-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qs9sk\" (UID: \"e2d3c44a-60a5-4624-a39f-d73ff62fda74\") " pod="openshift-insights/insights-runtime-extractor-qs9sk" Jul 17 21:05:10.738205 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:10.738171 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8lg9w\"" Jul 17 21:05:10.746541 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:10.746508 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qs9sk" Jul 17 21:05:10.882970 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:10.882941 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qs9sk"] Jul 17 21:05:11.141218 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:11.141175 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-mslsb" event={"ID":"b10c40a3-26aa-47cf-ae7a-83c9605b4306","Type":"ContainerStarted","Data":"c7d6f243af720d105611163f5fed77cbdd636ac90468d6b969a7d747285f99bb"} Jul 17 21:05:11.141442 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:11.141409 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-mslsb" Jul 17 21:05:11.146670 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:11.146636 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-mslsb" Jul 17 21:05:11.167123 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:11.167077 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-mslsb" podStartSLOduration=2.678496564 podStartE2EDuration="4.167064308s" totalImagesPullingTime="1.488567744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:05:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:05:11.166699468 +0000 UTC m=+89.966498789" watchObservedRunningTime="2026-07-17 21:05:11.167064308 +0000 UTC m=+89.966863637" Jul 17 21:05:11.777794 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:11.777763 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-zzrvs"] Jul 17 21:05:11.786408 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:11.786379 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-zzrvs" Jul 17 21:05:11.790361 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:11.790339 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 17 21:05:11.790495 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:11.790463 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 17 21:05:11.790495 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:11.790476 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 17 21:05:11.790613 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:11.790564 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 17 21:05:11.790923 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:11.790873 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 17 21:05:11.791036 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:11.790921 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-bns22\"" Jul 17 21:05:11.792725 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:11.792703 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-zzrvs"] Jul 17 21:05:11.863265 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:05:11.863238 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2d3c44a_60a5_4624_a39f_d73ff62fda74.slice/crio-3af498f484cdd9576ac232e792c3220c376b2f042bb66d6f1b503d4dfd031020 WatchSource:0}: Error finding container 3af498f484cdd9576ac232e792c3220c376b2f042bb66d6f1b503d4dfd031020: Status 404 returned error can't find the container with id 3af498f484cdd9576ac232e792c3220c376b2f042bb66d6f1b503d4dfd031020 Jul 17 21:05:11.898551 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:11.898516 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttbzq\" (UniqueName: \"kubernetes.io/projected/97424303-3ff7-457b-9199-c7d33de2a9e1-kube-api-access-ttbzq\") pod \"prometheus-operator-5945b5cfd-zzrvs\" (UID: \"97424303-3ff7-457b-9199-c7d33de2a9e1\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zzrvs" Jul 17 21:05:11.898660 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:11.898558 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97424303-3ff7-457b-9199-c7d33de2a9e1-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-zzrvs\" (UID: \"97424303-3ff7-457b-9199-c7d33de2a9e1\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zzrvs" Jul 17 21:05:11.898660 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:11.898579 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/97424303-3ff7-457b-9199-c7d33de2a9e1-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-zzrvs\" (UID: \"97424303-3ff7-457b-9199-c7d33de2a9e1\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zzrvs" Jul 17 21:05:11.898788 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:11.898767 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/97424303-3ff7-457b-9199-c7d33de2a9e1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-zzrvs\" (UID: \"97424303-3ff7-457b-9199-c7d33de2a9e1\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zzrvs" Jul 17 21:05:11.999707 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:11.999644 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97424303-3ff7-457b-9199-c7d33de2a9e1-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-zzrvs\" (UID: \"97424303-3ff7-457b-9199-c7d33de2a9e1\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zzrvs" Jul 17 21:05:11.999869 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:11.999713 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/97424303-3ff7-457b-9199-c7d33de2a9e1-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-zzrvs\" (UID: \"97424303-3ff7-457b-9199-c7d33de2a9e1\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zzrvs" Jul 17 21:05:11.999869 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:11.999810 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/97424303-3ff7-457b-9199-c7d33de2a9e1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-zzrvs\" (UID: \"97424303-3ff7-457b-9199-c7d33de2a9e1\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zzrvs" Jul 17 21:05:11.999869 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:11.999853 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttbzq\" (UniqueName: \"kubernetes.io/projected/97424303-3ff7-457b-9199-c7d33de2a9e1-kube-api-access-ttbzq\") pod \"prometheus-operator-5945b5cfd-zzrvs\" (UID: \"97424303-3ff7-457b-9199-c7d33de2a9e1\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zzrvs" Jul 17 21:05:12.000445 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:12.000421 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97424303-3ff7-457b-9199-c7d33de2a9e1-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-zzrvs\" (UID: \"97424303-3ff7-457b-9199-c7d33de2a9e1\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zzrvs" Jul 17 21:05:12.002263 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:12.002234 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/97424303-3ff7-457b-9199-c7d33de2a9e1-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-zzrvs\" (UID: \"97424303-3ff7-457b-9199-c7d33de2a9e1\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zzrvs" Jul 17 21:05:12.002263 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:12.002239 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/97424303-3ff7-457b-9199-c7d33de2a9e1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-zzrvs\" (UID: \"97424303-3ff7-457b-9199-c7d33de2a9e1\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zzrvs" Jul 17 21:05:12.009132 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:12.009109 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttbzq\" (UniqueName: \"kubernetes.io/projected/97424303-3ff7-457b-9199-c7d33de2a9e1-kube-api-access-ttbzq\") pod \"prometheus-operator-5945b5cfd-zzrvs\" (UID: \"97424303-3ff7-457b-9199-c7d33de2a9e1\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zzrvs" Jul 17 21:05:12.098090 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:12.098064 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-zzrvs" Jul 17 21:05:12.146862 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:12.146781 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qs9sk" event={"ID":"e2d3c44a-60a5-4624-a39f-d73ff62fda74","Type":"ContainerStarted","Data":"3af498f484cdd9576ac232e792c3220c376b2f042bb66d6f1b503d4dfd031020"} Jul 17 21:05:12.148979 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:12.148913 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85f78f69-vqp4v" event={"ID":"ad8ee5ec-c65d-4cb8-995c-73b4c632ab04","Type":"ContainerStarted","Data":"046ea51b76a7daddfc4e9b5861a7dc2fd2d61956160d3180e6d4e249745fee56"} Jul 17 21:05:12.171229 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:12.170786 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85f78f69-vqp4v" podStartSLOduration=1.034682181 podStartE2EDuration="4.170765903s" totalImagesPullingTime="3.136083722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:05:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:05:12.170312731 +0000 UTC m=+90.970112061" watchObservedRunningTime="2026-07-17 21:05:12.170765903 +0000 UTC m=+90.970565233" Jul 17 21:05:12.225066 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:12.225009 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-zzrvs"] Jul 17 21:05:12.228388 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:05:12.228351 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97424303_3ff7_457b_9199_c7d33de2a9e1.slice/crio-623b5c43331032b28616355eed431ff77cfd955655aaa76ae4dbfefec885a4a8 WatchSource:0}: Error finding container 623b5c43331032b28616355eed431ff77cfd955655aaa76ae4dbfefec885a4a8: Status 404 returned error can't find the container with id 623b5c43331032b28616355eed431ff77cfd955655aaa76ae4dbfefec885a4a8 Jul 17 21:05:13.153051 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:13.153012 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-zzrvs" event={"ID":"97424303-3ff7-457b-9199-c7d33de2a9e1","Type":"ContainerStarted","Data":"623b5c43331032b28616355eed431ff77cfd955655aaa76ae4dbfefec885a4a8"} Jul 17 21:05:14.158720 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:14.158665 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-zzrvs" event={"ID":"97424303-3ff7-457b-9199-c7d33de2a9e1","Type":"ContainerStarted","Data":"bcb6993ee4f42f8c5d12cfc2e968aa3de49ff5a8deff777ab0255411d5d1ca76"} Jul 17 21:05:14.159148 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:14.158738 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-zzrvs" event={"ID":"97424303-3ff7-457b-9199-c7d33de2a9e1","Type":"ContainerStarted","Data":"5941163c7dbdc951f9ae34f0bdeaa5b769d1b9a1ebb21562db5e14419d7f65a4"} Jul 17 21:05:14.177389 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:14.177339 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-zzrvs" podStartSLOduration=1.893487994 podStartE2EDuration="3.177322124s" totalImagesPullingTime="1.28383413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:05:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:05:14.177206733 +0000 UTC m=+92.977006063" watchObservedRunningTime="2026-07-17 21:05:14.177322124 +0000 UTC m=+92.977121453" Jul 17 21:05:14.289663 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:14.289629 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-87889c954-x4kdg"] Jul 17 21:05:14.292811 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:14.292786 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-87889c954-x4kdg" Jul 17 21:05:14.302033 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:14.302004 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 17 21:05:14.307169 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:14.307143 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-87889c954-x4kdg"] Jul 17 21:05:14.423094 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:14.422990 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e124264-eb28-437d-8380-e449b34cfbaf-console-oauth-config\") pod \"console-87889c954-x4kdg\" (UID: \"5e124264-eb28-437d-8380-e449b34cfbaf\") " pod="openshift-console/console-87889c954-x4kdg" Jul 17 21:05:14.423306 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:14.423136 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcg7c\" (UniqueName: \"kubernetes.io/projected/5e124264-eb28-437d-8380-e449b34cfbaf-kube-api-access-tcg7c\") pod \"console-87889c954-x4kdg\" (UID: \"5e124264-eb28-437d-8380-e449b34cfbaf\") " pod="openshift-console/console-87889c954-x4kdg" Jul 17 21:05:14.423306 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:14.423183 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e124264-eb28-437d-8380-e449b34cfbaf-console-config\") pod \"console-87889c954-x4kdg\" (UID: \"5e124264-eb28-437d-8380-e449b34cfbaf\") " pod="openshift-console/console-87889c954-x4kdg" Jul 17 21:05:14.423306 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:14.423247 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e124264-eb28-437d-8380-e449b34cfbaf-trusted-ca-bundle\") pod \"console-87889c954-x4kdg\" (UID: \"5e124264-eb28-437d-8380-e449b34cfbaf\") " pod="openshift-console/console-87889c954-x4kdg" Jul 17 21:05:14.423306 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:14.423285 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e124264-eb28-437d-8380-e449b34cfbaf-service-ca\") pod \"console-87889c954-x4kdg\" (UID: \"5e124264-eb28-437d-8380-e449b34cfbaf\") " pod="openshift-console/console-87889c954-x4kdg" Jul 17 21:05:14.423519 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:14.423341 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e124264-eb28-437d-8380-e449b34cfbaf-oauth-serving-cert\") pod \"console-87889c954-x4kdg\" (UID: \"5e124264-eb28-437d-8380-e449b34cfbaf\") " pod="openshift-console/console-87889c954-x4kdg" Jul 17 21:05:14.423519 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:14.423400 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e124264-eb28-437d-8380-e449b34cfbaf-console-serving-cert\") pod \"console-87889c954-x4kdg\" (UID: \"5e124264-eb28-437d-8380-e449b34cfbaf\") " pod="openshift-console/console-87889c954-x4kdg" Jul 17 21:05:14.523939 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:14.523897 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e124264-eb28-437d-8380-e449b34cfbaf-console-oauth-config\") pod \"console-87889c954-x4kdg\" (UID: \"5e124264-eb28-437d-8380-e449b34cfbaf\") " pod="openshift-console/console-87889c954-x4kdg" Jul 17 21:05:14.524131 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:14.523966 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcg7c\" (UniqueName: \"kubernetes.io/projected/5e124264-eb28-437d-8380-e449b34cfbaf-kube-api-access-tcg7c\") pod \"console-87889c954-x4kdg\" (UID: \"5e124264-eb28-437d-8380-e449b34cfbaf\") " pod="openshift-console/console-87889c954-x4kdg" Jul 17 21:05:14.524131 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:14.523999 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e124264-eb28-437d-8380-e449b34cfbaf-console-config\") pod \"console-87889c954-x4kdg\" (UID: \"5e124264-eb28-437d-8380-e449b34cfbaf\") " pod="openshift-console/console-87889c954-x4kdg" Jul 17 21:05:14.524131 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:14.524079 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e124264-eb28-437d-8380-e449b34cfbaf-trusted-ca-bundle\") pod \"console-87889c954-x4kdg\" (UID: \"5e124264-eb28-437d-8380-e449b34cfbaf\") " pod="openshift-console/console-87889c954-x4kdg" Jul 17 21:05:14.524310 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:14.524136 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e124264-eb28-437d-8380-e449b34cfbaf-service-ca\") pod \"console-87889c954-x4kdg\" (UID: \"5e124264-eb28-437d-8380-e449b34cfbaf\") " pod="openshift-console/console-87889c954-x4kdg" Jul 17 21:05:14.524310 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:14.524173 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e124264-eb28-437d-8380-e449b34cfbaf-oauth-serving-cert\") pod \"console-87889c954-x4kdg\" (UID: \"5e124264-eb28-437d-8380-e449b34cfbaf\") " pod="openshift-console/console-87889c954-x4kdg" Jul 17 21:05:14.524310 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:14.524226 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e124264-eb28-437d-8380-e449b34cfbaf-console-serving-cert\") pod \"console-87889c954-x4kdg\" (UID: \"5e124264-eb28-437d-8380-e449b34cfbaf\") " pod="openshift-console/console-87889c954-x4kdg" Jul 17 21:05:14.524987 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:14.524923 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e124264-eb28-437d-8380-e449b34cfbaf-service-ca\") pod \"console-87889c954-x4kdg\" (UID: \"5e124264-eb28-437d-8380-e449b34cfbaf\") " pod="openshift-console/console-87889c954-x4kdg" Jul 17 21:05:14.525232 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:14.525212 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e124264-eb28-437d-8380-e449b34cfbaf-console-config\") pod \"console-87889c954-x4kdg\" (UID: \"5e124264-eb28-437d-8380-e449b34cfbaf\") " pod="openshift-console/console-87889c954-x4kdg" Jul 17 21:05:14.525317 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:14.525277 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e124264-eb28-437d-8380-e449b34cfbaf-oauth-serving-cert\") pod \"console-87889c954-x4kdg\" (UID: \"5e124264-eb28-437d-8380-e449b34cfbaf\") " pod="openshift-console/console-87889c954-x4kdg" Jul 17 21:05:14.525409 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:14.525387 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e124264-eb28-437d-8380-e449b34cfbaf-trusted-ca-bundle\") pod \"console-87889c954-x4kdg\" (UID: \"5e124264-eb28-437d-8380-e449b34cfbaf\") " pod="openshift-console/console-87889c954-x4kdg" Jul 17 21:05:14.526672 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:14.526649 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e124264-eb28-437d-8380-e449b34cfbaf-console-oauth-config\") pod \"console-87889c954-x4kdg\" (UID: \"5e124264-eb28-437d-8380-e449b34cfbaf\") " pod="openshift-console/console-87889c954-x4kdg" Jul 17 21:05:14.527044 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:14.527028 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e124264-eb28-437d-8380-e449b34cfbaf-console-serving-cert\") pod \"console-87889c954-x4kdg\" (UID: \"5e124264-eb28-437d-8380-e449b34cfbaf\") " pod="openshift-console/console-87889c954-x4kdg" Jul 17 21:05:14.533624 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:14.533599 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcg7c\" (UniqueName: \"kubernetes.io/projected/5e124264-eb28-437d-8380-e449b34cfbaf-kube-api-access-tcg7c\") pod \"console-87889c954-x4kdg\" (UID: \"5e124264-eb28-437d-8380-e449b34cfbaf\") " pod="openshift-console/console-87889c954-x4kdg" Jul 17 21:05:14.604449 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:14.604410 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-87889c954-x4kdg" Jul 17 21:05:14.756992 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:14.756964 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-87889c954-x4kdg"] Jul 17 21:05:14.759026 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:05:14.758963 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e124264_eb28_437d_8380_e449b34cfbaf.slice/crio-6a0ab982fd52ff7d656500e4a53bc4ca2a2ae1191672d2e294049715b0a3ffd1 WatchSource:0}: Error finding container 6a0ab982fd52ff7d656500e4a53bc4ca2a2ae1191672d2e294049715b0a3ffd1: Status 404 returned error can't find the container with id 6a0ab982fd52ff7d656500e4a53bc4ca2a2ae1191672d2e294049715b0a3ffd1 Jul 17 21:05:15.164333 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:15.164300 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-87889c954-x4kdg" event={"ID":"5e124264-eb28-437d-8380-e449b34cfbaf","Type":"ContainerStarted","Data":"52b1f33e29e1a67f64498663bd3e9578685c40a98f6c647e5ecf94538919a056"} Jul 17 21:05:15.165002 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:15.164360 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-87889c954-x4kdg" event={"ID":"5e124264-eb28-437d-8380-e449b34cfbaf","Type":"ContainerStarted","Data":"6a0ab982fd52ff7d656500e4a53bc4ca2a2ae1191672d2e294049715b0a3ffd1"} Jul 17 21:05:15.234343 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:15.234290 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-87889c954-x4kdg" podStartSLOduration=1.234271894 podStartE2EDuration="1.234271894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:05:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:05:15.232870563 +0000 UTC m=+94.032669893" watchObservedRunningTime="2026-07-17 21:05:15.234271894 +0000 UTC m=+94.034071225" Jul 17 21:05:16.086516 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.086474 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-8hvrk"] Jul 17 21:05:16.105558 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.105521 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-8hvrk"] Jul 17 21:05:16.105737 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.105713 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8hvrk" Jul 17 21:05:16.109009 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.108983 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 17 21:05:16.109525 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.109508 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 17 21:05:16.115599 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.115582 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-rwnz9\"" Jul 17 21:05:16.140793 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.140767 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-b8qzz"] Jul 17 21:05:16.146090 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.146069 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b8qzz" Jul 17 21:05:16.148836 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.148815 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 17 21:05:16.149806 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.149788 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qhtzp\"" Jul 17 21:05:16.149806 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.149798 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 17 21:05:16.151978 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.151961 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 17 21:05:16.242673 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.242637 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ada777c3-e00f-4e3e-9ae4-03d217e4f0e4-metrics-client-ca\") pod \"node-exporter-b8qzz\" (UID: \"ada777c3-e00f-4e3e-9ae4-03d217e4f0e4\") " pod="openshift-monitoring/node-exporter-b8qzz" Jul 17 21:05:16.243078 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.242701 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ada777c3-e00f-4e3e-9ae4-03d217e4f0e4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b8qzz\" (UID: \"ada777c3-e00f-4e3e-9ae4-03d217e4f0e4\") " pod="openshift-monitoring/node-exporter-b8qzz" Jul 17 21:05:16.243078 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.242740 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8017f112-8fc6-4105-9779-4f744661ba0e-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-8hvrk\" (UID: \"8017f112-8fc6-4105-9779-4f744661ba0e\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8hvrk" Jul 17 21:05:16.243078 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.242770 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt8dg\" (UniqueName: \"kubernetes.io/projected/8017f112-8fc6-4105-9779-4f744661ba0e-kube-api-access-qt8dg\") pod \"openshift-state-metrics-79f6958cdf-8hvrk\" (UID: \"8017f112-8fc6-4105-9779-4f744661ba0e\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8hvrk" Jul 17 21:05:16.243078 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.242827 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ada777c3-e00f-4e3e-9ae4-03d217e4f0e4-root\") pod \"node-exporter-b8qzz\" (UID: \"ada777c3-e00f-4e3e-9ae4-03d217e4f0e4\") " pod="openshift-monitoring/node-exporter-b8qzz" Jul 17 21:05:16.243078 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.242859 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ada777c3-e00f-4e3e-9ae4-03d217e4f0e4-node-exporter-wtmp\") pod \"node-exporter-b8qzz\" (UID: \"ada777c3-e00f-4e3e-9ae4-03d217e4f0e4\") " pod="openshift-monitoring/node-exporter-b8qzz" Jul 17 21:05:16.243078 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.242883 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8017f112-8fc6-4105-9779-4f744661ba0e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-8hvrk\" (UID: \"8017f112-8fc6-4105-9779-4f744661ba0e\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8hvrk" Jul 17 21:05:16.243078 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.242947 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbk8l\" (UniqueName: \"kubernetes.io/projected/ada777c3-e00f-4e3e-9ae4-03d217e4f0e4-kube-api-access-nbk8l\") pod \"node-exporter-b8qzz\" (UID: \"ada777c3-e00f-4e3e-9ae4-03d217e4f0e4\") " pod="openshift-monitoring/node-exporter-b8qzz" Jul 17 21:05:16.243078 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.243060 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ada777c3-e00f-4e3e-9ae4-03d217e4f0e4-node-exporter-textfile\") pod \"node-exporter-b8qzz\" (UID: \"ada777c3-e00f-4e3e-9ae4-03d217e4f0e4\") " pod="openshift-monitoring/node-exporter-b8qzz" Jul 17 21:05:16.243447 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.243098 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ada777c3-e00f-4e3e-9ae4-03d217e4f0e4-sys\") pod \"node-exporter-b8qzz\" (UID: \"ada777c3-e00f-4e3e-9ae4-03d217e4f0e4\") " pod="openshift-monitoring/node-exporter-b8qzz" Jul 17 21:05:16.243447 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.243183 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ada777c3-e00f-4e3e-9ae4-03d217e4f0e4-node-exporter-accelerators-collector-config\") pod \"node-exporter-b8qzz\" (UID: \"ada777c3-e00f-4e3e-9ae4-03d217e4f0e4\") " pod="openshift-monitoring/node-exporter-b8qzz" Jul 17 21:05:16.243447 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.243241 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8017f112-8fc6-4105-9779-4f744661ba0e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-8hvrk\" (UID: \"8017f112-8fc6-4105-9779-4f744661ba0e\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8hvrk" Jul 17 21:05:16.243447 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.243298 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ada777c3-e00f-4e3e-9ae4-03d217e4f0e4-node-exporter-tls\") pod \"node-exporter-b8qzz\" (UID: \"ada777c3-e00f-4e3e-9ae4-03d217e4f0e4\") " pod="openshift-monitoring/node-exporter-b8qzz" Jul 17 21:05:16.344798 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.344717 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ada777c3-e00f-4e3e-9ae4-03d217e4f0e4-node-exporter-textfile\") pod \"node-exporter-b8qzz\" (UID: \"ada777c3-e00f-4e3e-9ae4-03d217e4f0e4\") " pod="openshift-monitoring/node-exporter-b8qzz" Jul 17 21:05:16.344798 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.344769 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ada777c3-e00f-4e3e-9ae4-03d217e4f0e4-sys\") pod \"node-exporter-b8qzz\" (UID: \"ada777c3-e00f-4e3e-9ae4-03d217e4f0e4\") " pod="openshift-monitoring/node-exporter-b8qzz" Jul 17 21:05:16.345028 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.344808 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ada777c3-e00f-4e3e-9ae4-03d217e4f0e4-node-exporter-accelerators-collector-config\") pod \"node-exporter-b8qzz\" (UID: \"ada777c3-e00f-4e3e-9ae4-03d217e4f0e4\") " pod="openshift-monitoring/node-exporter-b8qzz" Jul 17 21:05:16.345028 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.344842 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8017f112-8fc6-4105-9779-4f744661ba0e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-8hvrk\" (UID: \"8017f112-8fc6-4105-9779-4f744661ba0e\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8hvrk" Jul 17 21:05:16.345028 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.344885 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ada777c3-e00f-4e3e-9ae4-03d217e4f0e4-node-exporter-tls\") pod \"node-exporter-b8qzz\" (UID: \"ada777c3-e00f-4e3e-9ae4-03d217e4f0e4\") " pod="openshift-monitoring/node-exporter-b8qzz" Jul 17 21:05:16.345028 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.344910 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ada777c3-e00f-4e3e-9ae4-03d217e4f0e4-metrics-client-ca\") pod \"node-exporter-b8qzz\" (UID: \"ada777c3-e00f-4e3e-9ae4-03d217e4f0e4\") " pod="openshift-monitoring/node-exporter-b8qzz" Jul 17 21:05:16.345028 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.344958 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ada777c3-e00f-4e3e-9ae4-03d217e4f0e4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b8qzz\" (UID: \"ada777c3-e00f-4e3e-9ae4-03d217e4f0e4\") " pod="openshift-monitoring/node-exporter-b8qzz" Jul 17 21:05:16.345028 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.344985 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8017f112-8fc6-4105-9779-4f744661ba0e-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-8hvrk\" (UID: \"8017f112-8fc6-4105-9779-4f744661ba0e\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8hvrk" Jul 17 21:05:16.345028 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.345017 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ada777c3-e00f-4e3e-9ae4-03d217e4f0e4-sys\") pod \"node-exporter-b8qzz\" (UID: \"ada777c3-e00f-4e3e-9ae4-03d217e4f0e4\") " pod="openshift-monitoring/node-exporter-b8qzz" Jul 17 21:05:16.345344 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.345121 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ada777c3-e00f-4e3e-9ae4-03d217e4f0e4-node-exporter-textfile\") pod \"node-exporter-b8qzz\" (UID: \"ada777c3-e00f-4e3e-9ae4-03d217e4f0e4\") " pod="openshift-monitoring/node-exporter-b8qzz" Jul 17 21:05:16.345398 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.345345 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt8dg\" (UniqueName: \"kubernetes.io/projected/8017f112-8fc6-4105-9779-4f744661ba0e-kube-api-access-qt8dg\") pod \"openshift-state-metrics-79f6958cdf-8hvrk\" (UID: \"8017f112-8fc6-4105-9779-4f744661ba0e\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8hvrk" Jul 17 21:05:16.345462 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.345412 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ada777c3-e00f-4e3e-9ae4-03d217e4f0e4-root\") pod \"node-exporter-b8qzz\" (UID: \"ada777c3-e00f-4e3e-9ae4-03d217e4f0e4\") " pod="openshift-monitoring/node-exporter-b8qzz" Jul 17 21:05:16.345462 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.345440 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ada777c3-e00f-4e3e-9ae4-03d217e4f0e4-node-exporter-wtmp\") pod \"node-exporter-b8qzz\" (UID: \"ada777c3-e00f-4e3e-9ae4-03d217e4f0e4\") " pod="openshift-monitoring/node-exporter-b8qzz" Jul 17 21:05:16.345559 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.345468 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8017f112-8fc6-4105-9779-4f744661ba0e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-8hvrk\" (UID: \"8017f112-8fc6-4105-9779-4f744661ba0e\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8hvrk" Jul 17 21:05:16.345559 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.345483 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ada777c3-e00f-4e3e-9ae4-03d217e4f0e4-node-exporter-accelerators-collector-config\") pod \"node-exporter-b8qzz\" (UID: \"ada777c3-e00f-4e3e-9ae4-03d217e4f0e4\") " pod="openshift-monitoring/node-exporter-b8qzz" Jul 17 21:05:16.345559 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.345500 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbk8l\" (UniqueName: \"kubernetes.io/projected/ada777c3-e00f-4e3e-9ae4-03d217e4f0e4-kube-api-access-nbk8l\") pod \"node-exporter-b8qzz\" (UID: \"ada777c3-e00f-4e3e-9ae4-03d217e4f0e4\") " pod="openshift-monitoring/node-exporter-b8qzz" Jul 17 21:05:16.345772 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.345598 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ada777c3-e00f-4e3e-9ae4-03d217e4f0e4-root\") pod \"node-exporter-b8qzz\" (UID: \"ada777c3-e00f-4e3e-9ae4-03d217e4f0e4\") " pod="openshift-monitoring/node-exporter-b8qzz" Jul 17 21:05:16.345772 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.345693 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8017f112-8fc6-4105-9779-4f744661ba0e-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-8hvrk\" (UID: \"8017f112-8fc6-4105-9779-4f744661ba0e\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8hvrk" Jul 17 21:05:16.345772 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.345730 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ada777c3-e00f-4e3e-9ae4-03d217e4f0e4-node-exporter-wtmp\") pod \"node-exporter-b8qzz\" (UID: \"ada777c3-e00f-4e3e-9ae4-03d217e4f0e4\") " pod="openshift-monitoring/node-exporter-b8qzz" Jul 17 21:05:16.345924 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:05:16.345786 2568 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 17 21:05:16.345924 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.345846 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ada777c3-e00f-4e3e-9ae4-03d217e4f0e4-metrics-client-ca\") pod \"node-exporter-b8qzz\" (UID: \"ada777c3-e00f-4e3e-9ae4-03d217e4f0e4\") " pod="openshift-monitoring/node-exporter-b8qzz" Jul 17 21:05:16.345924 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:05:16.345859 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8017f112-8fc6-4105-9779-4f744661ba0e-openshift-state-metrics-tls podName:8017f112-8fc6-4105-9779-4f744661ba0e nodeName:}" failed. No retries permitted until 2026-07-17 21:05:16.845841729 +0000 UTC m=+95.645641047 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/8017f112-8fc6-4105-9779-4f744661ba0e-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-8hvrk" (UID: "8017f112-8fc6-4105-9779-4f744661ba0e") : secret "openshift-state-metrics-tls" not found Jul 17 21:05:16.347601 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.347578 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ada777c3-e00f-4e3e-9ae4-03d217e4f0e4-node-exporter-tls\") pod \"node-exporter-b8qzz\" (UID: \"ada777c3-e00f-4e3e-9ae4-03d217e4f0e4\") " pod="openshift-monitoring/node-exporter-b8qzz" Jul 17 21:05:16.347746 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.347667 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ada777c3-e00f-4e3e-9ae4-03d217e4f0e4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b8qzz\" (UID: \"ada777c3-e00f-4e3e-9ae4-03d217e4f0e4\") " pod="openshift-monitoring/node-exporter-b8qzz" Jul 17 21:05:16.348144 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.348122 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8017f112-8fc6-4105-9779-4f744661ba0e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-8hvrk\" (UID: \"8017f112-8fc6-4105-9779-4f744661ba0e\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8hvrk" Jul 17 21:05:16.357003 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.356985 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbk8l\" (UniqueName: \"kubernetes.io/projected/ada777c3-e00f-4e3e-9ae4-03d217e4f0e4-kube-api-access-nbk8l\") pod \"node-exporter-b8qzz\" (UID: \"ada777c3-e00f-4e3e-9ae4-03d217e4f0e4\") " pod="openshift-monitoring/node-exporter-b8qzz" Jul 17 21:05:16.357193 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.357176 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt8dg\" (UniqueName: \"kubernetes.io/projected/8017f112-8fc6-4105-9779-4f744661ba0e-kube-api-access-qt8dg\") pod \"openshift-state-metrics-79f6958cdf-8hvrk\" (UID: \"8017f112-8fc6-4105-9779-4f744661ba0e\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8hvrk" Jul 17 21:05:16.456226 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.455996 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b8qzz" Jul 17 21:05:16.850496 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.850459 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8017f112-8fc6-4105-9779-4f744661ba0e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-8hvrk\" (UID: \"8017f112-8fc6-4105-9779-4f744661ba0e\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8hvrk" Jul 17 21:05:16.853205 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:16.853174 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8017f112-8fc6-4105-9779-4f744661ba0e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-8hvrk\" (UID: \"8017f112-8fc6-4105-9779-4f744661ba0e\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8hvrk" Jul 17 21:05:17.018760 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:17.018724 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8hvrk" Jul 17 21:05:17.728071 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:05:17.728002 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podada777c3_e00f_4e3e_9ae4_03d217e4f0e4.slice/crio-ba6312371273fe32772c18ce37498cfa4d83002352ec4cd85d52020aecec4eef WatchSource:0}: Error finding container ba6312371273fe32772c18ce37498cfa4d83002352ec4cd85d52020aecec4eef: Status 404 returned error can't find the container with id ba6312371273fe32772c18ce37498cfa4d83002352ec4cd85d52020aecec4eef Jul 17 21:05:17.855095 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:17.855066 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-8hvrk"] Jul 17 21:05:17.859195 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:05:17.859153 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8017f112_8fc6_4105_9779_4f744661ba0e.slice/crio-e7b83dc79840c44baba2d6bfb43a9fd2df4593393859fa9239aed789b2d9c6f9 WatchSource:0}: Error finding container e7b83dc79840c44baba2d6bfb43a9fd2df4593393859fa9239aed789b2d9c6f9: Status 404 returned error can't find the container with id e7b83dc79840c44baba2d6bfb43a9fd2df4593393859fa9239aed789b2d9c6f9 Jul 17 21:05:18.175905 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:18.175870 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qs9sk" event={"ID":"e2d3c44a-60a5-4624-a39f-d73ff62fda74","Type":"ContainerStarted","Data":"49882400a8e71d967a193272ec755f58f87610d1217f06ef19e3c33d20f5795d"} Jul 17 21:05:18.178110 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:18.178078 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8hvrk" event={"ID":"8017f112-8fc6-4105-9779-4f744661ba0e","Type":"ContainerStarted","Data":"5a43e47911d39981d0854e2cb83bf6feee8a7929dd75882255ac694239c4f6b2"} Jul 17 21:05:18.178229 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:18.178137 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8hvrk" event={"ID":"8017f112-8fc6-4105-9779-4f744661ba0e","Type":"ContainerStarted","Data":"515bc6b430782f2629b4ab5a5f02022d2de993fceeeddba103e96ac786b3451d"} Jul 17 21:05:18.178229 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:18.178163 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8hvrk" event={"ID":"8017f112-8fc6-4105-9779-4f744661ba0e","Type":"ContainerStarted","Data":"e7b83dc79840c44baba2d6bfb43a9fd2df4593393859fa9239aed789b2d9c6f9"} Jul 17 21:05:18.179615 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:18.179584 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b8qzz" event={"ID":"ada777c3-e00f-4e3e-9ae4-03d217e4f0e4","Type":"ContainerStarted","Data":"ba6312371273fe32772c18ce37498cfa4d83002352ec4cd85d52020aecec4eef"} Jul 17 21:05:18.627637 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:18.627168 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85f78f69-vqp4v" Jul 17 21:05:18.627637 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:18.627271 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85f78f69-vqp4v" Jul 17 21:05:18.633630 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:18.633599 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-85f78f69-vqp4v" Jul 17 21:05:19.185226 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:19.185185 2568 generic.go:356] "Generic (PLEG): container finished" podID="ada777c3-e00f-4e3e-9ae4-03d217e4f0e4" containerID="7b2214ba67a13c41a6bad78dc4fd27b21eef600605d47d9d9e8b1f98f3a6d140" exitCode=0 Jul 17 21:05:19.185640 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:19.185226 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b8qzz" event={"ID":"ada777c3-e00f-4e3e-9ae4-03d217e4f0e4","Type":"ContainerDied","Data":"7b2214ba67a13c41a6bad78dc4fd27b21eef600605d47d9d9e8b1f98f3a6d140"} Jul 17 21:05:19.187877 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:19.187752 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8hvrk" event={"ID":"8017f112-8fc6-4105-9779-4f744661ba0e","Type":"ContainerStarted","Data":"b0fd26276f6b71cc8f503fe6cbd9ca61d4201aa3e601623e7c9003f8518665b5"} Jul 17 21:05:19.192469 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:19.192439 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-85f78f69-vqp4v" Jul 17 21:05:20.195056 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.194979 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b8qzz" event={"ID":"ada777c3-e00f-4e3e-9ae4-03d217e4f0e4","Type":"ContainerStarted","Data":"1470db5f5d83b7a8fcc8e14489cbdb503cc2f62577f7bad7712e88a809bbc610"} Jul 17 21:05:20.195056 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.195039 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b8qzz" event={"ID":"ada777c3-e00f-4e3e-9ae4-03d217e4f0e4","Type":"ContainerStarted","Data":"547045daf58d3d722a967249e57c8e7353b600802fb89332d567daf47260fc34"} Jul 17 21:05:20.217951 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.217907 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8hvrk" podStartSLOduration=3.219770883 podStartE2EDuration="4.217890852s" totalImagesPullingTime="998.119969ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:05:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:05:19.244335112 +0000 UTC m=+98.044134441" watchObservedRunningTime="2026-07-17 21:05:20.217890852 +0000 UTC m=+99.017690182" Jul 17 21:05:20.218117 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.218015 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-b8qzz" podStartSLOduration=2.9245049229999998 podStartE2EDuration="4.21800807s" totalImagesPullingTime="1.219441061s" totalInitContainerRuntime="74.062086ms" isStatefulPod=true podCreationTimestamp="2026-07-17 21:05:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:05:20.216489272 +0000 UTC m=+99.016288602" watchObservedRunningTime="2026-07-17 21:05:20.21800807 +0000 UTC m=+99.017807398" Jul 17 21:05:20.561239 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.561205 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-fbf477467-r5ctl"] Jul 17 21:05:20.583815 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.583782 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-fbf477467-r5ctl"] Jul 17 21:05:20.583997 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.583877 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/512e4197-ce1e-465a-b519-3eaf1a327192-registry-tls\") pod \"image-registry-578cf8bcff-26v2c\" (UID: \"512e4197-ce1e-465a-b519-3eaf1a327192\") " pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" Jul 17 21:05:20.583997 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.583916 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-fbf477467-r5ctl" Jul 17 21:05:20.584120 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.583922 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02b0f677-12f3-4a7e-bb15-d10c6257534d-metrics-tls\") pod \"dns-default-tlgcs\" (UID: \"02b0f677-12f3-4a7e-bb15-d10c6257534d\") " pod="openshift-dns/dns-default-tlgcs" Jul 17 21:05:20.587300 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.586705 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 17 21:05:20.587300 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.586899 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02b0f677-12f3-4a7e-bb15-d10c6257534d-metrics-tls\") pod \"dns-default-tlgcs\" (UID: \"02b0f677-12f3-4a7e-bb15-d10c6257534d\") " pod="openshift-dns/dns-default-tlgcs" Jul 17 21:05:20.587300 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.586963 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 17 21:05:20.587300 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.587034 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/512e4197-ce1e-465a-b519-3eaf1a327192-registry-tls\") pod \"image-registry-578cf8bcff-26v2c\" (UID: \"512e4197-ce1e-465a-b519-3eaf1a327192\") " pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" Jul 17 21:05:20.587881 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.587715 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 17 21:05:20.587881 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.587758 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-wzhqr\"" Jul 17 21:05:20.587881 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.587790 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-g050efqjsgm5\"" Jul 17 21:05:20.587881 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.587808 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 17 21:05:20.684866 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.684820 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/faf36c2d-10fd-4011-9733-8761868aeb36-audit-log\") pod \"metrics-server-fbf477467-r5ctl\" (UID: \"faf36c2d-10fd-4011-9733-8761868aeb36\") " pod="openshift-monitoring/metrics-server-fbf477467-r5ctl" Jul 17 21:05:20.685014 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.684881 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/faf36c2d-10fd-4011-9733-8761868aeb36-metrics-server-audit-profiles\") pod \"metrics-server-fbf477467-r5ctl\" (UID: \"faf36c2d-10fd-4011-9733-8761868aeb36\") " pod="openshift-monitoring/metrics-server-fbf477467-r5ctl" Jul 17 21:05:20.685014 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.684921 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsb7g\" (UniqueName: \"kubernetes.io/projected/faf36c2d-10fd-4011-9733-8761868aeb36-kube-api-access-xsb7g\") pod \"metrics-server-fbf477467-r5ctl\" (UID: \"faf36c2d-10fd-4011-9733-8761868aeb36\") " pod="openshift-monitoring/metrics-server-fbf477467-r5ctl" Jul 17 21:05:20.685014 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.684971 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/faf36c2d-10fd-4011-9733-8761868aeb36-secret-metrics-server-tls\") pod \"metrics-server-fbf477467-r5ctl\" (UID: \"faf36c2d-10fd-4011-9733-8761868aeb36\") " pod="openshift-monitoring/metrics-server-fbf477467-r5ctl" Jul 17 21:05:20.685158 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.685016 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/faf36c2d-10fd-4011-9733-8761868aeb36-secret-metrics-server-client-certs\") pod \"metrics-server-fbf477467-r5ctl\" (UID: \"faf36c2d-10fd-4011-9733-8761868aeb36\") " pod="openshift-monitoring/metrics-server-fbf477467-r5ctl" Jul 17 21:05:20.685158 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.685065 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/faf36c2d-10fd-4011-9733-8761868aeb36-client-ca-bundle\") pod \"metrics-server-fbf477467-r5ctl\" (UID: \"faf36c2d-10fd-4011-9733-8761868aeb36\") " pod="openshift-monitoring/metrics-server-fbf477467-r5ctl" Jul 17 21:05:20.685158 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.685125 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faf36c2d-10fd-4011-9733-8761868aeb36-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-fbf477467-r5ctl\" (UID: \"faf36c2d-10fd-4011-9733-8761868aeb36\") " pod="openshift-monitoring/metrics-server-fbf477467-r5ctl" Jul 17 21:05:20.786147 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.786052 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/faf36c2d-10fd-4011-9733-8761868aeb36-client-ca-bundle\") pod \"metrics-server-fbf477467-r5ctl\" (UID: \"faf36c2d-10fd-4011-9733-8761868aeb36\") " pod="openshift-monitoring/metrics-server-fbf477467-r5ctl" Jul 17 21:05:20.786147 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.786114 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faf36c2d-10fd-4011-9733-8761868aeb36-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-fbf477467-r5ctl\" (UID: \"faf36c2d-10fd-4011-9733-8761868aeb36\") " pod="openshift-monitoring/metrics-server-fbf477467-r5ctl" Jul 17 21:05:20.786147 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.786149 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/faf36c2d-10fd-4011-9733-8761868aeb36-audit-log\") pod \"metrics-server-fbf477467-r5ctl\" (UID: \"faf36c2d-10fd-4011-9733-8761868aeb36\") " pod="openshift-monitoring/metrics-server-fbf477467-r5ctl" Jul 17 21:05:20.786415 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.786172 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/faf36c2d-10fd-4011-9733-8761868aeb36-metrics-server-audit-profiles\") pod \"metrics-server-fbf477467-r5ctl\" (UID: \"faf36c2d-10fd-4011-9733-8761868aeb36\") " pod="openshift-monitoring/metrics-server-fbf477467-r5ctl" Jul 17 21:05:20.786415 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.786197 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsb7g\" (UniqueName: \"kubernetes.io/projected/faf36c2d-10fd-4011-9733-8761868aeb36-kube-api-access-xsb7g\") pod \"metrics-server-fbf477467-r5ctl\" (UID: \"faf36c2d-10fd-4011-9733-8761868aeb36\") " pod="openshift-monitoring/metrics-server-fbf477467-r5ctl" Jul 17 21:05:20.786415 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.786236 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/faf36c2d-10fd-4011-9733-8761868aeb36-secret-metrics-server-tls\") pod \"metrics-server-fbf477467-r5ctl\" (UID: \"faf36c2d-10fd-4011-9733-8761868aeb36\") " pod="openshift-monitoring/metrics-server-fbf477467-r5ctl" Jul 17 21:05:20.786415 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.786267 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/faf36c2d-10fd-4011-9733-8761868aeb36-secret-metrics-server-client-certs\") pod \"metrics-server-fbf477467-r5ctl\" (UID: \"faf36c2d-10fd-4011-9733-8761868aeb36\") " pod="openshift-monitoring/metrics-server-fbf477467-r5ctl" Jul 17 21:05:20.786775 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.786745 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/faf36c2d-10fd-4011-9733-8761868aeb36-audit-log\") pod \"metrics-server-fbf477467-r5ctl\" (UID: \"faf36c2d-10fd-4011-9733-8761868aeb36\") " pod="openshift-monitoring/metrics-server-fbf477467-r5ctl" Jul 17 21:05:20.787193 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.787167 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faf36c2d-10fd-4011-9733-8761868aeb36-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-fbf477467-r5ctl\" (UID: \"faf36c2d-10fd-4011-9733-8761868aeb36\") " pod="openshift-monitoring/metrics-server-fbf477467-r5ctl" Jul 17 21:05:20.787407 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.787386 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/faf36c2d-10fd-4011-9733-8761868aeb36-metrics-server-audit-profiles\") pod \"metrics-server-fbf477467-r5ctl\" (UID: \"faf36c2d-10fd-4011-9733-8761868aeb36\") " pod="openshift-monitoring/metrics-server-fbf477467-r5ctl" Jul 17 21:05:20.789047 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.788918 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/faf36c2d-10fd-4011-9733-8761868aeb36-secret-metrics-server-tls\") pod \"metrics-server-fbf477467-r5ctl\" (UID: \"faf36c2d-10fd-4011-9733-8761868aeb36\") " pod="openshift-monitoring/metrics-server-fbf477467-r5ctl" Jul 17 21:05:20.789363 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.789344 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/faf36c2d-10fd-4011-9733-8761868aeb36-client-ca-bundle\") pod \"metrics-server-fbf477467-r5ctl\" (UID: \"faf36c2d-10fd-4011-9733-8761868aeb36\") " pod="openshift-monitoring/metrics-server-fbf477467-r5ctl" Jul 17 21:05:20.789946 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.789925 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/faf36c2d-10fd-4011-9733-8761868aeb36-secret-metrics-server-client-certs\") pod \"metrics-server-fbf477467-r5ctl\" (UID: \"faf36c2d-10fd-4011-9733-8761868aeb36\") " pod="openshift-monitoring/metrics-server-fbf477467-r5ctl" Jul 17 21:05:20.794638 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.794614 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsb7g\" (UniqueName: \"kubernetes.io/projected/faf36c2d-10fd-4011-9733-8761868aeb36-kube-api-access-xsb7g\") pod \"metrics-server-fbf477467-r5ctl\" (UID: \"faf36c2d-10fd-4011-9733-8761868aeb36\") " pod="openshift-monitoring/metrics-server-fbf477467-r5ctl" Jul 17 21:05:20.819179 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.819145 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gp6nq\"" Jul 17 21:05:20.827309 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.827281 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" Jul 17 21:05:20.852912 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.852840 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nzpb7\"" Jul 17 21:05:20.861106 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.860969 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tlgcs" Jul 17 21:05:20.898608 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.898579 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xqld2"] Jul 17 21:05:20.902079 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.902039 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-fbf477467-r5ctl" Jul 17 21:05:20.903339 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.903323 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xqld2" Jul 17 21:05:20.905830 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.905810 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-rkd66\"" Jul 17 21:05:20.905943 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.905810 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 17 21:05:20.910394 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.910342 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xqld2"] Jul 17 21:05:20.988004 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.987972 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpcjs\" (UniqueName: \"kubernetes.io/projected/27afe524-31d3-4afb-a4fa-fc49198dc4f7-kube-api-access-tpcjs\") pod \"monitoring-plugin-7b7b7bc8bf-xqld2\" (UID: \"27afe524-31d3-4afb-a4fa-fc49198dc4f7\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xqld2" Jul 17 21:05:20.988168 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:20.988033 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/27afe524-31d3-4afb-a4fa-fc49198dc4f7-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-xqld2\" (UID: \"27afe524-31d3-4afb-a4fa-fc49198dc4f7\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xqld2" Jul 17 21:05:21.089222 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:21.089186 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpcjs\" (UniqueName: \"kubernetes.io/projected/27afe524-31d3-4afb-a4fa-fc49198dc4f7-kube-api-access-tpcjs\") pod \"monitoring-plugin-7b7b7bc8bf-xqld2\" (UID: \"27afe524-31d3-4afb-a4fa-fc49198dc4f7\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xqld2" Jul 17 21:05:21.089411 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:21.089250 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/27afe524-31d3-4afb-a4fa-fc49198dc4f7-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-xqld2\" (UID: \"27afe524-31d3-4afb-a4fa-fc49198dc4f7\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xqld2" Jul 17 21:05:21.089490 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:05:21.089431 2568 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 17 21:05:21.089548 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:05:21.089497 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27afe524-31d3-4afb-a4fa-fc49198dc4f7-monitoring-plugin-cert podName:27afe524-31d3-4afb-a4fa-fc49198dc4f7 nodeName:}" failed. No retries permitted until 2026-07-17 21:05:21.589479651 +0000 UTC m=+100.389278959 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/27afe524-31d3-4afb-a4fa-fc49198dc4f7-monitoring-plugin-cert") pod "monitoring-plugin-7b7b7bc8bf-xqld2" (UID: "27afe524-31d3-4afb-a4fa-fc49198dc4f7") : secret "monitoring-plugin-cert" not found Jul 17 21:05:21.101196 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:21.101147 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-87889c954-x4kdg"] Jul 17 21:05:21.108480 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:21.108449 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpcjs\" (UniqueName: \"kubernetes.io/projected/27afe524-31d3-4afb-a4fa-fc49198dc4f7-kube-api-access-tpcjs\") pod \"monitoring-plugin-7b7b7bc8bf-xqld2\" (UID: \"27afe524-31d3-4afb-a4fa-fc49198dc4f7\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xqld2" Jul 17 21:05:21.144087 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:21.144059 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b887fdbbc-465xm"] Jul 17 21:05:21.154406 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:21.154384 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b887fdbbc-465xm" Jul 17 21:05:21.160159 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:21.160130 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b887fdbbc-465xm"] Jul 17 21:05:21.190109 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:21.190079 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11b25c75-d7a8-4ebc-94a8-da4c618eda82-console-serving-cert\") pod \"console-5b887fdbbc-465xm\" (UID: \"11b25c75-d7a8-4ebc-94a8-da4c618eda82\") " pod="openshift-console/console-5b887fdbbc-465xm" Jul 17 21:05:21.190229 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:21.190134 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11b25c75-d7a8-4ebc-94a8-da4c618eda82-service-ca\") pod \"console-5b887fdbbc-465xm\" (UID: \"11b25c75-d7a8-4ebc-94a8-da4c618eda82\") " pod="openshift-console/console-5b887fdbbc-465xm" Jul 17 21:05:21.190229 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:21.190179 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7t4s\" (UniqueName: \"kubernetes.io/projected/11b25c75-d7a8-4ebc-94a8-da4c618eda82-kube-api-access-x7t4s\") pod \"console-5b887fdbbc-465xm\" (UID: \"11b25c75-d7a8-4ebc-94a8-da4c618eda82\") " pod="openshift-console/console-5b887fdbbc-465xm" Jul 17 21:05:21.190229 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:21.190208 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11b25c75-d7a8-4ebc-94a8-da4c618eda82-console-oauth-config\") pod \"console-5b887fdbbc-465xm\" (UID: \"11b25c75-d7a8-4ebc-94a8-da4c618eda82\") " pod="openshift-console/console-5b887fdbbc-465xm" Jul 17 21:05:21.190353 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:21.190232 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11b25c75-d7a8-4ebc-94a8-da4c618eda82-trusted-ca-bundle\") pod \"console-5b887fdbbc-465xm\" (UID: \"11b25c75-d7a8-4ebc-94a8-da4c618eda82\") " pod="openshift-console/console-5b887fdbbc-465xm" Jul 17 21:05:21.190353 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:21.190270 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11b25c75-d7a8-4ebc-94a8-da4c618eda82-console-config\") pod \"console-5b887fdbbc-465xm\" (UID: \"11b25c75-d7a8-4ebc-94a8-da4c618eda82\") " pod="openshift-console/console-5b887fdbbc-465xm" Jul 17 21:05:21.190353 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:21.190322 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11b25c75-d7a8-4ebc-94a8-da4c618eda82-oauth-serving-cert\") pod \"console-5b887fdbbc-465xm\" (UID: \"11b25c75-d7a8-4ebc-94a8-da4c618eda82\") " pod="openshift-console/console-5b887fdbbc-465xm" Jul 17 21:05:21.291798 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:21.291762 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11b25c75-d7a8-4ebc-94a8-da4c618eda82-oauth-serving-cert\") pod \"console-5b887fdbbc-465xm\" (UID: \"11b25c75-d7a8-4ebc-94a8-da4c618eda82\") " pod="openshift-console/console-5b887fdbbc-465xm" Jul 17 21:05:21.292407 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:21.291898 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11b25c75-d7a8-4ebc-94a8-da4c618eda82-console-serving-cert\") pod \"console-5b887fdbbc-465xm\" (UID: \"11b25c75-d7a8-4ebc-94a8-da4c618eda82\") " pod="openshift-console/console-5b887fdbbc-465xm" Jul 17 21:05:21.292407 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:21.291960 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11b25c75-d7a8-4ebc-94a8-da4c618eda82-service-ca\") pod \"console-5b887fdbbc-465xm\" (UID: \"11b25c75-d7a8-4ebc-94a8-da4c618eda82\") " pod="openshift-console/console-5b887fdbbc-465xm" Jul 17 21:05:21.292407 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:21.292003 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7t4s\" (UniqueName: \"kubernetes.io/projected/11b25c75-d7a8-4ebc-94a8-da4c618eda82-kube-api-access-x7t4s\") pod \"console-5b887fdbbc-465xm\" (UID: \"11b25c75-d7a8-4ebc-94a8-da4c618eda82\") " pod="openshift-console/console-5b887fdbbc-465xm" Jul 17 21:05:21.292407 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:21.292028 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11b25c75-d7a8-4ebc-94a8-da4c618eda82-console-oauth-config\") pod \"console-5b887fdbbc-465xm\" (UID: \"11b25c75-d7a8-4ebc-94a8-da4c618eda82\") " pod="openshift-console/console-5b887fdbbc-465xm" Jul 17 21:05:21.292407 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:21.292047 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11b25c75-d7a8-4ebc-94a8-da4c618eda82-trusted-ca-bundle\") pod \"console-5b887fdbbc-465xm\" (UID: \"11b25c75-d7a8-4ebc-94a8-da4c618eda82\") " pod="openshift-console/console-5b887fdbbc-465xm" Jul 17 21:05:21.292407 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:21.292100 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11b25c75-d7a8-4ebc-94a8-da4c618eda82-console-config\") pod \"console-5b887fdbbc-465xm\" (UID: \"11b25c75-d7a8-4ebc-94a8-da4c618eda82\") " pod="openshift-console/console-5b887fdbbc-465xm" Jul 17 21:05:21.292895 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:21.292867 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11b25c75-d7a8-4ebc-94a8-da4c618eda82-trusted-ca-bundle\") pod \"console-5b887fdbbc-465xm\" (UID: \"11b25c75-d7a8-4ebc-94a8-da4c618eda82\") " pod="openshift-console/console-5b887fdbbc-465xm" Jul 17 21:05:21.293173 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:21.293140 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11b25c75-d7a8-4ebc-94a8-da4c618eda82-oauth-serving-cert\") pod \"console-5b887fdbbc-465xm\" (UID: \"11b25c75-d7a8-4ebc-94a8-da4c618eda82\") " pod="openshift-console/console-5b887fdbbc-465xm" Jul 17 21:05:21.293266 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:21.293223 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11b25c75-d7a8-4ebc-94a8-da4c618eda82-console-config\") pod \"console-5b887fdbbc-465xm\" (UID: \"11b25c75-d7a8-4ebc-94a8-da4c618eda82\") " pod="openshift-console/console-5b887fdbbc-465xm" Jul 17 21:05:21.293317 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:21.293261 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11b25c75-d7a8-4ebc-94a8-da4c618eda82-service-ca\") pod \"console-5b887fdbbc-465xm\" (UID: \"11b25c75-d7a8-4ebc-94a8-da4c618eda82\") " pod="openshift-console/console-5b887fdbbc-465xm" Jul 17 21:05:21.295147 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:21.295113 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11b25c75-d7a8-4ebc-94a8-da4c618eda82-console-serving-cert\") pod \"console-5b887fdbbc-465xm\" (UID: \"11b25c75-d7a8-4ebc-94a8-da4c618eda82\") " pod="openshift-console/console-5b887fdbbc-465xm" Jul 17 21:05:21.295241 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:21.295123 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11b25c75-d7a8-4ebc-94a8-da4c618eda82-console-oauth-config\") pod \"console-5b887fdbbc-465xm\" (UID: \"11b25c75-d7a8-4ebc-94a8-da4c618eda82\") " pod="openshift-console/console-5b887fdbbc-465xm" Jul 17 21:05:21.302999 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:21.302979 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7t4s\" (UniqueName: \"kubernetes.io/projected/11b25c75-d7a8-4ebc-94a8-da4c618eda82-kube-api-access-x7t4s\") pod \"console-5b887fdbbc-465xm\" (UID: \"11b25c75-d7a8-4ebc-94a8-da4c618eda82\") " pod="openshift-console/console-5b887fdbbc-465xm" Jul 17 21:05:21.465768 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:21.465693 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b887fdbbc-465xm" Jul 17 21:05:21.594971 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:21.594933 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/27afe524-31d3-4afb-a4fa-fc49198dc4f7-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-xqld2\" (UID: \"27afe524-31d3-4afb-a4fa-fc49198dc4f7\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xqld2" Jul 17 21:05:21.598557 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:21.598530 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/27afe524-31d3-4afb-a4fa-fc49198dc4f7-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-xqld2\" (UID: \"27afe524-31d3-4afb-a4fa-fc49198dc4f7\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xqld2" Jul 17 21:05:21.635279 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:21.635252 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-578cf8bcff-26v2c"] Jul 17 21:05:21.638733 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:05:21.638672 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod512e4197_ce1e_465a_b519_3eaf1a327192.slice/crio-7fd73a5997947a9597396536bceb5b34173cb7be4394e7850f60c9351f7a5198 WatchSource:0}: Error finding container 7fd73a5997947a9597396536bceb5b34173cb7be4394e7850f60c9351f7a5198: Status 404 returned error can't find the container with id 7fd73a5997947a9597396536bceb5b34173cb7be4394e7850f60c9351f7a5198 Jul 17 21:05:21.649746 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:21.649653 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tlgcs"] Jul 17 21:05:21.815581 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:21.815551 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xqld2" Jul 17 21:05:21.874808 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:21.874779 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-fbf477467-r5ctl"] Jul 17 21:05:21.877197 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:21.877169 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b887fdbbc-465xm"] Jul 17 21:05:21.880605 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:05:21.880574 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaf36c2d_10fd_4011_9733_8761868aeb36.slice/crio-9f2b4484cd8df13846a23643e916949ef59a077ca7d2ef014e63dc4b2386cdbf WatchSource:0}: Error finding container 9f2b4484cd8df13846a23643e916949ef59a077ca7d2ef014e63dc4b2386cdbf: Status 404 returned error can't find the container with id 9f2b4484cd8df13846a23643e916949ef59a077ca7d2ef014e63dc4b2386cdbf Jul 17 21:05:21.881206 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:05:21.881170 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11b25c75_d7a8_4ebc_94a8_da4c618eda82.slice/crio-2c0f2931e9d8c3e5c46db471a827684f26bda6792b74b27738312e2a92689b34 WatchSource:0}: Error finding container 2c0f2931e9d8c3e5c46db471a827684f26bda6792b74b27738312e2a92689b34: Status 404 returned error can't find the container with id 2c0f2931e9d8c3e5c46db471a827684f26bda6792b74b27738312e2a92689b34 Jul 17 21:05:21.952002 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:21.951980 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xqld2"] Jul 17 21:05:21.954437 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:05:21.954417 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27afe524_31d3_4afb_a4fa_fc49198dc4f7.slice/crio-e9039439df018e923237c86e0541ecf4e62f2bfe3cd69d7fb8b65d96df92592c WatchSource:0}: Error finding container e9039439df018e923237c86e0541ecf4e62f2bfe3cd69d7fb8b65d96df92592c: Status 404 returned error can't find the container with id e9039439df018e923237c86e0541ecf4e62f2bfe3cd69d7fb8b65d96df92592c Jul 17 21:05:22.206463 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.206325 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qs9sk" event={"ID":"e2d3c44a-60a5-4624-a39f-d73ff62fda74","Type":"ContainerStarted","Data":"e8f460e864a0044aad8015233f5506e91881b1dd7c44a31ceacc4e39c2185734"} Jul 17 21:05:22.207764 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.207731 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tlgcs" event={"ID":"02b0f677-12f3-4a7e-bb15-d10c6257534d","Type":"ContainerStarted","Data":"449f9e0fbc2caadfe583fc3a199db55f9a6b159e36484b0a0feebce67c512654"} Jul 17 21:05:22.210041 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.210006 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-fbf477467-r5ctl" event={"ID":"faf36c2d-10fd-4011-9733-8761868aeb36","Type":"ContainerStarted","Data":"9f2b4484cd8df13846a23643e916949ef59a077ca7d2ef014e63dc4b2386cdbf"} Jul 17 21:05:22.211335 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.211307 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xqld2" event={"ID":"27afe524-31d3-4afb-a4fa-fc49198dc4f7","Type":"ContainerStarted","Data":"e9039439df018e923237c86e0541ecf4e62f2bfe3cd69d7fb8b65d96df92592c"} Jul 17 21:05:22.212972 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.212943 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" event={"ID":"512e4197-ce1e-465a-b519-3eaf1a327192","Type":"ContainerStarted","Data":"56bf78a83d02df3a4f1d2464bf7c9687320295fe4f25c99d9f9807434118ce70"} Jul 17 21:05:22.213127 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.212986 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" event={"ID":"512e4197-ce1e-465a-b519-3eaf1a327192","Type":"ContainerStarted","Data":"7fd73a5997947a9597396536bceb5b34173cb7be4394e7850f60c9351f7a5198"} Jul 17 21:05:22.213203 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.213183 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" Jul 17 21:05:22.219056 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.216919 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b887fdbbc-465xm" event={"ID":"11b25c75-d7a8-4ebc-94a8-da4c618eda82","Type":"ContainerStarted","Data":"553433c71dcaee3f4c5afab88177f149c97a4f16b9348badfacacad023674ebb"} Jul 17 21:05:22.219056 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.217000 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b887fdbbc-465xm" event={"ID":"11b25c75-d7a8-4ebc-94a8-da4c618eda82","Type":"ContainerStarted","Data":"2c0f2931e9d8c3e5c46db471a827684f26bda6792b74b27738312e2a92689b34"} Jul 17 21:05:22.244158 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.242808 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" podStartSLOduration=100.242793254 podStartE2EDuration="1m40.242793254s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:03:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:05:22.242252563 +0000 UTC m=+101.042051918" watchObservedRunningTime="2026-07-17 21:05:22.242793254 +0000 UTC m=+101.042592586" Jul 17 21:05:22.265633 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.265579 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b887fdbbc-465xm" podStartSLOduration=1.265560378 podStartE2EDuration="1.265560378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:05:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:05:22.26339534 +0000 UTC m=+101.063194668" watchObservedRunningTime="2026-07-17 21:05:22.265560378 +0000 UTC m=+101.065359709" Jul 17 21:05:22.382153 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.381095 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 17 21:05:22.389631 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.388275 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.393114 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.393056 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 17 21:05:22.393336 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.393311 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 17 21:05:22.393519 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.393500 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 17 21:05:22.393755 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.393731 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 17 21:05:22.394003 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.393587 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 17 21:05:22.394082 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.394037 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 17 21:05:22.394322 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.394294 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 17 21:05:22.394426 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.394392 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-be279p6bum5rs\"" Jul 17 21:05:22.394645 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.394602 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 17 21:05:22.394799 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.394779 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 17 21:05:22.394985 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.394967 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 17 21:05:22.395286 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.395078 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 17 21:05:22.395286 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.395282 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 17 21:05:22.395842 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.395823 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-kqtlf\"" Jul 17 21:05:22.395934 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.395827 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 17 21:05:22.398538 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.398376 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 17 21:05:22.407186 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.406258 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-config\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.407186 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.406315 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.407186 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.406341 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.407186 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.406365 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.407186 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.406407 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.407186 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.406434 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.407186 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.406456 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.407186 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.406484 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjpj8\" (UniqueName: \"kubernetes.io/projected/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-kube-api-access-tjpj8\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.407186 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.406524 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-web-config\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.407186 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.406562 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.407186 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.406591 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.407186 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.406613 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.407186 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.406638 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.407186 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.406696 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.407186 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.406745 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.407186 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.406773 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.408590 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.406797 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.408590 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.406824 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.408590 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.406852 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.408590 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.406882 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-config-out\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.408590 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.408296 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 17 21:05:22.508883 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.507740 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.508883 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.507790 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.508883 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.507818 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.508883 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.507856 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.508883 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.507884 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.508883 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.507907 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.508883 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.507930 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjpj8\" (UniqueName: \"kubernetes.io/projected/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-kube-api-access-tjpj8\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.508883 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.507968 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-web-config\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.508883 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.508006 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.508883 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.508034 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.508883 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.508060 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.508883 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.508081 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.508883 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.508121 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.508883 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.508168 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.508883 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.508194 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.508883 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.508217 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.508883 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.508242 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.510921 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.508270 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.510921 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.508296 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-config-out\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.510921 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.508327 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-config\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.510921 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.510609 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.511777 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.511433 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-config\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.512700 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.511864 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.514223 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.514198 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.515369 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.514821 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.515455 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.515433 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.516107 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.516086 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.516170 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.516131 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.518197 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.517502 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.518197 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.518131 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-web-config\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.518197 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.518152 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.518673 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.518570 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-config-out\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.518962 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.518924 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.518962 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.518930 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.519194 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.519148 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.519285 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.519233 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.519805 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.519545 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.519805 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.519768 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.520867 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.520842 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.530151 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.530131 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjpj8\" (UniqueName: \"kubernetes.io/projected/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-kube-api-access-tjpj8\") pod \"prometheus-k8s-0\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.702173 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.702134 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:22.900742 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:22.900715 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 17 21:05:22.904144 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:05:22.904098 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3393ce16_67dd_4889_bd2a_8083f0f0fdb9.slice/crio-35670b43420b1be30380fbf42c84942887aee521df609566eadc4faae583c8d4 WatchSource:0}: Error finding container 35670b43420b1be30380fbf42c84942887aee521df609566eadc4faae583c8d4: Status 404 returned error can't find the container with id 35670b43420b1be30380fbf42c84942887aee521df609566eadc4faae583c8d4 Jul 17 21:05:23.225099 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:23.225056 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3393ce16-67dd-4889-bd2a-8083f0f0fdb9","Type":"ContainerStarted","Data":"35670b43420b1be30380fbf42c84942887aee521df609566eadc4faae583c8d4"} Jul 17 21:05:24.605016 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:24.604978 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-87889c954-x4kdg" Jul 17 21:05:26.092263 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:26.092224 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lvjx6" Jul 17 21:05:28.250235 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:28.250190 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qs9sk" event={"ID":"e2d3c44a-60a5-4624-a39f-d73ff62fda74","Type":"ContainerStarted","Data":"2a8043ab3f9e938d8b274a922f6c100bff307d9dc92d8fde7e5972c79e78cca2"} Jul 17 21:05:28.251975 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:28.251951 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tlgcs" event={"ID":"02b0f677-12f3-4a7e-bb15-d10c6257534d","Type":"ContainerStarted","Data":"560c02143493e10acc4a7189856653111f693dd974dd6ac14c7fb82c183d3873"} Jul 17 21:05:28.254088 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:28.254063 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-fbf477467-r5ctl" event={"ID":"faf36c2d-10fd-4011-9733-8761868aeb36","Type":"ContainerStarted","Data":"2291c8bf1ba1b6d3f68ac11e9bc587313517d02427b1735f12efc88734d60023"} Jul 17 21:05:28.257727 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:28.256111 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xqld2" event={"ID":"27afe524-31d3-4afb-a4fa-fc49198dc4f7","Type":"ContainerStarted","Data":"5914aaffade89fdd2b1d319339e45ba9b1a84c3215c847be2201cb5f4a30a426"} Jul 17 21:05:28.257727 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:28.257319 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xqld2" Jul 17 21:05:28.259341 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:28.259320 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3393ce16-67dd-4889-bd2a-8083f0f0fdb9","Type":"ContainerStarted","Data":"7fc3c45bba319637e68a7425f8eabcb8a050e4a018fcc2e88b9e69478802ace7"} Jul 17 21:05:28.262537 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:28.262515 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xqld2" Jul 17 21:05:28.273388 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:28.273326 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-fbf477467-r5ctl" podStartSLOduration=2.120722615 podStartE2EDuration="8.273314025s" totalImagesPullingTime="6.15259141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:05:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:05:28.273045043 +0000 UTC m=+107.072844375" watchObservedRunningTime="2026-07-17 21:05:28.273314025 +0000 UTC m=+107.073113353" Jul 17 21:05:28.291290 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:28.291211 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xqld2" podStartSLOduration=2.2107382859999998 podStartE2EDuration="8.291194166s" totalImagesPullingTime="6.08045588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:05:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:05:28.290813286 +0000 UTC m=+107.090612617" watchObservedRunningTime="2026-07-17 21:05:28.291194166 +0000 UTC m=+107.090993499" Jul 17 21:05:29.264473 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:29.264435 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tlgcs" event={"ID":"02b0f677-12f3-4a7e-bb15-d10c6257534d","Type":"ContainerStarted","Data":"fa9e505bc6c60965f11531bff34963bdae53a9dbbae0f523867683cb6419411c"} Jul 17 21:05:29.264942 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:29.264549 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tlgcs" Jul 17 21:05:29.266292 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:29.266268 2568 generic.go:356] "Generic (PLEG): container finished" podID="3393ce16-67dd-4889-bd2a-8083f0f0fdb9" containerID="7fc3c45bba319637e68a7425f8eabcb8a050e4a018fcc2e88b9e69478802ace7" exitCode=0 Jul 17 21:05:29.266415 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:29.266341 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3393ce16-67dd-4889-bd2a-8083f0f0fdb9","Type":"ContainerDied","Data":"7fc3c45bba319637e68a7425f8eabcb8a050e4a018fcc2e88b9e69478802ace7"} Jul 17 21:05:29.285815 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:29.285775 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tlgcs" podStartSLOduration=66.907334209 podStartE2EDuration="1m13.285760642s" totalImagesPullingTime="6.378426433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:04:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:05:29.285164445 +0000 UTC m=+108.084963774" watchObservedRunningTime="2026-07-17 21:05:29.285760642 +0000 UTC m=+108.085559971" Jul 17 21:05:29.309760 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:29.309720 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qs9sk" podStartSLOduration=35.313035135 podStartE2EDuration="51.309703777s" totalImagesPullingTime="15.996668642s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:04:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:05:29.308330462 +0000 UTC m=+108.108129788" watchObservedRunningTime="2026-07-17 21:05:29.309703777 +0000 UTC m=+108.109503105" Jul 17 21:05:29.327936 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:29.327910 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-578cf8bcff-26v2c"] Jul 17 21:05:31.466126 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:31.466092 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b887fdbbc-465xm" Jul 17 21:05:31.466603 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:31.466147 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b887fdbbc-465xm" Jul 17 21:05:31.471310 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:31.471285 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b887fdbbc-465xm" Jul 17 21:05:32.283962 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:32.283930 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3393ce16-67dd-4889-bd2a-8083f0f0fdb9","Type":"ContainerStarted","Data":"60c456a6cdb1d5697d7984f2c0e0784d9a846088e444f21432c294f00105783b"} Jul 17 21:05:32.288263 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:32.288241 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b887fdbbc-465xm" Jul 17 21:05:32.344705 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:32.343963 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85f78f69-vqp4v"] Jul 17 21:05:33.292056 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:33.292017 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3393ce16-67dd-4889-bd2a-8083f0f0fdb9","Type":"ContainerStarted","Data":"75de274cb2f773bedcffe5b0c683c700c36aeaae9f2f71e119bea8c1e5ef8fdc"} Jul 17 21:05:34.299092 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:34.299067 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3393ce16-67dd-4889-bd2a-8083f0f0fdb9","Type":"ContainerStarted","Data":"30a527f35127ab4261c68ac950f66b96e7165ca6b65f561126ec2dbf9345ef7d"} Jul 17 21:05:34.299394 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:34.299130 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3393ce16-67dd-4889-bd2a-8083f0f0fdb9","Type":"ContainerStarted","Data":"500dadb158c44cf9026a82431c937fe148afe9d4f287f2f6bff3681af00599b2"} Jul 17 21:05:34.299394 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:34.299158 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3393ce16-67dd-4889-bd2a-8083f0f0fdb9","Type":"ContainerStarted","Data":"6c922549b9639495f542a34a12fbfc126a051df53f94c47049b1e98b9711c3cf"} Jul 17 21:05:34.299394 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:34.299185 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3393ce16-67dd-4889-bd2a-8083f0f0fdb9","Type":"ContainerStarted","Data":"f5476f03e7376c8d25533bf5babf8166130e47480888946dd0f3ecbc40fe9875"} Jul 17 21:05:34.338090 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:34.338047 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.521126292 podStartE2EDuration="12.33802797s" totalImagesPullingTime="9.779563896s" totalInitContainerRuntime="37.337782ms" isStatefulPod=false podCreationTimestamp="2026-07-17 21:05:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:05:34.335979641 +0000 UTC m=+113.135778970" watchObservedRunningTime="2026-07-17 21:05:34.33802797 +0000 UTC m=+113.137827300" Jul 17 21:05:36.168300 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:36.168257 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6448cb7687-mtqq6"] Jul 17 21:05:36.171512 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:36.171486 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6448cb7687-mtqq6" Jul 17 21:05:36.183748 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:36.183723 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6448cb7687-mtqq6"] Jul 17 21:05:36.241985 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:36.241952 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d60eae0-81fb-4d48-9940-aa329a18cce0-oauth-serving-cert\") pod \"console-6448cb7687-mtqq6\" (UID: \"8d60eae0-81fb-4d48-9940-aa329a18cce0\") " pod="openshift-console/console-6448cb7687-mtqq6" Jul 17 21:05:36.242151 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:36.241996 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkzqb\" (UniqueName: \"kubernetes.io/projected/8d60eae0-81fb-4d48-9940-aa329a18cce0-kube-api-access-dkzqb\") pod \"console-6448cb7687-mtqq6\" (UID: \"8d60eae0-81fb-4d48-9940-aa329a18cce0\") " pod="openshift-console/console-6448cb7687-mtqq6" Jul 17 21:05:36.242151 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:36.242018 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d60eae0-81fb-4d48-9940-aa329a18cce0-console-config\") pod \"console-6448cb7687-mtqq6\" (UID: \"8d60eae0-81fb-4d48-9940-aa329a18cce0\") " pod="openshift-console/console-6448cb7687-mtqq6" Jul 17 21:05:36.242151 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:36.242085 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d60eae0-81fb-4d48-9940-aa329a18cce0-console-serving-cert\") pod \"console-6448cb7687-mtqq6\" (UID: \"8d60eae0-81fb-4d48-9940-aa329a18cce0\") " pod="openshift-console/console-6448cb7687-mtqq6" Jul 17 21:05:36.242248 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:36.242190 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d60eae0-81fb-4d48-9940-aa329a18cce0-trusted-ca-bundle\") pod \"console-6448cb7687-mtqq6\" (UID: \"8d60eae0-81fb-4d48-9940-aa329a18cce0\") " pod="openshift-console/console-6448cb7687-mtqq6" Jul 17 21:05:36.242248 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:36.242216 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d60eae0-81fb-4d48-9940-aa329a18cce0-service-ca\") pod \"console-6448cb7687-mtqq6\" (UID: \"8d60eae0-81fb-4d48-9940-aa329a18cce0\") " pod="openshift-console/console-6448cb7687-mtqq6" Jul 17 21:05:36.242248 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:36.242239 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d60eae0-81fb-4d48-9940-aa329a18cce0-console-oauth-config\") pod \"console-6448cb7687-mtqq6\" (UID: \"8d60eae0-81fb-4d48-9940-aa329a18cce0\") " pod="openshift-console/console-6448cb7687-mtqq6" Jul 17 21:05:36.342690 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:36.342659 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d60eae0-81fb-4d48-9940-aa329a18cce0-console-oauth-config\") pod \"console-6448cb7687-mtqq6\" (UID: \"8d60eae0-81fb-4d48-9940-aa329a18cce0\") " pod="openshift-console/console-6448cb7687-mtqq6" Jul 17 21:05:36.342864 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:36.342732 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d60eae0-81fb-4d48-9940-aa329a18cce0-oauth-serving-cert\") pod \"console-6448cb7687-mtqq6\" (UID: \"8d60eae0-81fb-4d48-9940-aa329a18cce0\") " pod="openshift-console/console-6448cb7687-mtqq6" Jul 17 21:05:36.342864 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:36.342751 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkzqb\" (UniqueName: \"kubernetes.io/projected/8d60eae0-81fb-4d48-9940-aa329a18cce0-kube-api-access-dkzqb\") pod \"console-6448cb7687-mtqq6\" (UID: \"8d60eae0-81fb-4d48-9940-aa329a18cce0\") " pod="openshift-console/console-6448cb7687-mtqq6" Jul 17 21:05:36.342864 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:36.342770 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d60eae0-81fb-4d48-9940-aa329a18cce0-console-config\") pod \"console-6448cb7687-mtqq6\" (UID: \"8d60eae0-81fb-4d48-9940-aa329a18cce0\") " pod="openshift-console/console-6448cb7687-mtqq6" Jul 17 21:05:36.342864 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:36.342794 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d60eae0-81fb-4d48-9940-aa329a18cce0-console-serving-cert\") pod \"console-6448cb7687-mtqq6\" (UID: \"8d60eae0-81fb-4d48-9940-aa329a18cce0\") " pod="openshift-console/console-6448cb7687-mtqq6" Jul 17 21:05:36.343079 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:36.342894 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d60eae0-81fb-4d48-9940-aa329a18cce0-trusted-ca-bundle\") pod \"console-6448cb7687-mtqq6\" (UID: \"8d60eae0-81fb-4d48-9940-aa329a18cce0\") " pod="openshift-console/console-6448cb7687-mtqq6" Jul 17 21:05:36.343079 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:36.342929 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d60eae0-81fb-4d48-9940-aa329a18cce0-service-ca\") pod \"console-6448cb7687-mtqq6\" (UID: \"8d60eae0-81fb-4d48-9940-aa329a18cce0\") " pod="openshift-console/console-6448cb7687-mtqq6" Jul 17 21:05:36.343636 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:36.343609 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d60eae0-81fb-4d48-9940-aa329a18cce0-oauth-serving-cert\") pod \"console-6448cb7687-mtqq6\" (UID: \"8d60eae0-81fb-4d48-9940-aa329a18cce0\") " pod="openshift-console/console-6448cb7687-mtqq6" Jul 17 21:05:36.343768 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:36.343650 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d60eae0-81fb-4d48-9940-aa329a18cce0-console-config\") pod \"console-6448cb7687-mtqq6\" (UID: \"8d60eae0-81fb-4d48-9940-aa329a18cce0\") " pod="openshift-console/console-6448cb7687-mtqq6" Jul 17 21:05:36.343768 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:36.343714 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d60eae0-81fb-4d48-9940-aa329a18cce0-service-ca\") pod \"console-6448cb7687-mtqq6\" (UID: \"8d60eae0-81fb-4d48-9940-aa329a18cce0\") " pod="openshift-console/console-6448cb7687-mtqq6" Jul 17 21:05:36.343939 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:36.343915 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d60eae0-81fb-4d48-9940-aa329a18cce0-trusted-ca-bundle\") pod \"console-6448cb7687-mtqq6\" (UID: \"8d60eae0-81fb-4d48-9940-aa329a18cce0\") " pod="openshift-console/console-6448cb7687-mtqq6" Jul 17 21:05:36.345155 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:36.345124 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d60eae0-81fb-4d48-9940-aa329a18cce0-console-oauth-config\") pod \"console-6448cb7687-mtqq6\" (UID: \"8d60eae0-81fb-4d48-9940-aa329a18cce0\") " pod="openshift-console/console-6448cb7687-mtqq6" Jul 17 21:05:36.345368 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:36.345347 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d60eae0-81fb-4d48-9940-aa329a18cce0-console-serving-cert\") pod \"console-6448cb7687-mtqq6\" (UID: \"8d60eae0-81fb-4d48-9940-aa329a18cce0\") " pod="openshift-console/console-6448cb7687-mtqq6" Jul 17 21:05:36.353113 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:36.353093 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkzqb\" (UniqueName: \"kubernetes.io/projected/8d60eae0-81fb-4d48-9940-aa329a18cce0-kube-api-access-dkzqb\") pod \"console-6448cb7687-mtqq6\" (UID: \"8d60eae0-81fb-4d48-9940-aa329a18cce0\") " pod="openshift-console/console-6448cb7687-mtqq6" Jul 17 21:05:36.480226 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:36.480131 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6448cb7687-mtqq6" Jul 17 21:05:36.630637 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:36.630355 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6448cb7687-mtqq6"] Jul 17 21:05:36.634554 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:05:36.634523 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d60eae0_81fb_4d48_9940_aa329a18cce0.slice/crio-29d681ce283fef889cb5a08d9ab00444112dff7283242054ce2f5f6ca410f3ea WatchSource:0}: Error finding container 29d681ce283fef889cb5a08d9ab00444112dff7283242054ce2f5f6ca410f3ea: Status 404 returned error can't find the container with id 29d681ce283fef889cb5a08d9ab00444112dff7283242054ce2f5f6ca410f3ea Jul 17 21:05:37.312739 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:37.312701 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6448cb7687-mtqq6" event={"ID":"8d60eae0-81fb-4d48-9940-aa329a18cce0","Type":"ContainerStarted","Data":"3a21c1dd121fd18b130d7c4ec38db08f0cf6fd981b2c4e9894d7eee279fd34b2"} Jul 17 21:05:37.313112 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:37.312752 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6448cb7687-mtqq6" event={"ID":"8d60eae0-81fb-4d48-9940-aa329a18cce0","Type":"ContainerStarted","Data":"29d681ce283fef889cb5a08d9ab00444112dff7283242054ce2f5f6ca410f3ea"} Jul 17 21:05:37.332062 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:37.332009 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6448cb7687-mtqq6" podStartSLOduration=1.331992552 podStartE2EDuration="1.331992552s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:05:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:05:37.331314709 +0000 UTC m=+116.131114074" watchObservedRunningTime="2026-07-17 21:05:37.331992552 +0000 UTC m=+116.131791880" Jul 17 21:05:37.703071 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:37.702989 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:05:39.274206 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:39.274172 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tlgcs" Jul 17 21:05:39.333996 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:39.333968 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" Jul 17 21:05:40.902177 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:40.902143 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-fbf477467-r5ctl" Jul 17 21:05:40.902554 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:40.902212 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-fbf477467-r5ctl" Jul 17 21:05:42.769023 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:42.768994 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7nb8k_a00219cb-5630-43c0-a6cc-37d9dcd8a73f/serve-healthcheck-canary/0.log" Jul 17 21:05:46.130426 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:46.130384 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-87889c954-x4kdg" podUID="5e124264-eb28-437d-8380-e449b34cfbaf" containerName="console" containerID="cri-o://52b1f33e29e1a67f64498663bd3e9578685c40a98f6c647e5ecf94538919a056" gracePeriod=15 Jul 17 21:05:46.348741 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:46.348711 2568 generic.go:356] "Generic (PLEG): container finished" podID="5e124264-eb28-437d-8380-e449b34cfbaf" containerID="52b1f33e29e1a67f64498663bd3e9578685c40a98f6c647e5ecf94538919a056" exitCode=0 Jul 17 21:05:46.348882 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:46.348787 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-87889c954-x4kdg" event={"ID":"5e124264-eb28-437d-8380-e449b34cfbaf","Type":"ContainerDied","Data":"52b1f33e29e1a67f64498663bd3e9578685c40a98f6c647e5ecf94538919a056"} Jul 17 21:05:46.370920 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:46.370898 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-87889c954-x4kdg" Jul 17 21:05:46.481121 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:46.481053 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6448cb7687-mtqq6" Jul 17 21:05:46.481121 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:46.481116 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6448cb7687-mtqq6" Jul 17 21:05:46.485851 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:46.485831 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6448cb7687-mtqq6" Jul 17 21:05:46.537155 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:46.537136 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tcg7c\" (UniqueName: \"kubernetes.io/projected/5e124264-eb28-437d-8380-e449b34cfbaf-kube-api-access-tcg7c\") pod \"5e124264-eb28-437d-8380-e449b34cfbaf\" (UID: \"5e124264-eb28-437d-8380-e449b34cfbaf\") " Jul 17 21:05:46.537274 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:46.537162 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e124264-eb28-437d-8380-e449b34cfbaf-console-config\") pod \"5e124264-eb28-437d-8380-e449b34cfbaf\" (UID: \"5e124264-eb28-437d-8380-e449b34cfbaf\") " Jul 17 21:05:46.537274 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:46.537178 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e124264-eb28-437d-8380-e449b34cfbaf-trusted-ca-bundle\") pod \"5e124264-eb28-437d-8380-e449b34cfbaf\" (UID: \"5e124264-eb28-437d-8380-e449b34cfbaf\") " Jul 17 21:05:46.537274 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:46.537198 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e124264-eb28-437d-8380-e449b34cfbaf-oauth-serving-cert\") pod \"5e124264-eb28-437d-8380-e449b34cfbaf\" (UID: \"5e124264-eb28-437d-8380-e449b34cfbaf\") " Jul 17 21:05:46.537274 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:46.537253 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e124264-eb28-437d-8380-e449b34cfbaf-console-oauth-config\") pod \"5e124264-eb28-437d-8380-e449b34cfbaf\" (UID: \"5e124264-eb28-437d-8380-e449b34cfbaf\") " Jul 17 21:05:46.537478 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:46.537327 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e124264-eb28-437d-8380-e449b34cfbaf-service-ca\") pod \"5e124264-eb28-437d-8380-e449b34cfbaf\" (UID: \"5e124264-eb28-437d-8380-e449b34cfbaf\") " Jul 17 21:05:46.537478 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:46.537348 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e124264-eb28-437d-8380-e449b34cfbaf-console-serving-cert\") pod \"5e124264-eb28-437d-8380-e449b34cfbaf\" (UID: \"5e124264-eb28-437d-8380-e449b34cfbaf\") " Jul 17 21:05:46.537704 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:46.537630 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e124264-eb28-437d-8380-e449b34cfbaf-console-config" (OuterVolumeSpecName: "console-config") pod "5e124264-eb28-437d-8380-e449b34cfbaf" (UID: "5e124264-eb28-437d-8380-e449b34cfbaf"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:05:46.537820 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:46.537713 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e124264-eb28-437d-8380-e449b34cfbaf-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5e124264-eb28-437d-8380-e449b34cfbaf" (UID: "5e124264-eb28-437d-8380-e449b34cfbaf"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:05:46.537820 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:46.537724 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e124264-eb28-437d-8380-e449b34cfbaf-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5e124264-eb28-437d-8380-e449b34cfbaf" (UID: "5e124264-eb28-437d-8380-e449b34cfbaf"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:05:46.537820 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:46.537765 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e124264-eb28-437d-8380-e449b34cfbaf-service-ca" (OuterVolumeSpecName: "service-ca") pod "5e124264-eb28-437d-8380-e449b34cfbaf" (UID: "5e124264-eb28-437d-8380-e449b34cfbaf"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:05:46.539428 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:46.539401 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e124264-eb28-437d-8380-e449b34cfbaf-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5e124264-eb28-437d-8380-e449b34cfbaf" (UID: "5e124264-eb28-437d-8380-e449b34cfbaf"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 21:05:46.539428 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:46.539415 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e124264-eb28-437d-8380-e449b34cfbaf-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5e124264-eb28-437d-8380-e449b34cfbaf" (UID: "5e124264-eb28-437d-8380-e449b34cfbaf"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 21:05:46.539564 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:46.539470 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e124264-eb28-437d-8380-e449b34cfbaf-kube-api-access-tcg7c" (OuterVolumeSpecName: "kube-api-access-tcg7c") pod "5e124264-eb28-437d-8380-e449b34cfbaf" (UID: "5e124264-eb28-437d-8380-e449b34cfbaf"). InnerVolumeSpecName "kube-api-access-tcg7c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:05:46.638912 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:46.638884 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcg7c\" (UniqueName: \"kubernetes.io/projected/5e124264-eb28-437d-8380-e449b34cfbaf-kube-api-access-tcg7c\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:05:46.639018 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:46.638912 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e124264-eb28-437d-8380-e449b34cfbaf-console-config\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:05:46.639018 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:46.638930 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e124264-eb28-437d-8380-e449b34cfbaf-trusted-ca-bundle\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:05:46.639018 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:46.638944 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e124264-eb28-437d-8380-e449b34cfbaf-oauth-serving-cert\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:05:46.639018 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:46.638957 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e124264-eb28-437d-8380-e449b34cfbaf-console-oauth-config\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:05:46.639018 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:46.638970 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e124264-eb28-437d-8380-e449b34cfbaf-service-ca\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:05:46.639018 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:46.638983 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e124264-eb28-437d-8380-e449b34cfbaf-console-serving-cert\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:05:47.359564 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:47.359528 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-87889c954-x4kdg" Jul 17 21:05:47.359564 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:47.359559 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-87889c954-x4kdg" event={"ID":"5e124264-eb28-437d-8380-e449b34cfbaf","Type":"ContainerDied","Data":"6a0ab982fd52ff7d656500e4a53bc4ca2a2ae1191672d2e294049715b0a3ffd1"} Jul 17 21:05:47.360122 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:47.359615 2568 scope.go:117] "RemoveContainer" containerID="52b1f33e29e1a67f64498663bd3e9578685c40a98f6c647e5ecf94538919a056" Jul 17 21:05:47.364138 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:47.364116 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6448cb7687-mtqq6" Jul 17 21:05:47.403510 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:47.403458 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-87889c954-x4kdg"] Jul 17 21:05:47.413989 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:47.413960 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-87889c954-x4kdg"] Jul 17 21:05:47.421204 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:47.421169 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b887fdbbc-465xm"] Jul 17 21:05:47.735734 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:47.735629 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e124264-eb28-437d-8380-e449b34cfbaf" path="/var/lib/kubelet/pods/5e124264-eb28-437d-8380-e449b34cfbaf/volumes" Jul 17 21:05:51.882726 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:51.882667 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff4b059f-6fba-47d3-b03e-e977255d54d3-metrics-certs\") pod \"network-metrics-daemon-6klsf\" (UID: \"ff4b059f-6fba-47d3-b03e-e977255d54d3\") " pod="openshift-multus/network-metrics-daemon-6klsf" Jul 17 21:05:51.885072 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:51.885047 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff4b059f-6fba-47d3-b03e-e977255d54d3-metrics-certs\") pod \"network-metrics-daemon-6klsf\" (UID: \"ff4b059f-6fba-47d3-b03e-e977255d54d3\") " pod="openshift-multus/network-metrics-daemon-6klsf" Jul 17 21:05:52.153501 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:52.153391 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pkggp\"" Jul 17 21:05:52.161471 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:52.161449 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6klsf" Jul 17 21:05:52.411822 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:52.411796 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6klsf"] Jul 17 21:05:52.414168 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:05:52.414139 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff4b059f_6fba_47d3_b03e_e977255d54d3.slice/crio-362168c548dc835034e10c553c89ee6eb969bd239375dc3eda3a6d72b425ef4c WatchSource:0}: Error finding container 362168c548dc835034e10c553c89ee6eb969bd239375dc3eda3a6d72b425ef4c: Status 404 returned error can't find the container with id 362168c548dc835034e10c553c89ee6eb969bd239375dc3eda3a6d72b425ef4c Jul 17 21:05:53.388171 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:53.388131 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6klsf" event={"ID":"ff4b059f-6fba-47d3-b03e-e977255d54d3","Type":"ContainerStarted","Data":"362168c548dc835034e10c553c89ee6eb969bd239375dc3eda3a6d72b425ef4c"} Jul 17 21:05:54.348196 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:54.348142 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" podUID="512e4197-ce1e-465a-b519-3eaf1a327192" containerName="registry" containerID="cri-o://56bf78a83d02df3a4f1d2464bf7c9687320295fe4f25c99d9f9807434118ce70" gracePeriod=30 Jul 17 21:05:54.394378 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:54.394342 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6klsf" event={"ID":"ff4b059f-6fba-47d3-b03e-e977255d54d3","Type":"ContainerStarted","Data":"1223f371c1b4b97e5b9fb4d3b30f9b0f36c6d222f26695ca3c93820005fe0e49"} Jul 17 21:05:54.394756 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:54.394406 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6klsf" event={"ID":"ff4b059f-6fba-47d3-b03e-e977255d54d3","Type":"ContainerStarted","Data":"505a8742802b79fc97acf1f252a863aac9a39552291c840f219e2b071491fdde"} Jul 17 21:05:54.411377 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:54.411333 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6klsf" podStartSLOduration=131.804204428 podStartE2EDuration="2m13.411317915s" totalImagesPullingTime="1.607113487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:03:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:05:54.410780053 +0000 UTC m=+133.210579464" watchObservedRunningTime="2026-07-17 21:05:54.411317915 +0000 UTC m=+133.211117245" Jul 17 21:05:54.651198 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:54.651172 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" Jul 17 21:05:54.809158 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:54.809123 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/512e4197-ce1e-465a-b519-3eaf1a327192-trusted-ca\") pod \"512e4197-ce1e-465a-b519-3eaf1a327192\" (UID: \"512e4197-ce1e-465a-b519-3eaf1a327192\") " Jul 17 21:05:54.809338 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:54.809165 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/512e4197-ce1e-465a-b519-3eaf1a327192-registry-certificates\") pod \"512e4197-ce1e-465a-b519-3eaf1a327192\" (UID: \"512e4197-ce1e-465a-b519-3eaf1a327192\") " Jul 17 21:05:54.809338 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:54.809197 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cx7x2\" (UniqueName: \"kubernetes.io/projected/512e4197-ce1e-465a-b519-3eaf1a327192-kube-api-access-cx7x2\") pod \"512e4197-ce1e-465a-b519-3eaf1a327192\" (UID: \"512e4197-ce1e-465a-b519-3eaf1a327192\") " Jul 17 21:05:54.809338 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:54.809304 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/512e4197-ce1e-465a-b519-3eaf1a327192-ca-trust-extracted\") pod \"512e4197-ce1e-465a-b519-3eaf1a327192\" (UID: \"512e4197-ce1e-465a-b519-3eaf1a327192\") " Jul 17 21:05:54.809504 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:54.809374 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/512e4197-ce1e-465a-b519-3eaf1a327192-image-registry-private-configuration\") pod \"512e4197-ce1e-465a-b519-3eaf1a327192\" (UID: \"512e4197-ce1e-465a-b519-3eaf1a327192\") " Jul 17 21:05:54.809504 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:54.809418 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/512e4197-ce1e-465a-b519-3eaf1a327192-registry-tls\") pod \"512e4197-ce1e-465a-b519-3eaf1a327192\" (UID: \"512e4197-ce1e-465a-b519-3eaf1a327192\") " Jul 17 21:05:54.809504 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:54.809463 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/512e4197-ce1e-465a-b519-3eaf1a327192-bound-sa-token\") pod \"512e4197-ce1e-465a-b519-3eaf1a327192\" (UID: \"512e4197-ce1e-465a-b519-3eaf1a327192\") " Jul 17 21:05:54.809654 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:54.809515 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/512e4197-ce1e-465a-b519-3eaf1a327192-installation-pull-secrets\") pod \"512e4197-ce1e-465a-b519-3eaf1a327192\" (UID: \"512e4197-ce1e-465a-b519-3eaf1a327192\") " Jul 17 21:05:54.809654 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:54.809558 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/512e4197-ce1e-465a-b519-3eaf1a327192-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "512e4197-ce1e-465a-b519-3eaf1a327192" (UID: "512e4197-ce1e-465a-b519-3eaf1a327192"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:05:54.809654 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:54.809565 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/512e4197-ce1e-465a-b519-3eaf1a327192-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "512e4197-ce1e-465a-b519-3eaf1a327192" (UID: "512e4197-ce1e-465a-b519-3eaf1a327192"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:05:54.809865 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:54.809808 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/512e4197-ce1e-465a-b519-3eaf1a327192-trusted-ca\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:05:54.809865 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:54.809828 2568 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/512e4197-ce1e-465a-b519-3eaf1a327192-registry-certificates\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:05:54.812252 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:54.812203 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/512e4197-ce1e-465a-b519-3eaf1a327192-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "512e4197-ce1e-465a-b519-3eaf1a327192" (UID: "512e4197-ce1e-465a-b519-3eaf1a327192"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:05:54.812398 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:54.812341 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/512e4197-ce1e-465a-b519-3eaf1a327192-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "512e4197-ce1e-465a-b519-3eaf1a327192" (UID: "512e4197-ce1e-465a-b519-3eaf1a327192"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:05:54.812482 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:54.812394 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/512e4197-ce1e-465a-b519-3eaf1a327192-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "512e4197-ce1e-465a-b519-3eaf1a327192" (UID: "512e4197-ce1e-465a-b519-3eaf1a327192"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 21:05:54.812538 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:54.812472 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/512e4197-ce1e-465a-b519-3eaf1a327192-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "512e4197-ce1e-465a-b519-3eaf1a327192" (UID: "512e4197-ce1e-465a-b519-3eaf1a327192"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 21:05:54.812763 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:54.812744 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/512e4197-ce1e-465a-b519-3eaf1a327192-kube-api-access-cx7x2" (OuterVolumeSpecName: "kube-api-access-cx7x2") pod "512e4197-ce1e-465a-b519-3eaf1a327192" (UID: "512e4197-ce1e-465a-b519-3eaf1a327192"). InnerVolumeSpecName "kube-api-access-cx7x2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:05:54.819065 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:54.819036 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/512e4197-ce1e-465a-b519-3eaf1a327192-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "512e4197-ce1e-465a-b519-3eaf1a327192" (UID: "512e4197-ce1e-465a-b519-3eaf1a327192"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:05:54.911051 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:54.910977 2568 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/512e4197-ce1e-465a-b519-3eaf1a327192-bound-sa-token\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:05:54.911051 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:54.911006 2568 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/512e4197-ce1e-465a-b519-3eaf1a327192-installation-pull-secrets\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:05:54.911051 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:54.911015 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cx7x2\" (UniqueName: \"kubernetes.io/projected/512e4197-ce1e-465a-b519-3eaf1a327192-kube-api-access-cx7x2\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:05:54.911051 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:54.911026 2568 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/512e4197-ce1e-465a-b519-3eaf1a327192-ca-trust-extracted\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:05:54.911051 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:54.911038 2568 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/512e4197-ce1e-465a-b519-3eaf1a327192-image-registry-private-configuration\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:05:54.911051 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:54.911047 2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/512e4197-ce1e-465a-b519-3eaf1a327192-registry-tls\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:05:55.405703 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:55.402405 2568 generic.go:356] "Generic (PLEG): container finished" podID="512e4197-ce1e-465a-b519-3eaf1a327192" containerID="56bf78a83d02df3a4f1d2464bf7c9687320295fe4f25c99d9f9807434118ce70" exitCode=0 Jul 17 21:05:55.405703 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:55.403203 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" Jul 17 21:05:55.406649 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:55.406297 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" event={"ID":"512e4197-ce1e-465a-b519-3eaf1a327192","Type":"ContainerDied","Data":"56bf78a83d02df3a4f1d2464bf7c9687320295fe4f25c99d9f9807434118ce70"} Jul 17 21:05:55.406649 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:55.406368 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-578cf8bcff-26v2c" event={"ID":"512e4197-ce1e-465a-b519-3eaf1a327192","Type":"ContainerDied","Data":"7fd73a5997947a9597396536bceb5b34173cb7be4394e7850f60c9351f7a5198"} Jul 17 21:05:55.406649 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:55.406400 2568 scope.go:117] "RemoveContainer" containerID="56bf78a83d02df3a4f1d2464bf7c9687320295fe4f25c99d9f9807434118ce70" Jul 17 21:05:55.419648 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:55.419627 2568 scope.go:117] "RemoveContainer" containerID="56bf78a83d02df3a4f1d2464bf7c9687320295fe4f25c99d9f9807434118ce70" Jul 17 21:05:55.419958 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:05:55.419936 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56bf78a83d02df3a4f1d2464bf7c9687320295fe4f25c99d9f9807434118ce70\": container with ID starting with 56bf78a83d02df3a4f1d2464bf7c9687320295fe4f25c99d9f9807434118ce70 not found: ID does not exist" containerID="56bf78a83d02df3a4f1d2464bf7c9687320295fe4f25c99d9f9807434118ce70" Jul 17 21:05:55.420033 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:55.419967 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56bf78a83d02df3a4f1d2464bf7c9687320295fe4f25c99d9f9807434118ce70"} err="failed to get container status \"56bf78a83d02df3a4f1d2464bf7c9687320295fe4f25c99d9f9807434118ce70\": rpc error: code = NotFound desc = could not find container \"56bf78a83d02df3a4f1d2464bf7c9687320295fe4f25c99d9f9807434118ce70\": container with ID starting with 56bf78a83d02df3a4f1d2464bf7c9687320295fe4f25c99d9f9807434118ce70 not found: ID does not exist" Jul 17 21:05:55.429731 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:55.429705 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-578cf8bcff-26v2c"] Jul 17 21:05:55.433719 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:55.433695 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-578cf8bcff-26v2c"] Jul 17 21:05:55.736609 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:55.736525 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="512e4197-ce1e-465a-b519-3eaf1a327192" path="/var/lib/kubelet/pods/512e4197-ce1e-465a-b519-3eaf1a327192/volumes" Jul 17 21:05:57.373364 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:57.373312 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-85f78f69-vqp4v" podUID="ad8ee5ec-c65d-4cb8-995c-73b4c632ab04" containerName="console" containerID="cri-o://046ea51b76a7daddfc4e9b5861a7dc2fd2d61956160d3180e6d4e249745fee56" gracePeriod=15 Jul 17 21:05:57.617131 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:57.617107 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85f78f69-vqp4v" Jul 17 21:05:57.737491 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:57.737415 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad8ee5ec-c65d-4cb8-995c-73b4c632ab04-oauth-serving-cert\") pod \"ad8ee5ec-c65d-4cb8-995c-73b4c632ab04\" (UID: \"ad8ee5ec-c65d-4cb8-995c-73b4c632ab04\") " Jul 17 21:05:57.737491 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:57.737470 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad8ee5ec-c65d-4cb8-995c-73b4c632ab04-console-oauth-config\") pod \"ad8ee5ec-c65d-4cb8-995c-73b4c632ab04\" (UID: \"ad8ee5ec-c65d-4cb8-995c-73b4c632ab04\") " Jul 17 21:05:57.737739 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:57.737500 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad8ee5ec-c65d-4cb8-995c-73b4c632ab04-console-config\") pod \"ad8ee5ec-c65d-4cb8-995c-73b4c632ab04\" (UID: \"ad8ee5ec-c65d-4cb8-995c-73b4c632ab04\") " Jul 17 21:05:57.737739 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:57.737550 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad8ee5ec-c65d-4cb8-995c-73b4c632ab04-service-ca\") pod \"ad8ee5ec-c65d-4cb8-995c-73b4c632ab04\" (UID: \"ad8ee5ec-c65d-4cb8-995c-73b4c632ab04\") " Jul 17 21:05:57.737739 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:57.737578 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad8ee5ec-c65d-4cb8-995c-73b4c632ab04-console-serving-cert\") pod \"ad8ee5ec-c65d-4cb8-995c-73b4c632ab04\" (UID: \"ad8ee5ec-c65d-4cb8-995c-73b4c632ab04\") " Jul 17 21:05:57.737739 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:57.737613 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xb8b8\" (UniqueName: \"kubernetes.io/projected/ad8ee5ec-c65d-4cb8-995c-73b4c632ab04-kube-api-access-xb8b8\") pod \"ad8ee5ec-c65d-4cb8-995c-73b4c632ab04\" (UID: \"ad8ee5ec-c65d-4cb8-995c-73b4c632ab04\") " Jul 17 21:05:57.737946 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:57.737867 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad8ee5ec-c65d-4cb8-995c-73b4c632ab04-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ad8ee5ec-c65d-4cb8-995c-73b4c632ab04" (UID: "ad8ee5ec-c65d-4cb8-995c-73b4c632ab04"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:05:57.737946 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:57.737914 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad8ee5ec-c65d-4cb8-995c-73b4c632ab04-service-ca" (OuterVolumeSpecName: "service-ca") pod "ad8ee5ec-c65d-4cb8-995c-73b4c632ab04" (UID: "ad8ee5ec-c65d-4cb8-995c-73b4c632ab04"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:05:57.737946 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:57.737922 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad8ee5ec-c65d-4cb8-995c-73b4c632ab04-console-config" (OuterVolumeSpecName: "console-config") pod "ad8ee5ec-c65d-4cb8-995c-73b4c632ab04" (UID: "ad8ee5ec-c65d-4cb8-995c-73b4c632ab04"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:05:57.739645 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:57.739622 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad8ee5ec-c65d-4cb8-995c-73b4c632ab04-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ad8ee5ec-c65d-4cb8-995c-73b4c632ab04" (UID: "ad8ee5ec-c65d-4cb8-995c-73b4c632ab04"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 21:05:57.739748 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:57.739713 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad8ee5ec-c65d-4cb8-995c-73b4c632ab04-kube-api-access-xb8b8" (OuterVolumeSpecName: "kube-api-access-xb8b8") pod "ad8ee5ec-c65d-4cb8-995c-73b4c632ab04" (UID: "ad8ee5ec-c65d-4cb8-995c-73b4c632ab04"). InnerVolumeSpecName "kube-api-access-xb8b8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:05:57.739748 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:57.739731 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad8ee5ec-c65d-4cb8-995c-73b4c632ab04-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ad8ee5ec-c65d-4cb8-995c-73b4c632ab04" (UID: "ad8ee5ec-c65d-4cb8-995c-73b4c632ab04"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 21:05:57.839235 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:57.839198 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad8ee5ec-c65d-4cb8-995c-73b4c632ab04-console-config\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:05:57.839235 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:57.839229 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad8ee5ec-c65d-4cb8-995c-73b4c632ab04-service-ca\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:05:57.839235 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:57.839239 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad8ee5ec-c65d-4cb8-995c-73b4c632ab04-console-serving-cert\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:05:57.839465 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:57.839249 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xb8b8\" (UniqueName: \"kubernetes.io/projected/ad8ee5ec-c65d-4cb8-995c-73b4c632ab04-kube-api-access-xb8b8\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:05:57.839465 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:57.839264 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad8ee5ec-c65d-4cb8-995c-73b4c632ab04-oauth-serving-cert\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:05:57.839465 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:57.839278 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad8ee5ec-c65d-4cb8-995c-73b4c632ab04-console-oauth-config\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:05:58.418445 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:58.418411 2568 generic.go:356] "Generic (PLEG): container finished" podID="ad8ee5ec-c65d-4cb8-995c-73b4c632ab04" containerID="046ea51b76a7daddfc4e9b5861a7dc2fd2d61956160d3180e6d4e249745fee56" exitCode=0 Jul 17 21:05:58.418904 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:58.418460 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85f78f69-vqp4v" Jul 17 21:05:58.418904 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:58.418502 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85f78f69-vqp4v" event={"ID":"ad8ee5ec-c65d-4cb8-995c-73b4c632ab04","Type":"ContainerDied","Data":"046ea51b76a7daddfc4e9b5861a7dc2fd2d61956160d3180e6d4e249745fee56"} Jul 17 21:05:58.418904 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:58.418553 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85f78f69-vqp4v" event={"ID":"ad8ee5ec-c65d-4cb8-995c-73b4c632ab04","Type":"ContainerDied","Data":"71339ea7560087d700439074a4f660476e3b36f95d0a3797ed70752dd2e7fc65"} Jul 17 21:05:58.418904 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:58.418574 2568 scope.go:117] "RemoveContainer" containerID="046ea51b76a7daddfc4e9b5861a7dc2fd2d61956160d3180e6d4e249745fee56" Jul 17 21:05:58.427273 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:58.427254 2568 scope.go:117] "RemoveContainer" containerID="046ea51b76a7daddfc4e9b5861a7dc2fd2d61956160d3180e6d4e249745fee56" Jul 17 21:05:58.427538 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:05:58.427520 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"046ea51b76a7daddfc4e9b5861a7dc2fd2d61956160d3180e6d4e249745fee56\": container with ID starting with 046ea51b76a7daddfc4e9b5861a7dc2fd2d61956160d3180e6d4e249745fee56 not found: ID does not exist" containerID="046ea51b76a7daddfc4e9b5861a7dc2fd2d61956160d3180e6d4e249745fee56" Jul 17 21:05:58.427582 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:58.427547 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"046ea51b76a7daddfc4e9b5861a7dc2fd2d61956160d3180e6d4e249745fee56"} err="failed to get container status \"046ea51b76a7daddfc4e9b5861a7dc2fd2d61956160d3180e6d4e249745fee56\": rpc error: code = NotFound desc = could not find container \"046ea51b76a7daddfc4e9b5861a7dc2fd2d61956160d3180e6d4e249745fee56\": container with ID starting with 046ea51b76a7daddfc4e9b5861a7dc2fd2d61956160d3180e6d4e249745fee56 not found: ID does not exist" Jul 17 21:05:58.439725 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:58.439649 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85f78f69-vqp4v"] Jul 17 21:05:58.442003 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:58.441969 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85f78f69-vqp4v"] Jul 17 21:05:59.735569 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:05:59.735535 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad8ee5ec-c65d-4cb8-995c-73b4c632ab04" path="/var/lib/kubelet/pods/ad8ee5ec-c65d-4cb8-995c-73b4c632ab04/volumes" Jul 17 21:06:00.907869 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:00.907837 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-fbf477467-r5ctl" Jul 17 21:06:00.911569 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:00.911546 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-fbf477467-r5ctl" Jul 17 21:06:12.452957 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:12.452919 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5b887fdbbc-465xm" podUID="11b25c75-d7a8-4ebc-94a8-da4c618eda82" containerName="console" containerID="cri-o://553433c71dcaee3f4c5afab88177f149c97a4f16b9348badfacacad023674ebb" gracePeriod=15 Jul 17 21:06:12.692845 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:12.692823 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b887fdbbc-465xm" Jul 17 21:06:12.738916 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:12.738864 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11b25c75-d7a8-4ebc-94a8-da4c618eda82-console-serving-cert\") pod \"11b25c75-d7a8-4ebc-94a8-da4c618eda82\" (UID: \"11b25c75-d7a8-4ebc-94a8-da4c618eda82\") " Jul 17 21:06:12.738916 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:12.738910 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11b25c75-d7a8-4ebc-94a8-da4c618eda82-service-ca\") pod \"11b25c75-d7a8-4ebc-94a8-da4c618eda82\" (UID: \"11b25c75-d7a8-4ebc-94a8-da4c618eda82\") " Jul 17 21:06:12.739085 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:12.738928 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11b25c75-d7a8-4ebc-94a8-da4c618eda82-trusted-ca-bundle\") pod \"11b25c75-d7a8-4ebc-94a8-da4c618eda82\" (UID: \"11b25c75-d7a8-4ebc-94a8-da4c618eda82\") " Jul 17 21:06:12.739085 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:12.738948 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11b25c75-d7a8-4ebc-94a8-da4c618eda82-console-config\") pod \"11b25c75-d7a8-4ebc-94a8-da4c618eda82\" (UID: \"11b25c75-d7a8-4ebc-94a8-da4c618eda82\") " Jul 17 21:06:12.739085 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:12.738973 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11b25c75-d7a8-4ebc-94a8-da4c618eda82-console-oauth-config\") pod \"11b25c75-d7a8-4ebc-94a8-da4c618eda82\" (UID: \"11b25c75-d7a8-4ebc-94a8-da4c618eda82\") " Jul 17 21:06:12.739241 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:12.739105 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11b25c75-d7a8-4ebc-94a8-da4c618eda82-oauth-serving-cert\") pod \"11b25c75-d7a8-4ebc-94a8-da4c618eda82\" (UID: \"11b25c75-d7a8-4ebc-94a8-da4c618eda82\") " Jul 17 21:06:12.739241 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:12.739144 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7t4s\" (UniqueName: \"kubernetes.io/projected/11b25c75-d7a8-4ebc-94a8-da4c618eda82-kube-api-access-x7t4s\") pod \"11b25c75-d7a8-4ebc-94a8-da4c618eda82\" (UID: \"11b25c75-d7a8-4ebc-94a8-da4c618eda82\") " Jul 17 21:06:12.739378 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:12.739333 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11b25c75-d7a8-4ebc-94a8-da4c618eda82-service-ca" (OuterVolumeSpecName: "service-ca") pod "11b25c75-d7a8-4ebc-94a8-da4c618eda82" (UID: "11b25c75-d7a8-4ebc-94a8-da4c618eda82"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:06:12.739488 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:12.739459 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11b25c75-d7a8-4ebc-94a8-da4c618eda82-console-config" (OuterVolumeSpecName: "console-config") pod "11b25c75-d7a8-4ebc-94a8-da4c618eda82" (UID: "11b25c75-d7a8-4ebc-94a8-da4c618eda82"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:06:12.739488 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:12.739475 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11b25c75-d7a8-4ebc-94a8-da4c618eda82-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "11b25c75-d7a8-4ebc-94a8-da4c618eda82" (UID: "11b25c75-d7a8-4ebc-94a8-da4c618eda82"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:06:12.739659 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:12.739572 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11b25c75-d7a8-4ebc-94a8-da4c618eda82-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "11b25c75-d7a8-4ebc-94a8-da4c618eda82" (UID: "11b25c75-d7a8-4ebc-94a8-da4c618eda82"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:06:12.741012 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:12.740992 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11b25c75-d7a8-4ebc-94a8-da4c618eda82-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "11b25c75-d7a8-4ebc-94a8-da4c618eda82" (UID: "11b25c75-d7a8-4ebc-94a8-da4c618eda82"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 21:06:12.741104 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:12.741050 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11b25c75-d7a8-4ebc-94a8-da4c618eda82-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "11b25c75-d7a8-4ebc-94a8-da4c618eda82" (UID: "11b25c75-d7a8-4ebc-94a8-da4c618eda82"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 21:06:12.741104 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:12.741089 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11b25c75-d7a8-4ebc-94a8-da4c618eda82-kube-api-access-x7t4s" (OuterVolumeSpecName: "kube-api-access-x7t4s") pod "11b25c75-d7a8-4ebc-94a8-da4c618eda82" (UID: "11b25c75-d7a8-4ebc-94a8-da4c618eda82"). InnerVolumeSpecName "kube-api-access-x7t4s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:06:12.840389 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:12.840367 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11b25c75-d7a8-4ebc-94a8-da4c618eda82-service-ca\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:06:12.840389 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:12.840387 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11b25c75-d7a8-4ebc-94a8-da4c618eda82-trusted-ca-bundle\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:06:12.840527 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:12.840398 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11b25c75-d7a8-4ebc-94a8-da4c618eda82-console-config\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:06:12.840527 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:12.840407 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11b25c75-d7a8-4ebc-94a8-da4c618eda82-console-oauth-config\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:06:12.840527 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:12.840416 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11b25c75-d7a8-4ebc-94a8-da4c618eda82-oauth-serving-cert\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:06:12.840527 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:12.840424 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7t4s\" (UniqueName: \"kubernetes.io/projected/11b25c75-d7a8-4ebc-94a8-da4c618eda82-kube-api-access-x7t4s\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:06:12.840527 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:12.840433 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11b25c75-d7a8-4ebc-94a8-da4c618eda82-console-serving-cert\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:06:13.476871 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:13.476834 2568 generic.go:356] "Generic (PLEG): container finished" podID="11b25c75-d7a8-4ebc-94a8-da4c618eda82" containerID="553433c71dcaee3f4c5afab88177f149c97a4f16b9348badfacacad023674ebb" exitCode=0 Jul 17 21:06:13.476871 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:13.476878 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b887fdbbc-465xm" Jul 17 21:06:13.477339 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:13.476900 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b887fdbbc-465xm" event={"ID":"11b25c75-d7a8-4ebc-94a8-da4c618eda82","Type":"ContainerDied","Data":"553433c71dcaee3f4c5afab88177f149c97a4f16b9348badfacacad023674ebb"} Jul 17 21:06:13.477339 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:13.476947 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b887fdbbc-465xm" event={"ID":"11b25c75-d7a8-4ebc-94a8-da4c618eda82","Type":"ContainerDied","Data":"2c0f2931e9d8c3e5c46db471a827684f26bda6792b74b27738312e2a92689b34"} Jul 17 21:06:13.477339 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:13.476970 2568 scope.go:117] "RemoveContainer" containerID="553433c71dcaee3f4c5afab88177f149c97a4f16b9348badfacacad023674ebb" Jul 17 21:06:13.487146 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:13.487107 2568 scope.go:117] "RemoveContainer" containerID="553433c71dcaee3f4c5afab88177f149c97a4f16b9348badfacacad023674ebb" Jul 17 21:06:13.487512 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:06:13.487478 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"553433c71dcaee3f4c5afab88177f149c97a4f16b9348badfacacad023674ebb\": container with ID starting with 553433c71dcaee3f4c5afab88177f149c97a4f16b9348badfacacad023674ebb not found: ID does not exist" containerID="553433c71dcaee3f4c5afab88177f149c97a4f16b9348badfacacad023674ebb" Jul 17 21:06:13.487609 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:13.487518 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"553433c71dcaee3f4c5afab88177f149c97a4f16b9348badfacacad023674ebb"} err="failed to get container status \"553433c71dcaee3f4c5afab88177f149c97a4f16b9348badfacacad023674ebb\": rpc error: code = NotFound desc = could not find container \"553433c71dcaee3f4c5afab88177f149c97a4f16b9348badfacacad023674ebb\": container with ID starting with 553433c71dcaee3f4c5afab88177f149c97a4f16b9348badfacacad023674ebb not found: ID does not exist" Jul 17 21:06:13.500441 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:13.500422 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b887fdbbc-465xm"] Jul 17 21:06:13.506008 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:13.505990 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b887fdbbc-465xm"] Jul 17 21:06:13.735852 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:13.735785 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11b25c75-d7a8-4ebc-94a8-da4c618eda82" path="/var/lib/kubelet/pods/11b25c75-d7a8-4ebc-94a8-da4c618eda82/volumes" Jul 17 21:06:22.703055 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:22.703016 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:22.721796 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:22.721773 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:23.530295 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:23.530270 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:40.732972 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:40.732874 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 17 21:06:40.733720 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:40.733230 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3393ce16-67dd-4889-bd2a-8083f0f0fdb9" containerName="prometheus" containerID="cri-o://60c456a6cdb1d5697d7984f2c0e0784d9a846088e444f21432c294f00105783b" gracePeriod=600 Jul 17 21:06:40.733720 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:40.733600 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3393ce16-67dd-4889-bd2a-8083f0f0fdb9" containerName="kube-rbac-proxy-thanos" containerID="cri-o://30a527f35127ab4261c68ac950f66b96e7165ca6b65f561126ec2dbf9345ef7d" gracePeriod=600 Jul 17 21:06:40.733864 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:40.733736 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3393ce16-67dd-4889-bd2a-8083f0f0fdb9" containerName="kube-rbac-proxy" containerID="cri-o://500dadb158c44cf9026a82431c937fe148afe9d4f287f2f6bff3681af00599b2" gracePeriod=600 Jul 17 21:06:40.733864 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:40.733819 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3393ce16-67dd-4889-bd2a-8083f0f0fdb9" containerName="kube-rbac-proxy-web" containerID="cri-o://6c922549b9639495f542a34a12fbfc126a051df53f94c47049b1e98b9711c3cf" gracePeriod=600 Jul 17 21:06:40.733961 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:40.733891 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3393ce16-67dd-4889-bd2a-8083f0f0fdb9" containerName="thanos-sidecar" containerID="cri-o://f5476f03e7376c8d25533bf5babf8166130e47480888946dd0f3ecbc40fe9875" gracePeriod=600 Jul 17 21:06:40.734015 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:40.733956 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3393ce16-67dd-4889-bd2a-8083f0f0fdb9" containerName="config-reloader" containerID="cri-o://75de274cb2f773bedcffe5b0c683c700c36aeaae9f2f71e119bea8c1e5ef8fdc" gracePeriod=600 Jul 17 21:06:40.985671 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:40.985317 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.041397 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.041367 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-prometheus-k8s-rulefiles-2\") pod \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " Jul 17 21:06:41.041544 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.041416 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-tls-assets\") pod \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " Jul 17 21:06:41.041544 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.041448 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-secret-metrics-client-certs\") pod \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " Jul 17 21:06:41.041544 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.041481 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-config-out\") pod \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " Jul 17 21:06:41.041544 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.041506 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-configmap-serving-certs-ca-bundle\") pod \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " Jul 17 21:06:41.041769 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.041562 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " Jul 17 21:06:41.041769 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.041589 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-configmap-metrics-client-ca\") pod \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " Jul 17 21:06:41.041769 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.041616 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-config\") pod \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " Jul 17 21:06:41.041769 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.041662 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjpj8\" (UniqueName: \"kubernetes.io/projected/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-kube-api-access-tjpj8\") pod \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " Jul 17 21:06:41.041769 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.041672 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "3393ce16-67dd-4889-bd2a-8083f0f0fdb9" (UID: "3393ce16-67dd-4889-bd2a-8083f0f0fdb9"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:06:41.041769 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.041706 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-configmap-kubelet-serving-ca-bundle\") pod \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " Jul 17 21:06:41.041769 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.041742 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-prometheus-k8s-db\") pod \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " Jul 17 21:06:41.041769 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.041772 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-web-config\") pod \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " Jul 17 21:06:41.042163 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.041813 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-thanos-prometheus-http-client-file\") pod \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " Jul 17 21:06:41.042163 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.041847 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-prometheus-trusted-ca-bundle\") pod \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " Jul 17 21:06:41.042163 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.041872 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-secret-grpc-tls\") pod \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " Jul 17 21:06:41.042163 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.041900 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-prometheus-k8s-rulefiles-0\") pod \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " Jul 17 21:06:41.042163 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.041938 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-prometheus-k8s-rulefiles-1\") pod \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " Jul 17 21:06:41.042163 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.041951 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "3393ce16-67dd-4889-bd2a-8083f0f0fdb9" (UID: "3393ce16-67dd-4889-bd2a-8083f0f0fdb9"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:06:41.042163 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.041963 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-secret-kube-rbac-proxy\") pod \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " Jul 17 21:06:41.042163 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.041959 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "3393ce16-67dd-4889-bd2a-8083f0f0fdb9" (UID: "3393ce16-67dd-4889-bd2a-8083f0f0fdb9"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:06:41.042163 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.041990 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-secret-prometheus-k8s-tls\") pod \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " Jul 17 21:06:41.042163 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.042018 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\" (UID: \"3393ce16-67dd-4889-bd2a-8083f0f0fdb9\") " Jul 17 21:06:41.042163 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.042131 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "3393ce16-67dd-4889-bd2a-8083f0f0fdb9" (UID: "3393ce16-67dd-4889-bd2a-8083f0f0fdb9"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:06:41.042716 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.042288 2568 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:06:41.042716 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.042310 2568 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:06:41.042716 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.042326 2568 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:06:41.044919 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.044856 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "3393ce16-67dd-4889-bd2a-8083f0f0fdb9" (UID: "3393ce16-67dd-4889-bd2a-8083f0f0fdb9"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 21:06:41.045847 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.045540 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "3393ce16-67dd-4889-bd2a-8083f0f0fdb9" (UID: "3393ce16-67dd-4889-bd2a-8083f0f0fdb9"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 21:06:41.045847 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.045615 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3393ce16-67dd-4889-bd2a-8083f0f0fdb9" (UID: "3393ce16-67dd-4889-bd2a-8083f0f0fdb9"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:06:41.046163 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.046117 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "3393ce16-67dd-4889-bd2a-8083f0f0fdb9" (UID: "3393ce16-67dd-4889-bd2a-8083f0f0fdb9"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:06:41.046534 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.046503 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "3393ce16-67dd-4889-bd2a-8083f0f0fdb9" (UID: "3393ce16-67dd-4889-bd2a-8083f0f0fdb9"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:06:41.046659 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.046625 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "3393ce16-67dd-4889-bd2a-8083f0f0fdb9" (UID: "3393ce16-67dd-4889-bd2a-8083f0f0fdb9"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:06:41.046783 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.046756 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "3393ce16-67dd-4889-bd2a-8083f0f0fdb9" (UID: "3393ce16-67dd-4889-bd2a-8083f0f0fdb9"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:06:41.047268 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.047238 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-kube-api-access-tjpj8" (OuterVolumeSpecName: "kube-api-access-tjpj8") pod "3393ce16-67dd-4889-bd2a-8083f0f0fdb9" (UID: "3393ce16-67dd-4889-bd2a-8083f0f0fdb9"). InnerVolumeSpecName "kube-api-access-tjpj8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:06:41.047729 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.047703 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-config-out" (OuterVolumeSpecName: "config-out") pod "3393ce16-67dd-4889-bd2a-8083f0f0fdb9" (UID: "3393ce16-67dd-4889-bd2a-8083f0f0fdb9"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:06:41.047837 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.047817 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "3393ce16-67dd-4889-bd2a-8083f0f0fdb9" (UID: "3393ce16-67dd-4889-bd2a-8083f0f0fdb9"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 21:06:41.048012 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.047970 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "3393ce16-67dd-4889-bd2a-8083f0f0fdb9" (UID: "3393ce16-67dd-4889-bd2a-8083f0f0fdb9"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 21:06:41.048661 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.048326 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "3393ce16-67dd-4889-bd2a-8083f0f0fdb9" (UID: "3393ce16-67dd-4889-bd2a-8083f0f0fdb9"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 21:06:41.048661 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.048500 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-config" (OuterVolumeSpecName: "config") pod "3393ce16-67dd-4889-bd2a-8083f0f0fdb9" (UID: "3393ce16-67dd-4889-bd2a-8083f0f0fdb9"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 21:06:41.049138 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.049109 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "3393ce16-67dd-4889-bd2a-8083f0f0fdb9" (UID: "3393ce16-67dd-4889-bd2a-8083f0f0fdb9"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 21:06:41.049424 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.049391 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "3393ce16-67dd-4889-bd2a-8083f0f0fdb9" (UID: "3393ce16-67dd-4889-bd2a-8083f0f0fdb9"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 21:06:41.058844 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.058810 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-web-config" (OuterVolumeSpecName: "web-config") pod "3393ce16-67dd-4889-bd2a-8083f0f0fdb9" (UID: "3393ce16-67dd-4889-bd2a-8083f0f0fdb9"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 21:06:41.142715 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.142670 2568 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-thanos-prometheus-http-client-file\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:06:41.142794 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.142720 2568 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-prometheus-trusted-ca-bundle\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:06:41.142794 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.142736 2568 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-secret-grpc-tls\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:06:41.142794 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.142749 2568 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:06:41.142794 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.142762 2568 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:06:41.142794 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.142777 2568 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-secret-kube-rbac-proxy\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:06:41.142794 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.142790 2568 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-secret-prometheus-k8s-tls\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:06:41.142979 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.142804 2568 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:06:41.142979 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.142818 2568 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-tls-assets\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:06:41.142979 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.142831 2568 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-secret-metrics-client-certs\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:06:41.142979 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.142845 2568 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-config-out\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:06:41.142979 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.142859 2568 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:06:41.142979 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.142873 2568 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-configmap-metrics-client-ca\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:06:41.142979 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.142886 2568 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-config\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:06:41.142979 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.142898 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjpj8\" (UniqueName: \"kubernetes.io/projected/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-kube-api-access-tjpj8\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:06:41.142979 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.142911 2568 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-prometheus-k8s-db\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:06:41.142979 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.142949 2568 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3393ce16-67dd-4889-bd2a-8083f0f0fdb9-web-config\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:06:41.586527 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.586497 2568 generic.go:356] "Generic (PLEG): container finished" podID="3393ce16-67dd-4889-bd2a-8083f0f0fdb9" containerID="30a527f35127ab4261c68ac950f66b96e7165ca6b65f561126ec2dbf9345ef7d" exitCode=0 Jul 17 21:06:41.586527 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.586519 2568 generic.go:356] "Generic (PLEG): container finished" podID="3393ce16-67dd-4889-bd2a-8083f0f0fdb9" containerID="500dadb158c44cf9026a82431c937fe148afe9d4f287f2f6bff3681af00599b2" exitCode=0 Jul 17 21:06:41.586527 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.586525 2568 generic.go:356] "Generic (PLEG): container finished" podID="3393ce16-67dd-4889-bd2a-8083f0f0fdb9" containerID="6c922549b9639495f542a34a12fbfc126a051df53f94c47049b1e98b9711c3cf" exitCode=0 Jul 17 21:06:41.586527 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.586531 2568 generic.go:356] "Generic (PLEG): container finished" podID="3393ce16-67dd-4889-bd2a-8083f0f0fdb9" containerID="f5476f03e7376c8d25533bf5babf8166130e47480888946dd0f3ecbc40fe9875" exitCode=0 Jul 17 21:06:41.586859 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.586536 2568 generic.go:356] "Generic (PLEG): container finished" podID="3393ce16-67dd-4889-bd2a-8083f0f0fdb9" containerID="75de274cb2f773bedcffe5b0c683c700c36aeaae9f2f71e119bea8c1e5ef8fdc" exitCode=0 Jul 17 21:06:41.586859 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.586541 2568 generic.go:356] "Generic (PLEG): container finished" podID="3393ce16-67dd-4889-bd2a-8083f0f0fdb9" containerID="60c456a6cdb1d5697d7984f2c0e0784d9a846088e444f21432c294f00105783b" exitCode=0 Jul 17 21:06:41.586859 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.586582 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.586859 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.586574 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3393ce16-67dd-4889-bd2a-8083f0f0fdb9","Type":"ContainerDied","Data":"30a527f35127ab4261c68ac950f66b96e7165ca6b65f561126ec2dbf9345ef7d"} Jul 17 21:06:41.586859 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.586751 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3393ce16-67dd-4889-bd2a-8083f0f0fdb9","Type":"ContainerDied","Data":"500dadb158c44cf9026a82431c937fe148afe9d4f287f2f6bff3681af00599b2"} Jul 17 21:06:41.586859 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.586793 2568 scope.go:117] "RemoveContainer" containerID="30a527f35127ab4261c68ac950f66b96e7165ca6b65f561126ec2dbf9345ef7d" Jul 17 21:06:41.586859 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.586802 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3393ce16-67dd-4889-bd2a-8083f0f0fdb9","Type":"ContainerDied","Data":"6c922549b9639495f542a34a12fbfc126a051df53f94c47049b1e98b9711c3cf"} Jul 17 21:06:41.586859 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.586847 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3393ce16-67dd-4889-bd2a-8083f0f0fdb9","Type":"ContainerDied","Data":"f5476f03e7376c8d25533bf5babf8166130e47480888946dd0f3ecbc40fe9875"} Jul 17 21:06:41.587215 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.586890 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3393ce16-67dd-4889-bd2a-8083f0f0fdb9","Type":"ContainerDied","Data":"75de274cb2f773bedcffe5b0c683c700c36aeaae9f2f71e119bea8c1e5ef8fdc"} Jul 17 21:06:41.587215 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.586931 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3393ce16-67dd-4889-bd2a-8083f0f0fdb9","Type":"ContainerDied","Data":"60c456a6cdb1d5697d7984f2c0e0784d9a846088e444f21432c294f00105783b"} Jul 17 21:06:41.587215 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.586975 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3393ce16-67dd-4889-bd2a-8083f0f0fdb9","Type":"ContainerDied","Data":"35670b43420b1be30380fbf42c84942887aee521df609566eadc4faae583c8d4"} Jul 17 21:06:41.597644 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.597631 2568 scope.go:117] "RemoveContainer" containerID="500dadb158c44cf9026a82431c937fe148afe9d4f287f2f6bff3681af00599b2" Jul 17 21:06:41.606774 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.606741 2568 scope.go:117] "RemoveContainer" containerID="6c922549b9639495f542a34a12fbfc126a051df53f94c47049b1e98b9711c3cf" Jul 17 21:06:41.613450 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.613431 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 17 21:06:41.615511 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.615494 2568 scope.go:117] "RemoveContainer" containerID="f5476f03e7376c8d25533bf5babf8166130e47480888946dd0f3ecbc40fe9875" Jul 17 21:06:41.616566 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.616552 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 17 21:06:41.621649 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.621629 2568 scope.go:117] "RemoveContainer" containerID="75de274cb2f773bedcffe5b0c683c700c36aeaae9f2f71e119bea8c1e5ef8fdc" Jul 17 21:06:41.627902 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.627886 2568 scope.go:117] "RemoveContainer" containerID="60c456a6cdb1d5697d7984f2c0e0784d9a846088e444f21432c294f00105783b" Jul 17 21:06:41.634419 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.634405 2568 scope.go:117] "RemoveContainer" containerID="7fc3c45bba319637e68a7425f8eabcb8a050e4a018fcc2e88b9e69478802ace7" Jul 17 21:06:41.640474 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.640458 2568 scope.go:117] "RemoveContainer" containerID="30a527f35127ab4261c68ac950f66b96e7165ca6b65f561126ec2dbf9345ef7d" Jul 17 21:06:41.640735 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:06:41.640677 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30a527f35127ab4261c68ac950f66b96e7165ca6b65f561126ec2dbf9345ef7d\": container with ID starting with 30a527f35127ab4261c68ac950f66b96e7165ca6b65f561126ec2dbf9345ef7d not found: ID does not exist" containerID="30a527f35127ab4261c68ac950f66b96e7165ca6b65f561126ec2dbf9345ef7d" Jul 17 21:06:41.640786 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.640743 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30a527f35127ab4261c68ac950f66b96e7165ca6b65f561126ec2dbf9345ef7d"} err="failed to get container status \"30a527f35127ab4261c68ac950f66b96e7165ca6b65f561126ec2dbf9345ef7d\": rpc error: code = NotFound desc = could not find container \"30a527f35127ab4261c68ac950f66b96e7165ca6b65f561126ec2dbf9345ef7d\": container with ID starting with 30a527f35127ab4261c68ac950f66b96e7165ca6b65f561126ec2dbf9345ef7d not found: ID does not exist" Jul 17 21:06:41.640786 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.640761 2568 scope.go:117] "RemoveContainer" containerID="500dadb158c44cf9026a82431c937fe148afe9d4f287f2f6bff3681af00599b2" Jul 17 21:06:41.641026 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:06:41.641008 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"500dadb158c44cf9026a82431c937fe148afe9d4f287f2f6bff3681af00599b2\": container with ID starting with 500dadb158c44cf9026a82431c937fe148afe9d4f287f2f6bff3681af00599b2 not found: ID does not exist" containerID="500dadb158c44cf9026a82431c937fe148afe9d4f287f2f6bff3681af00599b2" Jul 17 21:06:41.641084 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.641030 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"500dadb158c44cf9026a82431c937fe148afe9d4f287f2f6bff3681af00599b2"} err="failed to get container status \"500dadb158c44cf9026a82431c937fe148afe9d4f287f2f6bff3681af00599b2\": rpc error: code = NotFound desc = could not find container \"500dadb158c44cf9026a82431c937fe148afe9d4f287f2f6bff3681af00599b2\": container with ID starting with 500dadb158c44cf9026a82431c937fe148afe9d4f287f2f6bff3681af00599b2 not found: ID does not exist" Jul 17 21:06:41.641084 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.641047 2568 scope.go:117] "RemoveContainer" containerID="6c922549b9639495f542a34a12fbfc126a051df53f94c47049b1e98b9711c3cf" Jul 17 21:06:41.641397 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:06:41.641366 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c922549b9639495f542a34a12fbfc126a051df53f94c47049b1e98b9711c3cf\": container with ID starting with 6c922549b9639495f542a34a12fbfc126a051df53f94c47049b1e98b9711c3cf not found: ID does not exist" containerID="6c922549b9639495f542a34a12fbfc126a051df53f94c47049b1e98b9711c3cf" Jul 17 21:06:41.641507 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.641400 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c922549b9639495f542a34a12fbfc126a051df53f94c47049b1e98b9711c3cf"} err="failed to get container status \"6c922549b9639495f542a34a12fbfc126a051df53f94c47049b1e98b9711c3cf\": rpc error: code = NotFound desc = could not find container \"6c922549b9639495f542a34a12fbfc126a051df53f94c47049b1e98b9711c3cf\": container with ID starting with 6c922549b9639495f542a34a12fbfc126a051df53f94c47049b1e98b9711c3cf not found: ID does not exist" Jul 17 21:06:41.641507 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.641417 2568 scope.go:117] "RemoveContainer" containerID="f5476f03e7376c8d25533bf5babf8166130e47480888946dd0f3ecbc40fe9875" Jul 17 21:06:41.641769 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:06:41.641745 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5476f03e7376c8d25533bf5babf8166130e47480888946dd0f3ecbc40fe9875\": container with ID starting with f5476f03e7376c8d25533bf5babf8166130e47480888946dd0f3ecbc40fe9875 not found: ID does not exist" containerID="f5476f03e7376c8d25533bf5babf8166130e47480888946dd0f3ecbc40fe9875" Jul 17 21:06:41.641858 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.641782 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5476f03e7376c8d25533bf5babf8166130e47480888946dd0f3ecbc40fe9875"} err="failed to get container status \"f5476f03e7376c8d25533bf5babf8166130e47480888946dd0f3ecbc40fe9875\": rpc error: code = NotFound desc = could not find container \"f5476f03e7376c8d25533bf5babf8166130e47480888946dd0f3ecbc40fe9875\": container with ID starting with f5476f03e7376c8d25533bf5babf8166130e47480888946dd0f3ecbc40fe9875 not found: ID does not exist" Jul 17 21:06:41.641858 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.641805 2568 scope.go:117] "RemoveContainer" containerID="75de274cb2f773bedcffe5b0c683c700c36aeaae9f2f71e119bea8c1e5ef8fdc" Jul 17 21:06:41.642071 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:06:41.642051 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75de274cb2f773bedcffe5b0c683c700c36aeaae9f2f71e119bea8c1e5ef8fdc\": container with ID starting with 75de274cb2f773bedcffe5b0c683c700c36aeaae9f2f71e119bea8c1e5ef8fdc not found: ID does not exist" containerID="75de274cb2f773bedcffe5b0c683c700c36aeaae9f2f71e119bea8c1e5ef8fdc" Jul 17 21:06:41.642136 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.642081 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75de274cb2f773bedcffe5b0c683c700c36aeaae9f2f71e119bea8c1e5ef8fdc"} err="failed to get container status \"75de274cb2f773bedcffe5b0c683c700c36aeaae9f2f71e119bea8c1e5ef8fdc\": rpc error: code = NotFound desc = could not find container \"75de274cb2f773bedcffe5b0c683c700c36aeaae9f2f71e119bea8c1e5ef8fdc\": container with ID starting with 75de274cb2f773bedcffe5b0c683c700c36aeaae9f2f71e119bea8c1e5ef8fdc not found: ID does not exist" Jul 17 21:06:41.642136 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.642095 2568 scope.go:117] "RemoveContainer" containerID="60c456a6cdb1d5697d7984f2c0e0784d9a846088e444f21432c294f00105783b" Jul 17 21:06:41.642354 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:06:41.642337 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60c456a6cdb1d5697d7984f2c0e0784d9a846088e444f21432c294f00105783b\": container with ID starting with 60c456a6cdb1d5697d7984f2c0e0784d9a846088e444f21432c294f00105783b not found: ID does not exist" containerID="60c456a6cdb1d5697d7984f2c0e0784d9a846088e444f21432c294f00105783b" Jul 17 21:06:41.642401 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.642360 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60c456a6cdb1d5697d7984f2c0e0784d9a846088e444f21432c294f00105783b"} err="failed to get container status \"60c456a6cdb1d5697d7984f2c0e0784d9a846088e444f21432c294f00105783b\": rpc error: code = NotFound desc = could not find container \"60c456a6cdb1d5697d7984f2c0e0784d9a846088e444f21432c294f00105783b\": container with ID starting with 60c456a6cdb1d5697d7984f2c0e0784d9a846088e444f21432c294f00105783b not found: ID does not exist" Jul 17 21:06:41.642401 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.642373 2568 scope.go:117] "RemoveContainer" containerID="7fc3c45bba319637e68a7425f8eabcb8a050e4a018fcc2e88b9e69478802ace7" Jul 17 21:06:41.642610 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:06:41.642595 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fc3c45bba319637e68a7425f8eabcb8a050e4a018fcc2e88b9e69478802ace7\": container with ID starting with 7fc3c45bba319637e68a7425f8eabcb8a050e4a018fcc2e88b9e69478802ace7 not found: ID does not exist" containerID="7fc3c45bba319637e68a7425f8eabcb8a050e4a018fcc2e88b9e69478802ace7" Jul 17 21:06:41.642651 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.642614 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fc3c45bba319637e68a7425f8eabcb8a050e4a018fcc2e88b9e69478802ace7"} err="failed to get container status \"7fc3c45bba319637e68a7425f8eabcb8a050e4a018fcc2e88b9e69478802ace7\": rpc error: code = NotFound desc = could not find container \"7fc3c45bba319637e68a7425f8eabcb8a050e4a018fcc2e88b9e69478802ace7\": container with ID starting with 7fc3c45bba319637e68a7425f8eabcb8a050e4a018fcc2e88b9e69478802ace7 not found: ID does not exist" Jul 17 21:06:41.642651 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.642627 2568 scope.go:117] "RemoveContainer" containerID="30a527f35127ab4261c68ac950f66b96e7165ca6b65f561126ec2dbf9345ef7d" Jul 17 21:06:41.642893 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.642868 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30a527f35127ab4261c68ac950f66b96e7165ca6b65f561126ec2dbf9345ef7d"} err="failed to get container status \"30a527f35127ab4261c68ac950f66b96e7165ca6b65f561126ec2dbf9345ef7d\": rpc error: code = NotFound desc = could not find container \"30a527f35127ab4261c68ac950f66b96e7165ca6b65f561126ec2dbf9345ef7d\": container with ID starting with 30a527f35127ab4261c68ac950f66b96e7165ca6b65f561126ec2dbf9345ef7d not found: ID does not exist" Jul 17 21:06:41.642936 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.642894 2568 scope.go:117] "RemoveContainer" containerID="500dadb158c44cf9026a82431c937fe148afe9d4f287f2f6bff3681af00599b2" Jul 17 21:06:41.643042 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.643024 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 17 21:06:41.643147 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.643118 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"500dadb158c44cf9026a82431c937fe148afe9d4f287f2f6bff3681af00599b2"} err="failed to get container status \"500dadb158c44cf9026a82431c937fe148afe9d4f287f2f6bff3681af00599b2\": rpc error: code = NotFound desc = could not find container \"500dadb158c44cf9026a82431c937fe148afe9d4f287f2f6bff3681af00599b2\": container with ID starting with 500dadb158c44cf9026a82431c937fe148afe9d4f287f2f6bff3681af00599b2 not found: ID does not exist" Jul 17 21:06:41.643147 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.643137 2568 scope.go:117] "RemoveContainer" containerID="6c922549b9639495f542a34a12fbfc126a051df53f94c47049b1e98b9711c3cf" Jul 17 21:06:41.643312 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.643296 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad8ee5ec-c65d-4cb8-995c-73b4c632ab04" containerName="console" Jul 17 21:06:41.643312 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.643312 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad8ee5ec-c65d-4cb8-995c-73b4c632ab04" containerName="console" Jul 17 21:06:41.643427 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.643325 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3393ce16-67dd-4889-bd2a-8083f0f0fdb9" containerName="config-reloader" Jul 17 21:06:41.643427 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.643333 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3393ce16-67dd-4889-bd2a-8083f0f0fdb9" containerName="config-reloader" Jul 17 21:06:41.643427 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.643344 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3393ce16-67dd-4889-bd2a-8083f0f0fdb9" containerName="thanos-sidecar" Jul 17 21:06:41.643427 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.643350 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3393ce16-67dd-4889-bd2a-8083f0f0fdb9" containerName="thanos-sidecar" Jul 17 21:06:41.643427 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.643350 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c922549b9639495f542a34a12fbfc126a051df53f94c47049b1e98b9711c3cf"} err="failed to get container status \"6c922549b9639495f542a34a12fbfc126a051df53f94c47049b1e98b9711c3cf\": rpc error: code = NotFound desc = could not find container \"6c922549b9639495f542a34a12fbfc126a051df53f94c47049b1e98b9711c3cf\": container with ID starting with 6c922549b9639495f542a34a12fbfc126a051df53f94c47049b1e98b9711c3cf not found: ID does not exist" Jul 17 21:06:41.643427 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.643366 2568 scope.go:117] "RemoveContainer" containerID="f5476f03e7376c8d25533bf5babf8166130e47480888946dd0f3ecbc40fe9875" Jul 17 21:06:41.643427 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.643359 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e124264-eb28-437d-8380-e449b34cfbaf" containerName="console" Jul 17 21:06:41.643427 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.643407 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e124264-eb28-437d-8380-e449b34cfbaf" containerName="console" Jul 17 21:06:41.643427 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.643421 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="512e4197-ce1e-465a-b519-3eaf1a327192" containerName="registry" Jul 17 21:06:41.643427 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.643427 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="512e4197-ce1e-465a-b519-3eaf1a327192" containerName="registry" Jul 17 21:06:41.643831 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.643433 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11b25c75-d7a8-4ebc-94a8-da4c618eda82" containerName="console" Jul 17 21:06:41.643831 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.643439 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="11b25c75-d7a8-4ebc-94a8-da4c618eda82" containerName="console" Jul 17 21:06:41.643831 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.643448 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3393ce16-67dd-4889-bd2a-8083f0f0fdb9" containerName="kube-rbac-proxy" Jul 17 21:06:41.643831 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.643452 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3393ce16-67dd-4889-bd2a-8083f0f0fdb9" containerName="kube-rbac-proxy" Jul 17 21:06:41.643831 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.643463 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3393ce16-67dd-4889-bd2a-8083f0f0fdb9" containerName="kube-rbac-proxy-thanos" Jul 17 21:06:41.643831 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.643471 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3393ce16-67dd-4889-bd2a-8083f0f0fdb9" containerName="kube-rbac-proxy-thanos" Jul 17 21:06:41.643831 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.643485 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3393ce16-67dd-4889-bd2a-8083f0f0fdb9" containerName="kube-rbac-proxy-web" Jul 17 21:06:41.643831 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.643490 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3393ce16-67dd-4889-bd2a-8083f0f0fdb9" containerName="kube-rbac-proxy-web" Jul 17 21:06:41.643831 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.643498 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3393ce16-67dd-4889-bd2a-8083f0f0fdb9" containerName="init-config-reloader" Jul 17 21:06:41.643831 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.643503 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3393ce16-67dd-4889-bd2a-8083f0f0fdb9" containerName="init-config-reloader" Jul 17 21:06:41.643831 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.643510 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3393ce16-67dd-4889-bd2a-8083f0f0fdb9" containerName="prometheus" Jul 17 21:06:41.643831 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.643518 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3393ce16-67dd-4889-bd2a-8083f0f0fdb9" containerName="prometheus" Jul 17 21:06:41.643831 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.643591 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="512e4197-ce1e-465a-b519-3eaf1a327192" containerName="registry" Jul 17 21:06:41.643831 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.643604 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3393ce16-67dd-4889-bd2a-8083f0f0fdb9" containerName="config-reloader" Jul 17 21:06:41.643831 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.643611 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="11b25c75-d7a8-4ebc-94a8-da4c618eda82" containerName="console" Jul 17 21:06:41.643831 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.643617 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3393ce16-67dd-4889-bd2a-8083f0f0fdb9" containerName="kube-rbac-proxy-web" Jul 17 21:06:41.643831 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.643623 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e124264-eb28-437d-8380-e449b34cfbaf" containerName="console" Jul 17 21:06:41.643831 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.643627 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3393ce16-67dd-4889-bd2a-8083f0f0fdb9" containerName="kube-rbac-proxy-thanos" Jul 17 21:06:41.643831 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.643633 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad8ee5ec-c65d-4cb8-995c-73b4c632ab04" containerName="console" Jul 17 21:06:41.643831 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.643629 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5476f03e7376c8d25533bf5babf8166130e47480888946dd0f3ecbc40fe9875"} err="failed to get container status \"f5476f03e7376c8d25533bf5babf8166130e47480888946dd0f3ecbc40fe9875\": rpc error: code = NotFound desc = could not find container \"f5476f03e7376c8d25533bf5babf8166130e47480888946dd0f3ecbc40fe9875\": container with ID starting with f5476f03e7376c8d25533bf5babf8166130e47480888946dd0f3ecbc40fe9875 not found: ID does not exist" Jul 17 21:06:41.643831 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.643651 2568 scope.go:117] "RemoveContainer" containerID="75de274cb2f773bedcffe5b0c683c700c36aeaae9f2f71e119bea8c1e5ef8fdc" Jul 17 21:06:41.643831 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.643637 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3393ce16-67dd-4889-bd2a-8083f0f0fdb9" containerName="thanos-sidecar" Jul 17 21:06:41.643831 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.643704 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3393ce16-67dd-4889-bd2a-8083f0f0fdb9" containerName="prometheus" Jul 17 21:06:41.643831 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.643710 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3393ce16-67dd-4889-bd2a-8083f0f0fdb9" containerName="kube-rbac-proxy" Jul 17 21:06:41.644633 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.643870 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75de274cb2f773bedcffe5b0c683c700c36aeaae9f2f71e119bea8c1e5ef8fdc"} err="failed to get container status \"75de274cb2f773bedcffe5b0c683c700c36aeaae9f2f71e119bea8c1e5ef8fdc\": rpc error: code = NotFound desc = could not find container \"75de274cb2f773bedcffe5b0c683c700c36aeaae9f2f71e119bea8c1e5ef8fdc\": container with ID starting with 75de274cb2f773bedcffe5b0c683c700c36aeaae9f2f71e119bea8c1e5ef8fdc not found: ID does not exist" Jul 17 21:06:41.644633 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.643886 2568 scope.go:117] "RemoveContainer" containerID="60c456a6cdb1d5697d7984f2c0e0784d9a846088e444f21432c294f00105783b" Jul 17 21:06:41.644633 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.644086 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60c456a6cdb1d5697d7984f2c0e0784d9a846088e444f21432c294f00105783b"} err="failed to get container status \"60c456a6cdb1d5697d7984f2c0e0784d9a846088e444f21432c294f00105783b\": rpc error: code = NotFound desc = could not find container \"60c456a6cdb1d5697d7984f2c0e0784d9a846088e444f21432c294f00105783b\": container with ID starting with 60c456a6cdb1d5697d7984f2c0e0784d9a846088e444f21432c294f00105783b not found: ID does not exist" Jul 17 21:06:41.644633 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.644100 2568 scope.go:117] "RemoveContainer" containerID="7fc3c45bba319637e68a7425f8eabcb8a050e4a018fcc2e88b9e69478802ace7" Jul 17 21:06:41.644633 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.644314 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fc3c45bba319637e68a7425f8eabcb8a050e4a018fcc2e88b9e69478802ace7"} err="failed to get container status \"7fc3c45bba319637e68a7425f8eabcb8a050e4a018fcc2e88b9e69478802ace7\": rpc error: code = NotFound desc = could not find container \"7fc3c45bba319637e68a7425f8eabcb8a050e4a018fcc2e88b9e69478802ace7\": container with ID starting with 7fc3c45bba319637e68a7425f8eabcb8a050e4a018fcc2e88b9e69478802ace7 not found: ID does not exist" Jul 17 21:06:41.644633 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.644327 2568 scope.go:117] "RemoveContainer" containerID="30a527f35127ab4261c68ac950f66b96e7165ca6b65f561126ec2dbf9345ef7d" Jul 17 21:06:41.644633 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.644530 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30a527f35127ab4261c68ac950f66b96e7165ca6b65f561126ec2dbf9345ef7d"} err="failed to get container status \"30a527f35127ab4261c68ac950f66b96e7165ca6b65f561126ec2dbf9345ef7d\": rpc error: code = NotFound desc = could not find container \"30a527f35127ab4261c68ac950f66b96e7165ca6b65f561126ec2dbf9345ef7d\": container with ID starting with 30a527f35127ab4261c68ac950f66b96e7165ca6b65f561126ec2dbf9345ef7d not found: ID does not exist" Jul 17 21:06:41.644633 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.644560 2568 scope.go:117] "RemoveContainer" containerID="500dadb158c44cf9026a82431c937fe148afe9d4f287f2f6bff3681af00599b2" Jul 17 21:06:41.644975 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.644767 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"500dadb158c44cf9026a82431c937fe148afe9d4f287f2f6bff3681af00599b2"} err="failed to get container status \"500dadb158c44cf9026a82431c937fe148afe9d4f287f2f6bff3681af00599b2\": rpc error: code = NotFound desc = could not find container \"500dadb158c44cf9026a82431c937fe148afe9d4f287f2f6bff3681af00599b2\": container with ID starting with 500dadb158c44cf9026a82431c937fe148afe9d4f287f2f6bff3681af00599b2 not found: ID does not exist" Jul 17 21:06:41.644975 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.644786 2568 scope.go:117] "RemoveContainer" containerID="6c922549b9639495f542a34a12fbfc126a051df53f94c47049b1e98b9711c3cf" Jul 17 21:06:41.645058 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.645029 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c922549b9639495f542a34a12fbfc126a051df53f94c47049b1e98b9711c3cf"} err="failed to get container status \"6c922549b9639495f542a34a12fbfc126a051df53f94c47049b1e98b9711c3cf\": rpc error: code = NotFound desc = could not find container \"6c922549b9639495f542a34a12fbfc126a051df53f94c47049b1e98b9711c3cf\": container with ID starting with 6c922549b9639495f542a34a12fbfc126a051df53f94c47049b1e98b9711c3cf not found: ID does not exist" Jul 17 21:06:41.645058 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.645045 2568 scope.go:117] "RemoveContainer" containerID="f5476f03e7376c8d25533bf5babf8166130e47480888946dd0f3ecbc40fe9875" Jul 17 21:06:41.645301 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.645281 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5476f03e7376c8d25533bf5babf8166130e47480888946dd0f3ecbc40fe9875"} err="failed to get container status \"f5476f03e7376c8d25533bf5babf8166130e47480888946dd0f3ecbc40fe9875\": rpc error: code = NotFound desc = could not find container \"f5476f03e7376c8d25533bf5babf8166130e47480888946dd0f3ecbc40fe9875\": container with ID starting with f5476f03e7376c8d25533bf5babf8166130e47480888946dd0f3ecbc40fe9875 not found: ID does not exist" Jul 17 21:06:41.645345 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.645301 2568 scope.go:117] "RemoveContainer" containerID="75de274cb2f773bedcffe5b0c683c700c36aeaae9f2f71e119bea8c1e5ef8fdc" Jul 17 21:06:41.645534 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.645512 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75de274cb2f773bedcffe5b0c683c700c36aeaae9f2f71e119bea8c1e5ef8fdc"} err="failed to get container status \"75de274cb2f773bedcffe5b0c683c700c36aeaae9f2f71e119bea8c1e5ef8fdc\": rpc error: code = NotFound desc = could not find container \"75de274cb2f773bedcffe5b0c683c700c36aeaae9f2f71e119bea8c1e5ef8fdc\": container with ID starting with 75de274cb2f773bedcffe5b0c683c700c36aeaae9f2f71e119bea8c1e5ef8fdc not found: ID does not exist" Jul 17 21:06:41.645593 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.645535 2568 scope.go:117] "RemoveContainer" containerID="60c456a6cdb1d5697d7984f2c0e0784d9a846088e444f21432c294f00105783b" Jul 17 21:06:41.645806 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.645786 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60c456a6cdb1d5697d7984f2c0e0784d9a846088e444f21432c294f00105783b"} err="failed to get container status \"60c456a6cdb1d5697d7984f2c0e0784d9a846088e444f21432c294f00105783b\": rpc error: code = NotFound desc = could not find container \"60c456a6cdb1d5697d7984f2c0e0784d9a846088e444f21432c294f00105783b\": container with ID starting with 60c456a6cdb1d5697d7984f2c0e0784d9a846088e444f21432c294f00105783b not found: ID does not exist" Jul 17 21:06:41.645873 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.645807 2568 scope.go:117] "RemoveContainer" containerID="7fc3c45bba319637e68a7425f8eabcb8a050e4a018fcc2e88b9e69478802ace7" Jul 17 21:06:41.646034 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.646018 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fc3c45bba319637e68a7425f8eabcb8a050e4a018fcc2e88b9e69478802ace7"} err="failed to get container status \"7fc3c45bba319637e68a7425f8eabcb8a050e4a018fcc2e88b9e69478802ace7\": rpc error: code = NotFound desc = could not find container \"7fc3c45bba319637e68a7425f8eabcb8a050e4a018fcc2e88b9e69478802ace7\": container with ID starting with 7fc3c45bba319637e68a7425f8eabcb8a050e4a018fcc2e88b9e69478802ace7 not found: ID does not exist" Jul 17 21:06:41.646105 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.646036 2568 scope.go:117] "RemoveContainer" containerID="30a527f35127ab4261c68ac950f66b96e7165ca6b65f561126ec2dbf9345ef7d" Jul 17 21:06:41.646296 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.646277 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30a527f35127ab4261c68ac950f66b96e7165ca6b65f561126ec2dbf9345ef7d"} err="failed to get container status \"30a527f35127ab4261c68ac950f66b96e7165ca6b65f561126ec2dbf9345ef7d\": rpc error: code = NotFound desc = could not find container \"30a527f35127ab4261c68ac950f66b96e7165ca6b65f561126ec2dbf9345ef7d\": container with ID starting with 30a527f35127ab4261c68ac950f66b96e7165ca6b65f561126ec2dbf9345ef7d not found: ID does not exist" Jul 17 21:06:41.646367 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.646297 2568 scope.go:117] "RemoveContainer" containerID="500dadb158c44cf9026a82431c937fe148afe9d4f287f2f6bff3681af00599b2" Jul 17 21:06:41.646569 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.646544 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"500dadb158c44cf9026a82431c937fe148afe9d4f287f2f6bff3681af00599b2"} err="failed to get container status \"500dadb158c44cf9026a82431c937fe148afe9d4f287f2f6bff3681af00599b2\": rpc error: code = NotFound desc = could not find container \"500dadb158c44cf9026a82431c937fe148afe9d4f287f2f6bff3681af00599b2\": container with ID starting with 500dadb158c44cf9026a82431c937fe148afe9d4f287f2f6bff3681af00599b2 not found: ID does not exist" Jul 17 21:06:41.646569 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.646568 2568 scope.go:117] "RemoveContainer" containerID="6c922549b9639495f542a34a12fbfc126a051df53f94c47049b1e98b9711c3cf" Jul 17 21:06:41.646859 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.646835 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c922549b9639495f542a34a12fbfc126a051df53f94c47049b1e98b9711c3cf"} err="failed to get container status \"6c922549b9639495f542a34a12fbfc126a051df53f94c47049b1e98b9711c3cf\": rpc error: code = NotFound desc = could not find container \"6c922549b9639495f542a34a12fbfc126a051df53f94c47049b1e98b9711c3cf\": container with ID starting with 6c922549b9639495f542a34a12fbfc126a051df53f94c47049b1e98b9711c3cf not found: ID does not exist" Jul 17 21:06:41.646922 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.646863 2568 scope.go:117] "RemoveContainer" containerID="f5476f03e7376c8d25533bf5babf8166130e47480888946dd0f3ecbc40fe9875" Jul 17 21:06:41.647177 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.647150 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5476f03e7376c8d25533bf5babf8166130e47480888946dd0f3ecbc40fe9875"} err="failed to get container status \"f5476f03e7376c8d25533bf5babf8166130e47480888946dd0f3ecbc40fe9875\": rpc error: code = NotFound desc = could not find container \"f5476f03e7376c8d25533bf5babf8166130e47480888946dd0f3ecbc40fe9875\": container with ID starting with f5476f03e7376c8d25533bf5babf8166130e47480888946dd0f3ecbc40fe9875 not found: ID does not exist" Jul 17 21:06:41.647255 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.647179 2568 scope.go:117] "RemoveContainer" containerID="75de274cb2f773bedcffe5b0c683c700c36aeaae9f2f71e119bea8c1e5ef8fdc" Jul 17 21:06:41.647488 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.647471 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.647488 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.647476 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75de274cb2f773bedcffe5b0c683c700c36aeaae9f2f71e119bea8c1e5ef8fdc"} err="failed to get container status \"75de274cb2f773bedcffe5b0c683c700c36aeaae9f2f71e119bea8c1e5ef8fdc\": rpc error: code = NotFound desc = could not find container \"75de274cb2f773bedcffe5b0c683c700c36aeaae9f2f71e119bea8c1e5ef8fdc\": container with ID starting with 75de274cb2f773bedcffe5b0c683c700c36aeaae9f2f71e119bea8c1e5ef8fdc not found: ID does not exist" Jul 17 21:06:41.647669 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.647494 2568 scope.go:117] "RemoveContainer" containerID="60c456a6cdb1d5697d7984f2c0e0784d9a846088e444f21432c294f00105783b" Jul 17 21:06:41.647913 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.647744 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60c456a6cdb1d5697d7984f2c0e0784d9a846088e444f21432c294f00105783b"} err="failed to get container status \"60c456a6cdb1d5697d7984f2c0e0784d9a846088e444f21432c294f00105783b\": rpc error: code = NotFound desc = could not find container \"60c456a6cdb1d5697d7984f2c0e0784d9a846088e444f21432c294f00105783b\": container with ID starting with 60c456a6cdb1d5697d7984f2c0e0784d9a846088e444f21432c294f00105783b not found: ID does not exist" Jul 17 21:06:41.647913 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.647771 2568 scope.go:117] "RemoveContainer" containerID="7fc3c45bba319637e68a7425f8eabcb8a050e4a018fcc2e88b9e69478802ace7" Jul 17 21:06:41.648478 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.648456 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fc3c45bba319637e68a7425f8eabcb8a050e4a018fcc2e88b9e69478802ace7"} err="failed to get container status \"7fc3c45bba319637e68a7425f8eabcb8a050e4a018fcc2e88b9e69478802ace7\": rpc error: code = NotFound desc = could not find container \"7fc3c45bba319637e68a7425f8eabcb8a050e4a018fcc2e88b9e69478802ace7\": container with ID starting with 7fc3c45bba319637e68a7425f8eabcb8a050e4a018fcc2e88b9e69478802ace7 not found: ID does not exist" Jul 17 21:06:41.648532 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.648480 2568 scope.go:117] "RemoveContainer" containerID="30a527f35127ab4261c68ac950f66b96e7165ca6b65f561126ec2dbf9345ef7d" Jul 17 21:06:41.648809 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.648789 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30a527f35127ab4261c68ac950f66b96e7165ca6b65f561126ec2dbf9345ef7d"} err="failed to get container status \"30a527f35127ab4261c68ac950f66b96e7165ca6b65f561126ec2dbf9345ef7d\": rpc error: code = NotFound desc = could not find container \"30a527f35127ab4261c68ac950f66b96e7165ca6b65f561126ec2dbf9345ef7d\": container with ID starting with 30a527f35127ab4261c68ac950f66b96e7165ca6b65f561126ec2dbf9345ef7d not found: ID does not exist" Jul 17 21:06:41.648864 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.648809 2568 scope.go:117] "RemoveContainer" containerID="500dadb158c44cf9026a82431c937fe148afe9d4f287f2f6bff3681af00599b2" Jul 17 21:06:41.649039 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.649017 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"500dadb158c44cf9026a82431c937fe148afe9d4f287f2f6bff3681af00599b2"} err="failed to get container status \"500dadb158c44cf9026a82431c937fe148afe9d4f287f2f6bff3681af00599b2\": rpc error: code = NotFound desc = could not find container \"500dadb158c44cf9026a82431c937fe148afe9d4f287f2f6bff3681af00599b2\": container with ID starting with 500dadb158c44cf9026a82431c937fe148afe9d4f287f2f6bff3681af00599b2 not found: ID does not exist" Jul 17 21:06:41.649039 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.649039 2568 scope.go:117] "RemoveContainer" containerID="6c922549b9639495f542a34a12fbfc126a051df53f94c47049b1e98b9711c3cf" Jul 17 21:06:41.649259 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.649242 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c922549b9639495f542a34a12fbfc126a051df53f94c47049b1e98b9711c3cf"} err="failed to get container status \"6c922549b9639495f542a34a12fbfc126a051df53f94c47049b1e98b9711c3cf\": rpc error: code = NotFound desc = could not find container \"6c922549b9639495f542a34a12fbfc126a051df53f94c47049b1e98b9711c3cf\": container with ID starting with 6c922549b9639495f542a34a12fbfc126a051df53f94c47049b1e98b9711c3cf not found: ID does not exist" Jul 17 21:06:41.649309 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.649261 2568 scope.go:117] "RemoveContainer" containerID="f5476f03e7376c8d25533bf5babf8166130e47480888946dd0f3ecbc40fe9875" Jul 17 21:06:41.649489 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.649470 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5476f03e7376c8d25533bf5babf8166130e47480888946dd0f3ecbc40fe9875"} err="failed to get container status \"f5476f03e7376c8d25533bf5babf8166130e47480888946dd0f3ecbc40fe9875\": rpc error: code = NotFound desc = could not find container \"f5476f03e7376c8d25533bf5babf8166130e47480888946dd0f3ecbc40fe9875\": container with ID starting with f5476f03e7376c8d25533bf5babf8166130e47480888946dd0f3ecbc40fe9875 not found: ID does not exist" Jul 17 21:06:41.649531 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.649492 2568 scope.go:117] "RemoveContainer" containerID="75de274cb2f773bedcffe5b0c683c700c36aeaae9f2f71e119bea8c1e5ef8fdc" Jul 17 21:06:41.649784 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.649757 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75de274cb2f773bedcffe5b0c683c700c36aeaae9f2f71e119bea8c1e5ef8fdc"} err="failed to get container status \"75de274cb2f773bedcffe5b0c683c700c36aeaae9f2f71e119bea8c1e5ef8fdc\": rpc error: code = NotFound desc = could not find container \"75de274cb2f773bedcffe5b0c683c700c36aeaae9f2f71e119bea8c1e5ef8fdc\": container with ID starting with 75de274cb2f773bedcffe5b0c683c700c36aeaae9f2f71e119bea8c1e5ef8fdc not found: ID does not exist" Jul 17 21:06:41.649784 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.649779 2568 scope.go:117] "RemoveContainer" containerID="60c456a6cdb1d5697d7984f2c0e0784d9a846088e444f21432c294f00105783b" Jul 17 21:06:41.649938 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.649906 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-be279p6bum5rs\"" Jul 17 21:06:41.649977 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.649964 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 17 21:06:41.650038 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.650011 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60c456a6cdb1d5697d7984f2c0e0784d9a846088e444f21432c294f00105783b"} err="failed to get container status \"60c456a6cdb1d5697d7984f2c0e0784d9a846088e444f21432c294f00105783b\": rpc error: code = NotFound desc = could not find container \"60c456a6cdb1d5697d7984f2c0e0784d9a846088e444f21432c294f00105783b\": container with ID starting with 60c456a6cdb1d5697d7984f2c0e0784d9a846088e444f21432c294f00105783b not found: ID does not exist" Jul 17 21:06:41.650075 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.650042 2568 scope.go:117] "RemoveContainer" containerID="7fc3c45bba319637e68a7425f8eabcb8a050e4a018fcc2e88b9e69478802ace7" Jul 17 21:06:41.650075 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.650047 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 17 21:06:41.650192 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.650166 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 17 21:06:41.650308 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.650291 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 17 21:06:41.650368 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.650319 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 17 21:06:41.650508 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.650474 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fc3c45bba319637e68a7425f8eabcb8a050e4a018fcc2e88b9e69478802ace7"} err="failed to get container status \"7fc3c45bba319637e68a7425f8eabcb8a050e4a018fcc2e88b9e69478802ace7\": rpc error: code = NotFound desc = could not find container \"7fc3c45bba319637e68a7425f8eabcb8a050e4a018fcc2e88b9e69478802ace7\": container with ID starting with 7fc3c45bba319637e68a7425f8eabcb8a050e4a018fcc2e88b9e69478802ace7 not found: ID does not exist" Jul 17 21:06:41.650508 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.650502 2568 scope.go:117] "RemoveContainer" containerID="30a527f35127ab4261c68ac950f66b96e7165ca6b65f561126ec2dbf9345ef7d" Jul 17 21:06:41.650672 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.650514 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 17 21:06:41.650763 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.650736 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 17 21:06:41.650827 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.650741 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 17 21:06:41.650882 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.650558 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 17 21:06:41.651011 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.650975 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30a527f35127ab4261c68ac950f66b96e7165ca6b65f561126ec2dbf9345ef7d"} err="failed to get container status \"30a527f35127ab4261c68ac950f66b96e7165ca6b65f561126ec2dbf9345ef7d\": rpc error: code = NotFound desc = could not find container \"30a527f35127ab4261c68ac950f66b96e7165ca6b65f561126ec2dbf9345ef7d\": container with ID starting with 30a527f35127ab4261c68ac950f66b96e7165ca6b65f561126ec2dbf9345ef7d not found: ID does not exist" Jul 17 21:06:41.651011 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.651006 2568 scope.go:117] "RemoveContainer" containerID="500dadb158c44cf9026a82431c937fe148afe9d4f287f2f6bff3681af00599b2" Jul 17 21:06:41.651126 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.651056 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 17 21:06:41.651126 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.651102 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-kqtlf\"" Jul 17 21:06:41.651126 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.651113 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 17 21:06:41.651382 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.651365 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 17 21:06:41.651496 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.651407 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"500dadb158c44cf9026a82431c937fe148afe9d4f287f2f6bff3681af00599b2"} err="failed to get container status \"500dadb158c44cf9026a82431c937fe148afe9d4f287f2f6bff3681af00599b2\": rpc error: code = NotFound desc = could not find container \"500dadb158c44cf9026a82431c937fe148afe9d4f287f2f6bff3681af00599b2\": container with ID starting with 500dadb158c44cf9026a82431c937fe148afe9d4f287f2f6bff3681af00599b2 not found: ID does not exist" Jul 17 21:06:41.651596 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.651498 2568 scope.go:117] "RemoveContainer" containerID="6c922549b9639495f542a34a12fbfc126a051df53f94c47049b1e98b9711c3cf" Jul 17 21:06:41.651815 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.651790 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c922549b9639495f542a34a12fbfc126a051df53f94c47049b1e98b9711c3cf"} err="failed to get container status \"6c922549b9639495f542a34a12fbfc126a051df53f94c47049b1e98b9711c3cf\": rpc error: code = NotFound desc = could not find container \"6c922549b9639495f542a34a12fbfc126a051df53f94c47049b1e98b9711c3cf\": container with ID starting with 6c922549b9639495f542a34a12fbfc126a051df53f94c47049b1e98b9711c3cf not found: ID does not exist" Jul 17 21:06:41.651895 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.651818 2568 scope.go:117] "RemoveContainer" containerID="f5476f03e7376c8d25533bf5babf8166130e47480888946dd0f3ecbc40fe9875" Jul 17 21:06:41.652098 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.652072 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5476f03e7376c8d25533bf5babf8166130e47480888946dd0f3ecbc40fe9875"} err="failed to get container status \"f5476f03e7376c8d25533bf5babf8166130e47480888946dd0f3ecbc40fe9875\": rpc error: code = NotFound desc = could not find container \"f5476f03e7376c8d25533bf5babf8166130e47480888946dd0f3ecbc40fe9875\": container with ID starting with f5476f03e7376c8d25533bf5babf8166130e47480888946dd0f3ecbc40fe9875 not found: ID does not exist" Jul 17 21:06:41.652098 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.652098 2568 scope.go:117] "RemoveContainer" containerID="75de274cb2f773bedcffe5b0c683c700c36aeaae9f2f71e119bea8c1e5ef8fdc" Jul 17 21:06:41.652394 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.652363 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75de274cb2f773bedcffe5b0c683c700c36aeaae9f2f71e119bea8c1e5ef8fdc"} err="failed to get container status \"75de274cb2f773bedcffe5b0c683c700c36aeaae9f2f71e119bea8c1e5ef8fdc\": rpc error: code = NotFound desc = could not find container \"75de274cb2f773bedcffe5b0c683c700c36aeaae9f2f71e119bea8c1e5ef8fdc\": container with ID starting with 75de274cb2f773bedcffe5b0c683c700c36aeaae9f2f71e119bea8c1e5ef8fdc not found: ID does not exist" Jul 17 21:06:41.652394 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.652391 2568 scope.go:117] "RemoveContainer" containerID="60c456a6cdb1d5697d7984f2c0e0784d9a846088e444f21432c294f00105783b" Jul 17 21:06:41.652661 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.652636 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60c456a6cdb1d5697d7984f2c0e0784d9a846088e444f21432c294f00105783b"} err="failed to get container status \"60c456a6cdb1d5697d7984f2c0e0784d9a846088e444f21432c294f00105783b\": rpc error: code = NotFound desc = could not find container \"60c456a6cdb1d5697d7984f2c0e0784d9a846088e444f21432c294f00105783b\": container with ID starting with 60c456a6cdb1d5697d7984f2c0e0784d9a846088e444f21432c294f00105783b not found: ID does not exist" Jul 17 21:06:41.652661 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.652659 2568 scope.go:117] "RemoveContainer" containerID="7fc3c45bba319637e68a7425f8eabcb8a050e4a018fcc2e88b9e69478802ace7" Jul 17 21:06:41.652957 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.652933 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fc3c45bba319637e68a7425f8eabcb8a050e4a018fcc2e88b9e69478802ace7"} err="failed to get container status \"7fc3c45bba319637e68a7425f8eabcb8a050e4a018fcc2e88b9e69478802ace7\": rpc error: code = NotFound desc = could not find container \"7fc3c45bba319637e68a7425f8eabcb8a050e4a018fcc2e88b9e69478802ace7\": container with ID starting with 7fc3c45bba319637e68a7425f8eabcb8a050e4a018fcc2e88b9e69478802ace7 not found: ID does not exist" Jul 17 21:06:41.653307 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.653291 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 17 21:06:41.661706 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.661663 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 17 21:06:41.662940 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.662921 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 17 21:06:41.735140 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.735106 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3393ce16-67dd-4889-bd2a-8083f0f0fdb9" path="/var/lib/kubelet/pods/3393ce16-67dd-4889-bd2a-8083f0f0fdb9/volumes" Jul 17 21:06:41.746354 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.746331 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7652e36b-451e-4fcb-884a-b4305be2a439-web-config\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.746424 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.746363 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7652e36b-451e-4fcb-884a-b4305be2a439-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.746424 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.746391 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7652e36b-451e-4fcb-884a-b4305be2a439-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.746527 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.746448 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7652e36b-451e-4fcb-884a-b4305be2a439-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.746527 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.746510 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7652e36b-451e-4fcb-884a-b4305be2a439-config\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.746616 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.746527 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7652e36b-451e-4fcb-884a-b4305be2a439-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.746616 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.746543 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7652e36b-451e-4fcb-884a-b4305be2a439-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.746616 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.746569 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7652e36b-451e-4fcb-884a-b4305be2a439-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.746786 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.746612 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7652e36b-451e-4fcb-884a-b4305be2a439-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.746786 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.746653 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7652e36b-451e-4fcb-884a-b4305be2a439-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.746786 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.746693 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7652e36b-451e-4fcb-884a-b4305be2a439-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.746786 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.746719 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9c4m\" (UniqueName: \"kubernetes.io/projected/7652e36b-451e-4fcb-884a-b4305be2a439-kube-api-access-z9c4m\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.746786 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.746743 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7652e36b-451e-4fcb-884a-b4305be2a439-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.746786 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.746768 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7652e36b-451e-4fcb-884a-b4305be2a439-config-out\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.747046 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.746791 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7652e36b-451e-4fcb-884a-b4305be2a439-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.747046 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.746821 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7652e36b-451e-4fcb-884a-b4305be2a439-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.747046 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.746853 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7652e36b-451e-4fcb-884a-b4305be2a439-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.747046 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.746900 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7652e36b-451e-4fcb-884a-b4305be2a439-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.747046 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.746923 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7652e36b-451e-4fcb-884a-b4305be2a439-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.747046 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.746953 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7652e36b-451e-4fcb-884a-b4305be2a439-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.847648 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.847580 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7652e36b-451e-4fcb-884a-b4305be2a439-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.847648 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.847620 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7652e36b-451e-4fcb-884a-b4305be2a439-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.847648 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.847647 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7652e36b-451e-4fcb-884a-b4305be2a439-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.847873 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.847705 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7652e36b-451e-4fcb-884a-b4305be2a439-web-config\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.847873 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.847741 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7652e36b-451e-4fcb-884a-b4305be2a439-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.847873 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.847774 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7652e36b-451e-4fcb-884a-b4305be2a439-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.847873 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.847799 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7652e36b-451e-4fcb-884a-b4305be2a439-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.847873 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.847833 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7652e36b-451e-4fcb-884a-b4305be2a439-config\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.847873 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.847859 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7652e36b-451e-4fcb-884a-b4305be2a439-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.848161 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.847887 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7652e36b-451e-4fcb-884a-b4305be2a439-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.848161 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.847916 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7652e36b-451e-4fcb-884a-b4305be2a439-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.848161 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.847940 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7652e36b-451e-4fcb-884a-b4305be2a439-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.848161 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.847976 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7652e36b-451e-4fcb-884a-b4305be2a439-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.848161 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.848001 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7652e36b-451e-4fcb-884a-b4305be2a439-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.848161 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.848024 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9c4m\" (UniqueName: \"kubernetes.io/projected/7652e36b-451e-4fcb-884a-b4305be2a439-kube-api-access-z9c4m\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.848161 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.848050 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7652e36b-451e-4fcb-884a-b4305be2a439-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.848161 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.848079 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7652e36b-451e-4fcb-884a-b4305be2a439-config-out\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.848161 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.848083 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7652e36b-451e-4fcb-884a-b4305be2a439-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.848161 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.848105 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7652e36b-451e-4fcb-884a-b4305be2a439-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.848161 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.848135 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7652e36b-451e-4fcb-884a-b4305be2a439-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.848161 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.848161 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7652e36b-451e-4fcb-884a-b4305be2a439-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.848759 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.848282 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7652e36b-451e-4fcb-884a-b4305be2a439-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.848759 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.848375 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7652e36b-451e-4fcb-884a-b4305be2a439-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.848863 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.848841 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7652e36b-451e-4fcb-884a-b4305be2a439-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.851883 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.850544 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7652e36b-451e-4fcb-884a-b4305be2a439-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.851883 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.850609 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/7652e36b-451e-4fcb-884a-b4305be2a439-config\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.851883 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.850609 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7652e36b-451e-4fcb-884a-b4305be2a439-web-config\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.851883 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.850878 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7652e36b-451e-4fcb-884a-b4305be2a439-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.851883 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.851075 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7652e36b-451e-4fcb-884a-b4305be2a439-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.851883 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.851212 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7652e36b-451e-4fcb-884a-b4305be2a439-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.851883 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.850878 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7652e36b-451e-4fcb-884a-b4305be2a439-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.851883 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.851824 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7652e36b-451e-4fcb-884a-b4305be2a439-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.852395 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.851917 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7652e36b-451e-4fcb-884a-b4305be2a439-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.852713 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.852674 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7652e36b-451e-4fcb-884a-b4305be2a439-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.853123 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.853100 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7652e36b-451e-4fcb-884a-b4305be2a439-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.853209 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.853164 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7652e36b-451e-4fcb-884a-b4305be2a439-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.853209 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.853180 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7652e36b-451e-4fcb-884a-b4305be2a439-config-out\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.853640 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.853606 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7652e36b-451e-4fcb-884a-b4305be2a439-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.854504 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.854486 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7652e36b-451e-4fcb-884a-b4305be2a439-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.858472 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.858453 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9c4m\" (UniqueName: \"kubernetes.io/projected/7652e36b-451e-4fcb-884a-b4305be2a439-kube-api-access-z9c4m\") pod \"prometheus-k8s-0\" (UID: \"7652e36b-451e-4fcb-884a-b4305be2a439\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:41.962000 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:41.961974 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:06:42.102724 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:42.102620 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 17 21:06:42.105344 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:06:42.105321 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7652e36b_451e_4fcb_884a_b4305be2a439.slice/crio-f9c802250726b8d232a6b68b8dcb89064269a535ce8ed743c83552581ed74eee WatchSource:0}: Error finding container f9c802250726b8d232a6b68b8dcb89064269a535ce8ed743c83552581ed74eee: Status 404 returned error can't find the container with id f9c802250726b8d232a6b68b8dcb89064269a535ce8ed743c83552581ed74eee Jul 17 21:06:42.591156 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:42.591120 2568 generic.go:356] "Generic (PLEG): container finished" podID="7652e36b-451e-4fcb-884a-b4305be2a439" containerID="5a8455b2b959e8b92560ca184748f6ff993bb15380f5b139e386f981e5797e41" exitCode=0 Jul 17 21:06:42.591332 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:42.591211 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7652e36b-451e-4fcb-884a-b4305be2a439","Type":"ContainerDied","Data":"5a8455b2b959e8b92560ca184748f6ff993bb15380f5b139e386f981e5797e41"} Jul 17 21:06:42.591332 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:42.591277 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7652e36b-451e-4fcb-884a-b4305be2a439","Type":"ContainerStarted","Data":"f9c802250726b8d232a6b68b8dcb89064269a535ce8ed743c83552581ed74eee"} Jul 17 21:06:43.599070 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:43.599032 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7652e36b-451e-4fcb-884a-b4305be2a439","Type":"ContainerStarted","Data":"cf28f71b48acce2cf1937ede5d113b9d37fc8e57590900d0e6201ee87ed4ee1f"} Jul 17 21:06:43.599542 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:43.599107 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7652e36b-451e-4fcb-884a-b4305be2a439","Type":"ContainerStarted","Data":"c31873c06465c3b308dcde9747e6ea345312c5016231ed8c8f5590733e40b21c"} Jul 17 21:06:43.599542 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:43.599146 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7652e36b-451e-4fcb-884a-b4305be2a439","Type":"ContainerStarted","Data":"0c3ab5de38d35bdaecb3ca0185458ea50aa424ba90b7ec8516ec43fe02987b13"} Jul 17 21:06:43.599542 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:43.599228 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7652e36b-451e-4fcb-884a-b4305be2a439","Type":"ContainerStarted","Data":"6da9335a2d5c40153cdaa6c249c5d9296fef6f14e9b31fbe4ae172130d0de04a"} Jul 17 21:06:43.599542 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:43.599265 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7652e36b-451e-4fcb-884a-b4305be2a439","Type":"ContainerStarted","Data":"3f26f8a13e6f0e1200ee337253d53cf990961e676ffb735b36b0f75bbe252aad"} Jul 17 21:06:43.599542 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:43.599318 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7652e36b-451e-4fcb-884a-b4305be2a439","Type":"ContainerStarted","Data":"c56bdb230f6d8a0be153f458cf36ce1bb2b31b4a1bed2539d32a23e56011628f"} Jul 17 21:06:43.631242 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:43.631180 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.61251248 podStartE2EDuration="2.631160596s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.648116ms" isStatefulPod=false podCreationTimestamp="2026-07-17 21:06:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:06:43.628727644 +0000 UTC m=+182.428526976" watchObservedRunningTime="2026-07-17 21:06:43.631160596 +0000 UTC m=+182.430959926" Jul 17 21:06:46.962962 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:06:46.962933 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:07:00.182904 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:00.182872 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5669c9bc8c-p8m6w"] Jul 17 21:07:00.187254 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:00.187233 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5669c9bc8c-p8m6w" Jul 17 21:07:00.197941 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:00.197925 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5669c9bc8c-p8m6w"] Jul 17 21:07:00.277872 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:00.277845 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e38f6df6-d263-4936-b9f8-6755afc37ee8-console-serving-cert\") pod \"console-5669c9bc8c-p8m6w\" (UID: \"e38f6df6-d263-4936-b9f8-6755afc37ee8\") " pod="openshift-console/console-5669c9bc8c-p8m6w" Jul 17 21:07:00.277959 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:00.277874 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e38f6df6-d263-4936-b9f8-6755afc37ee8-oauth-serving-cert\") pod \"console-5669c9bc8c-p8m6w\" (UID: \"e38f6df6-d263-4936-b9f8-6755afc37ee8\") " pod="openshift-console/console-5669c9bc8c-p8m6w" Jul 17 21:07:00.277959 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:00.277896 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxzw9\" (UniqueName: \"kubernetes.io/projected/e38f6df6-d263-4936-b9f8-6755afc37ee8-kube-api-access-sxzw9\") pod \"console-5669c9bc8c-p8m6w\" (UID: \"e38f6df6-d263-4936-b9f8-6755afc37ee8\") " pod="openshift-console/console-5669c9bc8c-p8m6w" Jul 17 21:07:00.277959 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:00.277913 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e38f6df6-d263-4936-b9f8-6755afc37ee8-service-ca\") pod \"console-5669c9bc8c-p8m6w\" (UID: \"e38f6df6-d263-4936-b9f8-6755afc37ee8\") " pod="openshift-console/console-5669c9bc8c-p8m6w" Jul 17 21:07:00.278066 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:00.277992 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e38f6df6-d263-4936-b9f8-6755afc37ee8-console-oauth-config\") pod \"console-5669c9bc8c-p8m6w\" (UID: \"e38f6df6-d263-4936-b9f8-6755afc37ee8\") " pod="openshift-console/console-5669c9bc8c-p8m6w" Jul 17 21:07:00.278066 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:00.278021 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e38f6df6-d263-4936-b9f8-6755afc37ee8-console-config\") pod \"console-5669c9bc8c-p8m6w\" (UID: \"e38f6df6-d263-4936-b9f8-6755afc37ee8\") " pod="openshift-console/console-5669c9bc8c-p8m6w" Jul 17 21:07:00.278066 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:00.278041 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e38f6df6-d263-4936-b9f8-6755afc37ee8-trusted-ca-bundle\") pod \"console-5669c9bc8c-p8m6w\" (UID: \"e38f6df6-d263-4936-b9f8-6755afc37ee8\") " pod="openshift-console/console-5669c9bc8c-p8m6w" Jul 17 21:07:00.379133 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:00.379097 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e38f6df6-d263-4936-b9f8-6755afc37ee8-console-serving-cert\") pod \"console-5669c9bc8c-p8m6w\" (UID: \"e38f6df6-d263-4936-b9f8-6755afc37ee8\") " pod="openshift-console/console-5669c9bc8c-p8m6w" Jul 17 21:07:00.379217 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:00.379138 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e38f6df6-d263-4936-b9f8-6755afc37ee8-oauth-serving-cert\") pod \"console-5669c9bc8c-p8m6w\" (UID: \"e38f6df6-d263-4936-b9f8-6755afc37ee8\") " pod="openshift-console/console-5669c9bc8c-p8m6w" Jul 17 21:07:00.379217 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:00.379154 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxzw9\" (UniqueName: \"kubernetes.io/projected/e38f6df6-d263-4936-b9f8-6755afc37ee8-kube-api-access-sxzw9\") pod \"console-5669c9bc8c-p8m6w\" (UID: \"e38f6df6-d263-4936-b9f8-6755afc37ee8\") " pod="openshift-console/console-5669c9bc8c-p8m6w" Jul 17 21:07:00.379217 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:00.379203 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e38f6df6-d263-4936-b9f8-6755afc37ee8-service-ca\") pod \"console-5669c9bc8c-p8m6w\" (UID: \"e38f6df6-d263-4936-b9f8-6755afc37ee8\") " pod="openshift-console/console-5669c9bc8c-p8m6w" Jul 17 21:07:00.379332 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:00.379233 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e38f6df6-d263-4936-b9f8-6755afc37ee8-console-oauth-config\") pod \"console-5669c9bc8c-p8m6w\" (UID: \"e38f6df6-d263-4936-b9f8-6755afc37ee8\") " pod="openshift-console/console-5669c9bc8c-p8m6w" Jul 17 21:07:00.379332 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:00.379252 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e38f6df6-d263-4936-b9f8-6755afc37ee8-console-config\") pod \"console-5669c9bc8c-p8m6w\" (UID: \"e38f6df6-d263-4936-b9f8-6755afc37ee8\") " pod="openshift-console/console-5669c9bc8c-p8m6w" Jul 17 21:07:00.379332 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:00.379285 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e38f6df6-d263-4936-b9f8-6755afc37ee8-trusted-ca-bundle\") pod \"console-5669c9bc8c-p8m6w\" (UID: \"e38f6df6-d263-4936-b9f8-6755afc37ee8\") " pod="openshift-console/console-5669c9bc8c-p8m6w" Jul 17 21:07:00.379925 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:00.379904 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e38f6df6-d263-4936-b9f8-6755afc37ee8-console-config\") pod \"console-5669c9bc8c-p8m6w\" (UID: \"e38f6df6-d263-4936-b9f8-6755afc37ee8\") " pod="openshift-console/console-5669c9bc8c-p8m6w" Jul 17 21:07:00.379925 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:00.379914 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e38f6df6-d263-4936-b9f8-6755afc37ee8-oauth-serving-cert\") pod \"console-5669c9bc8c-p8m6w\" (UID: \"e38f6df6-d263-4936-b9f8-6755afc37ee8\") " pod="openshift-console/console-5669c9bc8c-p8m6w" Jul 17 21:07:00.379925 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:00.379924 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e38f6df6-d263-4936-b9f8-6755afc37ee8-service-ca\") pod \"console-5669c9bc8c-p8m6w\" (UID: \"e38f6df6-d263-4936-b9f8-6755afc37ee8\") " pod="openshift-console/console-5669c9bc8c-p8m6w" Jul 17 21:07:00.380232 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:00.380212 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e38f6df6-d263-4936-b9f8-6755afc37ee8-trusted-ca-bundle\") pod \"console-5669c9bc8c-p8m6w\" (UID: \"e38f6df6-d263-4936-b9f8-6755afc37ee8\") " pod="openshift-console/console-5669c9bc8c-p8m6w" Jul 17 21:07:00.381636 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:00.381612 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e38f6df6-d263-4936-b9f8-6755afc37ee8-console-oauth-config\") pod \"console-5669c9bc8c-p8m6w\" (UID: \"e38f6df6-d263-4936-b9f8-6755afc37ee8\") " pod="openshift-console/console-5669c9bc8c-p8m6w" Jul 17 21:07:00.381779 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:00.381763 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e38f6df6-d263-4936-b9f8-6755afc37ee8-console-serving-cert\") pod \"console-5669c9bc8c-p8m6w\" (UID: \"e38f6df6-d263-4936-b9f8-6755afc37ee8\") " pod="openshift-console/console-5669c9bc8c-p8m6w" Jul 17 21:07:00.387531 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:00.387510 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxzw9\" (UniqueName: \"kubernetes.io/projected/e38f6df6-d263-4936-b9f8-6755afc37ee8-kube-api-access-sxzw9\") pod \"console-5669c9bc8c-p8m6w\" (UID: \"e38f6df6-d263-4936-b9f8-6755afc37ee8\") " pod="openshift-console/console-5669c9bc8c-p8m6w" Jul 17 21:07:00.496486 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:00.496428 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5669c9bc8c-p8m6w" Jul 17 21:07:00.621936 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:00.621910 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5669c9bc8c-p8m6w"] Jul 17 21:07:00.624347 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:07:00.624320 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode38f6df6_d263_4936_b9f8_6755afc37ee8.slice/crio-77b335f572375d0a010f332ebc9e95ff92b10633ec10abf97fcaf3a02a6bc2f3 WatchSource:0}: Error finding container 77b335f572375d0a010f332ebc9e95ff92b10633ec10abf97fcaf3a02a6bc2f3: Status 404 returned error can't find the container with id 77b335f572375d0a010f332ebc9e95ff92b10633ec10abf97fcaf3a02a6bc2f3 Jul 17 21:07:00.663403 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:00.663368 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5669c9bc8c-p8m6w" event={"ID":"e38f6df6-d263-4936-b9f8-6755afc37ee8","Type":"ContainerStarted","Data":"77b335f572375d0a010f332ebc9e95ff92b10633ec10abf97fcaf3a02a6bc2f3"} Jul 17 21:07:01.668816 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:01.668782 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5669c9bc8c-p8m6w" event={"ID":"e38f6df6-d263-4936-b9f8-6755afc37ee8","Type":"ContainerStarted","Data":"fc4000fc081b2728764dc4a4ead9857baac6ad9454686978ec30ce9ad66c91ab"} Jul 17 21:07:01.686873 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:01.686784 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5669c9bc8c-p8m6w" podStartSLOduration=1.686766305 podStartE2EDuration="1.686766305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:07:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:07:01.686534536 +0000 UTC m=+200.486333895" watchObservedRunningTime="2026-07-17 21:07:01.686766305 +0000 UTC m=+200.486565635" Jul 17 21:07:10.497186 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:10.497152 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5669c9bc8c-p8m6w" Jul 17 21:07:10.497671 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:10.497384 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5669c9bc8c-p8m6w" Jul 17 21:07:10.501910 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:10.501891 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5669c9bc8c-p8m6w" Jul 17 21:07:10.710441 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:10.710417 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5669c9bc8c-p8m6w" Jul 17 21:07:10.764787 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:10.764713 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6448cb7687-mtqq6"] Jul 17 21:07:35.785274 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:35.785232 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6448cb7687-mtqq6" podUID="8d60eae0-81fb-4d48-9940-aa329a18cce0" containerName="console" containerID="cri-o://3a21c1dd121fd18b130d7c4ec38db08f0cf6fd981b2c4e9894d7eee279fd34b2" gracePeriod=15 Jul 17 21:07:36.036517 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:36.036463 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6448cb7687-mtqq6" Jul 17 21:07:36.124596 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:36.124567 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d60eae0-81fb-4d48-9940-aa329a18cce0-console-serving-cert\") pod \"8d60eae0-81fb-4d48-9940-aa329a18cce0\" (UID: \"8d60eae0-81fb-4d48-9940-aa329a18cce0\") " Jul 17 21:07:36.124779 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:36.124613 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d60eae0-81fb-4d48-9940-aa329a18cce0-oauth-serving-cert\") pod \"8d60eae0-81fb-4d48-9940-aa329a18cce0\" (UID: \"8d60eae0-81fb-4d48-9940-aa329a18cce0\") " Jul 17 21:07:36.124779 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:36.124632 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkzqb\" (UniqueName: \"kubernetes.io/projected/8d60eae0-81fb-4d48-9940-aa329a18cce0-kube-api-access-dkzqb\") pod \"8d60eae0-81fb-4d48-9940-aa329a18cce0\" (UID: \"8d60eae0-81fb-4d48-9940-aa329a18cce0\") " Jul 17 21:07:36.124779 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:36.124656 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d60eae0-81fb-4d48-9940-aa329a18cce0-console-config\") pod \"8d60eae0-81fb-4d48-9940-aa329a18cce0\" (UID: \"8d60eae0-81fb-4d48-9940-aa329a18cce0\") " Jul 17 21:07:36.124779 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:36.124705 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d60eae0-81fb-4d48-9940-aa329a18cce0-console-oauth-config\") pod \"8d60eae0-81fb-4d48-9940-aa329a18cce0\" (UID: \"8d60eae0-81fb-4d48-9940-aa329a18cce0\") " Jul 17 21:07:36.124779 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:36.124728 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d60eae0-81fb-4d48-9940-aa329a18cce0-trusted-ca-bundle\") pod \"8d60eae0-81fb-4d48-9940-aa329a18cce0\" (UID: \"8d60eae0-81fb-4d48-9940-aa329a18cce0\") " Jul 17 21:07:36.124779 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:36.124749 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d60eae0-81fb-4d48-9940-aa329a18cce0-service-ca\") pod \"8d60eae0-81fb-4d48-9940-aa329a18cce0\" (UID: \"8d60eae0-81fb-4d48-9940-aa329a18cce0\") " Jul 17 21:07:36.125557 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:36.125481 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d60eae0-81fb-4d48-9940-aa329a18cce0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8d60eae0-81fb-4d48-9940-aa329a18cce0" (UID: "8d60eae0-81fb-4d48-9940-aa329a18cce0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:07:36.125557 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:36.125541 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d60eae0-81fb-4d48-9940-aa329a18cce0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8d60eae0-81fb-4d48-9940-aa329a18cce0" (UID: "8d60eae0-81fb-4d48-9940-aa329a18cce0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:07:36.125909 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:36.125569 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d60eae0-81fb-4d48-9940-aa329a18cce0-console-config" (OuterVolumeSpecName: "console-config") pod "8d60eae0-81fb-4d48-9940-aa329a18cce0" (UID: "8d60eae0-81fb-4d48-9940-aa329a18cce0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:07:36.125909 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:36.125863 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d60eae0-81fb-4d48-9940-aa329a18cce0-service-ca" (OuterVolumeSpecName: "service-ca") pod "8d60eae0-81fb-4d48-9940-aa329a18cce0" (UID: "8d60eae0-81fb-4d48-9940-aa329a18cce0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:07:36.131609 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:36.131517 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d60eae0-81fb-4d48-9940-aa329a18cce0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8d60eae0-81fb-4d48-9940-aa329a18cce0" (UID: "8d60eae0-81fb-4d48-9940-aa329a18cce0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 21:07:36.131742 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:36.131662 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d60eae0-81fb-4d48-9940-aa329a18cce0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8d60eae0-81fb-4d48-9940-aa329a18cce0" (UID: "8d60eae0-81fb-4d48-9940-aa329a18cce0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 21:07:36.131813 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:36.131767 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d60eae0-81fb-4d48-9940-aa329a18cce0-kube-api-access-dkzqb" (OuterVolumeSpecName: "kube-api-access-dkzqb") pod "8d60eae0-81fb-4d48-9940-aa329a18cce0" (UID: "8d60eae0-81fb-4d48-9940-aa329a18cce0"). InnerVolumeSpecName "kube-api-access-dkzqb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:07:36.226085 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:36.226060 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d60eae0-81fb-4d48-9940-aa329a18cce0-console-serving-cert\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:07:36.226085 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:36.226082 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d60eae0-81fb-4d48-9940-aa329a18cce0-oauth-serving-cert\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:07:36.226235 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:36.226092 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkzqb\" (UniqueName: \"kubernetes.io/projected/8d60eae0-81fb-4d48-9940-aa329a18cce0-kube-api-access-dkzqb\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:07:36.226235 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:36.226101 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d60eae0-81fb-4d48-9940-aa329a18cce0-console-config\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:07:36.226235 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:36.226110 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d60eae0-81fb-4d48-9940-aa329a18cce0-console-oauth-config\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:07:36.226235 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:36.226118 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d60eae0-81fb-4d48-9940-aa329a18cce0-trusted-ca-bundle\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:07:36.226235 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:36.226127 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d60eae0-81fb-4d48-9940-aa329a18cce0-service-ca\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:07:36.797823 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:36.797786 2568 generic.go:356] "Generic (PLEG): container finished" podID="8d60eae0-81fb-4d48-9940-aa329a18cce0" containerID="3a21c1dd121fd18b130d7c4ec38db08f0cf6fd981b2c4e9894d7eee279fd34b2" exitCode=0 Jul 17 21:07:36.798245 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:36.797839 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6448cb7687-mtqq6" Jul 17 21:07:36.798245 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:36.797844 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6448cb7687-mtqq6" event={"ID":"8d60eae0-81fb-4d48-9940-aa329a18cce0","Type":"ContainerDied","Data":"3a21c1dd121fd18b130d7c4ec38db08f0cf6fd981b2c4e9894d7eee279fd34b2"} Jul 17 21:07:36.798245 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:36.797880 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6448cb7687-mtqq6" event={"ID":"8d60eae0-81fb-4d48-9940-aa329a18cce0","Type":"ContainerDied","Data":"29d681ce283fef889cb5a08d9ab00444112dff7283242054ce2f5f6ca410f3ea"} Jul 17 21:07:36.798245 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:36.797898 2568 scope.go:117] "RemoveContainer" containerID="3a21c1dd121fd18b130d7c4ec38db08f0cf6fd981b2c4e9894d7eee279fd34b2" Jul 17 21:07:36.808746 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:36.808727 2568 scope.go:117] "RemoveContainer" containerID="3a21c1dd121fd18b130d7c4ec38db08f0cf6fd981b2c4e9894d7eee279fd34b2" Jul 17 21:07:36.808988 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:07:36.808967 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a21c1dd121fd18b130d7c4ec38db08f0cf6fd981b2c4e9894d7eee279fd34b2\": container with ID starting with 3a21c1dd121fd18b130d7c4ec38db08f0cf6fd981b2c4e9894d7eee279fd34b2 not found: ID does not exist" containerID="3a21c1dd121fd18b130d7c4ec38db08f0cf6fd981b2c4e9894d7eee279fd34b2" Jul 17 21:07:36.809043 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:36.808996 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a21c1dd121fd18b130d7c4ec38db08f0cf6fd981b2c4e9894d7eee279fd34b2"} err="failed to get container status \"3a21c1dd121fd18b130d7c4ec38db08f0cf6fd981b2c4e9894d7eee279fd34b2\": rpc error: code = NotFound desc = could not find container \"3a21c1dd121fd18b130d7c4ec38db08f0cf6fd981b2c4e9894d7eee279fd34b2\": container with ID starting with 3a21c1dd121fd18b130d7c4ec38db08f0cf6fd981b2c4e9894d7eee279fd34b2 not found: ID does not exist" Jul 17 21:07:36.825923 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:36.825898 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6448cb7687-mtqq6"] Jul 17 21:07:36.833014 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:36.832993 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6448cb7687-mtqq6"] Jul 17 21:07:37.735697 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:37.735652 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d60eae0-81fb-4d48-9940-aa329a18cce0" path="/var/lib/kubelet/pods/8d60eae0-81fb-4d48-9940-aa329a18cce0/volumes" Jul 17 21:07:41.962677 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:41.962592 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:07:41.977874 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:41.977851 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:07:42.835818 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:42.835788 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 21:07:45.395084 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:45.395048 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xbv54"] Jul 17 21:07:45.395453 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:45.395388 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d60eae0-81fb-4d48-9940-aa329a18cce0" containerName="console" Jul 17 21:07:45.395453 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:45.395400 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d60eae0-81fb-4d48-9940-aa329a18cce0" containerName="console" Jul 17 21:07:45.395453 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:45.395452 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d60eae0-81fb-4d48-9940-aa329a18cce0" containerName="console" Jul 17 21:07:45.399936 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:45.399919 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xbv54" Jul 17 21:07:45.402357 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:45.402328 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 17 21:07:45.402465 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:45.402390 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 17 21:07:45.403202 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:45.403188 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-24r4m\"" Jul 17 21:07:45.408251 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:45.408221 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xbv54"] Jul 17 21:07:45.496166 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:45.496126 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d65d947e-5ea4-4cb0-90d7-6acea5fb21f5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xbv54\" (UID: \"d65d947e-5ea4-4cb0-90d7-6acea5fb21f5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xbv54" Jul 17 21:07:45.496336 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:45.496181 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcrqr\" (UniqueName: \"kubernetes.io/projected/d65d947e-5ea4-4cb0-90d7-6acea5fb21f5-kube-api-access-qcrqr\") pod \"cert-manager-cainjector-559cdd8c87-xbv54\" (UID: \"d65d947e-5ea4-4cb0-90d7-6acea5fb21f5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xbv54" Jul 17 21:07:45.596578 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:45.596531 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcrqr\" (UniqueName: \"kubernetes.io/projected/d65d947e-5ea4-4cb0-90d7-6acea5fb21f5-kube-api-access-qcrqr\") pod \"cert-manager-cainjector-559cdd8c87-xbv54\" (UID: \"d65d947e-5ea4-4cb0-90d7-6acea5fb21f5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xbv54" Jul 17 21:07:45.596746 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:45.596642 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d65d947e-5ea4-4cb0-90d7-6acea5fb21f5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xbv54\" (UID: \"d65d947e-5ea4-4cb0-90d7-6acea5fb21f5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xbv54" Jul 17 21:07:45.605120 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:45.605091 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d65d947e-5ea4-4cb0-90d7-6acea5fb21f5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xbv54\" (UID: \"d65d947e-5ea4-4cb0-90d7-6acea5fb21f5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xbv54" Jul 17 21:07:45.605241 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:45.605221 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcrqr\" (UniqueName: \"kubernetes.io/projected/d65d947e-5ea4-4cb0-90d7-6acea5fb21f5-kube-api-access-qcrqr\") pod \"cert-manager-cainjector-559cdd8c87-xbv54\" (UID: \"d65d947e-5ea4-4cb0-90d7-6acea5fb21f5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xbv54" Jul 17 21:07:45.717989 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:45.717928 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xbv54" Jul 17 21:07:45.871075 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:45.871048 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xbv54"] Jul 17 21:07:45.874043 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:07:45.874012 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd65d947e_5ea4_4cb0_90d7_6acea5fb21f5.slice/crio-5444abaa42a652a2519e8cc1a3d3b7bdabab6a8b42ea3c786194dea6183e273a WatchSource:0}: Error finding container 5444abaa42a652a2519e8cc1a3d3b7bdabab6a8b42ea3c786194dea6183e273a: Status 404 returned error can't find the container with id 5444abaa42a652a2519e8cc1a3d3b7bdabab6a8b42ea3c786194dea6183e273a Jul 17 21:07:46.838831 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:46.838792 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xbv54" event={"ID":"d65d947e-5ea4-4cb0-90d7-6acea5fb21f5","Type":"ContainerStarted","Data":"5444abaa42a652a2519e8cc1a3d3b7bdabab6a8b42ea3c786194dea6183e273a"} Jul 17 21:07:50.857092 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:50.857054 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xbv54" event={"ID":"d65d947e-5ea4-4cb0-90d7-6acea5fb21f5","Type":"ContainerStarted","Data":"526ca386f998722c1e96d066b1dec9b3ca99ff059504223973481cd460de0197"} Jul 17 21:07:50.885047 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:50.884999 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xbv54" podStartSLOduration=1.073164521 podStartE2EDuration="5.884981241s" totalImagesPullingTime="4.81181672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:07:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:07:50.884910606 +0000 UTC m=+249.684709936" watchObservedRunningTime="2026-07-17 21:07:50.884981241 +0000 UTC m=+249.684780574" Jul 17 21:07:56.557991 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:56.557955 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-88tgn"] Jul 17 21:07:56.561139 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:56.561121 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-88tgn" Jul 17 21:07:56.563896 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:56.563873 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 17 21:07:56.564004 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:56.563914 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-c4s68\"" Jul 17 21:07:56.564914 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:56.564901 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 17 21:07:56.569162 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:56.569139 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-88tgn"] Jul 17 21:07:56.687367 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:56.687323 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e69b7111-7c8b-452c-9255-beb5c8a20609-tmp\") pod \"openshift-lws-operator-fd8ccff4c-88tgn\" (UID: \"e69b7111-7c8b-452c-9255-beb5c8a20609\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-88tgn" Jul 17 21:07:56.687554 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:56.687409 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhjgn\" (UniqueName: \"kubernetes.io/projected/e69b7111-7c8b-452c-9255-beb5c8a20609-kube-api-access-xhjgn\") pod \"openshift-lws-operator-fd8ccff4c-88tgn\" (UID: \"e69b7111-7c8b-452c-9255-beb5c8a20609\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-88tgn" Jul 17 21:07:56.788514 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:56.788470 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e69b7111-7c8b-452c-9255-beb5c8a20609-tmp\") pod \"openshift-lws-operator-fd8ccff4c-88tgn\" (UID: \"e69b7111-7c8b-452c-9255-beb5c8a20609\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-88tgn" Jul 17 21:07:56.788711 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:56.788549 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhjgn\" (UniqueName: \"kubernetes.io/projected/e69b7111-7c8b-452c-9255-beb5c8a20609-kube-api-access-xhjgn\") pod \"openshift-lws-operator-fd8ccff4c-88tgn\" (UID: \"e69b7111-7c8b-452c-9255-beb5c8a20609\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-88tgn" Jul 17 21:07:56.789033 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:56.789015 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e69b7111-7c8b-452c-9255-beb5c8a20609-tmp\") pod \"openshift-lws-operator-fd8ccff4c-88tgn\" (UID: \"e69b7111-7c8b-452c-9255-beb5c8a20609\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-88tgn" Jul 17 21:07:56.797343 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:56.797322 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhjgn\" (UniqueName: \"kubernetes.io/projected/e69b7111-7c8b-452c-9255-beb5c8a20609-kube-api-access-xhjgn\") pod \"openshift-lws-operator-fd8ccff4c-88tgn\" (UID: \"e69b7111-7c8b-452c-9255-beb5c8a20609\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-88tgn" Jul 17 21:07:56.871432 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:56.871339 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-88tgn" Jul 17 21:07:57.003057 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:57.002881 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-88tgn"] Jul 17 21:07:57.005851 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:07:57.005817 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode69b7111_7c8b_452c_9255_beb5c8a20609.slice/crio-33dc3a6426e7738b02199a8c2ddeaab227081c1f77d1c25f574dc0f73a17eec9 WatchSource:0}: Error finding container 33dc3a6426e7738b02199a8c2ddeaab227081c1f77d1c25f574dc0f73a17eec9: Status 404 returned error can't find the container with id 33dc3a6426e7738b02199a8c2ddeaab227081c1f77d1c25f574dc0f73a17eec9 Jul 17 21:07:57.886228 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:57.886186 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-88tgn" event={"ID":"e69b7111-7c8b-452c-9255-beb5c8a20609","Type":"ContainerStarted","Data":"33dc3a6426e7738b02199a8c2ddeaab227081c1f77d1c25f574dc0f73a17eec9"} Jul 17 21:07:59.896190 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:59.896145 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-88tgn" event={"ID":"e69b7111-7c8b-452c-9255-beb5c8a20609","Type":"ContainerStarted","Data":"8c125b7755e03c6647960b830ffdc24748634779f9fed4df2fbe56290135e5bf"} Jul 17 21:07:59.916488 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:07:59.916398 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-88tgn" podStartSLOduration=1.266621018 podStartE2EDuration="3.916379777s" totalImagesPullingTime="2.649758759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:07:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:07:59.915865218 +0000 UTC m=+258.715664548" watchObservedRunningTime="2026-07-17 21:07:59.916379777 +0000 UTC m=+258.716179105" Jul 17 21:08:14.835469 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:14.835427 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-c8db86df9-pxqc4"] Jul 17 21:08:14.838231 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:14.838211 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c8db86df9-pxqc4" Jul 17 21:08:14.840816 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:14.840795 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 17 21:08:14.841615 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:14.841595 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 17 21:08:14.841736 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:14.841718 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 17 21:08:14.841792 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:14.841762 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-2zkdb\"" Jul 17 21:08:14.848842 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:14.848822 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c8db86df9-pxqc4"] Jul 17 21:08:14.941084 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:14.941050 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9ba3e036-7622-42eb-86f4-20e1bae3c2b3-manager-config\") pod \"lws-controller-manager-c8db86df9-pxqc4\" (UID: \"9ba3e036-7622-42eb-86f4-20e1bae3c2b3\") " pod="openshift-lws-operator/lws-controller-manager-c8db86df9-pxqc4" Jul 17 21:08:14.941246 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:14.941090 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9ba3e036-7622-42eb-86f4-20e1bae3c2b3-metrics-cert\") pod \"lws-controller-manager-c8db86df9-pxqc4\" (UID: \"9ba3e036-7622-42eb-86f4-20e1bae3c2b3\") " pod="openshift-lws-operator/lws-controller-manager-c8db86df9-pxqc4" Jul 17 21:08:14.941246 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:14.941159 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ba3e036-7622-42eb-86f4-20e1bae3c2b3-cert\") pod \"lws-controller-manager-c8db86df9-pxqc4\" (UID: \"9ba3e036-7622-42eb-86f4-20e1bae3c2b3\") " pod="openshift-lws-operator/lws-controller-manager-c8db86df9-pxqc4" Jul 17 21:08:14.941246 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:14.941235 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gphgt\" (UniqueName: \"kubernetes.io/projected/9ba3e036-7622-42eb-86f4-20e1bae3c2b3-kube-api-access-gphgt\") pod \"lws-controller-manager-c8db86df9-pxqc4\" (UID: \"9ba3e036-7622-42eb-86f4-20e1bae3c2b3\") " pod="openshift-lws-operator/lws-controller-manager-c8db86df9-pxqc4" Jul 17 21:08:15.041950 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:15.041915 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gphgt\" (UniqueName: \"kubernetes.io/projected/9ba3e036-7622-42eb-86f4-20e1bae3c2b3-kube-api-access-gphgt\") pod \"lws-controller-manager-c8db86df9-pxqc4\" (UID: \"9ba3e036-7622-42eb-86f4-20e1bae3c2b3\") " pod="openshift-lws-operator/lws-controller-manager-c8db86df9-pxqc4" Jul 17 21:08:15.041950 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:15.041956 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9ba3e036-7622-42eb-86f4-20e1bae3c2b3-manager-config\") pod \"lws-controller-manager-c8db86df9-pxqc4\" (UID: \"9ba3e036-7622-42eb-86f4-20e1bae3c2b3\") " pod="openshift-lws-operator/lws-controller-manager-c8db86df9-pxqc4" Jul 17 21:08:15.042185 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:15.041979 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9ba3e036-7622-42eb-86f4-20e1bae3c2b3-metrics-cert\") pod \"lws-controller-manager-c8db86df9-pxqc4\" (UID: \"9ba3e036-7622-42eb-86f4-20e1bae3c2b3\") " pod="openshift-lws-operator/lws-controller-manager-c8db86df9-pxqc4" Jul 17 21:08:15.042185 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:15.042018 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ba3e036-7622-42eb-86f4-20e1bae3c2b3-cert\") pod \"lws-controller-manager-c8db86df9-pxqc4\" (UID: \"9ba3e036-7622-42eb-86f4-20e1bae3c2b3\") " pod="openshift-lws-operator/lws-controller-manager-c8db86df9-pxqc4" Jul 17 21:08:15.042589 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:15.042560 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9ba3e036-7622-42eb-86f4-20e1bae3c2b3-manager-config\") pod \"lws-controller-manager-c8db86df9-pxqc4\" (UID: \"9ba3e036-7622-42eb-86f4-20e1bae3c2b3\") " pod="openshift-lws-operator/lws-controller-manager-c8db86df9-pxqc4" Jul 17 21:08:15.044528 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:15.044508 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9ba3e036-7622-42eb-86f4-20e1bae3c2b3-metrics-cert\") pod \"lws-controller-manager-c8db86df9-pxqc4\" (UID: \"9ba3e036-7622-42eb-86f4-20e1bae3c2b3\") " pod="openshift-lws-operator/lws-controller-manager-c8db86df9-pxqc4" Jul 17 21:08:15.044636 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:15.044538 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ba3e036-7622-42eb-86f4-20e1bae3c2b3-cert\") pod \"lws-controller-manager-c8db86df9-pxqc4\" (UID: \"9ba3e036-7622-42eb-86f4-20e1bae3c2b3\") " pod="openshift-lws-operator/lws-controller-manager-c8db86df9-pxqc4" Jul 17 21:08:15.055211 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:15.055177 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gphgt\" (UniqueName: \"kubernetes.io/projected/9ba3e036-7622-42eb-86f4-20e1bae3c2b3-kube-api-access-gphgt\") pod \"lws-controller-manager-c8db86df9-pxqc4\" (UID: \"9ba3e036-7622-42eb-86f4-20e1bae3c2b3\") " pod="openshift-lws-operator/lws-controller-manager-c8db86df9-pxqc4" Jul 17 21:08:15.147183 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:15.147086 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c8db86df9-pxqc4" Jul 17 21:08:15.278245 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:15.278216 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c8db86df9-pxqc4"] Jul 17 21:08:15.281019 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:08:15.280990 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ba3e036_7622_42eb_86f4_20e1bae3c2b3.slice/crio-61b765aa4e9a482a954a37b612f2226c21d61defc2bf02e8400f20d8d910a63f WatchSource:0}: Error finding container 61b765aa4e9a482a954a37b612f2226c21d61defc2bf02e8400f20d8d910a63f: Status 404 returned error can't find the container with id 61b765aa4e9a482a954a37b612f2226c21d61defc2bf02e8400f20d8d910a63f Jul 17 21:08:15.956950 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:15.956914 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c8db86df9-pxqc4" event={"ID":"9ba3e036-7622-42eb-86f4-20e1bae3c2b3","Type":"ContainerStarted","Data":"61b765aa4e9a482a954a37b612f2226c21d61defc2bf02e8400f20d8d910a63f"} Jul 17 21:08:18.970053 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:18.970019 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c8db86df9-pxqc4" event={"ID":"9ba3e036-7622-42eb-86f4-20e1bae3c2b3","Type":"ContainerStarted","Data":"7049e1e7d77fc7248375be42c088b3e0b65efb2a960f1bce18a67938b352f6c5"} Jul 17 21:08:18.970470 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:18.970145 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-c8db86df9-pxqc4" Jul 17 21:08:18.991992 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:18.991941 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-c8db86df9-pxqc4" podStartSLOduration=1.443682222 podStartE2EDuration="4.991922618s" totalImagesPullingTime="3.548240396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:08:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:08:18.98791647 +0000 UTC m=+277.787715801" watchObservedRunningTime="2026-07-17 21:08:18.991922618 +0000 UTC m=+277.791721947" Jul 17 21:08:19.517897 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:19.517863 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-8grtr"] Jul 17 21:08:19.521338 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:19.521321 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-8grtr" Jul 17 21:08:19.526978 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:19.526954 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 17 21:08:19.527177 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:19.527143 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 17 21:08:19.527399 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:19.527380 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gc7lq\"" Jul 17 21:08:19.527890 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:19.527757 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 17 21:08:19.530556 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:19.530536 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 17 21:08:19.545280 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:19.545256 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-8grtr"] Jul 17 21:08:19.681163 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:19.681119 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23b7c58e-efb1-48ae-be46-82dd6107b244-webhook-cert\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-8grtr\" (UID: \"23b7c58e-efb1-48ae-be46-82dd6107b244\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-8grtr" Jul 17 21:08:19.681354 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:19.681180 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23b7c58e-efb1-48ae-be46-82dd6107b244-tmp\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-8grtr\" (UID: \"23b7c58e-efb1-48ae-be46-82dd6107b244\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-8grtr" Jul 17 21:08:19.681354 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:19.681244 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/23b7c58e-efb1-48ae-be46-82dd6107b244-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-8grtr\" (UID: \"23b7c58e-efb1-48ae-be46-82dd6107b244\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-8grtr" Jul 17 21:08:19.681354 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:19.681314 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/23b7c58e-efb1-48ae-be46-82dd6107b244-manifests\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-8grtr\" (UID: \"23b7c58e-efb1-48ae-be46-82dd6107b244\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-8grtr" Jul 17 21:08:19.681472 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:19.681355 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5kzn\" (UniqueName: \"kubernetes.io/projected/23b7c58e-efb1-48ae-be46-82dd6107b244-kube-api-access-p5kzn\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-8grtr\" (UID: \"23b7c58e-efb1-48ae-be46-82dd6107b244\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-8grtr" Jul 17 21:08:19.781912 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:19.781826 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23b7c58e-efb1-48ae-be46-82dd6107b244-webhook-cert\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-8grtr\" (UID: \"23b7c58e-efb1-48ae-be46-82dd6107b244\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-8grtr" Jul 17 21:08:19.781912 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:19.781883 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23b7c58e-efb1-48ae-be46-82dd6107b244-tmp\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-8grtr\" (UID: \"23b7c58e-efb1-48ae-be46-82dd6107b244\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-8grtr" Jul 17 21:08:19.781912 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:19.781911 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/23b7c58e-efb1-48ae-be46-82dd6107b244-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-8grtr\" (UID: \"23b7c58e-efb1-48ae-be46-82dd6107b244\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-8grtr" Jul 17 21:08:19.782134 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:19.781929 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/23b7c58e-efb1-48ae-be46-82dd6107b244-manifests\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-8grtr\" (UID: \"23b7c58e-efb1-48ae-be46-82dd6107b244\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-8grtr" Jul 17 21:08:19.782134 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:19.781948 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5kzn\" (UniqueName: \"kubernetes.io/projected/23b7c58e-efb1-48ae-be46-82dd6107b244-kube-api-access-p5kzn\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-8grtr\" (UID: \"23b7c58e-efb1-48ae-be46-82dd6107b244\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-8grtr" Jul 17 21:08:19.782433 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:19.782411 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/23b7c58e-efb1-48ae-be46-82dd6107b244-manifests\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-8grtr\" (UID: \"23b7c58e-efb1-48ae-be46-82dd6107b244\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-8grtr" Jul 17 21:08:19.784161 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:19.784134 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23b7c58e-efb1-48ae-be46-82dd6107b244-tmp\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-8grtr\" (UID: \"23b7c58e-efb1-48ae-be46-82dd6107b244\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-8grtr" Jul 17 21:08:19.784372 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:19.784352 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23b7c58e-efb1-48ae-be46-82dd6107b244-webhook-cert\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-8grtr\" (UID: \"23b7c58e-efb1-48ae-be46-82dd6107b244\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-8grtr" Jul 17 21:08:19.784415 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:19.784378 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/23b7c58e-efb1-48ae-be46-82dd6107b244-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-8grtr\" (UID: \"23b7c58e-efb1-48ae-be46-82dd6107b244\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-8grtr" Jul 17 21:08:19.792199 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:19.792177 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5kzn\" (UniqueName: \"kubernetes.io/projected/23b7c58e-efb1-48ae-be46-82dd6107b244-kube-api-access-p5kzn\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-8grtr\" (UID: \"23b7c58e-efb1-48ae-be46-82dd6107b244\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-8grtr" Jul 17 21:08:19.831466 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:19.831433 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-8grtr" Jul 17 21:08:19.981642 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:19.981618 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-8grtr"] Jul 17 21:08:19.983355 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:08:19.983330 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23b7c58e_efb1_48ae_be46_82dd6107b244.slice/crio-aafea63205748ca20ec7dc44ef29f5097a80322f2dd49cd906870abf47cd1947 WatchSource:0}: Error finding container aafea63205748ca20ec7dc44ef29f5097a80322f2dd49cd906870abf47cd1947: Status 404 returned error can't find the container with id aafea63205748ca20ec7dc44ef29f5097a80322f2dd49cd906870abf47cd1947 Jul 17 21:08:20.981289 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:20.981248 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-8grtr" event={"ID":"23b7c58e-efb1-48ae-be46-82dd6107b244","Type":"ContainerStarted","Data":"aafea63205748ca20ec7dc44ef29f5097a80322f2dd49cd906870abf47cd1947"} Jul 17 21:08:23.994765 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:23.994725 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-8grtr" event={"ID":"23b7c58e-efb1-48ae-be46-82dd6107b244","Type":"ContainerStarted","Data":"76f9d2d2b573db9a0e582a69d1da1bfdf69125ff361306edac404315b25295b5"} Jul 17 21:08:25.000230 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:25.000188 2568 generic.go:356] "Generic (PLEG): container finished" podID="23b7c58e-efb1-48ae-be46-82dd6107b244" containerID="76f9d2d2b573db9a0e582a69d1da1bfdf69125ff361306edac404315b25295b5" exitCode=0 Jul 17 21:08:25.000709 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:25.000279 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-8grtr" event={"ID":"23b7c58e-efb1-48ae-be46-82dd6107b244","Type":"ContainerDied","Data":"76f9d2d2b573db9a0e582a69d1da1bfdf69125ff361306edac404315b25295b5"} Jul 17 21:08:26.007009 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:26.006963 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-8grtr" event={"ID":"23b7c58e-efb1-48ae-be46-82dd6107b244","Type":"ContainerStarted","Data":"375c4fd65d44438408846f7d0ab1271dd059116c77e718471241581dcde5920f"} Jul 17 21:08:26.007449 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:26.007108 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-8grtr" Jul 17 21:08:26.031192 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:26.031142 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-8grtr" podStartSLOduration=2.6497085 podStartE2EDuration="7.031127435s" totalImagesPullingTime="3.313342365s" totalInitContainerRuntime="1.06807657s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:08:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:08:26.030881384 +0000 UTC m=+284.830680715" watchObservedRunningTime="2026-07-17 21:08:26.031127435 +0000 UTC m=+284.830926763" Jul 17 21:08:29.976573 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:29.976531 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-c8db86df9-pxqc4" Jul 17 21:08:37.013860 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:37.013827 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-8grtr" Jul 17 21:08:39.358197 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:39.358155 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-748bb598b7-hr8kp"] Jul 17 21:08:39.361649 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:39.361627 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-748bb598b7-hr8kp" Jul 17 21:08:39.364903 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:39.364879 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 17 21:08:39.365030 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:39.364902 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 17 21:08:39.365894 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:39.365875 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-9sk67\"" Jul 17 21:08:39.365894 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:39.365886 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 17 21:08:39.366017 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:39.365882 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 17 21:08:39.376182 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:39.376153 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-748bb598b7-hr8kp"] Jul 17 21:08:39.459292 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:39.459259 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6135e8fc-3e04-4aaa-9b18-4b4014b49866-tls-certs\") pod \"kube-auth-proxy-748bb598b7-hr8kp\" (UID: \"6135e8fc-3e04-4aaa-9b18-4b4014b49866\") " pod="openshift-ingress/kube-auth-proxy-748bb598b7-hr8kp" Jul 17 21:08:39.459292 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:39.459296 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk28m\" (UniqueName: \"kubernetes.io/projected/6135e8fc-3e04-4aaa-9b18-4b4014b49866-kube-api-access-lk28m\") pod \"kube-auth-proxy-748bb598b7-hr8kp\" (UID: \"6135e8fc-3e04-4aaa-9b18-4b4014b49866\") " pod="openshift-ingress/kube-auth-proxy-748bb598b7-hr8kp" Jul 17 21:08:39.459545 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:39.459393 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6135e8fc-3e04-4aaa-9b18-4b4014b49866-tmp\") pod \"kube-auth-proxy-748bb598b7-hr8kp\" (UID: \"6135e8fc-3e04-4aaa-9b18-4b4014b49866\") " pod="openshift-ingress/kube-auth-proxy-748bb598b7-hr8kp" Jul 17 21:08:39.559986 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:39.559936 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6135e8fc-3e04-4aaa-9b18-4b4014b49866-tls-certs\") pod \"kube-auth-proxy-748bb598b7-hr8kp\" (UID: \"6135e8fc-3e04-4aaa-9b18-4b4014b49866\") " pod="openshift-ingress/kube-auth-proxy-748bb598b7-hr8kp" Jul 17 21:08:39.559986 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:39.559991 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk28m\" (UniqueName: \"kubernetes.io/projected/6135e8fc-3e04-4aaa-9b18-4b4014b49866-kube-api-access-lk28m\") pod \"kube-auth-proxy-748bb598b7-hr8kp\" (UID: \"6135e8fc-3e04-4aaa-9b18-4b4014b49866\") " pod="openshift-ingress/kube-auth-proxy-748bb598b7-hr8kp" Jul 17 21:08:39.560233 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:39.560058 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6135e8fc-3e04-4aaa-9b18-4b4014b49866-tmp\") pod \"kube-auth-proxy-748bb598b7-hr8kp\" (UID: \"6135e8fc-3e04-4aaa-9b18-4b4014b49866\") " pod="openshift-ingress/kube-auth-proxy-748bb598b7-hr8kp" Jul 17 21:08:39.562292 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:39.562262 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6135e8fc-3e04-4aaa-9b18-4b4014b49866-tmp\") pod \"kube-auth-proxy-748bb598b7-hr8kp\" (UID: \"6135e8fc-3e04-4aaa-9b18-4b4014b49866\") " pod="openshift-ingress/kube-auth-proxy-748bb598b7-hr8kp" Jul 17 21:08:39.562427 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:39.562407 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6135e8fc-3e04-4aaa-9b18-4b4014b49866-tls-certs\") pod \"kube-auth-proxy-748bb598b7-hr8kp\" (UID: \"6135e8fc-3e04-4aaa-9b18-4b4014b49866\") " pod="openshift-ingress/kube-auth-proxy-748bb598b7-hr8kp" Jul 17 21:08:39.573256 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:39.573230 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk28m\" (UniqueName: \"kubernetes.io/projected/6135e8fc-3e04-4aaa-9b18-4b4014b49866-kube-api-access-lk28m\") pod \"kube-auth-proxy-748bb598b7-hr8kp\" (UID: \"6135e8fc-3e04-4aaa-9b18-4b4014b49866\") " pod="openshift-ingress/kube-auth-proxy-748bb598b7-hr8kp" Jul 17 21:08:39.672417 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:39.672339 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-748bb598b7-hr8kp" Jul 17 21:08:39.818718 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:39.818672 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-748bb598b7-hr8kp"] Jul 17 21:08:39.821203 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:08:39.821173 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6135e8fc_3e04_4aaa_9b18_4b4014b49866.slice/crio-ebed852423b9842ae5efbab2f4daf2c0fc6a2bd257929030ce94f1310351ea01 WatchSource:0}: Error finding container ebed852423b9842ae5efbab2f4daf2c0fc6a2bd257929030ce94f1310351ea01: Status 404 returned error can't find the container with id ebed852423b9842ae5efbab2f4daf2c0fc6a2bd257929030ce94f1310351ea01 Jul 17 21:08:40.067512 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:40.067472 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-748bb598b7-hr8kp" event={"ID":"6135e8fc-3e04-4aaa-9b18-4b4014b49866","Type":"ContainerStarted","Data":"ebed852423b9842ae5efbab2f4daf2c0fc6a2bd257929030ce94f1310351ea01"} Jul 17 21:08:41.635994 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:41.635969 2568 kubelet.go:1648] "Image garbage collection succeeded" Jul 17 21:08:42.619379 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:42.619354 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 17 21:08:43.084767 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:43.084726 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-748bb598b7-hr8kp" event={"ID":"6135e8fc-3e04-4aaa-9b18-4b4014b49866","Type":"ContainerStarted","Data":"1cbbaad3c93c40f4be27463771a6edc6a37f091e86a9c4de18e473e670f84f38"} Jul 17 21:08:43.102480 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:08:43.102412 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-748bb598b7-hr8kp" podStartSLOduration=1.309058091 podStartE2EDuration="4.102391143s" totalImagesPullingTime="2.793333052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:08:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:08:43.100957338 +0000 UTC m=+301.900756665" watchObservedRunningTime="2026-07-17 21:08:43.102391143 +0000 UTC m=+301.902190493" Jul 17 21:10:37.277933 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:37.277893 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c9fbc5df8-th8r9"] Jul 17 21:10:37.282706 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:37.282172 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c9fbc5df8-th8r9" Jul 17 21:10:37.296941 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:37.296915 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c9fbc5df8-th8r9"] Jul 17 21:10:37.337348 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:37.337319 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab9578ee-6bdd-4952-bac7-cae69ff1f126-trusted-ca-bundle\") pod \"console-5c9fbc5df8-th8r9\" (UID: \"ab9578ee-6bdd-4952-bac7-cae69ff1f126\") " pod="openshift-console/console-5c9fbc5df8-th8r9" Jul 17 21:10:37.337477 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:37.337358 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab9578ee-6bdd-4952-bac7-cae69ff1f126-console-serving-cert\") pod \"console-5c9fbc5df8-th8r9\" (UID: \"ab9578ee-6bdd-4952-bac7-cae69ff1f126\") " pod="openshift-console/console-5c9fbc5df8-th8r9" Jul 17 21:10:37.337477 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:37.337384 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab9578ee-6bdd-4952-bac7-cae69ff1f126-console-config\") pod \"console-5c9fbc5df8-th8r9\" (UID: \"ab9578ee-6bdd-4952-bac7-cae69ff1f126\") " pod="openshift-console/console-5c9fbc5df8-th8r9" Jul 17 21:10:37.337477 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:37.337407 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86wbs\" (UniqueName: \"kubernetes.io/projected/ab9578ee-6bdd-4952-bac7-cae69ff1f126-kube-api-access-86wbs\") pod \"console-5c9fbc5df8-th8r9\" (UID: \"ab9578ee-6bdd-4952-bac7-cae69ff1f126\") " pod="openshift-console/console-5c9fbc5df8-th8r9" Jul 17 21:10:37.337477 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:37.337464 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab9578ee-6bdd-4952-bac7-cae69ff1f126-console-oauth-config\") pod \"console-5c9fbc5df8-th8r9\" (UID: \"ab9578ee-6bdd-4952-bac7-cae69ff1f126\") " pod="openshift-console/console-5c9fbc5df8-th8r9" Jul 17 21:10:37.337632 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:37.337513 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab9578ee-6bdd-4952-bac7-cae69ff1f126-oauth-serving-cert\") pod \"console-5c9fbc5df8-th8r9\" (UID: \"ab9578ee-6bdd-4952-bac7-cae69ff1f126\") " pod="openshift-console/console-5c9fbc5df8-th8r9" Jul 17 21:10:37.337632 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:37.337562 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab9578ee-6bdd-4952-bac7-cae69ff1f126-service-ca\") pod \"console-5c9fbc5df8-th8r9\" (UID: \"ab9578ee-6bdd-4952-bac7-cae69ff1f126\") " pod="openshift-console/console-5c9fbc5df8-th8r9" Jul 17 21:10:37.438304 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:37.438275 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab9578ee-6bdd-4952-bac7-cae69ff1f126-oauth-serving-cert\") pod \"console-5c9fbc5df8-th8r9\" (UID: \"ab9578ee-6bdd-4952-bac7-cae69ff1f126\") " pod="openshift-console/console-5c9fbc5df8-th8r9" Jul 17 21:10:37.438419 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:37.438320 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab9578ee-6bdd-4952-bac7-cae69ff1f126-service-ca\") pod \"console-5c9fbc5df8-th8r9\" (UID: \"ab9578ee-6bdd-4952-bac7-cae69ff1f126\") " pod="openshift-console/console-5c9fbc5df8-th8r9" Jul 17 21:10:37.438419 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:37.438355 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab9578ee-6bdd-4952-bac7-cae69ff1f126-trusted-ca-bundle\") pod \"console-5c9fbc5df8-th8r9\" (UID: \"ab9578ee-6bdd-4952-bac7-cae69ff1f126\") " pod="openshift-console/console-5c9fbc5df8-th8r9" Jul 17 21:10:37.438419 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:37.438387 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab9578ee-6bdd-4952-bac7-cae69ff1f126-console-serving-cert\") pod \"console-5c9fbc5df8-th8r9\" (UID: \"ab9578ee-6bdd-4952-bac7-cae69ff1f126\") " pod="openshift-console/console-5c9fbc5df8-th8r9" Jul 17 21:10:37.438419 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:37.438415 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab9578ee-6bdd-4952-bac7-cae69ff1f126-console-config\") pod \"console-5c9fbc5df8-th8r9\" (UID: \"ab9578ee-6bdd-4952-bac7-cae69ff1f126\") " pod="openshift-console/console-5c9fbc5df8-th8r9" Jul 17 21:10:37.438578 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:37.438474 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86wbs\" (UniqueName: \"kubernetes.io/projected/ab9578ee-6bdd-4952-bac7-cae69ff1f126-kube-api-access-86wbs\") pod \"console-5c9fbc5df8-th8r9\" (UID: \"ab9578ee-6bdd-4952-bac7-cae69ff1f126\") " pod="openshift-console/console-5c9fbc5df8-th8r9" Jul 17 21:10:37.438578 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:37.438524 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab9578ee-6bdd-4952-bac7-cae69ff1f126-console-oauth-config\") pod \"console-5c9fbc5df8-th8r9\" (UID: \"ab9578ee-6bdd-4952-bac7-cae69ff1f126\") " pod="openshift-console/console-5c9fbc5df8-th8r9" Jul 17 21:10:37.439104 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:37.439080 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab9578ee-6bdd-4952-bac7-cae69ff1f126-service-ca\") pod \"console-5c9fbc5df8-th8r9\" (UID: \"ab9578ee-6bdd-4952-bac7-cae69ff1f126\") " pod="openshift-console/console-5c9fbc5df8-th8r9" Jul 17 21:10:37.439104 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:37.439092 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab9578ee-6bdd-4952-bac7-cae69ff1f126-oauth-serving-cert\") pod \"console-5c9fbc5df8-th8r9\" (UID: \"ab9578ee-6bdd-4952-bac7-cae69ff1f126\") " pod="openshift-console/console-5c9fbc5df8-th8r9" Jul 17 21:10:37.439246 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:37.439106 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab9578ee-6bdd-4952-bac7-cae69ff1f126-console-config\") pod \"console-5c9fbc5df8-th8r9\" (UID: \"ab9578ee-6bdd-4952-bac7-cae69ff1f126\") " pod="openshift-console/console-5c9fbc5df8-th8r9" Jul 17 21:10:37.439418 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:37.439395 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab9578ee-6bdd-4952-bac7-cae69ff1f126-trusted-ca-bundle\") pod \"console-5c9fbc5df8-th8r9\" (UID: \"ab9578ee-6bdd-4952-bac7-cae69ff1f126\") " pod="openshift-console/console-5c9fbc5df8-th8r9" Jul 17 21:10:37.440956 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:37.440933 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab9578ee-6bdd-4952-bac7-cae69ff1f126-console-serving-cert\") pod \"console-5c9fbc5df8-th8r9\" (UID: \"ab9578ee-6bdd-4952-bac7-cae69ff1f126\") " pod="openshift-console/console-5c9fbc5df8-th8r9" Jul 17 21:10:37.441032 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:37.440994 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab9578ee-6bdd-4952-bac7-cae69ff1f126-console-oauth-config\") pod \"console-5c9fbc5df8-th8r9\" (UID: \"ab9578ee-6bdd-4952-bac7-cae69ff1f126\") " pod="openshift-console/console-5c9fbc5df8-th8r9" Jul 17 21:10:37.447219 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:37.447198 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86wbs\" (UniqueName: \"kubernetes.io/projected/ab9578ee-6bdd-4952-bac7-cae69ff1f126-kube-api-access-86wbs\") pod \"console-5c9fbc5df8-th8r9\" (UID: \"ab9578ee-6bdd-4952-bac7-cae69ff1f126\") " pod="openshift-console/console-5c9fbc5df8-th8r9" Jul 17 21:10:37.593514 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:37.593489 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c9fbc5df8-th8r9" Jul 17 21:10:37.729111 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:37.729082 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c9fbc5df8-th8r9"] Jul 17 21:10:37.732719 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:10:37.732669 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab9578ee_6bdd_4952_bac7_cae69ff1f126.slice/crio-699e452af4384aebd314e3a892a03973000bd84253543cee3ed4ce5c29ee31e8 WatchSource:0}: Error finding container 699e452af4384aebd314e3a892a03973000bd84253543cee3ed4ce5c29ee31e8: Status 404 returned error can't find the container with id 699e452af4384aebd314e3a892a03973000bd84253543cee3ed4ce5c29ee31e8 Jul 17 21:10:38.570821 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:38.570786 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c9fbc5df8-th8r9" event={"ID":"ab9578ee-6bdd-4952-bac7-cae69ff1f126","Type":"ContainerStarted","Data":"2cc004b40b5e11e1f74582b43076d6bb878ae70a378a4016e842fb43b69df07a"} Jul 17 21:10:38.571189 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:38.570836 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c9fbc5df8-th8r9" event={"ID":"ab9578ee-6bdd-4952-bac7-cae69ff1f126","Type":"ContainerStarted","Data":"699e452af4384aebd314e3a892a03973000bd84253543cee3ed4ce5c29ee31e8"} Jul 17 21:10:38.591309 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:38.591262 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c9fbc5df8-th8r9" podStartSLOduration=1.591248781 podStartE2EDuration="1.591248781s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:10:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:10:38.589362364 +0000 UTC m=+417.389161716" watchObservedRunningTime="2026-07-17 21:10:38.591248781 +0000 UTC m=+417.391048108" Jul 17 21:10:41.547467 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:41.547436 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ssd5d"] Jul 17 21:10:41.550781 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:41.550758 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ssd5d" Jul 17 21:10:41.553975 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:41.553954 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 17 21:10:41.554069 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:41.553993 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 17 21:10:41.554299 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:41.554285 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wc476\"" Jul 17 21:10:41.567503 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:41.567482 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ssd5d"] Jul 17 21:10:41.674001 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:41.673971 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb9mc\" (UniqueName: \"kubernetes.io/projected/2cd0a695-eb8e-4734-a140-0ff021cf19b7-kube-api-access-pb9mc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ssd5d\" (UID: \"2cd0a695-eb8e-4734-a140-0ff021cf19b7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ssd5d" Jul 17 21:10:41.674151 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:41.674008 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2cd0a695-eb8e-4734-a140-0ff021cf19b7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ssd5d\" (UID: \"2cd0a695-eb8e-4734-a140-0ff021cf19b7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ssd5d" Jul 17 21:10:41.775286 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:41.775246 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb9mc\" (UniqueName: \"kubernetes.io/projected/2cd0a695-eb8e-4734-a140-0ff021cf19b7-kube-api-access-pb9mc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ssd5d\" (UID: \"2cd0a695-eb8e-4734-a140-0ff021cf19b7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ssd5d" Jul 17 21:10:41.775286 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:41.775297 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2cd0a695-eb8e-4734-a140-0ff021cf19b7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ssd5d\" (UID: \"2cd0a695-eb8e-4734-a140-0ff021cf19b7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ssd5d" Jul 17 21:10:41.775673 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:41.775649 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2cd0a695-eb8e-4734-a140-0ff021cf19b7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ssd5d\" (UID: \"2cd0a695-eb8e-4734-a140-0ff021cf19b7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ssd5d" Jul 17 21:10:41.783913 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:41.783892 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 17 21:10:41.794330 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:41.794314 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 17 21:10:41.804583 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:41.804525 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb9mc\" (UniqueName: \"kubernetes.io/projected/2cd0a695-eb8e-4734-a140-0ff021cf19b7-kube-api-access-pb9mc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ssd5d\" (UID: \"2cd0a695-eb8e-4734-a140-0ff021cf19b7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ssd5d" Jul 17 21:10:41.864058 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:41.864037 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wc476\"" Jul 17 21:10:41.872338 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:41.872318 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ssd5d" Jul 17 21:10:42.017717 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:42.017664 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ssd5d"] Jul 17 21:10:42.021010 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:10:42.020984 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cd0a695_eb8e_4734_a140_0ff021cf19b7.slice/crio-38e7be8cdeaa5f2fa1d83e8d3c39e0f6b50b14f0bae67bbfe1fbe18d44d14b4d WatchSource:0}: Error finding container 38e7be8cdeaa5f2fa1d83e8d3c39e0f6b50b14f0bae67bbfe1fbe18d44d14b4d: Status 404 returned error can't find the container with id 38e7be8cdeaa5f2fa1d83e8d3c39e0f6b50b14f0bae67bbfe1fbe18d44d14b4d Jul 17 21:10:42.023331 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:42.023312 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 21:10:42.296191 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:42.296051 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ssd5d"] Jul 17 21:10:42.297908 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:42.297874 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ssd5d"] Jul 17 21:10:42.319062 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:42.319037 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lzzmp"] Jul 17 21:10:42.323424 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:42.323401 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lzzmp" Jul 17 21:10:42.340663 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:42.340634 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lzzmp"] Jul 17 21:10:42.380568 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:42.380536 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6btb\" (UniqueName: \"kubernetes.io/projected/26707330-51b4-4765-99cb-61a4b39d9f75-kube-api-access-s6btb\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-lzzmp\" (UID: \"26707330-51b4-4765-99cb-61a4b39d9f75\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lzzmp" Jul 17 21:10:42.380747 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:42.380572 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/26707330-51b4-4765-99cb-61a4b39d9f75-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-lzzmp\" (UID: \"26707330-51b4-4765-99cb-61a4b39d9f75\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lzzmp" Jul 17 21:10:42.481601 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:42.481568 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6btb\" (UniqueName: \"kubernetes.io/projected/26707330-51b4-4765-99cb-61a4b39d9f75-kube-api-access-s6btb\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-lzzmp\" (UID: \"26707330-51b4-4765-99cb-61a4b39d9f75\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lzzmp" Jul 17 21:10:42.481772 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:42.481610 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/26707330-51b4-4765-99cb-61a4b39d9f75-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-lzzmp\" (UID: \"26707330-51b4-4765-99cb-61a4b39d9f75\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lzzmp" Jul 17 21:10:42.482030 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:42.482012 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/26707330-51b4-4765-99cb-61a4b39d9f75-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-lzzmp\" (UID: \"26707330-51b4-4765-99cb-61a4b39d9f75\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lzzmp" Jul 17 21:10:42.494091 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:42.494059 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6btb\" (UniqueName: \"kubernetes.io/projected/26707330-51b4-4765-99cb-61a4b39d9f75-kube-api-access-s6btb\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-lzzmp\" (UID: \"26707330-51b4-4765-99cb-61a4b39d9f75\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lzzmp" Jul 17 21:10:42.634414 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:42.634379 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lzzmp" Jul 17 21:10:42.784567 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:42.784527 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lzzmp"] Jul 17 21:10:42.821415 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:10:42.821386 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26707330_51b4_4765_99cb_61a4b39d9f75.slice/crio-6b9ca9363ea32346050079a250afae4e92f4cf91eb554449eb0eb76784c35cb5 WatchSource:0}: Error finding container 6b9ca9363ea32346050079a250afae4e92f4cf91eb554449eb0eb76784c35cb5: Status 404 returned error can't find the container with id 6b9ca9363ea32346050079a250afae4e92f4cf91eb554449eb0eb76784c35cb5 Jul 17 21:10:43.595917 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:43.595881 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lzzmp" event={"ID":"26707330-51b4-4765-99cb-61a4b39d9f75","Type":"ContainerStarted","Data":"6b9ca9363ea32346050079a250afae4e92f4cf91eb554449eb0eb76784c35cb5"} Jul 17 21:10:47.594511 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:47.594474 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c9fbc5df8-th8r9" Jul 17 21:10:47.594963 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:47.594536 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c9fbc5df8-th8r9" Jul 17 21:10:47.599017 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:47.598997 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c9fbc5df8-th8r9" Jul 17 21:10:47.616775 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:47.616744 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ssd5d" podUID="2cd0a695-eb8e-4734-a140-0ff021cf19b7" containerName="manager" containerID="cri-o://2095aa979411dd075a54f05ed0f37d985e771def4224f0b4dcf13eda76719365" gracePeriod=2 Jul 17 21:10:47.618813 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:47.618783 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lzzmp" event={"ID":"26707330-51b4-4765-99cb-61a4b39d9f75","Type":"ContainerStarted","Data":"91bd3f025bac9cbd5496f2f14937c942bb185b93f2cb526ad806aa0284cc3859"} Jul 17 21:10:47.622951 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:47.622932 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c9fbc5df8-th8r9" Jul 17 21:10:47.672962 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:47.672921 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lzzmp" podStartSLOduration=1.832354274 podStartE2EDuration="5.672906242s" totalImagesPullingTime="3.840551968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:10:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:10:47.671739415 +0000 UTC m=+426.471538743" watchObservedRunningTime="2026-07-17 21:10:47.672906242 +0000 UTC m=+426.472705572" Jul 17 21:10:47.700389 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:47.700358 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5669c9bc8c-p8m6w"] Jul 17 21:10:47.854727 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:47.854665 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ssd5d" Jul 17 21:10:47.936567 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:47.936538 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2cd0a695-eb8e-4734-a140-0ff021cf19b7-extensions-socket-volume\") pod \"2cd0a695-eb8e-4734-a140-0ff021cf19b7\" (UID: \"2cd0a695-eb8e-4734-a140-0ff021cf19b7\") " Jul 17 21:10:47.936705 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:47.936598 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pb9mc\" (UniqueName: \"kubernetes.io/projected/2cd0a695-eb8e-4734-a140-0ff021cf19b7-kube-api-access-pb9mc\") pod \"2cd0a695-eb8e-4734-a140-0ff021cf19b7\" (UID: \"2cd0a695-eb8e-4734-a140-0ff021cf19b7\") " Jul 17 21:10:47.936811 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:47.936790 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cd0a695-eb8e-4734-a140-0ff021cf19b7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2cd0a695-eb8e-4734-a140-0ff021cf19b7" (UID: "2cd0a695-eb8e-4734-a140-0ff021cf19b7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:10:47.938626 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:47.938607 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cd0a695-eb8e-4734-a140-0ff021cf19b7-kube-api-access-pb9mc" (OuterVolumeSpecName: "kube-api-access-pb9mc") pod "2cd0a695-eb8e-4734-a140-0ff021cf19b7" (UID: "2cd0a695-eb8e-4734-a140-0ff021cf19b7"). InnerVolumeSpecName "kube-api-access-pb9mc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:10:48.037895 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:48.037861 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pb9mc\" (UniqueName: \"kubernetes.io/projected/2cd0a695-eb8e-4734-a140-0ff021cf19b7-kube-api-access-pb9mc\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:10:48.037895 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:48.037889 2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2cd0a695-eb8e-4734-a140-0ff021cf19b7-extensions-socket-volume\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:10:48.624164 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:48.624128 2568 generic.go:356] "Generic (PLEG): container finished" podID="2cd0a695-eb8e-4734-a140-0ff021cf19b7" containerID="2095aa979411dd075a54f05ed0f37d985e771def4224f0b4dcf13eda76719365" exitCode=2 Jul 17 21:10:48.624674 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:48.624173 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ssd5d" Jul 17 21:10:48.624674 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:48.624228 2568 scope.go:117] "RemoveContainer" containerID="2095aa979411dd075a54f05ed0f37d985e771def4224f0b4dcf13eda76719365" Jul 17 21:10:48.624674 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:48.624477 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lzzmp" Jul 17 21:10:48.626770 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:10:48.626745 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-ssd5d\" is forbidden: User \"system:node:ip-10-0-131-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-37.ec2.internal' and this object" podUID="2cd0a695-eb8e-4734-a140-0ff021cf19b7" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ssd5d" Jul 17 21:10:48.634305 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:48.634291 2568 scope.go:117] "RemoveContainer" containerID="2095aa979411dd075a54f05ed0f37d985e771def4224f0b4dcf13eda76719365" Jul 17 21:10:48.634567 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:10:48.634546 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2095aa979411dd075a54f05ed0f37d985e771def4224f0b4dcf13eda76719365\": container with ID starting with 2095aa979411dd075a54f05ed0f37d985e771def4224f0b4dcf13eda76719365 not found: ID does not exist" containerID="2095aa979411dd075a54f05ed0f37d985e771def4224f0b4dcf13eda76719365" Jul 17 21:10:48.634627 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:48.634580 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2095aa979411dd075a54f05ed0f37d985e771def4224f0b4dcf13eda76719365"} err="failed to get container status \"2095aa979411dd075a54f05ed0f37d985e771def4224f0b4dcf13eda76719365\": rpc error: code = NotFound desc = could not find container \"2095aa979411dd075a54f05ed0f37d985e771def4224f0b4dcf13eda76719365\": container with ID starting with 2095aa979411dd075a54f05ed0f37d985e771def4224f0b4dcf13eda76719365 not found: ID does not exist" Jul 17 21:10:48.635629 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:10:48.635607 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-ssd5d\" is forbidden: User \"system:node:ip-10-0-131-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-37.ec2.internal' and this object" podUID="2cd0a695-eb8e-4734-a140-0ff021cf19b7" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ssd5d" Jul 17 21:10:49.736049 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:49.736015 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cd0a695-eb8e-4734-a140-0ff021cf19b7" path="/var/lib/kubelet/pods/2cd0a695-eb8e-4734-a140-0ff021cf19b7/volumes" Jul 17 21:10:59.632651 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:10:59.632620 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lzzmp" Jul 17 21:11:11.891704 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:11.891659 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lzzmp"] Jul 17 21:11:11.892170 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:11.891925 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lzzmp" podUID="26707330-51b4-4765-99cb-61a4b39d9f75" containerName="manager" containerID="cri-o://91bd3f025bac9cbd5496f2f14937c942bb185b93f2cb526ad806aa0284cc3859" gracePeriod=10 Jul 17 21:11:12.133296 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:12.133268 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lzzmp" Jul 17 21:11:12.140887 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:12.140864 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/26707330-51b4-4765-99cb-61a4b39d9f75-extensions-socket-volume\") pod \"26707330-51b4-4765-99cb-61a4b39d9f75\" (UID: \"26707330-51b4-4765-99cb-61a4b39d9f75\") " Jul 17 21:11:12.140979 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:12.140917 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6btb\" (UniqueName: \"kubernetes.io/projected/26707330-51b4-4765-99cb-61a4b39d9f75-kube-api-access-s6btb\") pod \"26707330-51b4-4765-99cb-61a4b39d9f75\" (UID: \"26707330-51b4-4765-99cb-61a4b39d9f75\") " Jul 17 21:11:12.141300 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:12.141277 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26707330-51b4-4765-99cb-61a4b39d9f75-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "26707330-51b4-4765-99cb-61a4b39d9f75" (UID: "26707330-51b4-4765-99cb-61a4b39d9f75"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:11:12.142785 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:12.142728 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26707330-51b4-4765-99cb-61a4b39d9f75-kube-api-access-s6btb" (OuterVolumeSpecName: "kube-api-access-s6btb") pod "26707330-51b4-4765-99cb-61a4b39d9f75" (UID: "26707330-51b4-4765-99cb-61a4b39d9f75"). InnerVolumeSpecName "kube-api-access-s6btb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:11:12.241952 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:12.241923 2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/26707330-51b4-4765-99cb-61a4b39d9f75-extensions-socket-volume\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:11:12.242120 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:12.241961 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6btb\" (UniqueName: \"kubernetes.io/projected/26707330-51b4-4765-99cb-61a4b39d9f75-kube-api-access-s6btb\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:11:12.721735 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:12.721674 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5669c9bc8c-p8m6w" podUID="e38f6df6-d263-4936-b9f8-6755afc37ee8" containerName="console" containerID="cri-o://fc4000fc081b2728764dc4a4ead9857baac6ad9454686978ec30ce9ad66c91ab" gracePeriod=15 Jul 17 21:11:12.739325 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:12.739300 2568 generic.go:356] "Generic (PLEG): container finished" podID="26707330-51b4-4765-99cb-61a4b39d9f75" containerID="91bd3f025bac9cbd5496f2f14937c942bb185b93f2cb526ad806aa0284cc3859" exitCode=0 Jul 17 21:11:12.739436 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:12.739339 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lzzmp" Jul 17 21:11:12.739436 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:12.739379 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lzzmp" event={"ID":"26707330-51b4-4765-99cb-61a4b39d9f75","Type":"ContainerDied","Data":"91bd3f025bac9cbd5496f2f14937c942bb185b93f2cb526ad806aa0284cc3859"} Jul 17 21:11:12.739436 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:12.739428 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lzzmp" event={"ID":"26707330-51b4-4765-99cb-61a4b39d9f75","Type":"ContainerDied","Data":"6b9ca9363ea32346050079a250afae4e92f4cf91eb554449eb0eb76784c35cb5"} Jul 17 21:11:12.739564 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:12.739454 2568 scope.go:117] "RemoveContainer" containerID="91bd3f025bac9cbd5496f2f14937c942bb185b93f2cb526ad806aa0284cc3859" Jul 17 21:11:12.796931 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:12.796905 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lzzmp"] Jul 17 21:11:12.803064 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:12.803040 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lzzmp"] Jul 17 21:11:12.833896 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:12.833875 2568 scope.go:117] "RemoveContainer" containerID="91bd3f025bac9cbd5496f2f14937c942bb185b93f2cb526ad806aa0284cc3859" Jul 17 21:11:12.834203 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:11:12.834180 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91bd3f025bac9cbd5496f2f14937c942bb185b93f2cb526ad806aa0284cc3859\": container with ID starting with 91bd3f025bac9cbd5496f2f14937c942bb185b93f2cb526ad806aa0284cc3859 not found: ID does not exist" containerID="91bd3f025bac9cbd5496f2f14937c942bb185b93f2cb526ad806aa0284cc3859" Jul 17 21:11:12.834292 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:12.834210 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91bd3f025bac9cbd5496f2f14937c942bb185b93f2cb526ad806aa0284cc3859"} err="failed to get container status \"91bd3f025bac9cbd5496f2f14937c942bb185b93f2cb526ad806aa0284cc3859\": rpc error: code = NotFound desc = could not find container \"91bd3f025bac9cbd5496f2f14937c942bb185b93f2cb526ad806aa0284cc3859\": container with ID starting with 91bd3f025bac9cbd5496f2f14937c942bb185b93f2cb526ad806aa0284cc3859 not found: ID does not exist" Jul 17 21:11:12.974966 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:12.974919 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5669c9bc8c-p8m6w" Jul 17 21:11:13.048563 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:13.048529 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e38f6df6-d263-4936-b9f8-6755afc37ee8-service-ca\") pod \"e38f6df6-d263-4936-b9f8-6755afc37ee8\" (UID: \"e38f6df6-d263-4936-b9f8-6755afc37ee8\") " Jul 17 21:11:13.048748 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:13.048617 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e38f6df6-d263-4936-b9f8-6755afc37ee8-trusted-ca-bundle\") pod \"e38f6df6-d263-4936-b9f8-6755afc37ee8\" (UID: \"e38f6df6-d263-4936-b9f8-6755afc37ee8\") " Jul 17 21:11:13.048748 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:13.048650 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e38f6df6-d263-4936-b9f8-6755afc37ee8-console-config\") pod \"e38f6df6-d263-4936-b9f8-6755afc37ee8\" (UID: \"e38f6df6-d263-4936-b9f8-6755afc37ee8\") " Jul 17 21:11:13.048748 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:13.048706 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxzw9\" (UniqueName: \"kubernetes.io/projected/e38f6df6-d263-4936-b9f8-6755afc37ee8-kube-api-access-sxzw9\") pod \"e38f6df6-d263-4936-b9f8-6755afc37ee8\" (UID: \"e38f6df6-d263-4936-b9f8-6755afc37ee8\") " Jul 17 21:11:13.048748 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:13.048737 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e38f6df6-d263-4936-b9f8-6755afc37ee8-oauth-serving-cert\") pod \"e38f6df6-d263-4936-b9f8-6755afc37ee8\" (UID: \"e38f6df6-d263-4936-b9f8-6755afc37ee8\") " Jul 17 21:11:13.048966 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:13.048778 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e38f6df6-d263-4936-b9f8-6755afc37ee8-console-serving-cert\") pod \"e38f6df6-d263-4936-b9f8-6755afc37ee8\" (UID: \"e38f6df6-d263-4936-b9f8-6755afc37ee8\") " Jul 17 21:11:13.048966 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:13.048871 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e38f6df6-d263-4936-b9f8-6755afc37ee8-console-oauth-config\") pod \"e38f6df6-d263-4936-b9f8-6755afc37ee8\" (UID: \"e38f6df6-d263-4936-b9f8-6755afc37ee8\") " Jul 17 21:11:13.049060 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:13.048959 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e38f6df6-d263-4936-b9f8-6755afc37ee8-service-ca" (OuterVolumeSpecName: "service-ca") pod "e38f6df6-d263-4936-b9f8-6755afc37ee8" (UID: "e38f6df6-d263-4936-b9f8-6755afc37ee8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:11:13.049120 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:13.049078 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e38f6df6-d263-4936-b9f8-6755afc37ee8-console-config" (OuterVolumeSpecName: "console-config") pod "e38f6df6-d263-4936-b9f8-6755afc37ee8" (UID: "e38f6df6-d263-4936-b9f8-6755afc37ee8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:11:13.049120 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:13.049087 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e38f6df6-d263-4936-b9f8-6755afc37ee8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e38f6df6-d263-4936-b9f8-6755afc37ee8" (UID: "e38f6df6-d263-4936-b9f8-6755afc37ee8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:11:13.049120 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:13.049114 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e38f6df6-d263-4936-b9f8-6755afc37ee8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e38f6df6-d263-4936-b9f8-6755afc37ee8" (UID: "e38f6df6-d263-4936-b9f8-6755afc37ee8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:11:13.049261 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:13.049133 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e38f6df6-d263-4936-b9f8-6755afc37ee8-service-ca\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:11:13.050840 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:13.050819 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e38f6df6-d263-4936-b9f8-6755afc37ee8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e38f6df6-d263-4936-b9f8-6755afc37ee8" (UID: "e38f6df6-d263-4936-b9f8-6755afc37ee8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 21:11:13.050979 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:13.050958 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e38f6df6-d263-4936-b9f8-6755afc37ee8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e38f6df6-d263-4936-b9f8-6755afc37ee8" (UID: "e38f6df6-d263-4936-b9f8-6755afc37ee8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 21:11:13.050979 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:13.050970 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e38f6df6-d263-4936-b9f8-6755afc37ee8-kube-api-access-sxzw9" (OuterVolumeSpecName: "kube-api-access-sxzw9") pod "e38f6df6-d263-4936-b9f8-6755afc37ee8" (UID: "e38f6df6-d263-4936-b9f8-6755afc37ee8"). InnerVolumeSpecName "kube-api-access-sxzw9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:11:13.149531 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:13.149499 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e38f6df6-d263-4936-b9f8-6755afc37ee8-oauth-serving-cert\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:11:13.149531 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:13.149526 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e38f6df6-d263-4936-b9f8-6755afc37ee8-console-serving-cert\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:11:13.149531 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:13.149535 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e38f6df6-d263-4936-b9f8-6755afc37ee8-console-oauth-config\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:11:13.149733 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:13.149543 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e38f6df6-d263-4936-b9f8-6755afc37ee8-trusted-ca-bundle\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:11:13.149733 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:13.149551 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e38f6df6-d263-4936-b9f8-6755afc37ee8-console-config\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:11:13.149733 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:13.149559 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxzw9\" (UniqueName: \"kubernetes.io/projected/e38f6df6-d263-4936-b9f8-6755afc37ee8-kube-api-access-sxzw9\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:11:13.736111 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:13.736080 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26707330-51b4-4765-99cb-61a4b39d9f75" path="/var/lib/kubelet/pods/26707330-51b4-4765-99cb-61a4b39d9f75/volumes" Jul 17 21:11:13.745558 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:13.745528 2568 generic.go:356] "Generic (PLEG): container finished" podID="e38f6df6-d263-4936-b9f8-6755afc37ee8" containerID="fc4000fc081b2728764dc4a4ead9857baac6ad9454686978ec30ce9ad66c91ab" exitCode=0 Jul 17 21:11:13.745695 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:13.745575 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5669c9bc8c-p8m6w" Jul 17 21:11:13.745695 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:13.745585 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5669c9bc8c-p8m6w" event={"ID":"e38f6df6-d263-4936-b9f8-6755afc37ee8","Type":"ContainerDied","Data":"fc4000fc081b2728764dc4a4ead9857baac6ad9454686978ec30ce9ad66c91ab"} Jul 17 21:11:13.745695 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:13.745625 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5669c9bc8c-p8m6w" event={"ID":"e38f6df6-d263-4936-b9f8-6755afc37ee8","Type":"ContainerDied","Data":"77b335f572375d0a010f332ebc9e95ff92b10633ec10abf97fcaf3a02a6bc2f3"} Jul 17 21:11:13.745695 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:13.745644 2568 scope.go:117] "RemoveContainer" containerID="fc4000fc081b2728764dc4a4ead9857baac6ad9454686978ec30ce9ad66c91ab" Jul 17 21:11:13.753361 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:13.753337 2568 scope.go:117] "RemoveContainer" containerID="fc4000fc081b2728764dc4a4ead9857baac6ad9454686978ec30ce9ad66c91ab" Jul 17 21:11:13.753611 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:11:13.753567 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc4000fc081b2728764dc4a4ead9857baac6ad9454686978ec30ce9ad66c91ab\": container with ID starting with fc4000fc081b2728764dc4a4ead9857baac6ad9454686978ec30ce9ad66c91ab not found: ID does not exist" containerID="fc4000fc081b2728764dc4a4ead9857baac6ad9454686978ec30ce9ad66c91ab" Jul 17 21:11:13.753611 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:13.753592 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc4000fc081b2728764dc4a4ead9857baac6ad9454686978ec30ce9ad66c91ab"} err="failed to get container status \"fc4000fc081b2728764dc4a4ead9857baac6ad9454686978ec30ce9ad66c91ab\": rpc error: code = NotFound desc = could not find container \"fc4000fc081b2728764dc4a4ead9857baac6ad9454686978ec30ce9ad66c91ab\": container with ID starting with fc4000fc081b2728764dc4a4ead9857baac6ad9454686978ec30ce9ad66c91ab not found: ID does not exist" Jul 17 21:11:13.766869 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:13.766845 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5669c9bc8c-p8m6w"] Jul 17 21:11:13.768910 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:13.768891 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5669c9bc8c-p8m6w"] Jul 17 21:11:15.735619 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:15.735585 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e38f6df6-d263-4936-b9f8-6755afc37ee8" path="/var/lib/kubelet/pods/e38f6df6-d263-4936-b9f8-6755afc37ee8/volumes" Jul 17 21:11:28.910003 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:28.909965 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:11:28.910384 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:28.910281 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e38f6df6-d263-4936-b9f8-6755afc37ee8" containerName="console" Jul 17 21:11:28.910384 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:28.910291 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e38f6df6-d263-4936-b9f8-6755afc37ee8" containerName="console" Jul 17 21:11:28.910384 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:28.910303 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cd0a695-eb8e-4734-a140-0ff021cf19b7" containerName="manager" Jul 17 21:11:28.910384 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:28.910308 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cd0a695-eb8e-4734-a140-0ff021cf19b7" containerName="manager" Jul 17 21:11:28.910384 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:28.910320 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26707330-51b4-4765-99cb-61a4b39d9f75" containerName="manager" Jul 17 21:11:28.910384 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:28.910326 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="26707330-51b4-4765-99cb-61a4b39d9f75" containerName="manager" Jul 17 21:11:28.910384 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:28.910374 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e38f6df6-d263-4936-b9f8-6755afc37ee8" containerName="console" Jul 17 21:11:28.910384 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:28.910383 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cd0a695-eb8e-4734-a140-0ff021cf19b7" containerName="manager" Jul 17 21:11:28.910635 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:28.910390 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="26707330-51b4-4765-99cb-61a4b39d9f75" containerName="manager" Jul 17 21:11:28.915095 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:28.915077 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-mmr9b" Jul 17 21:11:28.917970 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:28.917947 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 17 21:11:28.918087 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:28.918010 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 17 21:11:28.918866 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:28.918847 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4nk2c\"" Jul 17 21:11:28.918962 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:28.918850 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 17 21:11:28.923644 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:28.923621 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:11:28.941553 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:28.941528 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:11:28.972307 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:28.972283 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dea149f7-7ea8-4377-bf68-57eacfe83660-config-file\") pod \"limitador-limitador-54d6d988d5-mmr9b\" (UID: \"dea149f7-7ea8-4377-bf68-57eacfe83660\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mmr9b" Jul 17 21:11:28.972414 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:28.972318 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5cdd\" (UniqueName: \"kubernetes.io/projected/dea149f7-7ea8-4377-bf68-57eacfe83660-kube-api-access-h5cdd\") pod \"limitador-limitador-54d6d988d5-mmr9b\" (UID: \"dea149f7-7ea8-4377-bf68-57eacfe83660\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mmr9b" Jul 17 21:11:29.073504 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:29.073469 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dea149f7-7ea8-4377-bf68-57eacfe83660-config-file\") pod \"limitador-limitador-54d6d988d5-mmr9b\" (UID: \"dea149f7-7ea8-4377-bf68-57eacfe83660\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mmr9b" Jul 17 21:11:29.073639 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:29.073511 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5cdd\" (UniqueName: \"kubernetes.io/projected/dea149f7-7ea8-4377-bf68-57eacfe83660-kube-api-access-h5cdd\") pod \"limitador-limitador-54d6d988d5-mmr9b\" (UID: \"dea149f7-7ea8-4377-bf68-57eacfe83660\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mmr9b" Jul 17 21:11:29.074130 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:29.074112 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dea149f7-7ea8-4377-bf68-57eacfe83660-config-file\") pod \"limitador-limitador-54d6d988d5-mmr9b\" (UID: \"dea149f7-7ea8-4377-bf68-57eacfe83660\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mmr9b" Jul 17 21:11:29.082089 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:29.082064 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5cdd\" (UniqueName: \"kubernetes.io/projected/dea149f7-7ea8-4377-bf68-57eacfe83660-kube-api-access-h5cdd\") pod \"limitador-limitador-54d6d988d5-mmr9b\" (UID: \"dea149f7-7ea8-4377-bf68-57eacfe83660\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mmr9b" Jul 17 21:11:29.226368 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:29.226294 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-mmr9b" Jul 17 21:11:29.357042 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:29.357008 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:11:29.359749 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:11:29.359722 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddea149f7_7ea8_4377_bf68_57eacfe83660.slice/crio-d2aaee6f737778695c2804f79c7e0fc1ec24775ec3a10df064d8958a2438ee10 WatchSource:0}: Error finding container d2aaee6f737778695c2804f79c7e0fc1ec24775ec3a10df064d8958a2438ee10: Status 404 returned error can't find the container with id d2aaee6f737778695c2804f79c7e0fc1ec24775ec3a10df064d8958a2438ee10 Jul 17 21:11:29.540034 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:29.539952 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-tqrf6"] Jul 17 21:11:29.542568 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:29.542551 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tqrf6" Jul 17 21:11:29.545147 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:29.545130 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-gdcvg\"" Jul 17 21:11:29.551467 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:29.551441 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tqrf6"] Jul 17 21:11:29.578173 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:29.578153 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk6sf\" (UniqueName: \"kubernetes.io/projected/34e7eb00-0bdc-4204-a8d7-c3f6f53a1b23-kube-api-access-pk6sf\") pod \"authorino-75d556bd77-tqrf6\" (UID: \"34e7eb00-0bdc-4204-a8d7-c3f6f53a1b23\") " pod="kuadrant-system/authorino-75d556bd77-tqrf6" Jul 17 21:11:29.678735 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:29.678700 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk6sf\" (UniqueName: \"kubernetes.io/projected/34e7eb00-0bdc-4204-a8d7-c3f6f53a1b23-kube-api-access-pk6sf\") pod \"authorino-75d556bd77-tqrf6\" (UID: \"34e7eb00-0bdc-4204-a8d7-c3f6f53a1b23\") " pod="kuadrant-system/authorino-75d556bd77-tqrf6" Jul 17 21:11:29.687269 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:29.687241 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk6sf\" (UniqueName: \"kubernetes.io/projected/34e7eb00-0bdc-4204-a8d7-c3f6f53a1b23-kube-api-access-pk6sf\") pod \"authorino-75d556bd77-tqrf6\" (UID: \"34e7eb00-0bdc-4204-a8d7-c3f6f53a1b23\") " pod="kuadrant-system/authorino-75d556bd77-tqrf6" Jul 17 21:11:29.815083 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:29.815046 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-mmr9b" event={"ID":"dea149f7-7ea8-4377-bf68-57eacfe83660","Type":"ContainerStarted","Data":"d2aaee6f737778695c2804f79c7e0fc1ec24775ec3a10df064d8958a2438ee10"} Jul 17 21:11:29.852907 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:29.852879 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tqrf6" Jul 17 21:11:30.025600 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:30.025527 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tqrf6"] Jul 17 21:11:30.029085 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:11:30.029052 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34e7eb00_0bdc_4204_a8d7_c3f6f53a1b23.slice/crio-6a1b26e5e792c92604b0db16af262dfc9d6e1157e4cf13c3f0dad1955455da3b WatchSource:0}: Error finding container 6a1b26e5e792c92604b0db16af262dfc9d6e1157e4cf13c3f0dad1955455da3b: Status 404 returned error can't find the container with id 6a1b26e5e792c92604b0db16af262dfc9d6e1157e4cf13c3f0dad1955455da3b Jul 17 21:11:30.824896 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:30.824847 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tqrf6" event={"ID":"34e7eb00-0bdc-4204-a8d7-c3f6f53a1b23","Type":"ContainerStarted","Data":"6a1b26e5e792c92604b0db16af262dfc9d6e1157e4cf13c3f0dad1955455da3b"} Jul 17 21:11:33.842359 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:33.842323 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-mmr9b" event={"ID":"dea149f7-7ea8-4377-bf68-57eacfe83660","Type":"ContainerStarted","Data":"6ff4cfb89234c925b58d98da39048108096b47c75087b34ed33c33323368c653"} Jul 17 21:11:33.842894 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:33.842432 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-mmr9b" Jul 17 21:11:33.844050 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:33.844026 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tqrf6" event={"ID":"34e7eb00-0bdc-4204-a8d7-c3f6f53a1b23","Type":"ContainerStarted","Data":"a5cc5aef886b261eaf05b93be2c890e0896da234e294f39f0b59077f8f92b1bc"} Jul 17 21:11:33.863176 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:33.863118 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-mmr9b" podStartSLOduration=1.488189997 podStartE2EDuration="5.863098405s" totalImagesPullingTime="4.374908408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:11:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:11:33.862767847 +0000 UTC m=+472.662567193" watchObservedRunningTime="2026-07-17 21:11:33.863098405 +0000 UTC m=+472.662897735" Jul 17 21:11:33.881055 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:33.881006 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-tqrf6" podStartSLOduration=1.163880564 podStartE2EDuration="4.880992537s" totalImagesPullingTime="3.717111973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:11:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:11:33.87995054 +0000 UTC m=+472.679749871" watchObservedRunningTime="2026-07-17 21:11:33.880992537 +0000 UTC m=+472.680791866" Jul 17 21:11:44.849380 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:11:44.849347 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-mmr9b" Jul 17 21:12:01.648285 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:01.648251 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4q4cf"] Jul 17 21:12:01.652571 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:01.652551 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4q4cf" Jul 17 21:12:01.661203 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:01.661184 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4q4cf"] Jul 17 21:12:01.765932 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:01.765898 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngfp7\" (UniqueName: \"kubernetes.io/projected/8f7c9168-b11b-48f3-9c57-ea1e1cad6c39-kube-api-access-ngfp7\") pod \"authorino-5d4b67c446-4q4cf\" (UID: \"8f7c9168-b11b-48f3-9c57-ea1e1cad6c39\") " pod="kuadrant-system/authorino-5d4b67c446-4q4cf" Jul 17 21:12:01.866446 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:01.866415 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngfp7\" (UniqueName: \"kubernetes.io/projected/8f7c9168-b11b-48f3-9c57-ea1e1cad6c39-kube-api-access-ngfp7\") pod \"authorino-5d4b67c446-4q4cf\" (UID: \"8f7c9168-b11b-48f3-9c57-ea1e1cad6c39\") " pod="kuadrant-system/authorino-5d4b67c446-4q4cf" Jul 17 21:12:01.869794 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:01.869768 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4q4cf"] Jul 17 21:12:01.869996 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:12:01.869979 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-ngfp7], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-4q4cf" podUID="8f7c9168-b11b-48f3-9c57-ea1e1cad6c39" Jul 17 21:12:01.874301 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:01.874279 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngfp7\" (UniqueName: \"kubernetes.io/projected/8f7c9168-b11b-48f3-9c57-ea1e1cad6c39-kube-api-access-ngfp7\") pod \"authorino-5d4b67c446-4q4cf\" (UID: \"8f7c9168-b11b-48f3-9c57-ea1e1cad6c39\") " pod="kuadrant-system/authorino-5d4b67c446-4q4cf" Jul 17 21:12:01.898514 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:01.898451 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-dd89765d7-wbpww"] Jul 17 21:12:01.900662 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:01.900647 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-dd89765d7-wbpww" Jul 17 21:12:01.913782 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:01.913760 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-dd89765d7-wbpww"] Jul 17 21:12:01.964831 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:01.964807 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4q4cf" Jul 17 21:12:01.970697 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:01.970658 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4q4cf" Jul 17 21:12:02.067914 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:02.067879 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ngfp7\" (UniqueName: \"kubernetes.io/projected/8f7c9168-b11b-48f3-9c57-ea1e1cad6c39-kube-api-access-ngfp7\") pod \"8f7c9168-b11b-48f3-9c57-ea1e1cad6c39\" (UID: \"8f7c9168-b11b-48f3-9c57-ea1e1cad6c39\") " Jul 17 21:12:02.068084 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:02.068058 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96mlf\" (UniqueName: \"kubernetes.io/projected/73e16cbe-c208-4b9c-bd0f-97781629599a-kube-api-access-96mlf\") pod \"authorino-dd89765d7-wbpww\" (UID: \"73e16cbe-c208-4b9c-bd0f-97781629599a\") " pod="kuadrant-system/authorino-dd89765d7-wbpww" Jul 17 21:12:02.069913 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:02.069888 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f7c9168-b11b-48f3-9c57-ea1e1cad6c39-kube-api-access-ngfp7" (OuterVolumeSpecName: "kube-api-access-ngfp7") pod "8f7c9168-b11b-48f3-9c57-ea1e1cad6c39" (UID: "8f7c9168-b11b-48f3-9c57-ea1e1cad6c39"). InnerVolumeSpecName "kube-api-access-ngfp7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:12:02.168737 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:02.168648 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96mlf\" (UniqueName: \"kubernetes.io/projected/73e16cbe-c208-4b9c-bd0f-97781629599a-kube-api-access-96mlf\") pod \"authorino-dd89765d7-wbpww\" (UID: \"73e16cbe-c208-4b9c-bd0f-97781629599a\") " pod="kuadrant-system/authorino-dd89765d7-wbpww" Jul 17 21:12:02.168737 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:02.168720 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ngfp7\" (UniqueName: \"kubernetes.io/projected/8f7c9168-b11b-48f3-9c57-ea1e1cad6c39-kube-api-access-ngfp7\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:12:02.177547 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:02.177524 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96mlf\" (UniqueName: \"kubernetes.io/projected/73e16cbe-c208-4b9c-bd0f-97781629599a-kube-api-access-96mlf\") pod \"authorino-dd89765d7-wbpww\" (UID: \"73e16cbe-c208-4b9c-bd0f-97781629599a\") " pod="kuadrant-system/authorino-dd89765d7-wbpww" Jul 17 21:12:02.209377 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:02.209352 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-dd89765d7-wbpww" Jul 17 21:12:02.336361 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:02.336330 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-dd89765d7-wbpww"] Jul 17 21:12:02.338871 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:12:02.338844 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod73e16cbe_c208_4b9c_bd0f_97781629599a.slice/crio-121f21dc43f2ebc4da4820411bc0b0de17f3de0fd39d37c1afd07d769cd27622 WatchSource:0}: Error finding container 121f21dc43f2ebc4da4820411bc0b0de17f3de0fd39d37c1afd07d769cd27622: Status 404 returned error can't find the container with id 121f21dc43f2ebc4da4820411bc0b0de17f3de0fd39d37c1afd07d769cd27622 Jul 17 21:12:02.735395 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:02.735362 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-dd89765d7-wbpww"] Jul 17 21:12:02.970470 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:02.970375 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-dd89765d7-wbpww" event={"ID":"73e16cbe-c208-4b9c-bd0f-97781629599a","Type":"ContainerStarted","Data":"141868118d0804cad98921be7e67874d99fe128026b8d73dfc7fbfb62e5f974c"} Jul 17 21:12:02.970470 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:02.970398 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4q4cf" Jul 17 21:12:02.970470 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:02.970416 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-dd89765d7-wbpww" event={"ID":"73e16cbe-c208-4b9c-bd0f-97781629599a","Type":"ContainerStarted","Data":"121f21dc43f2ebc4da4820411bc0b0de17f3de0fd39d37c1afd07d769cd27622"} Jul 17 21:12:02.986370 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:02.986329 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-dd89765d7-wbpww" podStartSLOduration=1.6551899460000001 podStartE2EDuration="1.986314859s" totalImagesPullingTime="331.124913ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:12:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:12:02.985306023 +0000 UTC m=+501.785105351" watchObservedRunningTime="2026-07-17 21:12:02.986314859 +0000 UTC m=+501.786114188" Jul 17 21:12:03.008228 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:03.008200 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4q4cf"] Jul 17 21:12:03.011695 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:03.011662 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4q4cf"] Jul 17 21:12:03.735732 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:03.735698 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f7c9168-b11b-48f3-9c57-ea1e1cad6c39" path="/var/lib/kubelet/pods/8f7c9168-b11b-48f3-9c57-ea1e1cad6c39/volumes" Jul 17 21:12:03.974807 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:03.974768 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-dd89765d7-wbpww" podUID="73e16cbe-c208-4b9c-bd0f-97781629599a" containerName="authorino" containerID="cri-o://141868118d0804cad98921be7e67874d99fe128026b8d73dfc7fbfb62e5f974c" gracePeriod=30 Jul 17 21:12:04.179614 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:04.179585 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tqrf6"] Jul 17 21:12:04.179795 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:04.179775 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-tqrf6" podUID="34e7eb00-0bdc-4204-a8d7-c3f6f53a1b23" containerName="authorino" containerID="cri-o://a5cc5aef886b261eaf05b93be2c890e0896da234e294f39f0b59077f8f92b1bc" gracePeriod=30 Jul 17 21:12:04.300790 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:04.300768 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-dd89765d7-wbpww" Jul 17 21:12:04.414605 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:04.414576 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tqrf6" Jul 17 21:12:04.488221 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:04.488185 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-96mlf\" (UniqueName: \"kubernetes.io/projected/73e16cbe-c208-4b9c-bd0f-97781629599a-kube-api-access-96mlf\") pod \"73e16cbe-c208-4b9c-bd0f-97781629599a\" (UID: \"73e16cbe-c208-4b9c-bd0f-97781629599a\") " Jul 17 21:12:04.490167 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:04.490145 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73e16cbe-c208-4b9c-bd0f-97781629599a-kube-api-access-96mlf" (OuterVolumeSpecName: "kube-api-access-96mlf") pod "73e16cbe-c208-4b9c-bd0f-97781629599a" (UID: "73e16cbe-c208-4b9c-bd0f-97781629599a"). InnerVolumeSpecName "kube-api-access-96mlf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:12:04.588808 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:04.588776 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pk6sf\" (UniqueName: \"kubernetes.io/projected/34e7eb00-0bdc-4204-a8d7-c3f6f53a1b23-kube-api-access-pk6sf\") pod \"34e7eb00-0bdc-4204-a8d7-c3f6f53a1b23\" (UID: \"34e7eb00-0bdc-4204-a8d7-c3f6f53a1b23\") " Jul 17 21:12:04.588969 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:04.588940 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-96mlf\" (UniqueName: \"kubernetes.io/projected/73e16cbe-c208-4b9c-bd0f-97781629599a-kube-api-access-96mlf\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:12:04.590735 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:04.590713 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34e7eb00-0bdc-4204-a8d7-c3f6f53a1b23-kube-api-access-pk6sf" (OuterVolumeSpecName: "kube-api-access-pk6sf") pod "34e7eb00-0bdc-4204-a8d7-c3f6f53a1b23" (UID: "34e7eb00-0bdc-4204-a8d7-c3f6f53a1b23"). InnerVolumeSpecName "kube-api-access-pk6sf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:12:04.689382 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:04.689340 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pk6sf\" (UniqueName: \"kubernetes.io/projected/34e7eb00-0bdc-4204-a8d7-c3f6f53a1b23-kube-api-access-pk6sf\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:12:04.980633 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:04.980540 2568 generic.go:356] "Generic (PLEG): container finished" podID="34e7eb00-0bdc-4204-a8d7-c3f6f53a1b23" containerID="a5cc5aef886b261eaf05b93be2c890e0896da234e294f39f0b59077f8f92b1bc" exitCode=0 Jul 17 21:12:04.980633 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:04.980577 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tqrf6" Jul 17 21:12:04.980633 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:04.980619 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tqrf6" event={"ID":"34e7eb00-0bdc-4204-a8d7-c3f6f53a1b23","Type":"ContainerDied","Data":"a5cc5aef886b261eaf05b93be2c890e0896da234e294f39f0b59077f8f92b1bc"} Jul 17 21:12:04.981179 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:04.980655 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tqrf6" event={"ID":"34e7eb00-0bdc-4204-a8d7-c3f6f53a1b23","Type":"ContainerDied","Data":"6a1b26e5e792c92604b0db16af262dfc9d6e1157e4cf13c3f0dad1955455da3b"} Jul 17 21:12:04.981179 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:04.980672 2568 scope.go:117] "RemoveContainer" containerID="a5cc5aef886b261eaf05b93be2c890e0896da234e294f39f0b59077f8f92b1bc" Jul 17 21:12:04.981995 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:04.981960 2568 generic.go:356] "Generic (PLEG): container finished" podID="73e16cbe-c208-4b9c-bd0f-97781629599a" containerID="141868118d0804cad98921be7e67874d99fe128026b8d73dfc7fbfb62e5f974c" exitCode=0 Jul 17 21:12:04.981995 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:04.981984 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-dd89765d7-wbpww" event={"ID":"73e16cbe-c208-4b9c-bd0f-97781629599a","Type":"ContainerDied","Data":"141868118d0804cad98921be7e67874d99fe128026b8d73dfc7fbfb62e5f974c"} Jul 17 21:12:04.982101 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:04.982008 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-dd89765d7-wbpww" Jul 17 21:12:04.982101 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:04.982024 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-dd89765d7-wbpww" event={"ID":"73e16cbe-c208-4b9c-bd0f-97781629599a","Type":"ContainerDied","Data":"121f21dc43f2ebc4da4820411bc0b0de17f3de0fd39d37c1afd07d769cd27622"} Jul 17 21:12:04.996516 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:04.996499 2568 scope.go:117] "RemoveContainer" containerID="a5cc5aef886b261eaf05b93be2c890e0896da234e294f39f0b59077f8f92b1bc" Jul 17 21:12:04.996847 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:12:04.996815 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5cc5aef886b261eaf05b93be2c890e0896da234e294f39f0b59077f8f92b1bc\": container with ID starting with a5cc5aef886b261eaf05b93be2c890e0896da234e294f39f0b59077f8f92b1bc not found: ID does not exist" containerID="a5cc5aef886b261eaf05b93be2c890e0896da234e294f39f0b59077f8f92b1bc" Jul 17 21:12:04.996927 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:04.996853 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5cc5aef886b261eaf05b93be2c890e0896da234e294f39f0b59077f8f92b1bc"} err="failed to get container status \"a5cc5aef886b261eaf05b93be2c890e0896da234e294f39f0b59077f8f92b1bc\": rpc error: code = NotFound desc = could not find container \"a5cc5aef886b261eaf05b93be2c890e0896da234e294f39f0b59077f8f92b1bc\": container with ID starting with a5cc5aef886b261eaf05b93be2c890e0896da234e294f39f0b59077f8f92b1bc not found: ID does not exist" Jul 17 21:12:04.996927 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:04.996871 2568 scope.go:117] "RemoveContainer" containerID="141868118d0804cad98921be7e67874d99fe128026b8d73dfc7fbfb62e5f974c" Jul 17 21:12:05.004132 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:05.004113 2568 scope.go:117] "RemoveContainer" containerID="141868118d0804cad98921be7e67874d99fe128026b8d73dfc7fbfb62e5f974c" Jul 17 21:12:05.004390 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:12:05.004371 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"141868118d0804cad98921be7e67874d99fe128026b8d73dfc7fbfb62e5f974c\": container with ID starting with 141868118d0804cad98921be7e67874d99fe128026b8d73dfc7fbfb62e5f974c not found: ID does not exist" containerID="141868118d0804cad98921be7e67874d99fe128026b8d73dfc7fbfb62e5f974c" Jul 17 21:12:05.004445 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:05.004397 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"141868118d0804cad98921be7e67874d99fe128026b8d73dfc7fbfb62e5f974c"} err="failed to get container status \"141868118d0804cad98921be7e67874d99fe128026b8d73dfc7fbfb62e5f974c\": rpc error: code = NotFound desc = could not find container \"141868118d0804cad98921be7e67874d99fe128026b8d73dfc7fbfb62e5f974c\": container with ID starting with 141868118d0804cad98921be7e67874d99fe128026b8d73dfc7fbfb62e5f974c not found: ID does not exist" Jul 17 21:12:05.007243 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:05.007221 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tqrf6"] Jul 17 21:12:05.012964 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:05.012943 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tqrf6"] Jul 17 21:12:05.022501 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:05.022476 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-dd89765d7-wbpww"] Jul 17 21:12:05.024499 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:05.024479 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-dd89765d7-wbpww"] Jul 17 21:12:05.736241 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:05.736208 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34e7eb00-0bdc-4204-a8d7-c3f6f53a1b23" path="/var/lib/kubelet/pods/34e7eb00-0bdc-4204-a8d7-c3f6f53a1b23/volumes" Jul 17 21:12:05.736575 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:05.736560 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73e16cbe-c208-4b9c-bd0f-97781629599a" path="/var/lib/kubelet/pods/73e16cbe-c208-4b9c-bd0f-97781629599a/volumes" Jul 17 21:12:44.855202 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:44.855168 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-z49r2"] Jul 17 21:12:44.855670 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:44.855496 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73e16cbe-c208-4b9c-bd0f-97781629599a" containerName="authorino" Jul 17 21:12:44.855670 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:44.855508 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="73e16cbe-c208-4b9c-bd0f-97781629599a" containerName="authorino" Jul 17 21:12:44.855670 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:44.855524 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34e7eb00-0bdc-4204-a8d7-c3f6f53a1b23" containerName="authorino" Jul 17 21:12:44.855670 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:44.855530 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="34e7eb00-0bdc-4204-a8d7-c3f6f53a1b23" containerName="authorino" Jul 17 21:12:44.855670 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:44.855590 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="34e7eb00-0bdc-4204-a8d7-c3f6f53a1b23" containerName="authorino" Jul 17 21:12:44.855670 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:44.855601 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="73e16cbe-c208-4b9c-bd0f-97781629599a" containerName="authorino" Jul 17 21:12:44.858111 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:44.858092 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-z49r2" Jul 17 21:12:44.860798 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:44.860777 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-tfm7j\"" Jul 17 21:12:44.861053 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:44.861031 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 17 21:12:44.867797 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:44.867770 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-z49r2"] Jul 17 21:12:44.957047 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:44.957008 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:12:45.018833 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:45.018800 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef6ade2c-e01b-4cd8-a2dd-dc1734357997-plugins-config-volume\") pod \"payload-processing-5bf47cd988-z49r2\" (UID: \"ef6ade2c-e01b-4cd8-a2dd-dc1734357997\") " pod="openshift-ingress/payload-processing-5bf47cd988-z49r2" Jul 17 21:12:45.018833 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:45.018832 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqfqv\" (UniqueName: \"kubernetes.io/projected/ef6ade2c-e01b-4cd8-a2dd-dc1734357997-kube-api-access-pqfqv\") pod \"payload-processing-5bf47cd988-z49r2\" (UID: \"ef6ade2c-e01b-4cd8-a2dd-dc1734357997\") " pod="openshift-ingress/payload-processing-5bf47cd988-z49r2" Jul 17 21:12:45.119700 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:45.119609 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef6ade2c-e01b-4cd8-a2dd-dc1734357997-plugins-config-volume\") pod \"payload-processing-5bf47cd988-z49r2\" (UID: \"ef6ade2c-e01b-4cd8-a2dd-dc1734357997\") " pod="openshift-ingress/payload-processing-5bf47cd988-z49r2" Jul 17 21:12:45.119700 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:45.119641 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqfqv\" (UniqueName: \"kubernetes.io/projected/ef6ade2c-e01b-4cd8-a2dd-dc1734357997-kube-api-access-pqfqv\") pod \"payload-processing-5bf47cd988-z49r2\" (UID: \"ef6ade2c-e01b-4cd8-a2dd-dc1734357997\") " pod="openshift-ingress/payload-processing-5bf47cd988-z49r2" Jul 17 21:12:45.120443 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:45.120423 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef6ade2c-e01b-4cd8-a2dd-dc1734357997-plugins-config-volume\") pod \"payload-processing-5bf47cd988-z49r2\" (UID: \"ef6ade2c-e01b-4cd8-a2dd-dc1734357997\") " pod="openshift-ingress/payload-processing-5bf47cd988-z49r2" Jul 17 21:12:45.129167 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:45.129135 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqfqv\" (UniqueName: \"kubernetes.io/projected/ef6ade2c-e01b-4cd8-a2dd-dc1734357997-kube-api-access-pqfqv\") pod \"payload-processing-5bf47cd988-z49r2\" (UID: \"ef6ade2c-e01b-4cd8-a2dd-dc1734357997\") " pod="openshift-ingress/payload-processing-5bf47cd988-z49r2" Jul 17 21:12:45.168874 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:45.168846 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-z49r2" Jul 17 21:12:45.294036 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:45.294008 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-z49r2"] Jul 17 21:12:45.296505 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:12:45.296478 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef6ade2c_e01b_4cd8_a2dd_dc1734357997.slice/crio-a4991f71501a453e4358475b868454a5577940255a05c771062efdfdbb1f1f41 WatchSource:0}: Error finding container a4991f71501a453e4358475b868454a5577940255a05c771062efdfdbb1f1f41: Status 404 returned error can't find the container with id a4991f71501a453e4358475b868454a5577940255a05c771062efdfdbb1f1f41 Jul 17 21:12:46.176178 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:46.176130 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-z49r2" event={"ID":"ef6ade2c-e01b-4cd8-a2dd-dc1734357997","Type":"ContainerStarted","Data":"a4991f71501a453e4358475b868454a5577940255a05c771062efdfdbb1f1f41"} Jul 17 21:12:47.182413 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:47.182376 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-z49r2" event={"ID":"ef6ade2c-e01b-4cd8-a2dd-dc1734357997","Type":"ContainerStarted","Data":"6cfab6f582ccbf6836b8c126e345d814349dc1591df78f3b4faf207f749c9f43"} Jul 17 21:12:47.182948 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:47.182478 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-z49r2" Jul 17 21:12:47.203776 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:47.203736 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-z49r2" podStartSLOduration=1.7874310530000002 podStartE2EDuration="3.203722674s" totalImagesPullingTime="1.416291621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:12:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:12:47.202444058 +0000 UTC m=+546.002243387" watchObservedRunningTime="2026-07-17 21:12:47.203722674 +0000 UTC m=+546.003522003" Jul 17 21:12:58.189484 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:12:58.189450 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-z49r2" Jul 17 21:13:32.976243 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:13:32.976212 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:13:51.380954 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:13:51.380919 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:14:04.677898 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:04.677820 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-zh265"] Jul 17 21:14:04.681144 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:04.681126 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zh265" Jul 17 21:14:04.684588 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:04.684560 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lhl2r\"" Jul 17 21:14:04.684729 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:04.684583 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 17 21:14:04.684729 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:04.684627 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 17 21:14:04.684729 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:04.684718 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 17 21:14:04.693515 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:04.693491 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-zh265"] Jul 17 21:14:04.773246 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:04.773206 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce69f59e-0c28-4337-bde9-18987de2369d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zh265\" (UID: \"ce69f59e-0c28-4337-bde9-18987de2369d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zh265" Jul 17 21:14:04.773440 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:04.773268 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce69f59e-0c28-4337-bde9-18987de2369d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zh265\" (UID: \"ce69f59e-0c28-4337-bde9-18987de2369d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zh265" Jul 17 21:14:04.773440 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:04.773291 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce69f59e-0c28-4337-bde9-18987de2369d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zh265\" (UID: \"ce69f59e-0c28-4337-bde9-18987de2369d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zh265" Jul 17 21:14:04.773440 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:04.773317 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce69f59e-0c28-4337-bde9-18987de2369d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zh265\" (UID: \"ce69f59e-0c28-4337-bde9-18987de2369d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zh265" Jul 17 21:14:04.773440 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:04.773338 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpj9z\" (UniqueName: \"kubernetes.io/projected/ce69f59e-0c28-4337-bde9-18987de2369d-kube-api-access-cpj9z\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zh265\" (UID: \"ce69f59e-0c28-4337-bde9-18987de2369d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zh265" Jul 17 21:14:04.773440 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:04.773381 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce69f59e-0c28-4337-bde9-18987de2369d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zh265\" (UID: \"ce69f59e-0c28-4337-bde9-18987de2369d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zh265" Jul 17 21:14:04.874815 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:04.874774 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce69f59e-0c28-4337-bde9-18987de2369d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zh265\" (UID: \"ce69f59e-0c28-4337-bde9-18987de2369d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zh265" Jul 17 21:14:04.875021 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:04.874820 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpj9z\" (UniqueName: \"kubernetes.io/projected/ce69f59e-0c28-4337-bde9-18987de2369d-kube-api-access-cpj9z\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zh265\" (UID: \"ce69f59e-0c28-4337-bde9-18987de2369d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zh265" Jul 17 21:14:04.875021 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:04.874856 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce69f59e-0c28-4337-bde9-18987de2369d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zh265\" (UID: \"ce69f59e-0c28-4337-bde9-18987de2369d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zh265" Jul 17 21:14:04.875021 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:04.874912 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce69f59e-0c28-4337-bde9-18987de2369d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zh265\" (UID: \"ce69f59e-0c28-4337-bde9-18987de2369d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zh265" Jul 17 21:14:04.875021 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:04.874953 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce69f59e-0c28-4337-bde9-18987de2369d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zh265\" (UID: \"ce69f59e-0c28-4337-bde9-18987de2369d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zh265" Jul 17 21:14:04.875021 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:04.874980 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce69f59e-0c28-4337-bde9-18987de2369d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zh265\" (UID: \"ce69f59e-0c28-4337-bde9-18987de2369d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zh265" Jul 17 21:14:04.875285 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:04.875223 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce69f59e-0c28-4337-bde9-18987de2369d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zh265\" (UID: \"ce69f59e-0c28-4337-bde9-18987de2369d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zh265" Jul 17 21:14:04.875285 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:04.875268 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce69f59e-0c28-4337-bde9-18987de2369d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zh265\" (UID: \"ce69f59e-0c28-4337-bde9-18987de2369d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zh265" Jul 17 21:14:04.875398 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:04.875356 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce69f59e-0c28-4337-bde9-18987de2369d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zh265\" (UID: \"ce69f59e-0c28-4337-bde9-18987de2369d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zh265" Jul 17 21:14:04.877198 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:04.877171 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce69f59e-0c28-4337-bde9-18987de2369d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zh265\" (UID: \"ce69f59e-0c28-4337-bde9-18987de2369d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zh265" Jul 17 21:14:04.877337 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:04.877318 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce69f59e-0c28-4337-bde9-18987de2369d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zh265\" (UID: \"ce69f59e-0c28-4337-bde9-18987de2369d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zh265" Jul 17 21:14:04.884053 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:04.884029 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpj9z\" (UniqueName: \"kubernetes.io/projected/ce69f59e-0c28-4337-bde9-18987de2369d-kube-api-access-cpj9z\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zh265\" (UID: \"ce69f59e-0c28-4337-bde9-18987de2369d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zh265" Jul 17 21:14:04.991057 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:04.990972 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zh265" Jul 17 21:14:05.126475 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:05.126412 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-zh265"] Jul 17 21:14:05.129003 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:14:05.128970 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce69f59e_0c28_4337_bde9_18987de2369d.slice/crio-878509d809c8aeb5dd42a9af15c346c503e367a02356413b201909842277e77e WatchSource:0}: Error finding container 878509d809c8aeb5dd42a9af15c346c503e367a02356413b201909842277e77e: Status 404 returned error can't find the container with id 878509d809c8aeb5dd42a9af15c346c503e367a02356413b201909842277e77e Jul 17 21:14:05.534413 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:05.534373 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zh265" event={"ID":"ce69f59e-0c28-4337-bde9-18987de2369d","Type":"ContainerStarted","Data":"878509d809c8aeb5dd42a9af15c346c503e367a02356413b201909842277e77e"} Jul 17 21:14:05.780888 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:05.780006 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:14:06.539943 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:06.539857 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zh265" event={"ID":"ce69f59e-0c28-4337-bde9-18987de2369d","Type":"ContainerStarted","Data":"8f81dc2a439259ffaefb7f187504c0a5afc7251b3f31ba753a8ccfdf8e05b5e4"} Jul 17 21:14:06.562312 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:06.562260 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zh265" podStartSLOduration=1.537556705 podStartE2EDuration="2.562243243s" totalImagesPullingTime="1.024686538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:14:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:14:06.560868704 +0000 UTC m=+625.360668046" watchObservedRunningTime="2026-07-17 21:14:06.562243243 +0000 UTC m=+625.362042575" Jul 17 21:14:11.376629 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:11.376592 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:14:13.775132 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:13.775098 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-cgvn9"] Jul 17 21:14:13.779249 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:13.779227 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgvn9" Jul 17 21:14:13.781786 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:13.781764 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 17 21:14:13.787542 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:13.787522 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-cgvn9"] Jul 17 21:14:13.845367 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:13.845343 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fa5b05c-57a7-437d-89e4-08e3f0400cd1-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cgvn9\" (UID: \"2fa5b05c-57a7-437d-89e4-08e3f0400cd1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgvn9" Jul 17 21:14:13.845473 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:13.845376 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rt7rl\" (UniqueName: \"kubernetes.io/projected/2fa5b05c-57a7-437d-89e4-08e3f0400cd1-kube-api-access-rt7rl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cgvn9\" (UID: \"2fa5b05c-57a7-437d-89e4-08e3f0400cd1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgvn9" Jul 17 21:14:13.845473 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:13.845435 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fa5b05c-57a7-437d-89e4-08e3f0400cd1-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cgvn9\" (UID: \"2fa5b05c-57a7-437d-89e4-08e3f0400cd1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgvn9" Jul 17 21:14:13.845473 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:13.845463 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fa5b05c-57a7-437d-89e4-08e3f0400cd1-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cgvn9\" (UID: \"2fa5b05c-57a7-437d-89e4-08e3f0400cd1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgvn9" Jul 17 21:14:13.845584 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:13.845486 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fa5b05c-57a7-437d-89e4-08e3f0400cd1-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cgvn9\" (UID: \"2fa5b05c-57a7-437d-89e4-08e3f0400cd1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgvn9" Jul 17 21:14:13.845584 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:13.845548 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fa5b05c-57a7-437d-89e4-08e3f0400cd1-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cgvn9\" (UID: \"2fa5b05c-57a7-437d-89e4-08e3f0400cd1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgvn9" Jul 17 21:14:13.946388 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:13.946360 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fa5b05c-57a7-437d-89e4-08e3f0400cd1-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cgvn9\" (UID: \"2fa5b05c-57a7-437d-89e4-08e3f0400cd1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgvn9" Jul 17 21:14:13.946486 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:13.946392 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fa5b05c-57a7-437d-89e4-08e3f0400cd1-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cgvn9\" (UID: \"2fa5b05c-57a7-437d-89e4-08e3f0400cd1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgvn9" Jul 17 21:14:13.946486 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:13.946410 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt7rl\" (UniqueName: \"kubernetes.io/projected/2fa5b05c-57a7-437d-89e4-08e3f0400cd1-kube-api-access-rt7rl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cgvn9\" (UID: \"2fa5b05c-57a7-437d-89e4-08e3f0400cd1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgvn9" Jul 17 21:14:13.946486 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:13.946454 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fa5b05c-57a7-437d-89e4-08e3f0400cd1-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cgvn9\" (UID: \"2fa5b05c-57a7-437d-89e4-08e3f0400cd1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgvn9" Jul 17 21:14:13.946612 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:13.946493 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fa5b05c-57a7-437d-89e4-08e3f0400cd1-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cgvn9\" (UID: \"2fa5b05c-57a7-437d-89e4-08e3f0400cd1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgvn9" Jul 17 21:14:13.946612 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:13.946521 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fa5b05c-57a7-437d-89e4-08e3f0400cd1-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cgvn9\" (UID: \"2fa5b05c-57a7-437d-89e4-08e3f0400cd1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgvn9" Jul 17 21:14:13.946848 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:13.946829 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fa5b05c-57a7-437d-89e4-08e3f0400cd1-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cgvn9\" (UID: \"2fa5b05c-57a7-437d-89e4-08e3f0400cd1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgvn9" Jul 17 21:14:13.946918 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:13.946875 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fa5b05c-57a7-437d-89e4-08e3f0400cd1-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cgvn9\" (UID: \"2fa5b05c-57a7-437d-89e4-08e3f0400cd1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgvn9" Jul 17 21:14:13.946975 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:13.946937 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fa5b05c-57a7-437d-89e4-08e3f0400cd1-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cgvn9\" (UID: \"2fa5b05c-57a7-437d-89e4-08e3f0400cd1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgvn9" Jul 17 21:14:13.948641 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:13.948623 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fa5b05c-57a7-437d-89e4-08e3f0400cd1-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cgvn9\" (UID: \"2fa5b05c-57a7-437d-89e4-08e3f0400cd1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgvn9" Jul 17 21:14:13.948940 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:13.948923 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fa5b05c-57a7-437d-89e4-08e3f0400cd1-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cgvn9\" (UID: \"2fa5b05c-57a7-437d-89e4-08e3f0400cd1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgvn9" Jul 17 21:14:13.954332 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:13.954310 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rt7rl\" (UniqueName: \"kubernetes.io/projected/2fa5b05c-57a7-437d-89e4-08e3f0400cd1-kube-api-access-rt7rl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cgvn9\" (UID: \"2fa5b05c-57a7-437d-89e4-08e3f0400cd1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgvn9" Jul 17 21:14:14.090326 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:14.090301 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgvn9" Jul 17 21:14:14.217701 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:14.217604 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-cgvn9"] Jul 17 21:14:14.219836 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:14:14.219808 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fa5b05c_57a7_437d_89e4_08e3f0400cd1.slice/crio-b7af9d454846d5a40ce269a877a2267946faf69df41ccba10bae2c755c737b42 WatchSource:0}: Error finding container b7af9d454846d5a40ce269a877a2267946faf69df41ccba10bae2c755c737b42: Status 404 returned error can't find the container with id b7af9d454846d5a40ce269a877a2267946faf69df41ccba10bae2c755c737b42 Jul 17 21:14:14.573984 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:14.573949 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgvn9" event={"ID":"2fa5b05c-57a7-437d-89e4-08e3f0400cd1","Type":"ContainerStarted","Data":"d3074f30b5b0f3bbe9ae90ba814d8d9441a52512d717075b40ac2771af7321f6"} Jul 17 21:14:14.574280 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:14.574002 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgvn9" event={"ID":"2fa5b05c-57a7-437d-89e4-08e3f0400cd1","Type":"ContainerStarted","Data":"b7af9d454846d5a40ce269a877a2267946faf69df41ccba10bae2c755c737b42"} Jul 17 21:14:14.595354 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:14.595310 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgvn9" podStartSLOduration=1.4254396790000001 podStartE2EDuration="1.595295658s" totalImagesPullingTime="169.855979ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:14:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:14:14.593801835 +0000 UTC m=+633.393601215" watchObservedRunningTime="2026-07-17 21:14:14.595295658 +0000 UTC m=+633.395094986" Jul 17 21:14:14.991297 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:14.991259 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zh265" Jul 17 21:14:14.991653 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:14.991322 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zh265" Jul 17 21:14:15.003568 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:15.003546 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zh265" Jul 17 21:14:15.392493 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:15.392463 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:14:15.589065 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:15.589039 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zh265" Jul 17 21:14:24.091379 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:24.091330 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgvn9" Jul 17 21:14:24.091856 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:24.091444 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgvn9" Jul 17 21:14:24.103716 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:24.103670 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgvn9" Jul 17 21:14:24.627983 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:24.627947 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgvn9" Jul 17 21:14:32.582302 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:14:32.582265 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:15:42.276598 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:15:42.276517 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5bbb74bcb6-5jfb9"] Jul 17 21:15:42.280319 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:15:42.280292 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bbb74bcb6-5jfb9" Jul 17 21:15:42.284007 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:15:42.283987 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-gdcvg\"" Jul 17 21:15:42.284104 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:15:42.283987 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 17 21:15:42.289984 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:15:42.289961 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5bbb74bcb6-5jfb9"] Jul 17 21:15:42.390246 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:15:42.390214 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnpns\" (UniqueName: \"kubernetes.io/projected/d9ca43d6-2c28-41e4-96a5-e01c9cd3a7e0-kube-api-access-xnpns\") pod \"authorino-5bbb74bcb6-5jfb9\" (UID: \"d9ca43d6-2c28-41e4-96a5-e01c9cd3a7e0\") " pod="kuadrant-system/authorino-5bbb74bcb6-5jfb9" Jul 17 21:15:42.390393 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:15:42.390266 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d9ca43d6-2c28-41e4-96a5-e01c9cd3a7e0-tls-cert\") pod \"authorino-5bbb74bcb6-5jfb9\" (UID: \"d9ca43d6-2c28-41e4-96a5-e01c9cd3a7e0\") " pod="kuadrant-system/authorino-5bbb74bcb6-5jfb9" Jul 17 21:15:42.491608 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:15:42.491576 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnpns\" (UniqueName: \"kubernetes.io/projected/d9ca43d6-2c28-41e4-96a5-e01c9cd3a7e0-kube-api-access-xnpns\") pod \"authorino-5bbb74bcb6-5jfb9\" (UID: \"d9ca43d6-2c28-41e4-96a5-e01c9cd3a7e0\") " pod="kuadrant-system/authorino-5bbb74bcb6-5jfb9" Jul 17 21:15:42.491780 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:15:42.491645 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d9ca43d6-2c28-41e4-96a5-e01c9cd3a7e0-tls-cert\") pod \"authorino-5bbb74bcb6-5jfb9\" (UID: \"d9ca43d6-2c28-41e4-96a5-e01c9cd3a7e0\") " pod="kuadrant-system/authorino-5bbb74bcb6-5jfb9" Jul 17 21:15:42.494027 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:15:42.494010 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d9ca43d6-2c28-41e4-96a5-e01c9cd3a7e0-tls-cert\") pod \"authorino-5bbb74bcb6-5jfb9\" (UID: \"d9ca43d6-2c28-41e4-96a5-e01c9cd3a7e0\") " pod="kuadrant-system/authorino-5bbb74bcb6-5jfb9" Jul 17 21:15:42.500914 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:15:42.500886 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnpns\" (UniqueName: \"kubernetes.io/projected/d9ca43d6-2c28-41e4-96a5-e01c9cd3a7e0-kube-api-access-xnpns\") pod \"authorino-5bbb74bcb6-5jfb9\" (UID: \"d9ca43d6-2c28-41e4-96a5-e01c9cd3a7e0\") " pod="kuadrant-system/authorino-5bbb74bcb6-5jfb9" Jul 17 21:15:42.589737 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:15:42.589707 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bbb74bcb6-5jfb9" Jul 17 21:15:42.732927 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:15:42.732801 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5bbb74bcb6-5jfb9"] Jul 17 21:15:42.735691 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:15:42.735647 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd9ca43d6_2c28_41e4_96a5_e01c9cd3a7e0.slice/crio-8ed552f8329dd76ef890df4bd8ae0517a7793e4de9b83453d1e6c09a3fa310a1 WatchSource:0}: Error finding container 8ed552f8329dd76ef890df4bd8ae0517a7793e4de9b83453d1e6c09a3fa310a1: Status 404 returned error can't find the container with id 8ed552f8329dd76ef890df4bd8ae0517a7793e4de9b83453d1e6c09a3fa310a1 Jul 17 21:15:42.737127 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:15:42.737097 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 21:15:42.956713 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:15:42.956614 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bbb74bcb6-5jfb9" event={"ID":"d9ca43d6-2c28-41e4-96a5-e01c9cd3a7e0","Type":"ContainerStarted","Data":"8ed552f8329dd76ef890df4bd8ae0517a7793e4de9b83453d1e6c09a3fa310a1"} Jul 17 21:15:43.965029 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:15:43.964987 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bbb74bcb6-5jfb9" event={"ID":"d9ca43d6-2c28-41e4-96a5-e01c9cd3a7e0","Type":"ContainerStarted","Data":"205fdd44066a2cd307086836cdac5f87bd52633f7d616f58a4e0dae201fae414"} Jul 17 21:15:43.989290 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:15:43.989220 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5bbb74bcb6-5jfb9" podStartSLOduration=1.2969365640000001 podStartE2EDuration="1.989199572s" totalImagesPullingTime="692.263008ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:15:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:15:43.988475911 +0000 UTC m=+722.788275241" watchObservedRunningTime="2026-07-17 21:15:43.989199572 +0000 UTC m=+722.788998900" Jul 17 21:16:11.481028 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:16:11.480990 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:16:20.588851 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:16:20.588812 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:16:31.680179 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:16:31.680138 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:18:10.887085 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:18:10.887047 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:18:22.679126 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:18:22.679085 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:18:57.677583 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:18:57.677548 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:19:08.886168 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:19:08.886126 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:19:19.386758 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:19:19.386721 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:19:30.989178 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:19:30.989142 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:19:41.086060 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:19:41.086015 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:19:50.585377 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:19:50.585339 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:20:02.477753 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:20:02.477701 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:20:12.168991 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:20:12.168956 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:20:38.291344 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:20:38.291296 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:20:49.083297 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:20:49.083258 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:21:11.677086 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:21:11.677049 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:21:21.580480 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:21:21.580432 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:21:39.382550 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:21:39.382452 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:21:48.279928 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:21:48.279893 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:21:57.702528 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:21:57.702497 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:22:07.077171 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:22:07.077138 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:22:16.377747 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:22:16.377712 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:24:06.177865 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:24:06.177712 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:24:14.670145 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:24:14.670113 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:24:27.480351 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:24:27.480310 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:24:40.673633 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:24:40.673545 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:24:50.175881 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:24:50.175845 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:25:01.576547 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:25:01.576510 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:25:10.474424 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:25:10.474392 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:25:20.874023 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:25:20.873992 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:25:31.377433 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:25:31.377398 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:25:41.980439 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:25:41.980409 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:25:53.781929 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:25:53.781894 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:26:16.579542 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:26:16.579509 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:26:25.387817 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:26:25.387783 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:26:36.080732 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:26:36.080676 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:26:48.280769 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:26:48.280735 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:27:04.776689 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:27:04.776655 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:27:14.073376 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:27:14.073336 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:27:23.176890 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:27:23.176853 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:27:32.617827 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:27:32.617789 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:27:41.787177 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:27:41.787086 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:27:51.279477 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:27:51.279441 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:28:04.275510 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:28:04.275464 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:28:13.177168 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:28:13.177130 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:28:22.778879 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:28:22.778845 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:28:35.878640 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:28:35.878605 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:28:45.873668 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:28:45.873633 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:28:56.177891 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:28:56.177851 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:29:08.784631 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:29:08.784553 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:29:21.185483 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:29:21.185446 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:29:31.577183 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:29:31.577146 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:29:43.382375 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:29:43.382340 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:29:55.487504 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:29:55.487467 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:30:12.074229 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:30:12.074191 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:30:43.775142 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:30:43.775059 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:30:54.982092 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:30:54.982058 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:31:27.567271 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:31:27.567236 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:31:38.284649 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:31:38.284606 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:32:11.379258 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:32:11.379222 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:32:22.141031 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:32:22.140991 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:32:55.580381 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:32:55.580344 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:34:29.694353 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:34:29.694317 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:34:39.078738 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:34:39.078700 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:34:48.583977 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:34:48.583934 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:35:08.879555 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:35:08.879465 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:35:44.387222 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:35:44.387182 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:35:57.082012 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:35:57.081973 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:36:13.983283 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:36:13.983242 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:36:32.176375 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:36:32.174024 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:36:40.574483 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:36:40.574393 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:37:47.577853 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:37:47.577816 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:37:59.880674 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:37:59.880637 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:38:48.979128 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:38:48.979092 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:39:01.680341 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:39:01.680309 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-b28fb0/test-model-b28fb0-kserve-75649778fc-w9zsr"] Jul 17 21:39:01.683822 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:39:01.683806 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b28fb0/test-model-b28fb0-kserve-75649778fc-w9zsr" Jul 17 21:39:01.686387 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:39:01.686363 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-b28fb0\"/\"default-dockercfg-2m9xr\"" Jul 17 21:39:01.686387 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:39:01.686379 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-b28fb0\"/\"openshift-service-ca.crt\"" Jul 17 21:39:01.686977 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:39:01.686959 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:39:01.687108 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:39:01.687093 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-b28fb0\"/\"test-model-b28fb0-kserve-self-signed-certs\"" Jul 17 21:39:01.687196 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:39:01.687094 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-b28fb0\"/\"kube-root-ca.crt\"" Jul 17 21:39:01.694457 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:39:01.694432 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-b28fb0/test-model-b28fb0-kserve-75649778fc-w9zsr"] Jul 17 21:39:01.808303 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:39:01.808258 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8628ebd3-ebcb-4972-9369-deeb40668953-home\") pod \"test-model-b28fb0-kserve-75649778fc-w9zsr\" (UID: \"8628ebd3-ebcb-4972-9369-deeb40668953\") " pod="ai-tenant-e2e-inf-a-b28fb0/test-model-b28fb0-kserve-75649778fc-w9zsr" Jul 17 21:39:01.808552 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:39:01.808346 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8628ebd3-ebcb-4972-9369-deeb40668953-tls-certs\") pod \"test-model-b28fb0-kserve-75649778fc-w9zsr\" (UID: \"8628ebd3-ebcb-4972-9369-deeb40668953\") " pod="ai-tenant-e2e-inf-a-b28fb0/test-model-b28fb0-kserve-75649778fc-w9zsr" Jul 17 21:39:01.808552 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:39:01.808402 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8628ebd3-ebcb-4972-9369-deeb40668953-model-cache\") pod \"test-model-b28fb0-kserve-75649778fc-w9zsr\" (UID: \"8628ebd3-ebcb-4972-9369-deeb40668953\") " pod="ai-tenant-e2e-inf-a-b28fb0/test-model-b28fb0-kserve-75649778fc-w9zsr" Jul 17 21:39:01.808552 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:39:01.808507 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8628ebd3-ebcb-4972-9369-deeb40668953-tmp-dir\") pod \"test-model-b28fb0-kserve-75649778fc-w9zsr\" (UID: \"8628ebd3-ebcb-4972-9369-deeb40668953\") " pod="ai-tenant-e2e-inf-a-b28fb0/test-model-b28fb0-kserve-75649778fc-w9zsr" Jul 17 21:39:01.808770 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:39:01.808560 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8628ebd3-ebcb-4972-9369-deeb40668953-dshm\") pod \"test-model-b28fb0-kserve-75649778fc-w9zsr\" (UID: \"8628ebd3-ebcb-4972-9369-deeb40668953\") " pod="ai-tenant-e2e-inf-a-b28fb0/test-model-b28fb0-kserve-75649778fc-w9zsr" Jul 17 21:39:01.808770 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:39:01.808611 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmg6w\" (UniqueName: \"kubernetes.io/projected/8628ebd3-ebcb-4972-9369-deeb40668953-kube-api-access-mmg6w\") pod \"test-model-b28fb0-kserve-75649778fc-w9zsr\" (UID: \"8628ebd3-ebcb-4972-9369-deeb40668953\") " pod="ai-tenant-e2e-inf-a-b28fb0/test-model-b28fb0-kserve-75649778fc-w9zsr" Jul 17 21:39:01.909270 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:39:01.909225 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8628ebd3-ebcb-4972-9369-deeb40668953-model-cache\") pod \"test-model-b28fb0-kserve-75649778fc-w9zsr\" (UID: \"8628ebd3-ebcb-4972-9369-deeb40668953\") " pod="ai-tenant-e2e-inf-a-b28fb0/test-model-b28fb0-kserve-75649778fc-w9zsr" Jul 17 21:39:01.909448 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:39:01.909288 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8628ebd3-ebcb-4972-9369-deeb40668953-tmp-dir\") pod \"test-model-b28fb0-kserve-75649778fc-w9zsr\" (UID: \"8628ebd3-ebcb-4972-9369-deeb40668953\") " pod="ai-tenant-e2e-inf-a-b28fb0/test-model-b28fb0-kserve-75649778fc-w9zsr" Jul 17 21:39:01.909448 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:39:01.909313 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8628ebd3-ebcb-4972-9369-deeb40668953-dshm\") pod \"test-model-b28fb0-kserve-75649778fc-w9zsr\" (UID: \"8628ebd3-ebcb-4972-9369-deeb40668953\") " pod="ai-tenant-e2e-inf-a-b28fb0/test-model-b28fb0-kserve-75649778fc-w9zsr" Jul 17 21:39:01.909448 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:39:01.909331 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmg6w\" (UniqueName: \"kubernetes.io/projected/8628ebd3-ebcb-4972-9369-deeb40668953-kube-api-access-mmg6w\") pod \"test-model-b28fb0-kserve-75649778fc-w9zsr\" (UID: \"8628ebd3-ebcb-4972-9369-deeb40668953\") " pod="ai-tenant-e2e-inf-a-b28fb0/test-model-b28fb0-kserve-75649778fc-w9zsr" Jul 17 21:39:01.909448 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:39:01.909363 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8628ebd3-ebcb-4972-9369-deeb40668953-home\") pod \"test-model-b28fb0-kserve-75649778fc-w9zsr\" (UID: \"8628ebd3-ebcb-4972-9369-deeb40668953\") " pod="ai-tenant-e2e-inf-a-b28fb0/test-model-b28fb0-kserve-75649778fc-w9zsr" Jul 17 21:39:01.909448 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:39:01.909391 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8628ebd3-ebcb-4972-9369-deeb40668953-tls-certs\") pod \"test-model-b28fb0-kserve-75649778fc-w9zsr\" (UID: \"8628ebd3-ebcb-4972-9369-deeb40668953\") " pod="ai-tenant-e2e-inf-a-b28fb0/test-model-b28fb0-kserve-75649778fc-w9zsr" Jul 17 21:39:01.909745 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:39:01.909720 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8628ebd3-ebcb-4972-9369-deeb40668953-model-cache\") pod \"test-model-b28fb0-kserve-75649778fc-w9zsr\" (UID: \"8628ebd3-ebcb-4972-9369-deeb40668953\") " pod="ai-tenant-e2e-inf-a-b28fb0/test-model-b28fb0-kserve-75649778fc-w9zsr" Jul 17 21:39:01.909826 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:39:01.909776 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8628ebd3-ebcb-4972-9369-deeb40668953-tmp-dir\") pod \"test-model-b28fb0-kserve-75649778fc-w9zsr\" (UID: \"8628ebd3-ebcb-4972-9369-deeb40668953\") " pod="ai-tenant-e2e-inf-a-b28fb0/test-model-b28fb0-kserve-75649778fc-w9zsr" Jul 17 21:39:01.909878 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:39:01.909826 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8628ebd3-ebcb-4972-9369-deeb40668953-home\") pod \"test-model-b28fb0-kserve-75649778fc-w9zsr\" (UID: \"8628ebd3-ebcb-4972-9369-deeb40668953\") " pod="ai-tenant-e2e-inf-a-b28fb0/test-model-b28fb0-kserve-75649778fc-w9zsr" Jul 17 21:39:01.911555 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:39:01.911531 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8628ebd3-ebcb-4972-9369-deeb40668953-dshm\") pod \"test-model-b28fb0-kserve-75649778fc-w9zsr\" (UID: \"8628ebd3-ebcb-4972-9369-deeb40668953\") " pod="ai-tenant-e2e-inf-a-b28fb0/test-model-b28fb0-kserve-75649778fc-w9zsr" Jul 17 21:39:01.911864 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:39:01.911845 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8628ebd3-ebcb-4972-9369-deeb40668953-tls-certs\") pod \"test-model-b28fb0-kserve-75649778fc-w9zsr\" (UID: \"8628ebd3-ebcb-4972-9369-deeb40668953\") " pod="ai-tenant-e2e-inf-a-b28fb0/test-model-b28fb0-kserve-75649778fc-w9zsr" Jul 17 21:39:01.917574 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:39:01.917556 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmg6w\" (UniqueName: \"kubernetes.io/projected/8628ebd3-ebcb-4972-9369-deeb40668953-kube-api-access-mmg6w\") pod \"test-model-b28fb0-kserve-75649778fc-w9zsr\" (UID: \"8628ebd3-ebcb-4972-9369-deeb40668953\") " pod="ai-tenant-e2e-inf-a-b28fb0/test-model-b28fb0-kserve-75649778fc-w9zsr" Jul 17 21:39:01.993592 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:39:01.993501 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b28fb0/test-model-b28fb0-kserve-75649778fc-w9zsr" Jul 17 21:39:02.123715 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:39:02.123676 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-b28fb0/test-model-b28fb0-kserve-75649778fc-w9zsr"] Jul 17 21:39:02.125951 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:39:02.125917 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8628ebd3_ebcb_4972_9369_deeb40668953.slice/crio-f8e31bbd537a57a3151190381a7e33ed39a45321eb58ef02144db2f162503d2e WatchSource:0}: Error finding container f8e31bbd537a57a3151190381a7e33ed39a45321eb58ef02144db2f162503d2e: Status 404 returned error can't find the container with id f8e31bbd537a57a3151190381a7e33ed39a45321eb58ef02144db2f162503d2e Jul 17 21:39:02.247047 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:39:02.246953 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b28fb0/test-model-b28fb0-kserve-75649778fc-w9zsr" event={"ID":"8628ebd3-ebcb-4972-9369-deeb40668953","Type":"ContainerStarted","Data":"071f17dd88e0946893583f4bbc8c1e259cc4d2005acb47a362f74c1a6aac6cfe"} Jul 17 21:39:02.247047 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:39:02.247004 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b28fb0/test-model-b28fb0-kserve-75649778fc-w9zsr" event={"ID":"8628ebd3-ebcb-4972-9369-deeb40668953","Type":"ContainerStarted","Data":"f8e31bbd537a57a3151190381a7e33ed39a45321eb58ef02144db2f162503d2e"} Jul 17 21:39:02.264048 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:39:02.263999 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-b28fb0/test-model-b28fb0-kserve-75649778fc-w9zsr" podStartSLOduration=1.263981577 podStartE2EDuration="1.263981577s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:39:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:39:02.263820444 +0000 UTC m=+2121.063619772" watchObservedRunningTime="2026-07-17 21:39:02.263981577 +0000 UTC m=+2121.063780906" Jul 17 21:39:10.494118 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:39:10.494081 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:39:11.994003 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:39:11.993970 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-b28fb0/test-model-b28fb0-kserve-75649778fc-w9zsr" Jul 17 21:39:11.994367 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:39:11.994026 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-b28fb0/test-model-b28fb0-kserve-75649778fc-w9zsr" Jul 17 21:39:12.006066 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:39:12.006047 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-b28fb0/test-model-b28fb0-kserve-75649778fc-w9zsr" Jul 17 21:39:12.302133 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:39:12.302110 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-b28fb0/test-model-b28fb0-kserve-75649778fc-w9zsr" Jul 17 21:39:31.590958 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:39:31.590917 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:39:54.377408 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:39:54.377372 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-b28fb0/test-model-b28fb0-kserve-75649778fc-w9zsr"] Jul 17 21:39:59.181637 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:39:59.181596 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:40:09.396927 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:40:09.396864 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-b28fb0/test-model-b28fb0-kserve-75649778fc-w9zsr" podUID="8628ebd3-ebcb-4972-9369-deeb40668953" containerName="main" containerID="cri-o://071f17dd88e0946893583f4bbc8c1e259cc4d2005acb47a362f74c1a6aac6cfe" gracePeriod=45 Jul 17 21:40:09.556521 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:40:09.556489 2568 generic.go:356] "Generic (PLEG): container finished" podID="8628ebd3-ebcb-4972-9369-deeb40668953" containerID="071f17dd88e0946893583f4bbc8c1e259cc4d2005acb47a362f74c1a6aac6cfe" exitCode=0 Jul 17 21:40:09.556677 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:40:09.556528 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b28fb0/test-model-b28fb0-kserve-75649778fc-w9zsr" event={"ID":"8628ebd3-ebcb-4972-9369-deeb40668953","Type":"ContainerDied","Data":"071f17dd88e0946893583f4bbc8c1e259cc4d2005acb47a362f74c1a6aac6cfe"} Jul 17 21:40:09.644059 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:40:09.644036 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b28fb0/test-model-b28fb0-kserve-75649778fc-w9zsr" Jul 17 21:40:09.765720 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:40:09.765633 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmg6w\" (UniqueName: \"kubernetes.io/projected/8628ebd3-ebcb-4972-9369-deeb40668953-kube-api-access-mmg6w\") pod \"8628ebd3-ebcb-4972-9369-deeb40668953\" (UID: \"8628ebd3-ebcb-4972-9369-deeb40668953\") " Jul 17 21:40:09.765720 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:40:09.765666 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8628ebd3-ebcb-4972-9369-deeb40668953-home\") pod \"8628ebd3-ebcb-4972-9369-deeb40668953\" (UID: \"8628ebd3-ebcb-4972-9369-deeb40668953\") " Jul 17 21:40:09.765720 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:40:09.765718 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8628ebd3-ebcb-4972-9369-deeb40668953-dshm\") pod \"8628ebd3-ebcb-4972-9369-deeb40668953\" (UID: \"8628ebd3-ebcb-4972-9369-deeb40668953\") " Jul 17 21:40:09.765978 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:40:09.765762 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8628ebd3-ebcb-4972-9369-deeb40668953-tmp-dir\") pod \"8628ebd3-ebcb-4972-9369-deeb40668953\" (UID: \"8628ebd3-ebcb-4972-9369-deeb40668953\") " Jul 17 21:40:09.765978 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:40:09.765797 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8628ebd3-ebcb-4972-9369-deeb40668953-model-cache\") pod \"8628ebd3-ebcb-4972-9369-deeb40668953\" (UID: \"8628ebd3-ebcb-4972-9369-deeb40668953\") " Jul 17 21:40:09.765978 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:40:09.765827 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8628ebd3-ebcb-4972-9369-deeb40668953-tls-certs\") pod \"8628ebd3-ebcb-4972-9369-deeb40668953\" (UID: \"8628ebd3-ebcb-4972-9369-deeb40668953\") " Jul 17 21:40:09.766131 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:40:09.765989 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8628ebd3-ebcb-4972-9369-deeb40668953-home" (OuterVolumeSpecName: "home") pod "8628ebd3-ebcb-4972-9369-deeb40668953" (UID: "8628ebd3-ebcb-4972-9369-deeb40668953"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:40:09.766131 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:40:09.766066 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8628ebd3-ebcb-4972-9369-deeb40668953-model-cache" (OuterVolumeSpecName: "model-cache") pod "8628ebd3-ebcb-4972-9369-deeb40668953" (UID: "8628ebd3-ebcb-4972-9369-deeb40668953"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:40:09.766131 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:40:09.766086 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8628ebd3-ebcb-4972-9369-deeb40668953-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8628ebd3-ebcb-4972-9369-deeb40668953" (UID: "8628ebd3-ebcb-4972-9369-deeb40668953"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:40:09.768080 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:40:09.768045 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8628ebd3-ebcb-4972-9369-deeb40668953-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8628ebd3-ebcb-4972-9369-deeb40668953" (UID: "8628ebd3-ebcb-4972-9369-deeb40668953"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 21:40:09.768218 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:40:09.768199 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8628ebd3-ebcb-4972-9369-deeb40668953-dshm" (OuterVolumeSpecName: "dshm") pod "8628ebd3-ebcb-4972-9369-deeb40668953" (UID: "8628ebd3-ebcb-4972-9369-deeb40668953"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:40:09.768277 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:40:09.768220 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8628ebd3-ebcb-4972-9369-deeb40668953-kube-api-access-mmg6w" (OuterVolumeSpecName: "kube-api-access-mmg6w") pod "8628ebd3-ebcb-4972-9369-deeb40668953" (UID: "8628ebd3-ebcb-4972-9369-deeb40668953"). InnerVolumeSpecName "kube-api-access-mmg6w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:40:09.866915 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:40:09.866878 2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8628ebd3-ebcb-4972-9369-deeb40668953-tmp-dir\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:40:09.866915 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:40:09.866909 2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8628ebd3-ebcb-4972-9369-deeb40668953-model-cache\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:40:09.866915 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:40:09.866919 2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8628ebd3-ebcb-4972-9369-deeb40668953-tls-certs\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:40:09.867151 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:40:09.866928 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmg6w\" (UniqueName: \"kubernetes.io/projected/8628ebd3-ebcb-4972-9369-deeb40668953-kube-api-access-mmg6w\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:40:09.867151 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:40:09.866937 2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8628ebd3-ebcb-4972-9369-deeb40668953-home\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:40:09.867151 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:40:09.866944 2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8628ebd3-ebcb-4972-9369-deeb40668953-dshm\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:40:10.563266 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:40:10.563235 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b28fb0/test-model-b28fb0-kserve-75649778fc-w9zsr" Jul 17 21:40:10.563755 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:40:10.563263 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b28fb0/test-model-b28fb0-kserve-75649778fc-w9zsr" event={"ID":"8628ebd3-ebcb-4972-9369-deeb40668953","Type":"ContainerDied","Data":"f8e31bbd537a57a3151190381a7e33ed39a45321eb58ef02144db2f162503d2e"} Jul 17 21:40:10.563755 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:40:10.563313 2568 scope.go:117] "RemoveContainer" containerID="071f17dd88e0946893583f4bbc8c1e259cc4d2005acb47a362f74c1a6aac6cfe" Jul 17 21:40:10.588108 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:40:10.588077 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-b28fb0/test-model-b28fb0-kserve-75649778fc-w9zsr"] Jul 17 21:40:10.595519 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:40:10.595497 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-b28fb0/test-model-b28fb0-kserve-75649778fc-w9zsr"] Jul 17 21:40:11.735624 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:40:11.735590 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8628ebd3-ebcb-4972-9369-deeb40668953" path="/var/lib/kubelet/pods/8628ebd3-ebcb-4972-9369-deeb40668953/volumes" Jul 17 21:40:14.375956 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:40:14.375908 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:40:31.086889 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:40:31.086852 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:40:50.581138 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:40:50.581098 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:41:06.293225 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:41:06.293136 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:41:22.890562 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:41:22.890523 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:41:52.692230 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:41:52.692186 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:42:05.591198 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:42:05.591159 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:42:17.785151 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:42:17.785114 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:42:37.587718 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:42:37.587615 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:42:54.909659 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:42:54.909628 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-d5e469/auth-test-model-d5e469-kserve-7b774498c-w6z8c"] Jul 17 21:42:54.910084 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:42:54.909972 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8628ebd3-ebcb-4972-9369-deeb40668953" containerName="main" Jul 17 21:42:54.910084 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:42:54.909984 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8628ebd3-ebcb-4972-9369-deeb40668953" containerName="main" Jul 17 21:42:54.910084 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:42:54.910072 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="8628ebd3-ebcb-4972-9369-deeb40668953" containerName="main" Jul 17 21:42:54.912947 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:42:54.912930 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d5e469/auth-test-model-d5e469-kserve-7b774498c-w6z8c" Jul 17 21:42:54.916674 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:42:54.916646 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d5e469\"/\"openshift-service-ca.crt\"" Jul 17 21:42:54.916834 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:42:54.916650 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d5e469\"/\"kube-root-ca.crt\"" Jul 17 21:42:54.916834 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:42:54.916675 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d5e469\"/\"default-dockercfg-njhxf\"" Jul 17 21:42:54.916834 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:42:54.916709 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d5e469\"/\"auth-test-model-d5e469-kserve-self-signed-certs\"" Jul 17 21:42:54.922615 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:42:54.922590 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d5e469/auth-test-model-d5e469-kserve-7b774498c-w6z8c"] Jul 17 21:42:55.016704 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:42:55.016656 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw7dp\" (UniqueName: \"kubernetes.io/projected/9a2e72fe-d918-443f-85f4-5b695508b3fd-kube-api-access-tw7dp\") pod \"auth-test-model-d5e469-kserve-7b774498c-w6z8c\" (UID: \"9a2e72fe-d918-443f-85f4-5b695508b3fd\") " pod="ai-tenant-e2e-shared-b-d5e469/auth-test-model-d5e469-kserve-7b774498c-w6z8c" Jul 17 21:42:55.016871 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:42:55.016752 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a2e72fe-d918-443f-85f4-5b695508b3fd-tmp-dir\") pod \"auth-test-model-d5e469-kserve-7b774498c-w6z8c\" (UID: \"9a2e72fe-d918-443f-85f4-5b695508b3fd\") " pod="ai-tenant-e2e-shared-b-d5e469/auth-test-model-d5e469-kserve-7b774498c-w6z8c" Jul 17 21:42:55.016871 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:42:55.016803 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a2e72fe-d918-443f-85f4-5b695508b3fd-tls-certs\") pod \"auth-test-model-d5e469-kserve-7b774498c-w6z8c\" (UID: \"9a2e72fe-d918-443f-85f4-5b695508b3fd\") " pod="ai-tenant-e2e-shared-b-d5e469/auth-test-model-d5e469-kserve-7b774498c-w6z8c" Jul 17 21:42:55.016871 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:42:55.016830 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a2e72fe-d918-443f-85f4-5b695508b3fd-home\") pod \"auth-test-model-d5e469-kserve-7b774498c-w6z8c\" (UID: \"9a2e72fe-d918-443f-85f4-5b695508b3fd\") " pod="ai-tenant-e2e-shared-b-d5e469/auth-test-model-d5e469-kserve-7b774498c-w6z8c" Jul 17 21:42:55.016972 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:42:55.016922 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a2e72fe-d918-443f-85f4-5b695508b3fd-dshm\") pod \"auth-test-model-d5e469-kserve-7b774498c-w6z8c\" (UID: \"9a2e72fe-d918-443f-85f4-5b695508b3fd\") " pod="ai-tenant-e2e-shared-b-d5e469/auth-test-model-d5e469-kserve-7b774498c-w6z8c" Jul 17 21:42:55.016972 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:42:55.016958 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a2e72fe-d918-443f-85f4-5b695508b3fd-model-cache\") pod \"auth-test-model-d5e469-kserve-7b774498c-w6z8c\" (UID: \"9a2e72fe-d918-443f-85f4-5b695508b3fd\") " pod="ai-tenant-e2e-shared-b-d5e469/auth-test-model-d5e469-kserve-7b774498c-w6z8c" Jul 17 21:42:55.117510 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:42:55.117461 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a2e72fe-d918-443f-85f4-5b695508b3fd-tmp-dir\") pod \"auth-test-model-d5e469-kserve-7b774498c-w6z8c\" (UID: \"9a2e72fe-d918-443f-85f4-5b695508b3fd\") " pod="ai-tenant-e2e-shared-b-d5e469/auth-test-model-d5e469-kserve-7b774498c-w6z8c" Jul 17 21:42:55.117676 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:42:55.117525 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a2e72fe-d918-443f-85f4-5b695508b3fd-tls-certs\") pod \"auth-test-model-d5e469-kserve-7b774498c-w6z8c\" (UID: \"9a2e72fe-d918-443f-85f4-5b695508b3fd\") " pod="ai-tenant-e2e-shared-b-d5e469/auth-test-model-d5e469-kserve-7b774498c-w6z8c" Jul 17 21:42:55.117676 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:42:55.117561 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a2e72fe-d918-443f-85f4-5b695508b3fd-home\") pod \"auth-test-model-d5e469-kserve-7b774498c-w6z8c\" (UID: \"9a2e72fe-d918-443f-85f4-5b695508b3fd\") " pod="ai-tenant-e2e-shared-b-d5e469/auth-test-model-d5e469-kserve-7b774498c-w6z8c" Jul 17 21:42:55.117676 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:42:55.117636 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a2e72fe-d918-443f-85f4-5b695508b3fd-dshm\") pod \"auth-test-model-d5e469-kserve-7b774498c-w6z8c\" (UID: \"9a2e72fe-d918-443f-85f4-5b695508b3fd\") " pod="ai-tenant-e2e-shared-b-d5e469/auth-test-model-d5e469-kserve-7b774498c-w6z8c" Jul 17 21:42:55.117676 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:42:55.117669 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a2e72fe-d918-443f-85f4-5b695508b3fd-model-cache\") pod \"auth-test-model-d5e469-kserve-7b774498c-w6z8c\" (UID: \"9a2e72fe-d918-443f-85f4-5b695508b3fd\") " pod="ai-tenant-e2e-shared-b-d5e469/auth-test-model-d5e469-kserve-7b774498c-w6z8c" Jul 17 21:42:55.117854 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:42:55.117738 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw7dp\" (UniqueName: \"kubernetes.io/projected/9a2e72fe-d918-443f-85f4-5b695508b3fd-kube-api-access-tw7dp\") pod \"auth-test-model-d5e469-kserve-7b774498c-w6z8c\" (UID: \"9a2e72fe-d918-443f-85f4-5b695508b3fd\") " pod="ai-tenant-e2e-shared-b-d5e469/auth-test-model-d5e469-kserve-7b774498c-w6z8c" Jul 17 21:42:55.118124 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:42:55.118090 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a2e72fe-d918-443f-85f4-5b695508b3fd-home\") pod \"auth-test-model-d5e469-kserve-7b774498c-w6z8c\" (UID: \"9a2e72fe-d918-443f-85f4-5b695508b3fd\") " pod="ai-tenant-e2e-shared-b-d5e469/auth-test-model-d5e469-kserve-7b774498c-w6z8c" Jul 17 21:42:55.118124 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:42:55.118108 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a2e72fe-d918-443f-85f4-5b695508b3fd-tmp-dir\") pod \"auth-test-model-d5e469-kserve-7b774498c-w6z8c\" (UID: \"9a2e72fe-d918-443f-85f4-5b695508b3fd\") " pod="ai-tenant-e2e-shared-b-d5e469/auth-test-model-d5e469-kserve-7b774498c-w6z8c" Jul 17 21:42:55.118283 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:42:55.118156 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a2e72fe-d918-443f-85f4-5b695508b3fd-model-cache\") pod \"auth-test-model-d5e469-kserve-7b774498c-w6z8c\" (UID: \"9a2e72fe-d918-443f-85f4-5b695508b3fd\") " pod="ai-tenant-e2e-shared-b-d5e469/auth-test-model-d5e469-kserve-7b774498c-w6z8c" Jul 17 21:42:55.119812 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:42:55.119790 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a2e72fe-d918-443f-85f4-5b695508b3fd-dshm\") pod \"auth-test-model-d5e469-kserve-7b774498c-w6z8c\" (UID: \"9a2e72fe-d918-443f-85f4-5b695508b3fd\") " pod="ai-tenant-e2e-shared-b-d5e469/auth-test-model-d5e469-kserve-7b774498c-w6z8c" Jul 17 21:42:55.120187 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:42:55.120167 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a2e72fe-d918-443f-85f4-5b695508b3fd-tls-certs\") pod \"auth-test-model-d5e469-kserve-7b774498c-w6z8c\" (UID: \"9a2e72fe-d918-443f-85f4-5b695508b3fd\") " pod="ai-tenant-e2e-shared-b-d5e469/auth-test-model-d5e469-kserve-7b774498c-w6z8c" Jul 17 21:42:55.127833 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:42:55.127815 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw7dp\" (UniqueName: \"kubernetes.io/projected/9a2e72fe-d918-443f-85f4-5b695508b3fd-kube-api-access-tw7dp\") pod \"auth-test-model-d5e469-kserve-7b774498c-w6z8c\" (UID: \"9a2e72fe-d918-443f-85f4-5b695508b3fd\") " pod="ai-tenant-e2e-shared-b-d5e469/auth-test-model-d5e469-kserve-7b774498c-w6z8c" Jul 17 21:42:55.221862 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:42:55.221769 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d5e469/auth-test-model-d5e469-kserve-7b774498c-w6z8c" Jul 17 21:42:55.353647 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:42:55.353622 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d5e469/auth-test-model-d5e469-kserve-7b774498c-w6z8c"] Jul 17 21:42:55.355568 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:42:55.355538 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a2e72fe_d918_443f_85f4_5b695508b3fd.slice/crio-83fb151acd379cf9979b123356208c9466df148490aca0e9aa2b8b553c1fba91 WatchSource:0}: Error finding container 83fb151acd379cf9979b123356208c9466df148490aca0e9aa2b8b553c1fba91: Status 404 returned error can't find the container with id 83fb151acd379cf9979b123356208c9466df148490aca0e9aa2b8b553c1fba91 Jul 17 21:42:56.321888 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:42:56.321850 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d5e469/auth-test-model-d5e469-kserve-7b774498c-w6z8c" event={"ID":"9a2e72fe-d918-443f-85f4-5b695508b3fd","Type":"ContainerStarted","Data":"ca7442e747abd9a2dc8af5d3b4533462ffaa82034bdd3ffbc6566d6880b066fb"} Jul 17 21:42:56.322294 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:42:56.321899 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d5e469/auth-test-model-d5e469-kserve-7b774498c-w6z8c" event={"ID":"9a2e72fe-d918-443f-85f4-5b695508b3fd","Type":"ContainerStarted","Data":"83fb151acd379cf9979b123356208c9466df148490aca0e9aa2b8b553c1fba91"} Jul 17 21:42:56.344794 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:42:56.344740 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-d5e469/auth-test-model-d5e469-kserve-7b774498c-w6z8c" podStartSLOduration=2.344725249 podStartE2EDuration="2.344725249s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:42:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:42:56.343214311 +0000 UTC m=+2355.143013641" watchObservedRunningTime="2026-07-17 21:42:56.344725249 +0000 UTC m=+2355.144524578" Jul 17 21:42:58.672078 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:42:58.672043 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:43:05.222412 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:43:05.222377 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-d5e469/auth-test-model-d5e469-kserve-7b774498c-w6z8c" Jul 17 21:43:05.222846 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:43:05.222427 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-d5e469/auth-test-model-d5e469-kserve-7b774498c-w6z8c" Jul 17 21:43:05.234287 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:43:05.234263 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-d5e469/auth-test-model-d5e469-kserve-7b774498c-w6z8c" Jul 17 21:43:05.370583 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:43:05.370556 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-d5e469/auth-test-model-d5e469-kserve-7b774498c-w6z8c" Jul 17 21:43:12.690226 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:43:12.690183 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:43:27.582158 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:43:27.582119 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:43:47.068330 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:43:47.068292 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:44:03.381246 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:44:03.381207 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:44:21.182204 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:44:21.182167 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:44:40.693166 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:44:40.693129 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:44:52.675938 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:44:52.675896 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d5e469/auth-test-model-d5e469-kserve-7b774498c-w6z8c"] Jul 17 21:44:55.575015 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:44:55.574971 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:45:07.695142 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:07.695097 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-d5e469/auth-test-model-d5e469-kserve-7b774498c-w6z8c" podUID="9a2e72fe-d918-443f-85f4-5b695508b3fd" containerName="main" containerID="cri-o://ca7442e747abd9a2dc8af5d3b4533462ffaa82034bdd3ffbc6566d6880b066fb" gracePeriod=45 Jul 17 21:45:07.923590 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:07.923558 2568 generic.go:356] "Generic (PLEG): container finished" podID="9a2e72fe-d918-443f-85f4-5b695508b3fd" containerID="ca7442e747abd9a2dc8af5d3b4533462ffaa82034bdd3ffbc6566d6880b066fb" exitCode=0 Jul 17 21:45:07.923772 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:07.923601 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d5e469/auth-test-model-d5e469-kserve-7b774498c-w6z8c" event={"ID":"9a2e72fe-d918-443f-85f4-5b695508b3fd","Type":"ContainerDied","Data":"ca7442e747abd9a2dc8af5d3b4533462ffaa82034bdd3ffbc6566d6880b066fb"} Jul 17 21:45:07.945729 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:07.945651 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d5e469/auth-test-model-d5e469-kserve-7b774498c-w6z8c" Jul 17 21:45:08.091005 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:08.090972 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tw7dp\" (UniqueName: \"kubernetes.io/projected/9a2e72fe-d918-443f-85f4-5b695508b3fd-kube-api-access-tw7dp\") pod \"9a2e72fe-d918-443f-85f4-5b695508b3fd\" (UID: \"9a2e72fe-d918-443f-85f4-5b695508b3fd\") " Jul 17 21:45:08.091197 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:08.091047 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a2e72fe-d918-443f-85f4-5b695508b3fd-tmp-dir\") pod \"9a2e72fe-d918-443f-85f4-5b695508b3fd\" (UID: \"9a2e72fe-d918-443f-85f4-5b695508b3fd\") " Jul 17 21:45:08.091197 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:08.091075 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a2e72fe-d918-443f-85f4-5b695508b3fd-dshm\") pod \"9a2e72fe-d918-443f-85f4-5b695508b3fd\" (UID: \"9a2e72fe-d918-443f-85f4-5b695508b3fd\") " Jul 17 21:45:08.091197 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:08.091137 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a2e72fe-d918-443f-85f4-5b695508b3fd-home\") pod \"9a2e72fe-d918-443f-85f4-5b695508b3fd\" (UID: \"9a2e72fe-d918-443f-85f4-5b695508b3fd\") " Jul 17 21:45:08.091197 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:08.091192 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a2e72fe-d918-443f-85f4-5b695508b3fd-model-cache\") pod \"9a2e72fe-d918-443f-85f4-5b695508b3fd\" (UID: \"9a2e72fe-d918-443f-85f4-5b695508b3fd\") " Jul 17 21:45:08.091408 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:08.091219 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a2e72fe-d918-443f-85f4-5b695508b3fd-tls-certs\") pod \"9a2e72fe-d918-443f-85f4-5b695508b3fd\" (UID: \"9a2e72fe-d918-443f-85f4-5b695508b3fd\") " Jul 17 21:45:08.091466 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:08.091416 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a2e72fe-d918-443f-85f4-5b695508b3fd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9a2e72fe-d918-443f-85f4-5b695508b3fd" (UID: "9a2e72fe-d918-443f-85f4-5b695508b3fd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:45:08.091466 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:08.091452 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a2e72fe-d918-443f-85f4-5b695508b3fd-home" (OuterVolumeSpecName: "home") pod "9a2e72fe-d918-443f-85f4-5b695508b3fd" (UID: "9a2e72fe-d918-443f-85f4-5b695508b3fd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:45:08.091547 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:08.091459 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a2e72fe-d918-443f-85f4-5b695508b3fd-model-cache" (OuterVolumeSpecName: "model-cache") pod "9a2e72fe-d918-443f-85f4-5b695508b3fd" (UID: "9a2e72fe-d918-443f-85f4-5b695508b3fd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:45:08.091547 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:08.091520 2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a2e72fe-d918-443f-85f4-5b695508b3fd-tmp-dir\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:45:08.091547 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:08.091537 2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a2e72fe-d918-443f-85f4-5b695508b3fd-home\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:45:08.091653 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:08.091548 2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a2e72fe-d918-443f-85f4-5b695508b3fd-model-cache\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:45:08.093350 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:08.093328 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a2e72fe-d918-443f-85f4-5b695508b3fd-dshm" (OuterVolumeSpecName: "dshm") pod "9a2e72fe-d918-443f-85f4-5b695508b3fd" (UID: "9a2e72fe-d918-443f-85f4-5b695508b3fd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:45:08.093434 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:08.093357 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a2e72fe-d918-443f-85f4-5b695508b3fd-kube-api-access-tw7dp" (OuterVolumeSpecName: "kube-api-access-tw7dp") pod "9a2e72fe-d918-443f-85f4-5b695508b3fd" (UID: "9a2e72fe-d918-443f-85f4-5b695508b3fd"). InnerVolumeSpecName "kube-api-access-tw7dp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:45:08.093434 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:08.093360 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a2e72fe-d918-443f-85f4-5b695508b3fd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9a2e72fe-d918-443f-85f4-5b695508b3fd" (UID: "9a2e72fe-d918-443f-85f4-5b695508b3fd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 21:45:08.192463 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:08.192423 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tw7dp\" (UniqueName: \"kubernetes.io/projected/9a2e72fe-d918-443f-85f4-5b695508b3fd-kube-api-access-tw7dp\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:45:08.192463 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:08.192456 2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a2e72fe-d918-443f-85f4-5b695508b3fd-dshm\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:45:08.192463 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:08.192470 2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a2e72fe-d918-443f-85f4-5b695508b3fd-tls-certs\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:45:08.792068 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:08.792034 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:45:08.928912 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:08.928872 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d5e469/auth-test-model-d5e469-kserve-7b774498c-w6z8c" event={"ID":"9a2e72fe-d918-443f-85f4-5b695508b3fd","Type":"ContainerDied","Data":"83fb151acd379cf9979b123356208c9466df148490aca0e9aa2b8b553c1fba91"} Jul 17 21:45:08.929109 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:08.928936 2568 scope.go:117] "RemoveContainer" containerID="ca7442e747abd9a2dc8af5d3b4533462ffaa82034bdd3ffbc6566d6880b066fb" Jul 17 21:45:08.929109 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:08.928889 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d5e469/auth-test-model-d5e469-kserve-7b774498c-w6z8c" Jul 17 21:45:08.952168 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:08.952147 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d5e469/auth-test-model-d5e469-kserve-7b774498c-w6z8c"] Jul 17 21:45:08.955805 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:08.955782 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-d5e469/auth-test-model-d5e469-kserve-7b774498c-w6z8c"] Jul 17 21:45:09.737085 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:09.737052 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a2e72fe-d918-443f-85f4-5b695508b3fd" path="/var/lib/kubelet/pods/9a2e72fe-d918-443f-85f4-5b695508b3fd/volumes" Jul 17 21:45:22.186523 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:22.186487 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-d5e469/sub-test-model-d5e469-kserve-69c9786dd5-r4q7d"] Jul 17 21:45:22.187019 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:22.186855 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a2e72fe-d918-443f-85f4-5b695508b3fd" containerName="main" Jul 17 21:45:22.187019 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:22.186867 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a2e72fe-d918-443f-85f4-5b695508b3fd" containerName="main" Jul 17 21:45:22.187019 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:22.186929 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a2e72fe-d918-443f-85f4-5b695508b3fd" containerName="main" Jul 17 21:45:22.189861 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:22.189842 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d5e469/sub-test-model-d5e469-kserve-69c9786dd5-r4q7d" Jul 17 21:45:22.193185 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:22.193153 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d5e469\"/\"default-dockercfg-njhxf\"" Jul 17 21:45:22.193320 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:22.193233 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d5e469\"/\"kube-root-ca.crt\"" Jul 17 21:45:22.193320 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:22.193248 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d5e469\"/\"sub-test-model-d5e469-kserve-self-signed-certs\"" Jul 17 21:45:22.193320 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:22.193241 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d5e469\"/\"openshift-service-ca.crt\"" Jul 17 21:45:22.199638 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:22.199619 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d5e469/sub-test-model-d5e469-kserve-69c9786dd5-r4q7d"] Jul 17 21:45:22.201308 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:22.201286 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0861d22-8d3f-4072-812a-63686ffb79cd-dshm\") pod \"sub-test-model-d5e469-kserve-69c9786dd5-r4q7d\" (UID: \"b0861d22-8d3f-4072-812a-63686ffb79cd\") " pod="ai-tenant-e2e-shared-b-d5e469/sub-test-model-d5e469-kserve-69c9786dd5-r4q7d" Jul 17 21:45:22.201405 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:22.201348 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0861d22-8d3f-4072-812a-63686ffb79cd-model-cache\") pod \"sub-test-model-d5e469-kserve-69c9786dd5-r4q7d\" (UID: \"b0861d22-8d3f-4072-812a-63686ffb79cd\") " pod="ai-tenant-e2e-shared-b-d5e469/sub-test-model-d5e469-kserve-69c9786dd5-r4q7d" Jul 17 21:45:22.201405 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:22.201377 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0861d22-8d3f-4072-812a-63686ffb79cd-tls-certs\") pod \"sub-test-model-d5e469-kserve-69c9786dd5-r4q7d\" (UID: \"b0861d22-8d3f-4072-812a-63686ffb79cd\") " pod="ai-tenant-e2e-shared-b-d5e469/sub-test-model-d5e469-kserve-69c9786dd5-r4q7d" Jul 17 21:45:22.201520 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:22.201445 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0861d22-8d3f-4072-812a-63686ffb79cd-home\") pod \"sub-test-model-d5e469-kserve-69c9786dd5-r4q7d\" (UID: \"b0861d22-8d3f-4072-812a-63686ffb79cd\") " pod="ai-tenant-e2e-shared-b-d5e469/sub-test-model-d5e469-kserve-69c9786dd5-r4q7d" Jul 17 21:45:22.201558 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:22.201538 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0861d22-8d3f-4072-812a-63686ffb79cd-tmp-dir\") pod \"sub-test-model-d5e469-kserve-69c9786dd5-r4q7d\" (UID: \"b0861d22-8d3f-4072-812a-63686ffb79cd\") " pod="ai-tenant-e2e-shared-b-d5e469/sub-test-model-d5e469-kserve-69c9786dd5-r4q7d" Jul 17 21:45:22.201614 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:22.201564 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zjtt\" (UniqueName: \"kubernetes.io/projected/b0861d22-8d3f-4072-812a-63686ffb79cd-kube-api-access-4zjtt\") pod \"sub-test-model-d5e469-kserve-69c9786dd5-r4q7d\" (UID: \"b0861d22-8d3f-4072-812a-63686ffb79cd\") " pod="ai-tenant-e2e-shared-b-d5e469/sub-test-model-d5e469-kserve-69c9786dd5-r4q7d" Jul 17 21:45:22.302053 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:22.302021 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0861d22-8d3f-4072-812a-63686ffb79cd-model-cache\") pod \"sub-test-model-d5e469-kserve-69c9786dd5-r4q7d\" (UID: \"b0861d22-8d3f-4072-812a-63686ffb79cd\") " pod="ai-tenant-e2e-shared-b-d5e469/sub-test-model-d5e469-kserve-69c9786dd5-r4q7d" Jul 17 21:45:22.302053 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:22.302056 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0861d22-8d3f-4072-812a-63686ffb79cd-tls-certs\") pod \"sub-test-model-d5e469-kserve-69c9786dd5-r4q7d\" (UID: \"b0861d22-8d3f-4072-812a-63686ffb79cd\") " pod="ai-tenant-e2e-shared-b-d5e469/sub-test-model-d5e469-kserve-69c9786dd5-r4q7d" Jul 17 21:45:22.302286 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:22.302087 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0861d22-8d3f-4072-812a-63686ffb79cd-home\") pod \"sub-test-model-d5e469-kserve-69c9786dd5-r4q7d\" (UID: \"b0861d22-8d3f-4072-812a-63686ffb79cd\") " pod="ai-tenant-e2e-shared-b-d5e469/sub-test-model-d5e469-kserve-69c9786dd5-r4q7d" Jul 17 21:45:22.302286 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:22.302144 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0861d22-8d3f-4072-812a-63686ffb79cd-tmp-dir\") pod \"sub-test-model-d5e469-kserve-69c9786dd5-r4q7d\" (UID: \"b0861d22-8d3f-4072-812a-63686ffb79cd\") " pod="ai-tenant-e2e-shared-b-d5e469/sub-test-model-d5e469-kserve-69c9786dd5-r4q7d" Jul 17 21:45:22.302286 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:22.302170 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zjtt\" (UniqueName: \"kubernetes.io/projected/b0861d22-8d3f-4072-812a-63686ffb79cd-kube-api-access-4zjtt\") pod \"sub-test-model-d5e469-kserve-69c9786dd5-r4q7d\" (UID: \"b0861d22-8d3f-4072-812a-63686ffb79cd\") " pod="ai-tenant-e2e-shared-b-d5e469/sub-test-model-d5e469-kserve-69c9786dd5-r4q7d" Jul 17 21:45:22.302286 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:22.302216 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0861d22-8d3f-4072-812a-63686ffb79cd-dshm\") pod \"sub-test-model-d5e469-kserve-69c9786dd5-r4q7d\" (UID: \"b0861d22-8d3f-4072-812a-63686ffb79cd\") " pod="ai-tenant-e2e-shared-b-d5e469/sub-test-model-d5e469-kserve-69c9786dd5-r4q7d" Jul 17 21:45:22.302499 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:22.302458 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0861d22-8d3f-4072-812a-63686ffb79cd-model-cache\") pod \"sub-test-model-d5e469-kserve-69c9786dd5-r4q7d\" (UID: \"b0861d22-8d3f-4072-812a-63686ffb79cd\") " pod="ai-tenant-e2e-shared-b-d5e469/sub-test-model-d5e469-kserve-69c9786dd5-r4q7d" Jul 17 21:45:22.302557 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:22.302524 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0861d22-8d3f-4072-812a-63686ffb79cd-tmp-dir\") pod \"sub-test-model-d5e469-kserve-69c9786dd5-r4q7d\" (UID: \"b0861d22-8d3f-4072-812a-63686ffb79cd\") " pod="ai-tenant-e2e-shared-b-d5e469/sub-test-model-d5e469-kserve-69c9786dd5-r4q7d" Jul 17 21:45:22.302616 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:22.302577 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0861d22-8d3f-4072-812a-63686ffb79cd-home\") pod \"sub-test-model-d5e469-kserve-69c9786dd5-r4q7d\" (UID: \"b0861d22-8d3f-4072-812a-63686ffb79cd\") " pod="ai-tenant-e2e-shared-b-d5e469/sub-test-model-d5e469-kserve-69c9786dd5-r4q7d" Jul 17 21:45:22.304779 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:22.304751 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0861d22-8d3f-4072-812a-63686ffb79cd-dshm\") pod \"sub-test-model-d5e469-kserve-69c9786dd5-r4q7d\" (UID: \"b0861d22-8d3f-4072-812a-63686ffb79cd\") " pod="ai-tenant-e2e-shared-b-d5e469/sub-test-model-d5e469-kserve-69c9786dd5-r4q7d" Jul 17 21:45:22.305015 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:22.304998 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0861d22-8d3f-4072-812a-63686ffb79cd-tls-certs\") pod \"sub-test-model-d5e469-kserve-69c9786dd5-r4q7d\" (UID: \"b0861d22-8d3f-4072-812a-63686ffb79cd\") " pod="ai-tenant-e2e-shared-b-d5e469/sub-test-model-d5e469-kserve-69c9786dd5-r4q7d" Jul 17 21:45:22.311089 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:22.311068 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zjtt\" (UniqueName: \"kubernetes.io/projected/b0861d22-8d3f-4072-812a-63686ffb79cd-kube-api-access-4zjtt\") pod \"sub-test-model-d5e469-kserve-69c9786dd5-r4q7d\" (UID: \"b0861d22-8d3f-4072-812a-63686ffb79cd\") " pod="ai-tenant-e2e-shared-b-d5e469/sub-test-model-d5e469-kserve-69c9786dd5-r4q7d" Jul 17 21:45:22.499014 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:22.498917 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d5e469/sub-test-model-d5e469-kserve-69c9786dd5-r4q7d" Jul 17 21:45:22.633615 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:22.633587 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d5e469/sub-test-model-d5e469-kserve-69c9786dd5-r4q7d"] Jul 17 21:45:22.636474 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:45:22.636445 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb0861d22_8d3f_4072_812a_63686ffb79cd.slice/crio-63eae38e148600b89e1f335cafaea1a2cdb21d42f84b458ea37c1e011942d2ee WatchSource:0}: Error finding container 63eae38e148600b89e1f335cafaea1a2cdb21d42f84b458ea37c1e011942d2ee: Status 404 returned error can't find the container with id 63eae38e148600b89e1f335cafaea1a2cdb21d42f84b458ea37c1e011942d2ee Jul 17 21:45:22.998941 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:22.998907 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d5e469/sub-test-model-d5e469-kserve-69c9786dd5-r4q7d" event={"ID":"b0861d22-8d3f-4072-812a-63686ffb79cd","Type":"ContainerStarted","Data":"974247614ee99daf8fe86535d0a3a81889c59086ca42d038689507c854826ec6"} Jul 17 21:45:22.999129 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:22.998949 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d5e469/sub-test-model-d5e469-kserve-69c9786dd5-r4q7d" event={"ID":"b0861d22-8d3f-4072-812a-63686ffb79cd","Type":"ContainerStarted","Data":"63eae38e148600b89e1f335cafaea1a2cdb21d42f84b458ea37c1e011942d2ee"} Jul 17 21:45:23.016572 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:23.016513 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-d5e469/sub-test-model-d5e469-kserve-69c9786dd5-r4q7d" podStartSLOduration=1.016497798 podStartE2EDuration="1.016497798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:45:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:45:23.015220511 +0000 UTC m=+2501.815019838" watchObservedRunningTime="2026-07-17 21:45:23.016497798 +0000 UTC m=+2501.816297143" Jul 17 21:45:25.978250 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:25.978213 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:45:32.499437 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:32.499391 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-d5e469/sub-test-model-d5e469-kserve-69c9786dd5-r4q7d" Jul 17 21:45:32.499918 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:32.499671 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-d5e469/sub-test-model-d5e469-kserve-69c9786dd5-r4q7d" Jul 17 21:45:32.511334 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:32.511304 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-d5e469/sub-test-model-d5e469-kserve-69c9786dd5-r4q7d" Jul 17 21:45:33.053865 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:33.053838 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-d5e469/sub-test-model-d5e469-kserve-69c9786dd5-r4q7d" Jul 17 21:45:39.680272 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:39.680177 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:45:56.574866 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:45:56.574825 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:46:03.590176 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:03.590140 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d5e469/sub-test-model-d5e469-kserve-69c9786dd5-r4q7d"] Jul 17 21:46:13.776036 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:13.776002 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:46:18.609257 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:18.609215 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-d5e469/sub-test-model-d5e469-kserve-69c9786dd5-r4q7d" podUID="b0861d22-8d3f-4072-812a-63686ffb79cd" containerName="main" containerID="cri-o://974247614ee99daf8fe86535d0a3a81889c59086ca42d038689507c854826ec6" gracePeriod=45 Jul 17 21:46:18.847371 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:18.847331 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d5e469/sub-test-model-d5e469-kserve-69c9786dd5-r4q7d" Jul 17 21:46:18.887396 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:18.887326 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0861d22-8d3f-4072-812a-63686ffb79cd-dshm\") pod \"b0861d22-8d3f-4072-812a-63686ffb79cd\" (UID: \"b0861d22-8d3f-4072-812a-63686ffb79cd\") " Jul 17 21:46:18.887396 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:18.887365 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0861d22-8d3f-4072-812a-63686ffb79cd-home\") pod \"b0861d22-8d3f-4072-812a-63686ffb79cd\" (UID: \"b0861d22-8d3f-4072-812a-63686ffb79cd\") " Jul 17 21:46:18.887605 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:18.887424 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0861d22-8d3f-4072-812a-63686ffb79cd-model-cache\") pod \"b0861d22-8d3f-4072-812a-63686ffb79cd\" (UID: \"b0861d22-8d3f-4072-812a-63686ffb79cd\") " Jul 17 21:46:18.887605 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:18.887447 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0861d22-8d3f-4072-812a-63686ffb79cd-tmp-dir\") pod \"b0861d22-8d3f-4072-812a-63686ffb79cd\" (UID: \"b0861d22-8d3f-4072-812a-63686ffb79cd\") " Jul 17 21:46:18.887605 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:18.887473 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zjtt\" (UniqueName: \"kubernetes.io/projected/b0861d22-8d3f-4072-812a-63686ffb79cd-kube-api-access-4zjtt\") pod \"b0861d22-8d3f-4072-812a-63686ffb79cd\" (UID: \"b0861d22-8d3f-4072-812a-63686ffb79cd\") " Jul 17 21:46:18.887605 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:18.887515 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0861d22-8d3f-4072-812a-63686ffb79cd-tls-certs\") pod \"b0861d22-8d3f-4072-812a-63686ffb79cd\" (UID: \"b0861d22-8d3f-4072-812a-63686ffb79cd\") " Jul 17 21:46:18.887843 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:18.887695 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0861d22-8d3f-4072-812a-63686ffb79cd-home" (OuterVolumeSpecName: "home") pod "b0861d22-8d3f-4072-812a-63686ffb79cd" (UID: "b0861d22-8d3f-4072-812a-63686ffb79cd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:46:18.887899 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:18.887832 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0861d22-8d3f-4072-812a-63686ffb79cd-model-cache" (OuterVolumeSpecName: "model-cache") pod "b0861d22-8d3f-4072-812a-63686ffb79cd" (UID: "b0861d22-8d3f-4072-812a-63686ffb79cd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:46:18.887899 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:18.887845 2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0861d22-8d3f-4072-812a-63686ffb79cd-home\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:46:18.888171 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:18.888140 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0861d22-8d3f-4072-812a-63686ffb79cd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b0861d22-8d3f-4072-812a-63686ffb79cd" (UID: "b0861d22-8d3f-4072-812a-63686ffb79cd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:46:18.889811 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:18.889782 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0861d22-8d3f-4072-812a-63686ffb79cd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b0861d22-8d3f-4072-812a-63686ffb79cd" (UID: "b0861d22-8d3f-4072-812a-63686ffb79cd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 21:46:18.889928 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:18.889896 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0861d22-8d3f-4072-812a-63686ffb79cd-dshm" (OuterVolumeSpecName: "dshm") pod "b0861d22-8d3f-4072-812a-63686ffb79cd" (UID: "b0861d22-8d3f-4072-812a-63686ffb79cd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:46:18.890189 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:18.890151 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0861d22-8d3f-4072-812a-63686ffb79cd-kube-api-access-4zjtt" (OuterVolumeSpecName: "kube-api-access-4zjtt") pod "b0861d22-8d3f-4072-812a-63686ffb79cd" (UID: "b0861d22-8d3f-4072-812a-63686ffb79cd"). InnerVolumeSpecName "kube-api-access-4zjtt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:46:18.989205 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:18.989171 2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0861d22-8d3f-4072-812a-63686ffb79cd-dshm\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:46:18.989205 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:18.989202 2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0861d22-8d3f-4072-812a-63686ffb79cd-model-cache\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:46:18.989411 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:18.989216 2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0861d22-8d3f-4072-812a-63686ffb79cd-tmp-dir\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:46:18.989411 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:18.989228 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zjtt\" (UniqueName: \"kubernetes.io/projected/b0861d22-8d3f-4072-812a-63686ffb79cd-kube-api-access-4zjtt\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:46:18.989411 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:18.989239 2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0861d22-8d3f-4072-812a-63686ffb79cd-tls-certs\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:46:19.260773 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:19.260669 2568 generic.go:356] "Generic (PLEG): container finished" podID="b0861d22-8d3f-4072-812a-63686ffb79cd" containerID="974247614ee99daf8fe86535d0a3a81889c59086ca42d038689507c854826ec6" exitCode=0 Jul 17 21:46:19.260773 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:19.260718 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d5e469/sub-test-model-d5e469-kserve-69c9786dd5-r4q7d" event={"ID":"b0861d22-8d3f-4072-812a-63686ffb79cd","Type":"ContainerDied","Data":"974247614ee99daf8fe86535d0a3a81889c59086ca42d038689507c854826ec6"} Jul 17 21:46:19.260773 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:19.260737 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d5e469/sub-test-model-d5e469-kserve-69c9786dd5-r4q7d" Jul 17 21:46:19.260773 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:19.260765 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d5e469/sub-test-model-d5e469-kserve-69c9786dd5-r4q7d" event={"ID":"b0861d22-8d3f-4072-812a-63686ffb79cd","Type":"ContainerDied","Data":"63eae38e148600b89e1f335cafaea1a2cdb21d42f84b458ea37c1e011942d2ee"} Jul 17 21:46:19.261100 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:19.260782 2568 scope.go:117] "RemoveContainer" containerID="974247614ee99daf8fe86535d0a3a81889c59086ca42d038689507c854826ec6" Jul 17 21:46:19.270011 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:19.269995 2568 scope.go:117] "RemoveContainer" containerID="974247614ee99daf8fe86535d0a3a81889c59086ca42d038689507c854826ec6" Jul 17 21:46:19.270240 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:46:19.270220 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"974247614ee99daf8fe86535d0a3a81889c59086ca42d038689507c854826ec6\": container with ID starting with 974247614ee99daf8fe86535d0a3a81889c59086ca42d038689507c854826ec6 not found: ID does not exist" containerID="974247614ee99daf8fe86535d0a3a81889c59086ca42d038689507c854826ec6" Jul 17 21:46:19.270288 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:19.270250 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"974247614ee99daf8fe86535d0a3a81889c59086ca42d038689507c854826ec6"} err="failed to get container status \"974247614ee99daf8fe86535d0a3a81889c59086ca42d038689507c854826ec6\": rpc error: code = NotFound desc = could not find container \"974247614ee99daf8fe86535d0a3a81889c59086ca42d038689507c854826ec6\": container with ID starting with 974247614ee99daf8fe86535d0a3a81889c59086ca42d038689507c854826ec6 not found: ID does not exist" Jul 17 21:46:19.286659 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:19.286637 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d5e469/sub-test-model-d5e469-kserve-69c9786dd5-r4q7d"] Jul 17 21:46:19.291975 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:19.291952 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-d5e469/sub-test-model-d5e469-kserve-69c9786dd5-r4q7d"] Jul 17 21:46:19.736626 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:19.736593 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0861d22-8d3f-4072-812a-63686ffb79cd" path="/var/lib/kubelet/pods/b0861d22-8d3f-4072-812a-63686ffb79cd/volumes" Jul 17 21:46:23.277314 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:23.277278 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:46:36.177723 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:36.177672 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-d5e469/rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w"] Jul 17 21:46:36.178155 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:36.178055 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0861d22-8d3f-4072-812a-63686ffb79cd" containerName="main" Jul 17 21:46:36.178155 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:36.178068 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0861d22-8d3f-4072-812a-63686ffb79cd" containerName="main" Jul 17 21:46:36.178155 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:36.178140 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0861d22-8d3f-4072-812a-63686ffb79cd" containerName="main" Jul 17 21:46:36.182264 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:36.182244 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d5e469/rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w" Jul 17 21:46:36.184890 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:36.184865 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d5e469\"/\"openshift-service-ca.crt\"" Jul 17 21:46:36.185924 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:36.185901 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d5e469\"/\"default-dockercfg-njhxf\"" Jul 17 21:46:36.186030 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:36.185901 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d5e469\"/\"rate-test-model-d5e469-kserve-self-signed-certs\"" Jul 17 21:46:36.186030 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:36.185938 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d5e469\"/\"kube-root-ca.crt\"" Jul 17 21:46:36.189939 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:36.189768 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d5e469/rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w"] Jul 17 21:46:36.246004 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:36.245970 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xq8j\" (UniqueName: \"kubernetes.io/projected/d8361d21-799f-4e3c-a41d-23eb2b9c21fe-kube-api-access-7xq8j\") pod \"rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w\" (UID: \"d8361d21-799f-4e3c-a41d-23eb2b9c21fe\") " pod="ai-tenant-e2e-shared-b-d5e469/rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w" Jul 17 21:46:36.246148 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:36.246018 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8361d21-799f-4e3c-a41d-23eb2b9c21fe-model-cache\") pod \"rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w\" (UID: \"d8361d21-799f-4e3c-a41d-23eb2b9c21fe\") " pod="ai-tenant-e2e-shared-b-d5e469/rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w" Jul 17 21:46:36.246148 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:36.246069 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8361d21-799f-4e3c-a41d-23eb2b9c21fe-dshm\") pod \"rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w\" (UID: \"d8361d21-799f-4e3c-a41d-23eb2b9c21fe\") " pod="ai-tenant-e2e-shared-b-d5e469/rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w" Jul 17 21:46:36.246237 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:36.246156 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8361d21-799f-4e3c-a41d-23eb2b9c21fe-tmp-dir\") pod \"rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w\" (UID: \"d8361d21-799f-4e3c-a41d-23eb2b9c21fe\") " pod="ai-tenant-e2e-shared-b-d5e469/rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w" Jul 17 21:46:36.246237 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:36.246193 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8361d21-799f-4e3c-a41d-23eb2b9c21fe-home\") pod \"rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w\" (UID: \"d8361d21-799f-4e3c-a41d-23eb2b9c21fe\") " pod="ai-tenant-e2e-shared-b-d5e469/rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w" Jul 17 21:46:36.246237 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:36.246213 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8361d21-799f-4e3c-a41d-23eb2b9c21fe-tls-certs\") pod \"rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w\" (UID: \"d8361d21-799f-4e3c-a41d-23eb2b9c21fe\") " pod="ai-tenant-e2e-shared-b-d5e469/rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w" Jul 17 21:46:36.347643 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:36.347611 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xq8j\" (UniqueName: \"kubernetes.io/projected/d8361d21-799f-4e3c-a41d-23eb2b9c21fe-kube-api-access-7xq8j\") pod \"rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w\" (UID: \"d8361d21-799f-4e3c-a41d-23eb2b9c21fe\") " pod="ai-tenant-e2e-shared-b-d5e469/rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w" Jul 17 21:46:36.347859 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:36.347665 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8361d21-799f-4e3c-a41d-23eb2b9c21fe-model-cache\") pod \"rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w\" (UID: \"d8361d21-799f-4e3c-a41d-23eb2b9c21fe\") " pod="ai-tenant-e2e-shared-b-d5e469/rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w" Jul 17 21:46:36.347859 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:36.347714 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8361d21-799f-4e3c-a41d-23eb2b9c21fe-dshm\") pod \"rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w\" (UID: \"d8361d21-799f-4e3c-a41d-23eb2b9c21fe\") " pod="ai-tenant-e2e-shared-b-d5e469/rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w" Jul 17 21:46:36.347859 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:36.347775 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8361d21-799f-4e3c-a41d-23eb2b9c21fe-tmp-dir\") pod \"rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w\" (UID: \"d8361d21-799f-4e3c-a41d-23eb2b9c21fe\") " pod="ai-tenant-e2e-shared-b-d5e469/rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w" Jul 17 21:46:36.347859 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:36.347810 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8361d21-799f-4e3c-a41d-23eb2b9c21fe-home\") pod \"rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w\" (UID: \"d8361d21-799f-4e3c-a41d-23eb2b9c21fe\") " pod="ai-tenant-e2e-shared-b-d5e469/rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w" Jul 17 21:46:36.347859 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:36.347829 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8361d21-799f-4e3c-a41d-23eb2b9c21fe-tls-certs\") pod \"rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w\" (UID: \"d8361d21-799f-4e3c-a41d-23eb2b9c21fe\") " pod="ai-tenant-e2e-shared-b-d5e469/rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w" Jul 17 21:46:36.348138 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:36.348115 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8361d21-799f-4e3c-a41d-23eb2b9c21fe-model-cache\") pod \"rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w\" (UID: \"d8361d21-799f-4e3c-a41d-23eb2b9c21fe\") " pod="ai-tenant-e2e-shared-b-d5e469/rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w" Jul 17 21:46:36.348207 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:36.348185 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8361d21-799f-4e3c-a41d-23eb2b9c21fe-tmp-dir\") pod \"rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w\" (UID: \"d8361d21-799f-4e3c-a41d-23eb2b9c21fe\") " pod="ai-tenant-e2e-shared-b-d5e469/rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w" Jul 17 21:46:36.348256 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:36.348212 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8361d21-799f-4e3c-a41d-23eb2b9c21fe-home\") pod \"rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w\" (UID: \"d8361d21-799f-4e3c-a41d-23eb2b9c21fe\") " pod="ai-tenant-e2e-shared-b-d5e469/rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w" Jul 17 21:46:36.350069 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:36.350037 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8361d21-799f-4e3c-a41d-23eb2b9c21fe-dshm\") pod \"rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w\" (UID: \"d8361d21-799f-4e3c-a41d-23eb2b9c21fe\") " pod="ai-tenant-e2e-shared-b-d5e469/rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w" Jul 17 21:46:36.350360 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:36.350340 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8361d21-799f-4e3c-a41d-23eb2b9c21fe-tls-certs\") pod \"rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w\" (UID: \"d8361d21-799f-4e3c-a41d-23eb2b9c21fe\") " pod="ai-tenant-e2e-shared-b-d5e469/rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w" Jul 17 21:46:36.356086 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:36.356065 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xq8j\" (UniqueName: \"kubernetes.io/projected/d8361d21-799f-4e3c-a41d-23eb2b9c21fe-kube-api-access-7xq8j\") pod \"rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w\" (UID: \"d8361d21-799f-4e3c-a41d-23eb2b9c21fe\") " pod="ai-tenant-e2e-shared-b-d5e469/rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w" Jul 17 21:46:36.492741 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:36.492654 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d5e469/rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w" Jul 17 21:46:36.622111 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:36.622086 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d5e469/rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w"] Jul 17 21:46:36.624418 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:46:36.624393 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8361d21_799f_4e3c_a41d_23eb2b9c21fe.slice/crio-5eeb82004d58754ccdb95d49ec8d6a13678478c44f9c88eb0767d38a34d546a3 WatchSource:0}: Error finding container 5eeb82004d58754ccdb95d49ec8d6a13678478c44f9c88eb0767d38a34d546a3: Status 404 returned error can't find the container with id 5eeb82004d58754ccdb95d49ec8d6a13678478c44f9c88eb0767d38a34d546a3 Jul 17 21:46:37.350487 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:37.350450 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d5e469/rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w" event={"ID":"d8361d21-799f-4e3c-a41d-23eb2b9c21fe","Type":"ContainerStarted","Data":"bb0305d2737a39806145309f4b30ff5d819b55c32a17b48d87afa2a3702e91aa"} Jul 17 21:46:37.350857 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:37.350500 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d5e469/rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w" event={"ID":"d8361d21-799f-4e3c-a41d-23eb2b9c21fe","Type":"ContainerStarted","Data":"5eeb82004d58754ccdb95d49ec8d6a13678478c44f9c88eb0767d38a34d546a3"} Jul 17 21:46:37.370026 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:37.369981 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-d5e469/rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w" podStartSLOduration=1.36996569 podStartE2EDuration="1.36996569s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:46:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:46:37.368454698 +0000 UTC m=+2576.168254026" watchObservedRunningTime="2026-07-17 21:46:37.36996569 +0000 UTC m=+2576.169765016" Jul 17 21:46:39.274836 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:39.274798 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:46:46.492914 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:46.492873 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-d5e469/rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w" Jul 17 21:46:46.493398 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:46.492946 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-d5e469/rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w" Jul 17 21:46:46.505307 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:46.505283 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-d5e469/rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w" Jul 17 21:46:47.411634 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:47.411600 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-d5e469/rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w" Jul 17 21:46:54.883016 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:46:54.882974 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:47:09.678034 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:09.677952 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:47:16.498796 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:16.498764 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d5e469/rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w"] Jul 17 21:47:26.679838 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:26.679795 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:47:31.518545 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:31.518501 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-d5e469/rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w" podUID="d8361d21-799f-4e3c-a41d-23eb2b9c21fe" containerName="main" containerID="cri-o://bb0305d2737a39806145309f4b30ff5d819b55c32a17b48d87afa2a3702e91aa" gracePeriod=45 Jul 17 21:47:31.769259 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:31.769198 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d5e469/rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w" Jul 17 21:47:31.821006 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:31.820975 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8361d21-799f-4e3c-a41d-23eb2b9c21fe-dshm\") pod \"d8361d21-799f-4e3c-a41d-23eb2b9c21fe\" (UID: \"d8361d21-799f-4e3c-a41d-23eb2b9c21fe\") " Jul 17 21:47:31.821129 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:31.821042 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8361d21-799f-4e3c-a41d-23eb2b9c21fe-tmp-dir\") pod \"d8361d21-799f-4e3c-a41d-23eb2b9c21fe\" (UID: \"d8361d21-799f-4e3c-a41d-23eb2b9c21fe\") " Jul 17 21:47:31.821129 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:31.821060 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8361d21-799f-4e3c-a41d-23eb2b9c21fe-tls-certs\") pod \"d8361d21-799f-4e3c-a41d-23eb2b9c21fe\" (UID: \"d8361d21-799f-4e3c-a41d-23eb2b9c21fe\") " Jul 17 21:47:31.821129 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:31.821097 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xq8j\" (UniqueName: \"kubernetes.io/projected/d8361d21-799f-4e3c-a41d-23eb2b9c21fe-kube-api-access-7xq8j\") pod \"d8361d21-799f-4e3c-a41d-23eb2b9c21fe\" (UID: \"d8361d21-799f-4e3c-a41d-23eb2b9c21fe\") " Jul 17 21:47:31.821129 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:31.821116 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8361d21-799f-4e3c-a41d-23eb2b9c21fe-home\") pod \"d8361d21-799f-4e3c-a41d-23eb2b9c21fe\" (UID: \"d8361d21-799f-4e3c-a41d-23eb2b9c21fe\") " Jul 17 21:47:31.821311 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:31.821270 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8361d21-799f-4e3c-a41d-23eb2b9c21fe-model-cache\") pod \"d8361d21-799f-4e3c-a41d-23eb2b9c21fe\" (UID: \"d8361d21-799f-4e3c-a41d-23eb2b9c21fe\") " Jul 17 21:47:31.821430 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:31.821393 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8361d21-799f-4e3c-a41d-23eb2b9c21fe-home" (OuterVolumeSpecName: "home") pod "d8361d21-799f-4e3c-a41d-23eb2b9c21fe" (UID: "d8361d21-799f-4e3c-a41d-23eb2b9c21fe"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:47:31.821430 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:31.821415 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8361d21-799f-4e3c-a41d-23eb2b9c21fe-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d8361d21-799f-4e3c-a41d-23eb2b9c21fe" (UID: "d8361d21-799f-4e3c-a41d-23eb2b9c21fe"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:47:31.821648 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:31.821508 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8361d21-799f-4e3c-a41d-23eb2b9c21fe-model-cache" (OuterVolumeSpecName: "model-cache") pod "d8361d21-799f-4e3c-a41d-23eb2b9c21fe" (UID: "d8361d21-799f-4e3c-a41d-23eb2b9c21fe"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:47:31.821741 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:31.821669 2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8361d21-799f-4e3c-a41d-23eb2b9c21fe-tmp-dir\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:47:31.821741 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:31.821708 2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8361d21-799f-4e3c-a41d-23eb2b9c21fe-home\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:47:31.821741 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:31.821721 2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8361d21-799f-4e3c-a41d-23eb2b9c21fe-model-cache\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:47:31.823037 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:31.823017 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8361d21-799f-4e3c-a41d-23eb2b9c21fe-dshm" (OuterVolumeSpecName: "dshm") pod "d8361d21-799f-4e3c-a41d-23eb2b9c21fe" (UID: "d8361d21-799f-4e3c-a41d-23eb2b9c21fe"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:47:31.823236 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:31.823210 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8361d21-799f-4e3c-a41d-23eb2b9c21fe-kube-api-access-7xq8j" (OuterVolumeSpecName: "kube-api-access-7xq8j") pod "d8361d21-799f-4e3c-a41d-23eb2b9c21fe" (UID: "d8361d21-799f-4e3c-a41d-23eb2b9c21fe"). InnerVolumeSpecName "kube-api-access-7xq8j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:47:31.823316 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:31.823243 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8361d21-799f-4e3c-a41d-23eb2b9c21fe-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d8361d21-799f-4e3c-a41d-23eb2b9c21fe" (UID: "d8361d21-799f-4e3c-a41d-23eb2b9c21fe"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 21:47:31.922486 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:31.922439 2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8361d21-799f-4e3c-a41d-23eb2b9c21fe-dshm\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:47:31.922486 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:31.922482 2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8361d21-799f-4e3c-a41d-23eb2b9c21fe-tls-certs\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:47:31.922486 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:31.922494 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xq8j\" (UniqueName: \"kubernetes.io/projected/d8361d21-799f-4e3c-a41d-23eb2b9c21fe-kube-api-access-7xq8j\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:47:32.600954 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:32.600919 2568 generic.go:356] "Generic (PLEG): container finished" podID="d8361d21-799f-4e3c-a41d-23eb2b9c21fe" containerID="bb0305d2737a39806145309f4b30ff5d819b55c32a17b48d87afa2a3702e91aa" exitCode=0 Jul 17 21:47:32.601541 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:32.600961 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d5e469/rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w" Jul 17 21:47:32.601541 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:32.600956 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d5e469/rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w" event={"ID":"d8361d21-799f-4e3c-a41d-23eb2b9c21fe","Type":"ContainerDied","Data":"bb0305d2737a39806145309f4b30ff5d819b55c32a17b48d87afa2a3702e91aa"} Jul 17 21:47:32.601541 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:32.601075 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d5e469/rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w" event={"ID":"d8361d21-799f-4e3c-a41d-23eb2b9c21fe","Type":"ContainerDied","Data":"5eeb82004d58754ccdb95d49ec8d6a13678478c44f9c88eb0767d38a34d546a3"} Jul 17 21:47:32.601541 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:32.601101 2568 scope.go:117] "RemoveContainer" containerID="bb0305d2737a39806145309f4b30ff5d819b55c32a17b48d87afa2a3702e91aa" Jul 17 21:47:32.610916 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:32.610892 2568 scope.go:117] "RemoveContainer" containerID="bb0305d2737a39806145309f4b30ff5d819b55c32a17b48d87afa2a3702e91aa" Jul 17 21:47:32.611179 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:47:32.611154 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb0305d2737a39806145309f4b30ff5d819b55c32a17b48d87afa2a3702e91aa\": container with ID starting with bb0305d2737a39806145309f4b30ff5d819b55c32a17b48d87afa2a3702e91aa not found: ID does not exist" containerID="bb0305d2737a39806145309f4b30ff5d819b55c32a17b48d87afa2a3702e91aa" Jul 17 21:47:32.611295 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:32.611184 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb0305d2737a39806145309f4b30ff5d819b55c32a17b48d87afa2a3702e91aa"} err="failed to get container status \"bb0305d2737a39806145309f4b30ff5d819b55c32a17b48d87afa2a3702e91aa\": rpc error: code = NotFound desc = could not find container \"bb0305d2737a39806145309f4b30ff5d819b55c32a17b48d87afa2a3702e91aa\": container with ID starting with bb0305d2737a39806145309f4b30ff5d819b55c32a17b48d87afa2a3702e91aa not found: ID does not exist" Jul 17 21:47:32.625629 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:32.625605 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d5e469/rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w"] Jul 17 21:47:32.629056 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:32.629036 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-d5e469/rate-test-model-d5e469-kserve-5cf87b49ff-tlt2w"] Jul 17 21:47:32.762318 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:32.762280 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7694-140502483703680"] Jul 17 21:47:32.762715 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:32.762697 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8361d21-799f-4e3c-a41d-23eb2b9c21fe" containerName="main" Jul 17 21:47:32.762804 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:32.762716 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8361d21-799f-4e3c-a41d-23eb2b9c21fe" containerName="main" Jul 17 21:47:32.762858 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:32.762824 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8361d21-799f-4e3c-a41d-23eb2b9c21fe" containerName="main" Jul 17 21:47:32.767139 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:32.767118 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7694-140502483703680" Jul 17 21:47:32.769433 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:32.769415 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-z2vnj\"" Jul 17 21:47:32.773904 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:32.773883 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7694-140502483703680"] Jul 17 21:47:32.829550 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:32.829520 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr2dl\" (UniqueName: \"kubernetes.io/projected/0b916b10-e4bc-42c9-989e-edf9436123eb-kube-api-access-hr2dl\") pod \"test-curl-7694-140502483703680\" (UID: \"0b916b10-e4bc-42c9-989e-edf9436123eb\") " pod="opendatahub/test-curl-7694-140502483703680" Jul 17 21:47:32.930063 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:32.929979 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr2dl\" (UniqueName: \"kubernetes.io/projected/0b916b10-e4bc-42c9-989e-edf9436123eb-kube-api-access-hr2dl\") pod \"test-curl-7694-140502483703680\" (UID: \"0b916b10-e4bc-42c9-989e-edf9436123eb\") " pod="opendatahub/test-curl-7694-140502483703680" Jul 17 21:47:32.937500 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:32.937479 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr2dl\" (UniqueName: \"kubernetes.io/projected/0b916b10-e4bc-42c9-989e-edf9436123eb-kube-api-access-hr2dl\") pod \"test-curl-7694-140502483703680\" (UID: \"0b916b10-e4bc-42c9-989e-edf9436123eb\") " pod="opendatahub/test-curl-7694-140502483703680" Jul 17 21:47:33.077403 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:33.077359 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7694-140502483703680" Jul 17 21:47:33.201669 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:33.201534 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7694-140502483703680"] Jul 17 21:47:33.204705 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:47:33.204657 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b916b10_e4bc_42c9_989e_edf9436123eb.slice/crio-5ac40a2e9c4daf98fc806262af6256bbb7b2ec4e26319b4b379d67d0b5ededc0 WatchSource:0}: Error finding container 5ac40a2e9c4daf98fc806262af6256bbb7b2ec4e26319b4b379d67d0b5ededc0: Status 404 returned error can't find the container with id 5ac40a2e9c4daf98fc806262af6256bbb7b2ec4e26319b4b379d67d0b5ededc0 Jul 17 21:47:33.206297 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:33.206281 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 21:47:33.607203 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:33.607160 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7694-140502483703680" event={"ID":"0b916b10-e4bc-42c9-989e-edf9436123eb","Type":"ContainerStarted","Data":"5ac40a2e9c4daf98fc806262af6256bbb7b2ec4e26319b4b379d67d0b5ededc0"} Jul 17 21:47:33.744903 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:33.744870 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8361d21-799f-4e3c-a41d-23eb2b9c21fe" path="/var/lib/kubelet/pods/d8361d21-799f-4e3c-a41d-23eb2b9c21fe/volumes" Jul 17 21:47:34.614302 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:34.614267 2568 generic.go:356] "Generic (PLEG): container finished" podID="0b916b10-e4bc-42c9-989e-edf9436123eb" containerID="758d0434475cb40cf3d8c678e39a82982bcc168e6bf921393a2adc24ddcb2897" exitCode=0 Jul 17 21:47:34.614714 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:34.614348 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7694-140502483703680" event={"ID":"0b916b10-e4bc-42c9-989e-edf9436123eb","Type":"ContainerDied","Data":"758d0434475cb40cf3d8c678e39a82982bcc168e6bf921393a2adc24ddcb2897"} Jul 17 21:47:35.748788 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:35.748762 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7694-140502483703680" Jul 17 21:47:35.781968 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:35.781931 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7694-140502483703680_0b916b10-e4bc-42c9-989e-edf9436123eb/test-curl-7694-140502483703680/0.log" Jul 17 21:47:35.801973 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:35.801945 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7694-140502483703680"] Jul 17 21:47:35.803365 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:35.803345 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7694-140502483703680"] Jul 17 21:47:35.861175 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:35.861146 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hr2dl\" (UniqueName: \"kubernetes.io/projected/0b916b10-e4bc-42c9-989e-edf9436123eb-kube-api-access-hr2dl\") pod \"0b916b10-e4bc-42c9-989e-edf9436123eb\" (UID: \"0b916b10-e4bc-42c9-989e-edf9436123eb\") " Jul 17 21:47:35.863259 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:35.863237 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b916b10-e4bc-42c9-989e-edf9436123eb-kube-api-access-hr2dl" (OuterVolumeSpecName: "kube-api-access-hr2dl") pod "0b916b10-e4bc-42c9-989e-edf9436123eb" (UID: "0b916b10-e4bc-42c9-989e-edf9436123eb"). InnerVolumeSpecName "kube-api-access-hr2dl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:47:35.962486 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:35.962400 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hr2dl\" (UniqueName: \"kubernetes.io/projected/0b916b10-e4bc-42c9-989e-edf9436123eb-kube-api-access-hr2dl\") on node \"ip-10-0-131-37.ec2.internal\" DevicePath \"\"" Jul 17 21:47:36.624887 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:36.624857 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7694-140502483703680" Jul 17 21:47:36.624887 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:36.624877 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5ac40a2e9c4daf98fc806262af6256bbb7b2ec4e26319b4b379d67d0b5ededc0" Jul 17 21:47:36.634922 ip-10-0-131-37 kubenswrapper[2568]: E0717 21:47:36.634893 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7694-140502483703680\" is forbidden: User \"system:node:ip-10-0-131-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-37.ec2.internal' and this object" podUID="0b916b10-e4bc-42c9-989e-edf9436123eb" pod="opendatahub/test-curl-7694-140502483703680" Jul 17 21:47:37.738107 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:37.736170 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b916b10-e4bc-42c9-989e-edf9436123eb" path="/var/lib/kubelet/pods/0b916b10-e4bc-42c9-989e-edf9436123eb/volumes" Jul 17 21:47:49.382782 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:47:49.382743 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:48:11.479427 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:11.477021 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mmr9b"] Jul 17 21:48:20.853938 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:20.853899 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5bbb74bcb6-5jfb9_d9ca43d6-2c28-41e4-96a5-e01c9cd3a7e0/authorino/0.log" Jul 17 21:48:27.020874 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:27.020843 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5dd64c6cb8-8grtr_23b7c58e-efb1-48ae-be46-82dd6107b244/copy-manifests/0.log" Jul 17 21:48:27.038823 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:27.038795 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5dd64c6cb8-8grtr_23b7c58e-efb1-48ae-be46-82dd6107b244/manager/0.log" Jul 17 21:48:29.493544 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:29.493511 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5bbb74bcb6-5jfb9_d9ca43d6-2c28-41e4-96a5-e01c9cd3a7e0/authorino/0.log" Jul 17 21:48:30.202529 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:30.202500 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-mmr9b_dea149f7-7ea8-4377-bf68-57eacfe83660/limitador/0.log" Jul 17 21:48:30.944039 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:30.944006 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-748bb598b7-hr8kp_6135e8fc-3e04-4aaa-9b18-4b4014b49866/kube-auth-proxy/0.log" Jul 17 21:48:31.460213 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:31.460168 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-z49r2_ef6ade2c-e01b-4cd8-a2dd-dc1734357997/payload-processing/0.log" Jul 17 21:48:32.206547 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:32.206517 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-zh265_ce69f59e-0c28-4337-bde9-18987de2369d/main/0.log" Jul 17 21:48:32.447776 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:32.447744 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-cgvn9_2fa5b05c-57a7-437d-89e4-08e3f0400cd1/main/0.log" Jul 17 21:48:41.313112 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:41.313036 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5mn75_a700256e-b4d4-4dde-ae89-4b322addf3ad/global-pull-secret-syncer/0.log" Jul 17 21:48:41.465480 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:41.465446 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vjspr_3a43e428-7f49-45c4-8b89-d2f2ae686978/konnectivity-agent/0.log" Jul 17 21:48:41.487996 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:41.487969 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-37.ec2.internal_dd02f43dd4bf8de506722f80f7be8b04/haproxy/0.log" Jul 17 21:48:46.826910 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:46.826880 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5bbb74bcb6-5jfb9_d9ca43d6-2c28-41e4-96a5-e01c9cd3a7e0/authorino/0.log" Jul 17 21:48:47.157109 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:47.157033 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-mmr9b_dea149f7-7ea8-4377-bf68-57eacfe83660/limitador/0.log" Jul 17 21:48:49.029052 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:49.029016 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-fbf477467-r5ctl_faf36c2d-10fd-4011-9733-8761868aeb36/metrics-server/0.log" Jul 17 21:48:49.056800 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:49.056776 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-xqld2_27afe524-31d3-4afb-a4fa-fc49198dc4f7/monitoring-plugin/0.log" Jul 17 21:48:49.097875 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:49.097797 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b8qzz_ada777c3-e00f-4e3e-9ae4-03d217e4f0e4/node-exporter/0.log" Jul 17 21:48:49.120347 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:49.120318 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b8qzz_ada777c3-e00f-4e3e-9ae4-03d217e4f0e4/kube-rbac-proxy/0.log" Jul 17 21:48:49.140516 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:49.140495 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b8qzz_ada777c3-e00f-4e3e-9ae4-03d217e4f0e4/init-textfile/0.log" Jul 17 21:48:49.345669 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:49.345633 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-8hvrk_8017f112-8fc6-4105-9779-4f744661ba0e/kube-rbac-proxy-main/0.log" Jul 17 21:48:49.407127 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:49.407042 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-8hvrk_8017f112-8fc6-4105-9779-4f744661ba0e/kube-rbac-proxy-self/0.log" Jul 17 21:48:49.447694 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:49.447651 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-8hvrk_8017f112-8fc6-4105-9779-4f744661ba0e/openshift-state-metrics/0.log" Jul 17 21:48:49.486147 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:49.486122 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7652e36b-451e-4fcb-884a-b4305be2a439/prometheus/0.log" Jul 17 21:48:49.506163 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:49.506137 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7652e36b-451e-4fcb-884a-b4305be2a439/config-reloader/0.log" Jul 17 21:48:49.530786 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:49.530763 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7652e36b-451e-4fcb-884a-b4305be2a439/thanos-sidecar/0.log" Jul 17 21:48:49.558364 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:49.558329 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7652e36b-451e-4fcb-884a-b4305be2a439/kube-rbac-proxy-web/0.log" Jul 17 21:48:49.578021 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:49.577997 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7652e36b-451e-4fcb-884a-b4305be2a439/kube-rbac-proxy/0.log" Jul 17 21:48:49.597976 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:49.597952 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7652e36b-451e-4fcb-884a-b4305be2a439/kube-rbac-proxy-thanos/0.log" Jul 17 21:48:49.618357 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:49.618333 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7652e36b-451e-4fcb-884a-b4305be2a439/init-config-reloader/0.log" Jul 17 21:48:49.646728 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:49.646675 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-zzrvs_97424303-3ff7-457b-9199-c7d33de2a9e1/prometheus-operator/0.log" Jul 17 21:48:49.664433 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:49.664359 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-zzrvs_97424303-3ff7-457b-9199-c7d33de2a9e1/kube-rbac-proxy/0.log" Jul 17 21:48:49.691578 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:49.691553 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-mslsb_b10c40a3-26aa-47cf-ae7a-83c9605b4306/prometheus-operator-admission-webhook/0.log" Jul 17 21:48:50.992711 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:50.992668 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jqx7f/perf-node-gather-daemonset-hhvtv"] Jul 17 21:48:50.993092 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:50.993022 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b916b10-e4bc-42c9-989e-edf9436123eb" containerName="test-curl-7694-140502483703680" Jul 17 21:48:50.993092 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:50.993034 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b916b10-e4bc-42c9-989e-edf9436123eb" containerName="test-curl-7694-140502483703680" Jul 17 21:48:50.993166 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:50.993099 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b916b10-e4bc-42c9-989e-edf9436123eb" containerName="test-curl-7694-140502483703680" Jul 17 21:48:50.995991 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:50.995973 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-hhvtv" Jul 17 21:48:50.998403 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:50.998383 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jqx7f\"/\"openshift-service-ca.crt\"" Jul 17 21:48:50.998510 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:50.998400 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jqx7f\"/\"kube-root-ca.crt\"" Jul 17 21:48:50.999302 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:50.999283 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jqx7f\"/\"default-dockercfg-vtgzk\"" Jul 17 21:48:51.004055 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:51.004033 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jqx7f/perf-node-gather-daemonset-hhvtv"] Jul 17 21:48:51.102143 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:51.102116 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6339fcc0-2731-4cb0-a15e-0ebe9663a43c-podres\") pod \"perf-node-gather-daemonset-hhvtv\" (UID: \"6339fcc0-2731-4cb0-a15e-0ebe9663a43c\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-hhvtv" Jul 17 21:48:51.102143 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:51.102147 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6jqr\" (UniqueName: \"kubernetes.io/projected/6339fcc0-2731-4cb0-a15e-0ebe9663a43c-kube-api-access-z6jqr\") pod \"perf-node-gather-daemonset-hhvtv\" (UID: \"6339fcc0-2731-4cb0-a15e-0ebe9663a43c\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-hhvtv" Jul 17 21:48:51.102329 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:51.102167 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6339fcc0-2731-4cb0-a15e-0ebe9663a43c-lib-modules\") pod \"perf-node-gather-daemonset-hhvtv\" (UID: \"6339fcc0-2731-4cb0-a15e-0ebe9663a43c\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-hhvtv" Jul 17 21:48:51.102329 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:51.102211 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6339fcc0-2731-4cb0-a15e-0ebe9663a43c-proc\") pod \"perf-node-gather-daemonset-hhvtv\" (UID: \"6339fcc0-2731-4cb0-a15e-0ebe9663a43c\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-hhvtv" Jul 17 21:48:51.102329 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:51.102258 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6339fcc0-2731-4cb0-a15e-0ebe9663a43c-sys\") pod \"perf-node-gather-daemonset-hhvtv\" (UID: \"6339fcc0-2731-4cb0-a15e-0ebe9663a43c\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-hhvtv" Jul 17 21:48:51.203135 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:51.203100 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6339fcc0-2731-4cb0-a15e-0ebe9663a43c-sys\") pod \"perf-node-gather-daemonset-hhvtv\" (UID: \"6339fcc0-2731-4cb0-a15e-0ebe9663a43c\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-hhvtv" Jul 17 21:48:51.203312 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:51.203181 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6339fcc0-2731-4cb0-a15e-0ebe9663a43c-podres\") pod \"perf-node-gather-daemonset-hhvtv\" (UID: \"6339fcc0-2731-4cb0-a15e-0ebe9663a43c\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-hhvtv" Jul 17 21:48:51.203312 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:51.203201 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6jqr\" (UniqueName: \"kubernetes.io/projected/6339fcc0-2731-4cb0-a15e-0ebe9663a43c-kube-api-access-z6jqr\") pod \"perf-node-gather-daemonset-hhvtv\" (UID: \"6339fcc0-2731-4cb0-a15e-0ebe9663a43c\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-hhvtv" Jul 17 21:48:51.203312 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:51.203220 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6339fcc0-2731-4cb0-a15e-0ebe9663a43c-lib-modules\") pod \"perf-node-gather-daemonset-hhvtv\" (UID: \"6339fcc0-2731-4cb0-a15e-0ebe9663a43c\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-hhvtv" Jul 17 21:48:51.203312 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:51.203226 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6339fcc0-2731-4cb0-a15e-0ebe9663a43c-sys\") pod \"perf-node-gather-daemonset-hhvtv\" (UID: \"6339fcc0-2731-4cb0-a15e-0ebe9663a43c\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-hhvtv" Jul 17 21:48:51.203312 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:51.203244 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6339fcc0-2731-4cb0-a15e-0ebe9663a43c-proc\") pod \"perf-node-gather-daemonset-hhvtv\" (UID: \"6339fcc0-2731-4cb0-a15e-0ebe9663a43c\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-hhvtv" Jul 17 21:48:51.203538 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:51.203321 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6339fcc0-2731-4cb0-a15e-0ebe9663a43c-proc\") pod \"perf-node-gather-daemonset-hhvtv\" (UID: \"6339fcc0-2731-4cb0-a15e-0ebe9663a43c\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-hhvtv" Jul 17 21:48:51.203538 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:51.203339 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6339fcc0-2731-4cb0-a15e-0ebe9663a43c-podres\") pod \"perf-node-gather-daemonset-hhvtv\" (UID: \"6339fcc0-2731-4cb0-a15e-0ebe9663a43c\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-hhvtv" Jul 17 21:48:51.203538 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:51.203361 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6339fcc0-2731-4cb0-a15e-0ebe9663a43c-lib-modules\") pod \"perf-node-gather-daemonset-hhvtv\" (UID: \"6339fcc0-2731-4cb0-a15e-0ebe9663a43c\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-hhvtv" Jul 17 21:48:51.210317 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:51.210295 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6jqr\" (UniqueName: \"kubernetes.io/projected/6339fcc0-2731-4cb0-a15e-0ebe9663a43c-kube-api-access-z6jqr\") pod \"perf-node-gather-daemonset-hhvtv\" (UID: \"6339fcc0-2731-4cb0-a15e-0ebe9663a43c\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-hhvtv" Jul 17 21:48:51.306003 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:51.305976 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-hhvtv" Jul 17 21:48:51.433038 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:51.433014 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jqx7f/perf-node-gather-daemonset-hhvtv"] Jul 17 21:48:51.434733 ip-10-0-131-37 kubenswrapper[2568]: W0717 21:48:51.434705 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6339fcc0_2731_4cb0_a15e_0ebe9663a43c.slice/crio-543eef36cc3e7d58fe293c244565a4c251b2ab73b8082a1f616c43e9593dd4ec WatchSource:0}: Error finding container 543eef36cc3e7d58fe293c244565a4c251b2ab73b8082a1f616c43e9593dd4ec: Status 404 returned error can't find the container with id 543eef36cc3e7d58fe293c244565a4c251b2ab73b8082a1f616c43e9593dd4ec Jul 17 21:48:51.970125 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:51.970089 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-hhvtv" event={"ID":"6339fcc0-2731-4cb0-a15e-0ebe9663a43c","Type":"ContainerStarted","Data":"865be34c75e2ddab59615dfb01f3ffee2a22ecac15aa8da820b0a6453d5b2e7e"} Jul 17 21:48:51.970410 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:51.970145 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-hhvtv" event={"ID":"6339fcc0-2731-4cb0-a15e-0ebe9663a43c","Type":"ContainerStarted","Data":"543eef36cc3e7d58fe293c244565a4c251b2ab73b8082a1f616c43e9593dd4ec"} Jul 17 21:48:51.970410 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:51.970307 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-hhvtv" Jul 17 21:48:51.987139 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:51.987095 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-hhvtv" podStartSLOduration=1.98708138 podStartE2EDuration="1.98708138s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:48:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:48:51.985774499 +0000 UTC m=+2710.785573828" watchObservedRunningTime="2026-07-17 21:48:51.98708138 +0000 UTC m=+2710.786880707" Jul 17 21:48:52.190974 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:52.190943 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5c9fbc5df8-th8r9_ab9578ee-6bdd-4952-bac7-cae69ff1f126/console/0.log" Jul 17 21:48:53.841133 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:53.841104 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tlgcs_02b0f677-12f3-4a7e-bb15-d10c6257534d/dns/0.log" Jul 17 21:48:53.859548 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:53.859514 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tlgcs_02b0f677-12f3-4a7e-bb15-d10c6257534d/kube-rbac-proxy/0.log" Jul 17 21:48:53.935131 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:53.935109 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q6fjb_c272898b-56ad-4f67-96bb-1fda34e475f1/dns-node-resolver/0.log" Jul 17 21:48:54.459637 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:54.459606 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c5f67_1bc30f77-9ff9-477d-9a8d-72ae85c5d399/node-ca/0.log" Jul 17 21:48:55.572216 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:55.572188 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-748bb598b7-hr8kp_6135e8fc-3e04-4aaa-9b18-4b4014b49866/kube-auth-proxy/0.log" Jul 17 21:48:55.721328 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:55.721294 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-z49r2_ef6ade2c-e01b-4cd8-a2dd-dc1734357997/payload-processing/0.log" Jul 17 21:48:56.395441 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:56.395415 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7nb8k_a00219cb-5630-43c0-a6cc-37d9dcd8a73f/serve-healthcheck-canary/0.log" Jul 17 21:48:56.979957 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:56.979920 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qs9sk_e2d3c44a-60a5-4624-a39f-d73ff62fda74/kube-rbac-proxy/0.log" Jul 17 21:48:56.998151 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:56.998124 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qs9sk_e2d3c44a-60a5-4624-a39f-d73ff62fda74/exporter/0.log" Jul 17 21:48:57.018220 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:57.018180 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qs9sk_e2d3c44a-60a5-4624-a39f-d73ff62fda74/extractor/0.log" Jul 17 21:48:57.985848 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:57.985819 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-hhvtv" Jul 17 21:48:59.697924 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:59.697891 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5dd64c6cb8-8grtr_23b7c58e-efb1-48ae-be46-82dd6107b244/manager/0.log" Jul 17 21:48:59.713528 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:48:59.713501 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5dd64c6cb8-8grtr_23b7c58e-efb1-48ae-be46-82dd6107b244/copy-manifests/0.log" Jul 17 21:49:01.220796 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:49:01.220766 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-c8db86df9-pxqc4_9ba3e036-7622-42eb-86f4-20e1bae3c2b3/manager/0.log" Jul 17 21:49:01.238145 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:49:01.238121 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-748bb598b7-hr8kp_6135e8fc-3e04-4aaa-9b18-4b4014b49866/kube-auth-proxy/0.log" Jul 17 21:49:01.247216 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:49:01.247191 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-88tgn_e69b7111-7c8b-452c-9255-beb5c8a20609/openshift-lws-operator/0.log" Jul 17 21:49:01.356467 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:49:01.356434 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-z49r2_ef6ade2c-e01b-4cd8-a2dd-dc1734357997/payload-processing/0.log" Jul 17 21:49:02.634644 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:49:02.634614 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-748bb598b7-hr8kp_6135e8fc-3e04-4aaa-9b18-4b4014b49866/kube-auth-proxy/0.log" Jul 17 21:49:02.748885 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:49:02.748788 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-z49r2_ef6ade2c-e01b-4cd8-a2dd-dc1734357997/payload-processing/0.log" Jul 17 21:49:05.948822 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:49:05.948790 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-tvn5g_7550fa51-e259-4b3d-915a-17296892410b/migrator/0.log" Jul 17 21:49:05.967310 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:49:05.967289 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-tvn5g_7550fa51-e259-4b3d-915a-17296892410b/graceful-termination/0.log" Jul 17 21:49:07.241840 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:49:07.241809 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2h6l9_ed3c0b17-7695-427f-bb4b-64033d738c20/kube-multus/0.log" Jul 17 21:49:07.597183 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:49:07.597157 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-px578_df9f8578-e1aa-405f-8a8a-59f530e12761/kube-multus-additional-cni-plugins/0.log" Jul 17 21:49:07.618418 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:49:07.618392 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-px578_df9f8578-e1aa-405f-8a8a-59f530e12761/egress-router-binary-copy/0.log" Jul 17 21:49:07.638375 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:49:07.638342 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-px578_df9f8578-e1aa-405f-8a8a-59f530e12761/cni-plugins/0.log" Jul 17 21:49:07.658118 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:49:07.658098 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-px578_df9f8578-e1aa-405f-8a8a-59f530e12761/bond-cni-plugin/0.log" Jul 17 21:49:07.679059 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:49:07.679034 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-px578_df9f8578-e1aa-405f-8a8a-59f530e12761/routeoverride-cni/0.log" Jul 17 21:49:07.700775 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:49:07.700752 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-px578_df9f8578-e1aa-405f-8a8a-59f530e12761/whereabouts-cni-bincopy/0.log" Jul 17 21:49:07.719879 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:49:07.719856 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-px578_df9f8578-e1aa-405f-8a8a-59f530e12761/whereabouts-cni/0.log" Jul 17 21:49:07.777824 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:49:07.777799 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6klsf_ff4b059f-6fba-47d3-b03e-e977255d54d3/network-metrics-daemon/0.log" Jul 17 21:49:07.794991 ip-10-0-131-37 kubenswrapper[2568]: I0717 21:49:07.794969 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6klsf_ff4b059f-6fba-47d3-b03e-e977255d54d3/kube-rbac-proxy/0.log"