Jul 07 16:20:42.267971 ip-10-0-142-239 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 07 16:20:42.267988 ip-10-0-142-239 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 07 16:20:42.267998 ip-10-0-142-239 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 07 16:20:42.268229 ip-10-0-142-239 systemd[1]: Failed to start Kubernetes Kubelet. Jul 07 16:20:52.366988 ip-10-0-142-239 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 07 16:20:52.367005 ip-10-0-142-239 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 8c0a9ae8af3a4684a3132a8576584093 -- Jul 07 16:22:59.937532 ip-10-0-142-239 systemd[1]: Starting Kubernetes Kubelet... Jul 07 16:23:00.362702 ip-10-0-142-239 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 16:23:00.362702 ip-10-0-142-239 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 16:23:00.362702 ip-10-0-142-239 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 16:23:00.362702 ip-10-0-142-239 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 16:23:00.362702 ip-10-0-142-239 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 16:23:00.364489 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.364390 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 16:23:00.368363 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368344 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:23:00.368363 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368363 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:23:00.368441 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368367 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:23:00.368441 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368370 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:23:00.368441 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368373 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:23:00.368441 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368376 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:23:00.368441 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368379 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:23:00.368441 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368382 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:23:00.368441 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368385 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:23:00.368441 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368388 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:23:00.368441 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368390 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:23:00.368441 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368393 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:23:00.368441 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368396 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:23:00.368441 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368398 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:23:00.368441 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368401 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:23:00.368441 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368403 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:23:00.368441 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368406 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:23:00.368441 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368408 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:23:00.368441 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368412 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:23:00.368441 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368414 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:23:00.368441 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368417 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:23:00.368441 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368424 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:23:00.368944 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368427 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:23:00.368944 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368429 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:23:00.368944 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368432 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:23:00.368944 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368437 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:23:00.368944 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368441 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:23:00.368944 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368445 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:23:00.368944 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368448 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:23:00.368944 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368452 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:23:00.368944 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368455 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:23:00.368944 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368458 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:23:00.368944 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368461 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:23:00.368944 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368464 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:23:00.368944 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368467 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:23:00.368944 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368472 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:23:00.368944 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368475 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:23:00.368944 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368478 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:23:00.368944 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368480 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:23:00.368944 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368483 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:23:00.368944 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368486 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:23:00.369449 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368489 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:23:00.369449 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368491 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:23:00.369449 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368494 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:23:00.369449 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368497 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:23:00.369449 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368499 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:23:00.369449 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368502 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:23:00.369449 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368505 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:23:00.369449 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368507 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:23:00.369449 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368510 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:23:00.369449 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368512 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:23:00.369449 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368515 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:23:00.369449 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368517 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:23:00.369449 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368520 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:23:00.369449 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368522 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:23:00.369449 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368526 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:23:00.369449 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368529 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:23:00.369449 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368538 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:23:00.369449 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368541 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:23:00.369449 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368544 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:23:00.369449 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368547 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:23:00.369974 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368550 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:23:00.369974 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368552 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:23:00.369974 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368555 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:23:00.369974 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368558 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:23:00.369974 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368561 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:23:00.369974 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368563 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:23:00.369974 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368566 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:23:00.369974 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368569 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:23:00.369974 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368572 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:23:00.369974 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368575 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:23:00.369974 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368577 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:23:00.369974 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368580 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:23:00.369974 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368584 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:23:00.369974 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368587 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:23:00.369974 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368590 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:23:00.369974 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368592 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:23:00.369974 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368595 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:23:00.369974 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368597 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:23:00.369974 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368600 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:23:00.369974 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368603 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:23:00.370526 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368605 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:23:00.370526 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368608 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:23:00.370526 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368610 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:23:00.370526 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368613 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:23:00.370526 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368615 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:23:00.370526 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368619 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:23:00.370526 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368622 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:23:00.370526 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368625 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:23:00.370526 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368627 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:23:00.370526 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368630 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:23:00.370526 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368633 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:23:00.370526 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368635 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:23:00.370526 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368638 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:23:00.370526 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368641 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:23:00.370526 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368643 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:23:00.370526 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368646 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:23:00.370526 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368649 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:23:00.370526 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.368652 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:23:00.370526 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369463 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:23:00.371042 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369471 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:23:00.371042 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369474 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:23:00.371042 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369477 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:23:00.371042 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369480 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:23:00.371042 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369484 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:23:00.371042 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369487 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:23:00.371042 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369490 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:23:00.371042 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369493 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:23:00.371042 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369496 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:23:00.371042 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369499 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:23:00.371042 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369502 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:23:00.371042 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369505 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:23:00.371042 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369508 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:23:00.371042 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369513 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:23:00.371042 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369517 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:23:00.371042 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369520 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:23:00.371042 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369523 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:23:00.371042 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369526 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:23:00.371042 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369529 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:23:00.371554 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369533 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:23:00.371554 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369537 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:23:00.371554 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369540 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:23:00.371554 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369543 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:23:00.371554 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369546 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:23:00.371554 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369550 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:23:00.371554 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369553 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:23:00.371554 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369556 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:23:00.371554 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369558 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:23:00.371554 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369561 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:23:00.371554 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369565 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:23:00.371554 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369569 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:23:00.371554 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369572 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:23:00.371554 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369575 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:23:00.371554 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369578 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:23:00.371554 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369580 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:23:00.371554 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369583 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:23:00.371554 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369586 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:23:00.371554 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369589 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:23:00.372058 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369592 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:23:00.372058 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369595 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:23:00.372058 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369597 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:23:00.372058 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369600 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:23:00.372058 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369603 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:23:00.372058 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369606 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:23:00.372058 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369609 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:23:00.372058 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369611 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:23:00.372058 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369614 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:23:00.372058 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369616 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:23:00.372058 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369619 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:23:00.372058 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369621 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:23:00.372058 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369625 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:23:00.372058 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369628 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:23:00.372058 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369630 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:23:00.372058 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369634 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:23:00.372058 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369637 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:23:00.372058 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369639 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:23:00.372058 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369642 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:23:00.372058 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369645 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:23:00.372602 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369648 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:23:00.372602 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369650 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:23:00.372602 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369653 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:23:00.372602 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369655 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:23:00.372602 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369658 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:23:00.372602 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369661 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:23:00.372602 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369663 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:23:00.372602 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369666 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:23:00.372602 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369669 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:23:00.372602 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369671 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:23:00.372602 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369674 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:23:00.372602 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369676 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:23:00.372602 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369679 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:23:00.372602 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369682 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:23:00.372602 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369685 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:23:00.372602 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369687 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:23:00.372602 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369690 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:23:00.372602 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369693 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:23:00.372602 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369695 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:23:00.372602 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369698 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:23:00.373128 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369701 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:23:00.373128 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369703 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:23:00.373128 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369706 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:23:00.373128 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369708 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:23:00.373128 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369712 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:23:00.373128 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369715 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:23:00.373128 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369717 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:23:00.373128 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369720 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:23:00.373128 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369722 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:23:00.373128 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369725 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:23:00.373128 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369728 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:23:00.373128 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369730 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:23:00.373128 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369733 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:23:00.373128 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369736 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:23:00.373128 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369738 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:23:00.373128 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369741 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:23:00.373128 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369743 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:23:00.373128 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369746 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:23:00.373128 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369749 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:23:00.373128 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.369751 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:23:00.373687 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370154 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:23:00.373687 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370159 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:23:00.373687 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370162 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:23:00.373687 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370165 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:23:00.373687 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370168 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:23:00.373687 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370171 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:23:00.373687 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370174 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:23:00.373687 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370177 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:23:00.373687 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370180 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:23:00.373687 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370183 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:23:00.373687 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370185 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:23:00.373687 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370188 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:23:00.373687 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370191 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:23:00.373687 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370193 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:23:00.373687 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370196 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:23:00.373687 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370200 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:23:00.373687 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370203 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:23:00.373687 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370206 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:23:00.373687 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370209 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:23:00.374175 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370212 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:23:00.374175 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370214 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:23:00.374175 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370217 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:23:00.374175 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370221 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:23:00.374175 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370225 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:23:00.374175 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370228 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:23:00.374175 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370231 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:23:00.374175 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370234 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:23:00.374175 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370237 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:23:00.374175 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370241 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:23:00.374175 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370243 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:23:00.374175 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370246 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:23:00.374175 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370249 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:23:00.374175 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370252 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:23:00.374175 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370254 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:23:00.374175 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370257 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:23:00.374175 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370262 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:23:00.374175 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370265 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:23:00.374175 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370270 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:23:00.374175 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370273 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:23:00.374711 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370276 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:23:00.374711 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370279 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:23:00.374711 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370282 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:23:00.374711 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370284 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:23:00.374711 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370287 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:23:00.374711 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370289 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:23:00.374711 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370292 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:23:00.374711 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370294 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:23:00.374711 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370297 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:23:00.374711 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370300 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:23:00.374711 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370319 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:23:00.374711 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370321 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:23:00.374711 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370324 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:23:00.374711 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370327 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:23:00.374711 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370329 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:23:00.374711 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370332 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:23:00.374711 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370335 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:23:00.374711 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370338 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:23:00.374711 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370340 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:23:00.374711 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370343 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:23:00.375294 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370346 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:23:00.375294 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370349 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:23:00.375294 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370351 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:23:00.375294 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370354 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:23:00.375294 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370357 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:23:00.375294 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370360 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:23:00.375294 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370362 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:23:00.375294 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370365 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:23:00.375294 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370369 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:23:00.375294 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370372 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:23:00.375294 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370374 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:23:00.375294 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370377 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:23:00.375294 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370380 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:23:00.375294 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370383 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:23:00.375294 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370386 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:23:00.375294 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370389 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:23:00.375294 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370391 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:23:00.375294 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370394 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:23:00.375294 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370397 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:23:00.375822 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370400 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:23:00.375822 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370402 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:23:00.375822 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370408 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:23:00.375822 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370411 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:23:00.375822 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370413 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:23:00.375822 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370416 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:23:00.375822 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370419 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:23:00.375822 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370421 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:23:00.375822 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370424 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:23:00.375822 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370427 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:23:00.375822 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370429 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:23:00.375822 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370432 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:23:00.375822 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370434 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:23:00.375822 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370437 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:23:00.375822 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370440 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:23:00.375822 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370442 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:23:00.375822 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370446 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:23:00.375822 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370450 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:23:00.375822 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370453 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:23:00.375822 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370456 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:23:00.376372 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.370458 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:23:00.376372 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370540 2564 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 16:23:00.376372 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370548 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 16:23:00.376372 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370554 2564 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 16:23:00.376372 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370567 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 16:23:00.376372 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370574 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 16:23:00.376372 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370578 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 16:23:00.376372 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370582 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 16:23:00.376372 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370587 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 16:23:00.376372 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370590 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 16:23:00.376372 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370593 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 16:23:00.376372 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370596 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 16:23:00.376372 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370599 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 16:23:00.376372 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370603 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 16:23:00.376372 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370608 2564 flags.go:64] FLAG: --cgroup-root="" Jul 07 16:23:00.376372 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370611 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 16:23:00.376372 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370614 2564 flags.go:64] FLAG: --client-ca-file="" Jul 07 16:23:00.376372 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370617 2564 flags.go:64] FLAG: --cloud-provider="external" Jul 07 16:23:00.376372 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370620 2564 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 16:23:00.376372 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370625 2564 flags.go:64] FLAG: --cluster-domain="" Jul 07 16:23:00.376372 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370628 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 16:23:00.376372 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370632 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 16:23:00.376372 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370635 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 16:23:00.376372 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370638 2564 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 16:23:00.377047 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370643 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 16:23:00.377047 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370646 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 16:23:00.377047 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370649 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 16:23:00.377047 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370652 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 16:23:00.377047 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370656 2564 flags.go:64] FLAG: --contention-profiling="false" Jul 07 16:23:00.377047 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370659 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 16:23:00.377047 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370661 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 16:23:00.377047 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370665 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 16:23:00.377047 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370668 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 16:23:00.377047 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370672 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 16:23:00.377047 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370675 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 16:23:00.377047 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370678 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 16:23:00.377047 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370681 2564 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 16:23:00.377047 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370686 2564 flags.go:64] FLAG: --enable-server="true" Jul 07 16:23:00.377047 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370689 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 16:23:00.377047 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370694 2564 flags.go:64] FLAG: --event-burst="100" Jul 07 16:23:00.377047 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370697 2564 flags.go:64] FLAG: --event-qps="50" Jul 07 16:23:00.377047 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370700 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 16:23:00.377047 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370703 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 16:23:00.377047 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370706 2564 flags.go:64] FLAG: --eviction-hard="" Jul 07 16:23:00.377047 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370710 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 16:23:00.377047 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370713 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 16:23:00.377047 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370718 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 16:23:00.377047 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370721 2564 flags.go:64] FLAG: --eviction-soft="" Jul 07 16:23:00.377047 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370724 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 16:23:00.377767 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370727 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 16:23:00.377767 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370730 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 16:23:00.377767 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370733 2564 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 16:23:00.377767 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370736 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 16:23:00.377767 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370740 2564 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 16:23:00.377767 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370743 2564 flags.go:64] FLAG: --feature-gates="" Jul 07 16:23:00.377767 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370746 2564 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 16:23:00.377767 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370749 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 16:23:00.377767 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370753 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 16:23:00.377767 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370756 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 16:23:00.377767 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370759 2564 flags.go:64] FLAG: --healthz-port="10248" Jul 07 16:23:00.377767 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370762 2564 flags.go:64] FLAG: --help="false" Jul 07 16:23:00.377767 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370765 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-142-239.ec2.internal" Jul 07 16:23:00.377767 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370768 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 16:23:00.377767 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370771 2564 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 16:23:00.377767 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370774 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 16:23:00.377767 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370777 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 16:23:00.377767 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370781 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 16:23:00.377767 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370784 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 16:23:00.377767 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370787 2564 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 16:23:00.377767 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370791 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 16:23:00.377767 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370794 2564 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 16:23:00.377767 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370797 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 16:23:00.378422 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370801 2564 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 16:23:00.378422 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370804 2564 flags.go:64] FLAG: --kube-reserved="" Jul 07 16:23:00.378422 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370807 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 16:23:00.378422 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370810 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 16:23:00.378422 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370814 2564 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 16:23:00.378422 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370817 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 16:23:00.378422 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370821 2564 flags.go:64] FLAG: --lock-file="" Jul 07 16:23:00.378422 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370824 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 16:23:00.378422 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370827 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 16:23:00.378422 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370830 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 16:23:00.378422 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370836 2564 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 16:23:00.378422 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370839 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 16:23:00.378422 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370842 2564 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 16:23:00.378422 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370845 2564 flags.go:64] FLAG: --logging-format="text" Jul 07 16:23:00.378422 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370847 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 16:23:00.378422 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370851 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 16:23:00.378422 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370854 2564 flags.go:64] FLAG: --manifest-url="" Jul 07 16:23:00.378422 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370856 2564 flags.go:64] FLAG: --manifest-url-header="" Jul 07 16:23:00.378422 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370861 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 16:23:00.378422 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370864 2564 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 16:23:00.378422 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370868 2564 flags.go:64] FLAG: --max-pods="110" Jul 07 16:23:00.378422 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370872 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 16:23:00.378422 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370875 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 16:23:00.378422 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370878 2564 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 16:23:00.378422 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370881 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 16:23:00.379063 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370884 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 16:23:00.379063 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370887 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 16:23:00.379063 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370890 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 16:23:00.379063 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370898 2564 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 16:23:00.379063 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370902 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 16:23:00.379063 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370905 2564 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 16:23:00.379063 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370908 2564 flags.go:64] FLAG: --pod-cidr="" Jul 07 16:23:00.379063 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370911 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 16:23:00.379063 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370917 2564 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 16:23:00.379063 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370919 2564 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 16:23:00.379063 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370922 2564 flags.go:64] FLAG: --pods-per-core="0" Jul 07 16:23:00.379063 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370925 2564 flags.go:64] FLAG: --port="10250" Jul 07 16:23:00.379063 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370929 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 16:23:00.379063 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370931 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07f37d1f2ad30df9d" Jul 07 16:23:00.379063 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370936 2564 flags.go:64] FLAG: --qos-reserved="" Jul 07 16:23:00.379063 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370939 2564 flags.go:64] FLAG: --read-only-port="10255" Jul 07 16:23:00.379063 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370942 2564 flags.go:64] FLAG: --register-node="true" Jul 07 16:23:00.379063 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370945 2564 flags.go:64] FLAG: --register-with-taints="" Jul 07 16:23:00.379063 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370949 2564 flags.go:64] FLAG: --registry-burst="10" Jul 07 16:23:00.379063 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370952 2564 flags.go:64] FLAG: --registry-qps="5" Jul 07 16:23:00.379063 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370955 2564 flags.go:64] FLAG: --reserved-cpus="" Jul 07 16:23:00.379063 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370957 2564 flags.go:64] FLAG: --reserved-memory="" Jul 07 16:23:00.379063 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370961 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 16:23:00.379063 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370964 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 16:23:00.379063 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370968 2564 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 16:23:00.379732 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370971 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 16:23:00.379732 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370974 2564 flags.go:64] FLAG: --runonce="false" Jul 07 16:23:00.379732 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370976 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 16:23:00.379732 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370980 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 16:23:00.379732 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370983 2564 flags.go:64] FLAG: --seccomp-default="false" Jul 07 16:23:00.379732 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370986 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 16:23:00.379732 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370989 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 16:23:00.379732 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370992 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 16:23:00.379732 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370995 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 16:23:00.379732 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.370998 2564 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 16:23:00.379732 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.371001 2564 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 16:23:00.379732 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.371005 2564 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 16:23:00.379732 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.371008 2564 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 16:23:00.379732 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.371011 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 16:23:00.379732 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.371014 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 16:23:00.379732 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.371018 2564 flags.go:64] FLAG: --system-cgroups="" Jul 07 16:23:00.379732 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.371021 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 16:23:00.379732 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.371027 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 16:23:00.379732 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.371030 2564 flags.go:64] FLAG: --tls-cert-file="" Jul 07 16:23:00.379732 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.371032 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 16:23:00.379732 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.371037 2564 flags.go:64] FLAG: --tls-min-version="" Jul 07 16:23:00.379732 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.371041 2564 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 16:23:00.379732 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.371044 2564 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 16:23:00.379732 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.371048 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 16:23:00.379732 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.371051 2564 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 16:23:00.380448 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.371054 2564 flags.go:64] FLAG: --v="2" Jul 07 16:23:00.380448 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.371059 2564 flags.go:64] FLAG: --version="false" Jul 07 16:23:00.380448 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.371063 2564 flags.go:64] FLAG: --vmodule="" Jul 07 16:23:00.380448 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.371067 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 16:23:00.380448 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.371070 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 16:23:00.380448 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371191 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:23:00.380448 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371195 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:23:00.380448 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371199 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:23:00.380448 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371202 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:23:00.380448 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371205 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:23:00.380448 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371208 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:23:00.380448 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371211 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:23:00.380448 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371213 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:23:00.380448 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371216 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:23:00.380448 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371219 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:23:00.380448 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371222 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:23:00.380448 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371224 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:23:00.380448 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371227 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:23:00.380448 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371230 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:23:00.380448 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371233 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:23:00.380448 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371236 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:23:00.381014 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371238 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:23:00.381014 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371241 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:23:00.381014 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371244 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:23:00.381014 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371246 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:23:00.381014 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371249 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:23:00.381014 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371252 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:23:00.381014 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371255 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:23:00.381014 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371259 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:23:00.381014 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371261 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:23:00.381014 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371264 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:23:00.381014 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371267 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:23:00.381014 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371269 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:23:00.381014 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371273 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:23:00.381014 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371275 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:23:00.381014 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371279 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:23:00.381014 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371283 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:23:00.381014 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371286 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:23:00.381014 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371289 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:23:00.381014 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371292 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:23:00.381586 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371295 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:23:00.381586 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371298 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:23:00.381586 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371301 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:23:00.381586 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371320 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:23:00.381586 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371323 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:23:00.381586 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371326 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:23:00.381586 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371329 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:23:00.381586 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371331 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:23:00.381586 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371334 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:23:00.381586 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371336 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:23:00.381586 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371340 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:23:00.381586 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371343 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:23:00.381586 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371346 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:23:00.381586 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371348 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:23:00.381586 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371351 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:23:00.381586 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371354 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:23:00.381586 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371358 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:23:00.381586 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371361 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:23:00.381586 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371364 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:23:00.381586 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371366 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:23:00.382175 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371371 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:23:00.382175 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371374 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:23:00.382175 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371377 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:23:00.382175 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371379 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:23:00.382175 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371382 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:23:00.382175 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371385 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:23:00.382175 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371387 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:23:00.382175 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371390 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:23:00.382175 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371393 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:23:00.382175 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371396 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:23:00.382175 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371399 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:23:00.382175 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371402 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:23:00.382175 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371405 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:23:00.382175 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371407 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:23:00.382175 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371411 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:23:00.382175 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371413 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:23:00.382175 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371416 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:23:00.382175 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371419 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:23:00.382175 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371421 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:23:00.382175 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371424 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:23:00.382725 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371428 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:23:00.382725 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371432 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:23:00.382725 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371438 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:23:00.382725 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371441 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:23:00.382725 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371444 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:23:00.382725 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371447 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:23:00.382725 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371450 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:23:00.382725 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371453 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:23:00.382725 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371456 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:23:00.382725 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371459 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:23:00.382725 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371461 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:23:00.382725 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371464 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:23:00.382725 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371469 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:23:00.382725 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371472 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:23:00.382725 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371475 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:23:00.382725 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371478 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:23:00.382725 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371480 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:23:00.382725 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371483 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:23:00.382725 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371485 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:23:00.383217 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371488 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:23:00.383217 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371491 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:23:00.383217 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371494 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:23:00.383217 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371497 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:23:00.383217 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.371499 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:23:00.383217 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.371505 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 16:23:00.383217 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.379214 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 16:23:00.383217 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.379231 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 16:23:00.383217 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.379938 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 16:23:00.383217 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.379946 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 16:23:00.383217 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380009 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:23:00.383217 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380014 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:23:00.383217 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380018 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:23:00.383217 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380021 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:23:00.383217 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380024 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:23:00.383644 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380027 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:23:00.383644 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380030 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:23:00.383644 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380034 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:23:00.383644 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380037 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:23:00.383644 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380040 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:23:00.383644 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380043 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:23:00.383644 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380045 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:23:00.383644 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380050 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:23:00.383644 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380054 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:23:00.383644 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380057 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:23:00.383644 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380059 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:23:00.383644 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380062 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:23:00.383644 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380065 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:23:00.383644 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380068 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:23:00.383644 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380071 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:23:00.383644 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380074 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:23:00.383644 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380077 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:23:00.383644 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380080 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:23:00.383644 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380082 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:23:00.384202 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380085 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:23:00.384202 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380088 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:23:00.384202 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380091 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:23:00.384202 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380093 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:23:00.384202 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380096 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:23:00.384202 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380099 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:23:00.384202 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380102 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:23:00.384202 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380105 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:23:00.384202 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380107 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:23:00.384202 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380110 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:23:00.384202 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380113 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:23:00.384202 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380115 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:23:00.384202 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380118 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:23:00.384202 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380121 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:23:00.384202 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380123 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:23:00.384202 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380126 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:23:00.384202 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380128 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:23:00.384202 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380131 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:23:00.384202 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380133 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:23:00.384202 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380136 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:23:00.384822 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380138 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:23:00.384822 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380143 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:23:00.384822 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380146 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:23:00.384822 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380150 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:23:00.384822 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380153 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:23:00.384822 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380158 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:23:00.384822 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380161 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:23:00.384822 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380165 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:23:00.384822 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380168 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:23:00.384822 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380171 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:23:00.384822 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380174 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:23:00.384822 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380178 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:23:00.384822 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380181 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:23:00.384822 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380184 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:23:00.384822 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380187 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:23:00.384822 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380190 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:23:00.384822 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380193 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:23:00.384822 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380195 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:23:00.384822 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380198 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:23:00.385340 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380201 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:23:00.385340 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380204 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:23:00.385340 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380207 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:23:00.385340 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380210 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:23:00.385340 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380212 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:23:00.385340 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380215 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:23:00.385340 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380217 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:23:00.385340 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380220 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:23:00.385340 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380222 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:23:00.385340 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380225 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:23:00.385340 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380228 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:23:00.385340 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380230 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:23:00.385340 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380233 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:23:00.385340 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380237 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:23:00.385340 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380239 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:23:00.385340 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380242 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:23:00.385340 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380245 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:23:00.385340 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380248 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:23:00.385340 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380251 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:23:00.385340 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380255 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:23:00.385869 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380257 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:23:00.385869 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380260 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:23:00.385869 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380264 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:23:00.385869 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380266 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:23:00.385869 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380269 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:23:00.385869 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380273 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:23:00.385869 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380276 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:23:00.385869 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380278 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:23:00.385869 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380281 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:23:00.385869 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380284 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:23:00.385869 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380287 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:23:00.385869 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380290 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:23:00.385869 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380297 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:23:00.385869 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380300 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:23:00.385869 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380324 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:23:00.385869 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380327 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:23:00.386284 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.380332 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 16:23:00.386284 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380458 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:23:00.386284 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380465 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:23:00.386284 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380468 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:23:00.386284 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380471 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:23:00.386284 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380474 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:23:00.386284 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380476 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:23:00.386284 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380479 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:23:00.386284 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380481 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:23:00.386284 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380484 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:23:00.386284 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380487 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:23:00.386284 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380489 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:23:00.386284 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380493 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:23:00.386284 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380498 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:23:00.386284 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380501 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:23:00.386731 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380504 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:23:00.386731 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380507 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:23:00.386731 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380511 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:23:00.386731 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380514 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:23:00.386731 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380516 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:23:00.386731 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380519 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:23:00.386731 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380522 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:23:00.386731 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380524 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:23:00.386731 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380527 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:23:00.386731 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380530 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:23:00.386731 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380532 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:23:00.386731 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380535 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:23:00.386731 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380538 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:23:00.386731 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380541 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:23:00.386731 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380543 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:23:00.386731 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380546 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:23:00.386731 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380549 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:23:00.386731 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380551 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:23:00.386731 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380554 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:23:00.386731 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380556 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:23:00.387258 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380559 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:23:00.387258 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380562 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:23:00.387258 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380565 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:23:00.387258 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380568 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:23:00.387258 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380570 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:23:00.387258 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380573 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:23:00.387258 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380576 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:23:00.387258 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380579 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:23:00.387258 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380581 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:23:00.387258 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380584 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:23:00.387258 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380586 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:23:00.387258 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380589 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:23:00.387258 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380592 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:23:00.387258 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380594 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:23:00.387258 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380597 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:23:00.387258 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380600 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:23:00.387258 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380603 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:23:00.387258 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380605 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:23:00.387258 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380608 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:23:00.387766 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380610 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:23:00.387766 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380613 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:23:00.387766 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380615 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:23:00.387766 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380618 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:23:00.387766 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380621 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:23:00.387766 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380623 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:23:00.387766 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380626 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:23:00.387766 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380628 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:23:00.387766 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380631 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:23:00.387766 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380634 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:23:00.387766 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380637 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:23:00.387766 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380639 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:23:00.387766 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380648 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:23:00.387766 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380652 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:23:00.387766 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380656 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:23:00.387766 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380658 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:23:00.387766 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380661 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:23:00.387766 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380663 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:23:00.387766 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380666 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:23:00.387766 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380668 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:23:00.388642 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380671 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:23:00.388642 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380674 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:23:00.388642 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380676 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:23:00.388642 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380680 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:23:00.388642 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380684 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:23:00.388642 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380688 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:23:00.388642 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380692 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:23:00.388642 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380695 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:23:00.388642 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380699 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:23:00.388642 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380701 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:23:00.388642 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380704 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:23:00.388642 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380708 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:23:00.388642 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380710 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:23:00.388642 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380713 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:23:00.388642 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380716 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:23:00.388642 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380718 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:23:00.388642 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380721 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:23:00.388642 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380723 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:23:00.388642 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380726 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:23:00.389447 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380729 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:23:00.389447 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380731 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:23:00.389447 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380735 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:23:00.389447 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380737 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:23:00.389447 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380740 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:23:00.389447 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380743 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:23:00.389447 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:00.380745 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:23:00.389447 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.380751 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 16:23:00.389447 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.380876 2564 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 16:23:00.389447 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.383900 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 16:23:00.389447 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.385472 2564 server.go:1019] "Starting client certificate rotation" Jul 07 16:23:00.389447 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.385584 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 16:23:00.389447 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.385617 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 16:23:00.390020 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.388949 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 16:23:00.390940 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.390922 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 16:23:00.400223 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.400202 2564 log.go:25] "Validated CRI v1 runtime API" Jul 07 16:23:00.404100 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.404082 2564 log.go:25] "Validated CRI v1 image API" Jul 07 16:23:00.405043 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.405020 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 16:23:00.407602 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.407580 2564 fs.go:135] Filesystem UUIDs: map[542c538c-bb5e-4d25-99d3-072b795c9f97:/dev/nvme0n1p4 56dc0725-b317-48bd-a96b-b2dce5b90354:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 07 16:23:00.407667 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.407601 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 16:23:00.412348 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.412209 2564 manager.go:216] Machine: {Timestamp:2026-07-07 16:23:00.411706241 +0000 UTC m=+0.351215658 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101367 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22c11457110d5ebf71a1df56f4339d SystemUUID:ec22c114-5711-0d5e-bf71-a1df56f4339d BootID:8c0a9ae8-af3a-4684-a313-2a8576584093 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c6:2b:27:29:8f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c6:2b:27:29:8f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:42:6c:e2:42:98:2c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 16:23:00.412348 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.412346 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 16:23:00.412451 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.412428 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 16:23:00.413574 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.413546 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 16:23:00.413725 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.413580 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-239.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 16:23:00.414275 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.414259 2564 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 16:23:00.414275 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.414273 2564 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 16:23:00.414397 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.414282 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 16:23:00.414397 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.414298 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 16:23:00.415215 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.415204 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 16:23:00.416035 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.416019 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 16:23:00.416961 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.416949 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 07 16:23:00.417082 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.417072 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 16:23:00.417113 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.417110 2564 kubelet.go:486] "Attempting to sync node with API server" Jul 07 16:23:00.417142 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.417125 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 16:23:00.417171 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.417142 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 16:23:00.417171 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.417154 2564 kubelet.go:398] "Adding apiserver pod source" Jul 07 16:23:00.417171 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.417163 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 16:23:00.417586 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.417573 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 16:23:00.417628 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.417594 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 16:23:00.421730 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.421706 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 16:23:00.423529 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.423514 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 16:23:00.423591 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.423547 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 16:23:00.425375 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.425362 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 16:23:00.425478 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.425381 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 16:23:00.425478 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.425388 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 16:23:00.425478 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.425394 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 16:23:00.425478 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.425404 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 16:23:00.425478 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.425410 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 16:23:00.425478 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.425418 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 16:23:00.425478 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.425425 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 16:23:00.425478 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.425432 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 16:23:00.425478 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.425438 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 16:23:00.425478 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.425448 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 16:23:00.425478 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.425453 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 16:23:00.426165 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.426155 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 16:23:00.426165 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.426164 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 16:23:00.429463 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.429449 2564 server.go:1268] "Started kubelet" Jul 07 16:23:00.429562 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.429525 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 16:23:00.429616 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.429547 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 16:23:00.429679 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.429620 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 16:23:00.430445 ip-10-0-142-239 systemd[1]: Started Kubernetes Kubelet. Jul 07 16:23:00.431346 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.431294 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 16:23:00.434646 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.434624 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-239.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 16:23:00.434646 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:00.434622 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 16:23:00.434972 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.434956 2564 server.go:310] "Adding debug handlers to kubelet server" Jul 07 16:23:00.435360 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:00.435337 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 16:23:00.435398 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:00.435336 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-239.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 16:23:00.439378 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.439361 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 16:23:00.439464 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.439375 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 16:23:00.439464 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:00.439432 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-239.ec2.internal\" not found" Jul 07 16:23:00.440419 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.440063 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 16:23:00.440419 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.440097 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 16:23:00.440419 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.440111 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 16:23:00.440419 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.440241 2564 reconstruct.go:97] "Volume reconstruction finished" Jul 07 16:23:00.440419 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.440249 2564 reconciler.go:29] "Reconciler: start to sync state" Jul 07 16:23:00.442536 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.441658 2564 factory.go:55] Registering systemd factory Jul 07 16:23:00.442536 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.441676 2564 factory.go:223] Registration of the systemd container factory successfully Jul 07 16:23:00.442536 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.442117 2564 factory.go:153] Registering CRI-O factory Jul 07 16:23:00.442536 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.442255 2564 factory.go:223] Registration of the crio container factory successfully Jul 07 16:23:00.442536 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.442332 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 16:23:00.442536 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.442367 2564 factory.go:103] Registering Raw factory Jul 07 16:23:00.442536 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.442386 2564 manager.go:1196] Started watching for new ooms in manager Jul 07 16:23:00.443327 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:00.441160 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-239.ec2.internal.18c00e7c863a5a05 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-239.ec2.internal,UID:ip-10-0-142-239.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-239.ec2.internal,},FirstTimestamp:2026-07-07 16:23:00.429421061 +0000 UTC m=+0.368930479,LastTimestamp:2026-07-07 16:23:00.429421061 +0000 UTC m=+0.368930479,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-239.ec2.internal,}" Jul 07 16:23:00.443579 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.443561 2564 manager.go:349] Starting recovery of all containers Jul 07 16:23:00.447032 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.447000 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6c9zb" Jul 07 16:23:00.447171 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:00.447146 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-239.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 07 16:23:00.447256 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:00.447104 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 07 16:23:00.456146 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.456015 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6c9zb" Jul 07 16:23:00.456403 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.456389 2564 manager.go:354] Recovery completed Jul 07 16:23:00.460630 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.460614 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:23:00.463100 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.463077 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:23:00.463182 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.463107 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:23:00.463182 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.463119 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:23:00.463682 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.463668 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 16:23:00.463682 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.463682 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 16:23:00.463805 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.463683 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:23:00.463805 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.463701 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 07 16:23:00.464500 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.464482 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:23:00.464571 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.464520 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:23:00.464571 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.464533 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:23:00.464774 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.464760 2564 policy_none.go:49] "None policy: Start" Jul 07 16:23:00.464826 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.464786 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 16:23:00.464826 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.464802 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 16:23:00.465816 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.465802 2564 policy_none.go:47] "Start" Jul 07 16:23:00.465981 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:00.465882 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-239.ec2.internal.18c00e7c883c2860 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-239.ec2.internal,UID:ip-10-0-142-239.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-239.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-239.ec2.internal,},FirstTimestamp:2026-07-07 16:23:00.463093856 +0000 UTC m=+0.402603272,LastTimestamp:2026-07-07 16:23:00.463093856 +0000 UTC m=+0.402603272,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-239.ec2.internal,}" Jul 07 16:23:00.512920 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.512901 2564 manager.go:337] "Starting Device Plugin manager" Jul 07 16:23:00.513024 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:00.512943 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 16:23:00.513024 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.512958 2564 server.go:87] "Starting device plugin registration server" Jul 07 16:23:00.513254 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.513240 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 16:23:00.513332 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.513257 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 16:23:00.513380 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.513332 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 16:23:00.513430 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.513413 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 16:23:00.513430 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.513421 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 16:23:00.514035 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:00.513996 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 16:23:00.514117 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:00.514064 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-239.ec2.internal\" not found" Jul 07 16:23:00.613848 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.613776 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:23:00.614899 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.614858 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:23:00.614899 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.614886 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:23:00.614899 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.614899 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:23:00.615377 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.615365 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-239.ec2.internal" Jul 07 16:23:00.635505 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.635480 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-239.ec2.internal" Jul 07 16:23:00.635505 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:00.635505 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-239.ec2.internal\": node \"ip-10-0-142-239.ec2.internal\" not found" Jul 07 16:23:00.641815 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.641789 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 16:23:00.643292 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.643269 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 16:23:00.643420 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.643332 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 16:23:00.643420 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.643358 2564 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 16:23:00.643420 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:00.643401 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 16:23:00.646118 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.646091 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:23:00.665486 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:00.665462 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-239.ec2.internal\" not found" Jul 07 16:23:00.744513 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.744459 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-142-239.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-239.ec2.internal"] Jul 07 16:23:00.744689 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.744568 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:23:00.746571 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.746552 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:23:00.746641 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.746585 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:23:00.746641 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.746597 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:23:00.748018 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.748006 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:23:00.748132 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.748118 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-239.ec2.internal" Jul 07 16:23:00.748171 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.748149 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:23:00.748760 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.748743 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:23:00.748760 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.748752 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:23:00.748864 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.748770 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:23:00.748864 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.748772 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:23:00.748864 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.748780 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:23:00.748864 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.748788 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:23:00.750167 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.750154 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-239.ec2.internal" Jul 07 16:23:00.750227 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.750180 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:23:00.750824 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.750806 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:23:00.750922 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.750834 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:23:00.750922 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.750847 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:23:00.765522 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:00.765503 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-239.ec2.internal\" not found" Jul 07 16:23:00.774139 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:00.774121 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-239.ec2.internal\" not found" node="ip-10-0-142-239.ec2.internal" Jul 07 16:23:00.778784 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:00.778769 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-239.ec2.internal\" not found" node="ip-10-0-142-239.ec2.internal" Jul 07 16:23:00.844714 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.844666 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4171bb48f6e62864b15f6dcc9fa0fe2a-config\") pod \"kube-apiserver-proxy-ip-10-0-142-239.ec2.internal\" (UID: \"4171bb48f6e62864b15f6dcc9fa0fe2a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-239.ec2.internal" Jul 07 16:23:00.844714 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.844713 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5b613f510a320d3ccc3ec79b1f26f861-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-239.ec2.internal\" (UID: \"5b613f510a320d3ccc3ec79b1f26f861\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-239.ec2.internal" Jul 07 16:23:00.844894 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.844730 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b613f510a320d3ccc3ec79b1f26f861-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-239.ec2.internal\" (UID: \"5b613f510a320d3ccc3ec79b1f26f861\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-239.ec2.internal" Jul 07 16:23:00.865999 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:00.865938 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-239.ec2.internal\" not found" Jul 07 16:23:00.945861 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.945832 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b613f510a320d3ccc3ec79b1f26f861-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-239.ec2.internal\" (UID: \"5b613f510a320d3ccc3ec79b1f26f861\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-239.ec2.internal" Jul 07 16:23:00.945959 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.945865 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4171bb48f6e62864b15f6dcc9fa0fe2a-config\") pod \"kube-apiserver-proxy-ip-10-0-142-239.ec2.internal\" (UID: \"4171bb48f6e62864b15f6dcc9fa0fe2a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-239.ec2.internal" Jul 07 16:23:00.945959 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.945885 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5b613f510a320d3ccc3ec79b1f26f861-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-239.ec2.internal\" (UID: \"5b613f510a320d3ccc3ec79b1f26f861\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-239.ec2.internal" Jul 07 16:23:00.945959 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.945942 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5b613f510a320d3ccc3ec79b1f26f861-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-239.ec2.internal\" (UID: \"5b613f510a320d3ccc3ec79b1f26f861\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-239.ec2.internal" Jul 07 16:23:00.946058 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.945956 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4171bb48f6e62864b15f6dcc9fa0fe2a-config\") pod \"kube-apiserver-proxy-ip-10-0-142-239.ec2.internal\" (UID: \"4171bb48f6e62864b15f6dcc9fa0fe2a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-239.ec2.internal" Jul 07 16:23:00.946058 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:00.945942 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b613f510a320d3ccc3ec79b1f26f861-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-239.ec2.internal\" (UID: \"5b613f510a320d3ccc3ec79b1f26f861\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-239.ec2.internal" Jul 07 16:23:00.966326 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:00.966298 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-239.ec2.internal\" not found" Jul 07 16:23:01.067446 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:01.067398 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-239.ec2.internal\" not found" Jul 07 16:23:01.078437 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:01.078419 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-239.ec2.internal" Jul 07 16:23:01.082631 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:01.082395 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-239.ec2.internal" Jul 07 16:23:01.168913 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:01.168812 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-239.ec2.internal\" not found" Jul 07 16:23:01.270000 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:01.269941 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-239.ec2.internal\" not found" Jul 07 16:23:01.371098 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:01.371062 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-239.ec2.internal\" not found" Jul 07 16:23:01.385301 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:01.385272 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 16:23:01.385457 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:01.385438 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 16:23:01.431407 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:01.431336 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:23:01.457369 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:01.457350 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:23:01.460728 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:01.460703 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 16:18:01 +0000 UTC" deadline="2028-03-16 09:49:59.573203812 +0000 UTC" Jul 07 16:23:01.460777 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:01.460729 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14825h26m58.112477597s" Jul 07 16:23:01.540372 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:01.540346 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-239.ec2.internal" Jul 07 16:23:01.560437 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:01.560405 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 16:23:01.561484 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:01.561465 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-239.ec2.internal" Jul 07 16:23:01.576372 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:01.576336 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 16:23:01.809326 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:01.809286 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4171bb48f6e62864b15f6dcc9fa0fe2a.slice/crio-87a556f4903a7a699f7faab3871cb5e13099678d7ea4bf455bd80d6cf434255c WatchSource:0}: Error finding container 87a556f4903a7a699f7faab3871cb5e13099678d7ea4bf455bd80d6cf434255c: Status 404 returned error can't find the container with id 87a556f4903a7a699f7faab3871cb5e13099678d7ea4bf455bd80d6cf434255c Jul 07 16:23:01.809788 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:01.809771 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b613f510a320d3ccc3ec79b1f26f861.slice/crio-98d4c1dec3825362c2b96ac526ede1c0c1678f5d89afa75fdf6a7c800758be3b WatchSource:0}: Error finding container 98d4c1dec3825362c2b96ac526ede1c0c1678f5d89afa75fdf6a7c800758be3b: Status 404 returned error can't find the container with id 98d4c1dec3825362c2b96ac526ede1c0c1678f5d89afa75fdf6a7c800758be3b Jul 07 16:23:01.816596 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:01.816578 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 16:23:01.816900 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:01.816885 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:23:02.418415 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.418379 2564 apiserver.go:52] "Watching apiserver" Jul 07 16:23:02.440636 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.440597 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 16:23:02.505525 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.505034 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 16:23:02.507066 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.507030 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-5s79k","kube-system/konnectivity-agent-dzl6r","kube-system/kube-apiserver-proxy-ip-10-0-142-239.ec2.internal","openshift-cluster-node-tuning-operator/tuned-x2qr4","openshift-dns/node-resolver-stndg","openshift-image-registry/node-ca-dmrqb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-239.ec2.internal","openshift-multus/multus-t7dz8","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8l5vp","openshift-multus/multus-additional-cni-plugins-c8ln2","openshift-multus/network-metrics-daemon-k2mr5","openshift-network-diagnostics/network-check-target-ssslq","openshift-network-operator/iptables-alerter-tcwlz","openshift-ovn-kubernetes/ovnkube-node-4llwj"] Jul 07 16:23:02.509257 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.508664 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c8ln2" Jul 07 16:23:02.511917 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.511892 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tcwlz" Jul 07 16:23:02.513401 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.513372 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.522095 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.522070 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.523221 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.523197 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-stndg" Jul 07 16:23:02.524915 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.524895 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dmrqb" Jul 07 16:23:02.525905 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.525886 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8l5vp" Jul 07 16:23:02.527640 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.527620 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.529481 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.529343 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dzl6r" Jul 07 16:23:02.530960 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.530680 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:23:02.530960 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:02.530752 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s79k" podUID="dc1cd2ef-cb98-430b-bdee-883a3129c2af" Jul 07 16:23:02.532107 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.532085 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2mr5" Jul 07 16:23:02.532212 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:02.532146 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2mr5" podUID="d679cf5e-f509-4cf8-94e0-325f8c4180ea" Jul 07 16:23:02.533579 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.533473 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssslq" Jul 07 16:23:02.533579 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:02.533538 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssslq" podUID="d305b801-d058-4ce5-b43b-062c1994a145" Jul 07 16:23:02.536642 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.536434 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 16:23:02.537493 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.537472 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hdb49\"" Jul 07 16:23:02.537711 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.537680 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 16:23:02.537807 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.537773 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-56r5l\"" Jul 07 16:23:02.541705 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.541608 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 16:23:02.544374 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.544353 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 16:23:02.551271 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.551237 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 16:23:02.551919 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.551897 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 16:23:02.552282 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.552263 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-49ccj\"" Jul 07 16:23:02.553359 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.552526 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 16:23:02.553359 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.552870 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 16:23:02.553532 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.553513 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-v6dc2\"" Jul 07 16:23:02.553819 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.553801 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 16:23:02.554086 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.554069 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 16:23:02.554424 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.554404 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-env-overrides\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.554503 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.554439 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fbed629e-a8e6-45f4-bad1-47e0bcbac11e-device-dir\") pod \"aws-ebs-csi-driver-node-8l5vp\" (UID: \"fbed629e-a8e6-45f4-bad1-47e0bcbac11e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8l5vp" Jul 07 16:23:02.554503 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.554465 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc1cd2ef-cb98-430b-bdee-883a3129c2af-original-pull-secret\") pod \"global-pull-secret-syncer-5s79k\" (UID: \"dc1cd2ef-cb98-430b-bdee-883a3129c2af\") " pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:23:02.554503 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.554491 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7badfa9-b86b-4749-bae9-49c20ea917c3-cnibin\") pod \"multus-additional-cni-plugins-c8ln2\" (UID: \"d7badfa9-b86b-4749-bae9-49c20ea917c3\") " pod="openshift-multus/multus-additional-cni-plugins-c8ln2" Jul 07 16:23:02.554674 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.554519 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckmkm\" (UniqueName: \"kubernetes.io/projected/d7badfa9-b86b-4749-bae9-49c20ea917c3-kube-api-access-ckmkm\") pod \"multus-additional-cni-plugins-c8ln2\" (UID: \"d7badfa9-b86b-4749-bae9-49c20ea917c3\") " pod="openshift-multus/multus-additional-cni-plugins-c8ln2" Jul 07 16:23:02.554674 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.554545 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e0396be1-58ec-43ad-8d17-668c8218f8e4-lib-modules\") pod \"tuned-x2qr4\" (UID: \"e0396be1-58ec-43ad-8d17-668c8218f8e4\") " pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.554674 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.554568 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7262abd9-903a-4ecc-aece-7ede44afecf7-agent-certs\") pod \"konnectivity-agent-dzl6r\" (UID: \"7262abd9-903a-4ecc-aece-7ede44afecf7\") " pod="kube-system/konnectivity-agent-dzl6r" Jul 07 16:23:02.554674 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.554611 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.554674 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.554640 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7badfa9-b86b-4749-bae9-49c20ea917c3-system-cni-dir\") pod \"multus-additional-cni-plugins-c8ln2\" (UID: \"d7badfa9-b86b-4749-bae9-49c20ea917c3\") " pod="openshift-multus/multus-additional-cni-plugins-c8ln2" Jul 07 16:23:02.554924 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.554673 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d7badfa9-b86b-4749-bae9-49c20ea917c3-os-release\") pod \"multus-additional-cni-plugins-c8ln2\" (UID: \"d7badfa9-b86b-4749-bae9-49c20ea917c3\") " pod="openshift-multus/multus-additional-cni-plugins-c8ln2" Jul 07 16:23:02.554924 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.554698 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0a4b79ff-9d4c-44d6-b582-ee10d09e9bbc-serviceca\") pod \"node-ca-dmrqb\" (UID: \"0a4b79ff-9d4c-44d6-b582-ee10d09e9bbc\") " pod="openshift-image-registry/node-ca-dmrqb" Jul 07 16:23:02.554924 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.554724 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1153cddd-f227-4976-956c-db748068bdb4-host-run-k8s-cni-cncf-io\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.554924 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.554748 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1153cddd-f227-4976-956c-db748068bdb4-host-var-lib-kubelet\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.554924 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.554784 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-host-cni-bin\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.554924 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.554822 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw69r\" (UniqueName: \"kubernetes.io/projected/d679cf5e-f509-4cf8-94e0-325f8c4180ea-kube-api-access-bw69r\") pod \"network-metrics-daemon-k2mr5\" (UID: \"d679cf5e-f509-4cf8-94e0-325f8c4180ea\") " pod="openshift-multus/network-metrics-daemon-k2mr5" Jul 07 16:23:02.554924 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.554846 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0396be1-58ec-43ad-8d17-668c8218f8e4-var-lib-kubelet\") pod \"tuned-x2qr4\" (UID: \"e0396be1-58ec-43ad-8d17-668c8218f8e4\") " pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.554924 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.554873 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7262abd9-903a-4ecc-aece-7ede44afecf7-konnectivity-ca\") pod \"konnectivity-agent-dzl6r\" (UID: \"7262abd9-903a-4ecc-aece-7ede44afecf7\") " pod="kube-system/konnectivity-agent-dzl6r" Jul 07 16:23:02.554924 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.554905 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-var-lib-openvswitch\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.555393 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.554930 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-etc-openvswitch\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.555393 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.554965 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-ovnkube-config\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.555393 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.554991 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fbed629e-a8e6-45f4-bad1-47e0bcbac11e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8l5vp\" (UID: \"fbed629e-a8e6-45f4-bad1-47e0bcbac11e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8l5vp" Jul 07 16:23:02.555393 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.555016 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fbed629e-a8e6-45f4-bad1-47e0bcbac11e-registration-dir\") pod \"aws-ebs-csi-driver-node-8l5vp\" (UID: \"fbed629e-a8e6-45f4-bad1-47e0bcbac11e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8l5vp" Jul 07 16:23:02.555393 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.555041 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fbed629e-a8e6-45f4-bad1-47e0bcbac11e-sys-fs\") pod \"aws-ebs-csi-driver-node-8l5vp\" (UID: \"fbed629e-a8e6-45f4-bad1-47e0bcbac11e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8l5vp" Jul 07 16:23:02.555393 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.555064 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e0396be1-58ec-43ad-8d17-668c8218f8e4-sys\") pod \"tuned-x2qr4\" (UID: \"e0396be1-58ec-43ad-8d17-668c8218f8e4\") " pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.555393 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.555090 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-host-run-netns\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.555393 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.555117 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7badfa9-b86b-4749-bae9-49c20ea917c3-cni-binary-copy\") pod \"multus-additional-cni-plugins-c8ln2\" (UID: \"d7badfa9-b86b-4749-bae9-49c20ea917c3\") " pod="openshift-multus/multus-additional-cni-plugins-c8ln2" Jul 07 16:23:02.555393 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.555142 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/58ab2695-8573-4288-8a98-9f4f6b173cf4-host-slash\") pod \"iptables-alerter-tcwlz\" (UID: \"58ab2695-8573-4288-8a98-9f4f6b173cf4\") " pod="openshift-network-operator/iptables-alerter-tcwlz" Jul 07 16:23:02.555393 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.555176 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37491c06-836e-4547-b86c-de4dcf91a433-tmp-dir\") pod \"node-resolver-stndg\" (UID: \"37491c06-836e-4547-b86c-de4dcf91a433\") " pod="openshift-dns/node-resolver-stndg" Jul 07 16:23:02.555393 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.555202 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1153cddd-f227-4976-956c-db748068bdb4-cni-binary-copy\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.555393 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.555226 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1153cddd-f227-4976-956c-db748068bdb4-host-run-netns\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.555393 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.555252 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1153cddd-f227-4976-956c-db748068bdb4-etc-kubernetes\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.555393 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.555286 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-run-systemd\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.555393 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.555334 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-host-cni-netd\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.555393 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.555363 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cpp2\" (UniqueName: \"kubernetes.io/projected/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-kube-api-access-2cpp2\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.556179 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.555395 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e0396be1-58ec-43ad-8d17-668c8218f8e4-etc-sysconfig\") pod \"tuned-x2qr4\" (UID: \"e0396be1-58ec-43ad-8d17-668c8218f8e4\") " pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.556179 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.555423 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1153cddd-f227-4976-956c-db748068bdb4-host-var-lib-cni-bin\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.556179 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.555449 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fbed629e-a8e6-45f4-bad1-47e0bcbac11e-socket-dir\") pod \"aws-ebs-csi-driver-node-8l5vp\" (UID: \"fbed629e-a8e6-45f4-bad1-47e0bcbac11e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8l5vp" Jul 07 16:23:02.556179 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.555474 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d679cf5e-f509-4cf8-94e0-325f8c4180ea-metrics-certs\") pod \"network-metrics-daemon-k2mr5\" (UID: \"d679cf5e-f509-4cf8-94e0-325f8c4180ea\") " pod="openshift-multus/network-metrics-daemon-k2mr5" Jul 07 16:23:02.556179 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.555502 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppsdb\" (UniqueName: \"kubernetes.io/projected/58ab2695-8573-4288-8a98-9f4f6b173cf4-kube-api-access-ppsdb\") pod \"iptables-alerter-tcwlz\" (UID: \"58ab2695-8573-4288-8a98-9f4f6b173cf4\") " pod="openshift-network-operator/iptables-alerter-tcwlz" Jul 07 16:23:02.556179 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.555526 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0a4b79ff-9d4c-44d6-b582-ee10d09e9bbc-host\") pod \"node-ca-dmrqb\" (UID: \"0a4b79ff-9d4c-44d6-b582-ee10d09e9bbc\") " pod="openshift-image-registry/node-ca-dmrqb" Jul 07 16:23:02.556179 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.555555 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-systemd-units\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.556179 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.555582 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-run-ovn\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.556179 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.555607 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1153cddd-f227-4976-956c-db748068bdb4-cnibin\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.556179 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.555633 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1153cddd-f227-4976-956c-db748068bdb4-os-release\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.556179 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.555659 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1153cddd-f227-4976-956c-db748068bdb4-host-run-multus-certs\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.556179 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.555685 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-ovnkube-script-lib\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.556179 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.555710 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e0396be1-58ec-43ad-8d17-668c8218f8e4-etc-modprobe-d\") pod \"tuned-x2qr4\" (UID: \"e0396be1-58ec-43ad-8d17-668c8218f8e4\") " pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.556179 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.555736 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e0396be1-58ec-43ad-8d17-668c8218f8e4-etc-sysctl-conf\") pod \"tuned-x2qr4\" (UID: \"e0396be1-58ec-43ad-8d17-668c8218f8e4\") " pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.556179 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.555760 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1153cddd-f227-4976-956c-db748068bdb4-host-var-lib-cni-multus\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.556179 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.555786 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lfzl\" (UniqueName: \"kubernetes.io/projected/fbed629e-a8e6-45f4-bad1-47e0bcbac11e-kube-api-access-9lfzl\") pod \"aws-ebs-csi-driver-node-8l5vp\" (UID: \"fbed629e-a8e6-45f4-bad1-47e0bcbac11e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8l5vp" Jul 07 16:23:02.556992 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.555813 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/58ab2695-8573-4288-8a98-9f4f6b173cf4-iptables-alerter-script\") pod \"iptables-alerter-tcwlz\" (UID: \"58ab2695-8573-4288-8a98-9f4f6b173cf4\") " pod="openshift-network-operator/iptables-alerter-tcwlz" Jul 07 16:23:02.556992 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.555838 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e0396be1-58ec-43ad-8d17-668c8218f8e4-etc-systemd\") pod \"tuned-x2qr4\" (UID: \"e0396be1-58ec-43ad-8d17-668c8218f8e4\") " pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.556992 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.555866 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46cm5\" (UniqueName: \"kubernetes.io/projected/0a4b79ff-9d4c-44d6-b582-ee10d09e9bbc-kube-api-access-46cm5\") pod \"node-ca-dmrqb\" (UID: \"0a4b79ff-9d4c-44d6-b582-ee10d09e9bbc\") " pod="openshift-image-registry/node-ca-dmrqb" Jul 07 16:23:02.556992 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.555892 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1153cddd-f227-4976-956c-db748068bdb4-multus-socket-dir-parent\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.556992 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.555934 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1153cddd-f227-4976-956c-db748068bdb4-hostroot\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.556992 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.555963 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-ovn-node-metrics-cert\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.556992 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.555997 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fbed629e-a8e6-45f4-bad1-47e0bcbac11e-etc-selinux\") pod \"aws-ebs-csi-driver-node-8l5vp\" (UID: \"fbed629e-a8e6-45f4-bad1-47e0bcbac11e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8l5vp" Jul 07 16:23:02.556992 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.556023 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e0396be1-58ec-43ad-8d17-668c8218f8e4-etc-tuned\") pod \"tuned-x2qr4\" (UID: \"e0396be1-58ec-43ad-8d17-668c8218f8e4\") " pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.556992 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.556049 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1153cddd-f227-4976-956c-db748068bdb4-multus-cni-dir\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.556992 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.556074 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-host-slash\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.556992 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.556100 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-host-run-ovn-kubernetes\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.556992 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.556125 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e0396be1-58ec-43ad-8d17-668c8218f8e4-run\") pod \"tuned-x2qr4\" (UID: \"e0396be1-58ec-43ad-8d17-668c8218f8e4\") " pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.556992 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.556151 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g946w\" (UniqueName: \"kubernetes.io/projected/e0396be1-58ec-43ad-8d17-668c8218f8e4-kube-api-access-g946w\") pod \"tuned-x2qr4\" (UID: \"e0396be1-58ec-43ad-8d17-668c8218f8e4\") " pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.556992 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.556179 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqdjk\" (UniqueName: \"kubernetes.io/projected/1153cddd-f227-4976-956c-db748068bdb4-kube-api-access-kqdjk\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.556992 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.556215 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e0396be1-58ec-43ad-8d17-668c8218f8e4-etc-sysctl-d\") pod \"tuned-x2qr4\" (UID: \"e0396be1-58ec-43ad-8d17-668c8218f8e4\") " pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.556992 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.556244 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-run-openvswitch\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.557799 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.556270 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-node-log\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.557799 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.556295 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dc1cd2ef-cb98-430b-bdee-883a3129c2af-dbus\") pod \"global-pull-secret-syncer-5s79k\" (UID: \"dc1cd2ef-cb98-430b-bdee-883a3129c2af\") " pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:23:02.557799 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.556352 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpxdc\" (UniqueName: \"kubernetes.io/projected/d305b801-d058-4ce5-b43b-062c1994a145-kube-api-access-rpxdc\") pod \"network-check-target-ssslq\" (UID: \"d305b801-d058-4ce5-b43b-062c1994a145\") " pod="openshift-network-diagnostics/network-check-target-ssslq" Jul 07 16:23:02.557799 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.556379 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7badfa9-b86b-4749-bae9-49c20ea917c3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c8ln2\" (UID: \"d7badfa9-b86b-4749-bae9-49c20ea917c3\") " pod="openshift-multus/multus-additional-cni-plugins-c8ln2" Jul 07 16:23:02.557799 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.556404 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0396be1-58ec-43ad-8d17-668c8218f8e4-tmp\") pod \"tuned-x2qr4\" (UID: \"e0396be1-58ec-43ad-8d17-668c8218f8e4\") " pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.557799 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.556430 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1153cddd-f227-4976-956c-db748068bdb4-multus-daemon-config\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.557799 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.556459 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-host-kubelet\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.557799 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.556484 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-log-socket\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.557799 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.556514 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d7badfa9-b86b-4749-bae9-49c20ea917c3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c8ln2\" (UID: \"d7badfa9-b86b-4749-bae9-49c20ea917c3\") " pod="openshift-multus/multus-additional-cni-plugins-c8ln2" Jul 07 16:23:02.557799 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.556541 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0396be1-58ec-43ad-8d17-668c8218f8e4-etc-kubernetes\") pod \"tuned-x2qr4\" (UID: \"e0396be1-58ec-43ad-8d17-668c8218f8e4\") " pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.557799 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.556567 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/37491c06-836e-4547-b86c-de4dcf91a433-hosts-file\") pod \"node-resolver-stndg\" (UID: \"37491c06-836e-4547-b86c-de4dcf91a433\") " pod="openshift-dns/node-resolver-stndg" Jul 07 16:23:02.557799 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.556595 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zssgm\" (UniqueName: \"kubernetes.io/projected/37491c06-836e-4547-b86c-de4dcf91a433-kube-api-access-zssgm\") pod \"node-resolver-stndg\" (UID: \"37491c06-836e-4547-b86c-de4dcf91a433\") " pod="openshift-dns/node-resolver-stndg" Jul 07 16:23:02.557799 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.556622 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dc1cd2ef-cb98-430b-bdee-883a3129c2af-kubelet-config\") pod \"global-pull-secret-syncer-5s79k\" (UID: \"dc1cd2ef-cb98-430b-bdee-883a3129c2af\") " pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:23:02.557799 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.556650 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d7badfa9-b86b-4749-bae9-49c20ea917c3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c8ln2\" (UID: \"d7badfa9-b86b-4749-bae9-49c20ea917c3\") " pod="openshift-multus/multus-additional-cni-plugins-c8ln2" Jul 07 16:23:02.557799 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.556680 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e0396be1-58ec-43ad-8d17-668c8218f8e4-host\") pod \"tuned-x2qr4\" (UID: \"e0396be1-58ec-43ad-8d17-668c8218f8e4\") " pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.557799 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.556707 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1153cddd-f227-4976-956c-db748068bdb4-system-cni-dir\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.558578 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.556735 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1153cddd-f227-4976-956c-db748068bdb4-multus-conf-dir\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.558578 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.557776 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 16:23:02.558578 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.558030 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 16:23:02.566121 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.566098 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 16:23:02.566229 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.566206 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 16:23:02.567337 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.566376 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 16:23:02.567337 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.566415 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gf4wd\"" Jul 07 16:23:02.567337 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.566102 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 16:23:02.567337 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.566779 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 16:23:02.567337 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.566791 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 16:23:02.567337 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.566861 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9qkpw\"" Jul 07 16:23:02.567337 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.566892 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-psp69\"" Jul 07 16:23:02.567337 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.566954 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 16:23:02.567337 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.567057 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 16:23:02.567337 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.567096 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 16:23:02.567337 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.567238 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8s7hp\"" Jul 07 16:23:02.567337 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.567283 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 16:23:02.568111 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.567351 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 16:23:02.568111 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.567487 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cnsb9\"" Jul 07 16:23:02.568111 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.567566 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 16:23:02.568111 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.567641 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 16:23:02.568111 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.567681 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 16:23:02.568111 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.567743 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 16:23:02.570368 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.570348 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 16:23:02.580517 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.580189 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 16:23:02.580517 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.580291 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4bvpz" Jul 07 16:23:02.599087 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.599015 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4bvpz" Jul 07 16:23:02.648706 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.648651 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-239.ec2.internal" event={"ID":"5b613f510a320d3ccc3ec79b1f26f861","Type":"ContainerStarted","Data":"98d4c1dec3825362c2b96ac526ede1c0c1678f5d89afa75fdf6a7c800758be3b"} Jul 07 16:23:02.650128 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.650007 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-239.ec2.internal" event={"ID":"4171bb48f6e62864b15f6dcc9fa0fe2a","Type":"ContainerStarted","Data":"87a556f4903a7a699f7faab3871cb5e13099678d7ea4bf455bd80d6cf434255c"} Jul 07 16:23:02.657506 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.657478 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7badfa9-b86b-4749-bae9-49c20ea917c3-cni-binary-copy\") pod \"multus-additional-cni-plugins-c8ln2\" (UID: \"d7badfa9-b86b-4749-bae9-49c20ea917c3\") " pod="openshift-multus/multus-additional-cni-plugins-c8ln2" Jul 07 16:23:02.657627 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.657518 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/58ab2695-8573-4288-8a98-9f4f6b173cf4-host-slash\") pod \"iptables-alerter-tcwlz\" (UID: \"58ab2695-8573-4288-8a98-9f4f6b173cf4\") " pod="openshift-network-operator/iptables-alerter-tcwlz" Jul 07 16:23:02.657627 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.657546 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37491c06-836e-4547-b86c-de4dcf91a433-tmp-dir\") pod \"node-resolver-stndg\" (UID: \"37491c06-836e-4547-b86c-de4dcf91a433\") " pod="openshift-dns/node-resolver-stndg" Jul 07 16:23:02.657627 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.657571 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1153cddd-f227-4976-956c-db748068bdb4-cni-binary-copy\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.657794 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.657629 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1153cddd-f227-4976-956c-db748068bdb4-host-run-netns\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.657794 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.657656 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1153cddd-f227-4976-956c-db748068bdb4-etc-kubernetes\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.657794 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.657681 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-run-systemd\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.657794 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.657706 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-host-cni-netd\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.657794 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.657733 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cpp2\" (UniqueName: \"kubernetes.io/projected/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-kube-api-access-2cpp2\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.657794 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.657758 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e0396be1-58ec-43ad-8d17-668c8218f8e4-etc-sysconfig\") pod \"tuned-x2qr4\" (UID: \"e0396be1-58ec-43ad-8d17-668c8218f8e4\") " pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.657794 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.657783 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1153cddd-f227-4976-956c-db748068bdb4-host-var-lib-cni-bin\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.658151 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.657820 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fbed629e-a8e6-45f4-bad1-47e0bcbac11e-socket-dir\") pod \"aws-ebs-csi-driver-node-8l5vp\" (UID: \"fbed629e-a8e6-45f4-bad1-47e0bcbac11e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8l5vp" Jul 07 16:23:02.658151 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.657848 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d679cf5e-f509-4cf8-94e0-325f8c4180ea-metrics-certs\") pod \"network-metrics-daemon-k2mr5\" (UID: \"d679cf5e-f509-4cf8-94e0-325f8c4180ea\") " pod="openshift-multus/network-metrics-daemon-k2mr5" Jul 07 16:23:02.658151 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.657874 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppsdb\" (UniqueName: \"kubernetes.io/projected/58ab2695-8573-4288-8a98-9f4f6b173cf4-kube-api-access-ppsdb\") pod \"iptables-alerter-tcwlz\" (UID: \"58ab2695-8573-4288-8a98-9f4f6b173cf4\") " pod="openshift-network-operator/iptables-alerter-tcwlz" Jul 07 16:23:02.658151 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.657906 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0a4b79ff-9d4c-44d6-b582-ee10d09e9bbc-host\") pod \"node-ca-dmrqb\" (UID: \"0a4b79ff-9d4c-44d6-b582-ee10d09e9bbc\") " pod="openshift-image-registry/node-ca-dmrqb" Jul 07 16:23:02.658151 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.657950 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-systemd-units\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.658151 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.657973 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-run-ovn\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.658151 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.657998 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1153cddd-f227-4976-956c-db748068bdb4-cnibin\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.658151 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.658029 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1153cddd-f227-4976-956c-db748068bdb4-os-release\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.658151 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.658058 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1153cddd-f227-4976-956c-db748068bdb4-host-run-multus-certs\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.658151 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.658087 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-ovnkube-script-lib\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.658151 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.658115 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e0396be1-58ec-43ad-8d17-668c8218f8e4-etc-modprobe-d\") pod \"tuned-x2qr4\" (UID: \"e0396be1-58ec-43ad-8d17-668c8218f8e4\") " pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.658151 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.658141 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e0396be1-58ec-43ad-8d17-668c8218f8e4-etc-sysctl-conf\") pod \"tuned-x2qr4\" (UID: \"e0396be1-58ec-43ad-8d17-668c8218f8e4\") " pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.658739 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.658165 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1153cddd-f227-4976-956c-db748068bdb4-host-var-lib-cni-multus\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.658739 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.658192 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lfzl\" (UniqueName: \"kubernetes.io/projected/fbed629e-a8e6-45f4-bad1-47e0bcbac11e-kube-api-access-9lfzl\") pod \"aws-ebs-csi-driver-node-8l5vp\" (UID: \"fbed629e-a8e6-45f4-bad1-47e0bcbac11e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8l5vp" Jul 07 16:23:02.658739 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.658225 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/58ab2695-8573-4288-8a98-9f4f6b173cf4-iptables-alerter-script\") pod \"iptables-alerter-tcwlz\" (UID: \"58ab2695-8573-4288-8a98-9f4f6b173cf4\") " pod="openshift-network-operator/iptables-alerter-tcwlz" Jul 07 16:23:02.658739 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.658252 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e0396be1-58ec-43ad-8d17-668c8218f8e4-etc-systemd\") pod \"tuned-x2qr4\" (UID: \"e0396be1-58ec-43ad-8d17-668c8218f8e4\") " pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.658739 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.658277 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46cm5\" (UniqueName: \"kubernetes.io/projected/0a4b79ff-9d4c-44d6-b582-ee10d09e9bbc-kube-api-access-46cm5\") pod \"node-ca-dmrqb\" (UID: \"0a4b79ff-9d4c-44d6-b582-ee10d09e9bbc\") " pod="openshift-image-registry/node-ca-dmrqb" Jul 07 16:23:02.658739 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.658330 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1153cddd-f227-4976-956c-db748068bdb4-multus-socket-dir-parent\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.658739 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.658362 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1153cddd-f227-4976-956c-db748068bdb4-host-run-netns\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.658739 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.658385 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1153cddd-f227-4976-956c-db748068bdb4-hostroot\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.658739 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.658362 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1153cddd-f227-4976-956c-db748068bdb4-etc-kubernetes\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.658739 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.658426 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-ovn-node-metrics-cert\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.658739 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.658452 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1153cddd-f227-4976-956c-db748068bdb4-hostroot\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.658739 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:02.658456 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:23:02.658739 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.658456 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fbed629e-a8e6-45f4-bad1-47e0bcbac11e-etc-selinux\") pod \"aws-ebs-csi-driver-node-8l5vp\" (UID: \"fbed629e-a8e6-45f4-bad1-47e0bcbac11e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8l5vp" Jul 07 16:23:02.658739 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.658533 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1153cddd-f227-4976-956c-db748068bdb4-host-var-lib-cni-bin\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.658739 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:02.658557 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d679cf5e-f509-4cf8-94e0-325f8c4180ea-metrics-certs podName:d679cf5e-f509-4cf8-94e0-325f8c4180ea nodeName:}" failed. No retries permitted until 2026-07-07 16:23:03.158517629 +0000 UTC m=+3.098027035 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d679cf5e-f509-4cf8-94e0-325f8c4180ea-metrics-certs") pod "network-metrics-daemon-k2mr5" (UID: "d679cf5e-f509-4cf8-94e0-325f8c4180ea") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:23:02.658739 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.658653 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fbed629e-a8e6-45f4-bad1-47e0bcbac11e-socket-dir\") pod \"aws-ebs-csi-driver-node-8l5vp\" (UID: \"fbed629e-a8e6-45f4-bad1-47e0bcbac11e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8l5vp" Jul 07 16:23:02.658739 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.658706 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/58ab2695-8573-4288-8a98-9f4f6b173cf4-host-slash\") pod \"iptables-alerter-tcwlz\" (UID: \"58ab2695-8573-4288-8a98-9f4f6b173cf4\") " pod="openshift-network-operator/iptables-alerter-tcwlz" Jul 07 16:23:02.659631 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.658747 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-run-systemd\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.659631 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.658788 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-host-cni-netd\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.659631 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.658817 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37491c06-836e-4547-b86c-de4dcf91a433-tmp-dir\") pod \"node-resolver-stndg\" (UID: \"37491c06-836e-4547-b86c-de4dcf91a433\") " pod="openshift-dns/node-resolver-stndg" Jul 07 16:23:02.659631 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.658845 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-run-ovn\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.659631 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.658868 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e0396be1-58ec-43ad-8d17-668c8218f8e4-etc-tuned\") pod \"tuned-x2qr4\" (UID: \"e0396be1-58ec-43ad-8d17-668c8218f8e4\") " pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.659631 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.658909 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1153cddd-f227-4976-956c-db748068bdb4-cnibin\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.659631 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.659010 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1153cddd-f227-4976-956c-db748068bdb4-os-release\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.659631 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.659056 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1153cddd-f227-4976-956c-db748068bdb4-host-run-multus-certs\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.659631 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.659090 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0a4b79ff-9d4c-44d6-b582-ee10d09e9bbc-host\") pod \"node-ca-dmrqb\" (UID: \"0a4b79ff-9d4c-44d6-b582-ee10d09e9bbc\") " pod="openshift-image-registry/node-ca-dmrqb" Jul 07 16:23:02.659631 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.659410 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-systemd-units\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.659631 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.659465 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1153cddd-f227-4976-956c-db748068bdb4-host-var-lib-cni-multus\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.659631 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.659531 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1153cddd-f227-4976-956c-db748068bdb4-cni-binary-copy\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.659631 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.659541 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e0396be1-58ec-43ad-8d17-668c8218f8e4-etc-systemd\") pod \"tuned-x2qr4\" (UID: \"e0396be1-58ec-43ad-8d17-668c8218f8e4\") " pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.659631 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.659600 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e0396be1-58ec-43ad-8d17-668c8218f8e4-etc-sysconfig\") pod \"tuned-x2qr4\" (UID: \"e0396be1-58ec-43ad-8d17-668c8218f8e4\") " pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.659631 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.659616 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e0396be1-58ec-43ad-8d17-668c8218f8e4-etc-sysctl-conf\") pod \"tuned-x2qr4\" (UID: \"e0396be1-58ec-43ad-8d17-668c8218f8e4\") " pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.660385 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.659679 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1153cddd-f227-4976-956c-db748068bdb4-multus-cni-dir\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.660385 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.659710 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-host-slash\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.660385 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.659735 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-host-run-ovn-kubernetes\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.660385 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.659761 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e0396be1-58ec-43ad-8d17-668c8218f8e4-run\") pod \"tuned-x2qr4\" (UID: \"e0396be1-58ec-43ad-8d17-668c8218f8e4\") " pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.660385 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.659759 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-ovnkube-script-lib\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.660385 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.659791 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g946w\" (UniqueName: \"kubernetes.io/projected/e0396be1-58ec-43ad-8d17-668c8218f8e4-kube-api-access-g946w\") pod \"tuned-x2qr4\" (UID: \"e0396be1-58ec-43ad-8d17-668c8218f8e4\") " pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.660385 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.659831 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 16:23:02.660385 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.659923 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e0396be1-58ec-43ad-8d17-668c8218f8e4-etc-modprobe-d\") pod \"tuned-x2qr4\" (UID: \"e0396be1-58ec-43ad-8d17-668c8218f8e4\") " pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.660385 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.659925 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/58ab2695-8573-4288-8a98-9f4f6b173cf4-iptables-alerter-script\") pod \"iptables-alerter-tcwlz\" (UID: \"58ab2695-8573-4288-8a98-9f4f6b173cf4\") " pod="openshift-network-operator/iptables-alerter-tcwlz" Jul 07 16:23:02.660385 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.659971 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1153cddd-f227-4976-956c-db748068bdb4-multus-cni-dir\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.660385 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.660002 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7badfa9-b86b-4749-bae9-49c20ea917c3-cni-binary-copy\") pod \"multus-additional-cni-plugins-c8ln2\" (UID: \"d7badfa9-b86b-4749-bae9-49c20ea917c3\") " pod="openshift-multus/multus-additional-cni-plugins-c8ln2" Jul 07 16:23:02.660385 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.660020 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-host-run-ovn-kubernetes\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.660385 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.660080 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1153cddd-f227-4976-956c-db748068bdb4-multus-socket-dir-parent\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.660385 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.660083 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e0396be1-58ec-43ad-8d17-668c8218f8e4-run\") pod \"tuned-x2qr4\" (UID: \"e0396be1-58ec-43ad-8d17-668c8218f8e4\") " pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.660385 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.660093 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fbed629e-a8e6-45f4-bad1-47e0bcbac11e-etc-selinux\") pod \"aws-ebs-csi-driver-node-8l5vp\" (UID: \"fbed629e-a8e6-45f4-bad1-47e0bcbac11e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8l5vp" Jul 07 16:23:02.660385 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.660123 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-host-slash\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.660385 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.660159 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqdjk\" (UniqueName: \"kubernetes.io/projected/1153cddd-f227-4976-956c-db748068bdb4-kube-api-access-kqdjk\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.660385 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.660200 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e0396be1-58ec-43ad-8d17-668c8218f8e4-etc-sysctl-d\") pod \"tuned-x2qr4\" (UID: \"e0396be1-58ec-43ad-8d17-668c8218f8e4\") " pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.661276 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.660279 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-run-openvswitch\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.661276 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.660333 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-node-log\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.661276 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.660350 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dc1cd2ef-cb98-430b-bdee-883a3129c2af-dbus\") pod \"global-pull-secret-syncer-5s79k\" (UID: \"dc1cd2ef-cb98-430b-bdee-883a3129c2af\") " pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:23:02.661276 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.660368 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e0396be1-58ec-43ad-8d17-668c8218f8e4-etc-sysctl-d\") pod \"tuned-x2qr4\" (UID: \"e0396be1-58ec-43ad-8d17-668c8218f8e4\") " pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.661276 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.660375 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpxdc\" (UniqueName: \"kubernetes.io/projected/d305b801-d058-4ce5-b43b-062c1994a145-kube-api-access-rpxdc\") pod \"network-check-target-ssslq\" (UID: \"d305b801-d058-4ce5-b43b-062c1994a145\") " pod="openshift-network-diagnostics/network-check-target-ssslq" Jul 07 16:23:02.661276 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.660427 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7badfa9-b86b-4749-bae9-49c20ea917c3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c8ln2\" (UID: \"d7badfa9-b86b-4749-bae9-49c20ea917c3\") " pod="openshift-multus/multus-additional-cni-plugins-c8ln2" Jul 07 16:23:02.661276 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.660432 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-run-openvswitch\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.661276 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.660482 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-node-log\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.661276 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.660490 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0396be1-58ec-43ad-8d17-668c8218f8e4-tmp\") pod \"tuned-x2qr4\" (UID: \"e0396be1-58ec-43ad-8d17-668c8218f8e4\") " pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.661276 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.660510 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1153cddd-f227-4976-956c-db748068bdb4-multus-daemon-config\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.661276 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.660560 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-host-kubelet\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.661276 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.660581 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-log-socket\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.661276 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.660591 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7badfa9-b86b-4749-bae9-49c20ea917c3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c8ln2\" (UID: \"d7badfa9-b86b-4749-bae9-49c20ea917c3\") " pod="openshift-multus/multus-additional-cni-plugins-c8ln2" Jul 07 16:23:02.661276 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.660598 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d7badfa9-b86b-4749-bae9-49c20ea917c3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c8ln2\" (UID: \"d7badfa9-b86b-4749-bae9-49c20ea917c3\") " pod="openshift-multus/multus-additional-cni-plugins-c8ln2" Jul 07 16:23:02.661276 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.660617 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0396be1-58ec-43ad-8d17-668c8218f8e4-etc-kubernetes\") pod \"tuned-x2qr4\" (UID: \"e0396be1-58ec-43ad-8d17-668c8218f8e4\") " pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.661276 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.660633 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/37491c06-836e-4547-b86c-de4dcf91a433-hosts-file\") pod \"node-resolver-stndg\" (UID: \"37491c06-836e-4547-b86c-de4dcf91a433\") " pod="openshift-dns/node-resolver-stndg" Jul 07 16:23:02.661276 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.660656 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zssgm\" (UniqueName: \"kubernetes.io/projected/37491c06-836e-4547-b86c-de4dcf91a433-kube-api-access-zssgm\") pod \"node-resolver-stndg\" (UID: \"37491c06-836e-4547-b86c-de4dcf91a433\") " pod="openshift-dns/node-resolver-stndg" Jul 07 16:23:02.662145 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.660674 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dc1cd2ef-cb98-430b-bdee-883a3129c2af-kubelet-config\") pod \"global-pull-secret-syncer-5s79k\" (UID: \"dc1cd2ef-cb98-430b-bdee-883a3129c2af\") " pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:23:02.662145 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.660691 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d7badfa9-b86b-4749-bae9-49c20ea917c3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c8ln2\" (UID: \"d7badfa9-b86b-4749-bae9-49c20ea917c3\") " pod="openshift-multus/multus-additional-cni-plugins-c8ln2" Jul 07 16:23:02.662145 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.660706 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e0396be1-58ec-43ad-8d17-668c8218f8e4-host\") pod \"tuned-x2qr4\" (UID: \"e0396be1-58ec-43ad-8d17-668c8218f8e4\") " pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.662145 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.660778 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1153cddd-f227-4976-956c-db748068bdb4-system-cni-dir\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.662145 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.660796 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1153cddd-f227-4976-956c-db748068bdb4-multus-conf-dir\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.662145 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.660822 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-env-overrides\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.662145 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.660839 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fbed629e-a8e6-45f4-bad1-47e0bcbac11e-device-dir\") pod \"aws-ebs-csi-driver-node-8l5vp\" (UID: \"fbed629e-a8e6-45f4-bad1-47e0bcbac11e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8l5vp" Jul 07 16:23:02.662145 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.660856 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc1cd2ef-cb98-430b-bdee-883a3129c2af-original-pull-secret\") pod \"global-pull-secret-syncer-5s79k\" (UID: \"dc1cd2ef-cb98-430b-bdee-883a3129c2af\") " pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:23:02.662145 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.660875 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7badfa9-b86b-4749-bae9-49c20ea917c3-cnibin\") pod \"multus-additional-cni-plugins-c8ln2\" (UID: \"d7badfa9-b86b-4749-bae9-49c20ea917c3\") " pod="openshift-multus/multus-additional-cni-plugins-c8ln2" Jul 07 16:23:02.662145 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.660909 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckmkm\" (UniqueName: \"kubernetes.io/projected/d7badfa9-b86b-4749-bae9-49c20ea917c3-kube-api-access-ckmkm\") pod \"multus-additional-cni-plugins-c8ln2\" (UID: \"d7badfa9-b86b-4749-bae9-49c20ea917c3\") " pod="openshift-multus/multus-additional-cni-plugins-c8ln2" Jul 07 16:23:02.662145 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.660944 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e0396be1-58ec-43ad-8d17-668c8218f8e4-lib-modules\") pod \"tuned-x2qr4\" (UID: \"e0396be1-58ec-43ad-8d17-668c8218f8e4\") " pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.662145 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.660948 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dc1cd2ef-cb98-430b-bdee-883a3129c2af-dbus\") pod \"global-pull-secret-syncer-5s79k\" (UID: \"dc1cd2ef-cb98-430b-bdee-883a3129c2af\") " pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:23:02.662145 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.660997 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7262abd9-903a-4ecc-aece-7ede44afecf7-agent-certs\") pod \"konnectivity-agent-dzl6r\" (UID: \"7262abd9-903a-4ecc-aece-7ede44afecf7\") " pod="kube-system/konnectivity-agent-dzl6r" Jul 07 16:23:02.662145 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.660999 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7badfa9-b86b-4749-bae9-49c20ea917c3-cnibin\") pod \"multus-additional-cni-plugins-c8ln2\" (UID: \"d7badfa9-b86b-4749-bae9-49c20ea917c3\") " pod="openshift-multus/multus-additional-cni-plugins-c8ln2" Jul 07 16:23:02.662145 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.660947 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-log-socket\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.662145 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.661025 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.662145 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.661052 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7badfa9-b86b-4749-bae9-49c20ea917c3-system-cni-dir\") pod \"multus-additional-cni-plugins-c8ln2\" (UID: \"d7badfa9-b86b-4749-bae9-49c20ea917c3\") " pod="openshift-multus/multus-additional-cni-plugins-c8ln2" Jul 07 16:23:02.663017 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.661067 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fbed629e-a8e6-45f4-bad1-47e0bcbac11e-device-dir\") pod \"aws-ebs-csi-driver-node-8l5vp\" (UID: \"fbed629e-a8e6-45f4-bad1-47e0bcbac11e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8l5vp" Jul 07 16:23:02.663017 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.661080 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d7badfa9-b86b-4749-bae9-49c20ea917c3-os-release\") pod \"multus-additional-cni-plugins-c8ln2\" (UID: \"d7badfa9-b86b-4749-bae9-49c20ea917c3\") " pod="openshift-multus/multus-additional-cni-plugins-c8ln2" Jul 07 16:23:02.663017 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.661112 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0a4b79ff-9d4c-44d6-b582-ee10d09e9bbc-serviceca\") pod \"node-ca-dmrqb\" (UID: \"0a4b79ff-9d4c-44d6-b582-ee10d09e9bbc\") " pod="openshift-image-registry/node-ca-dmrqb" Jul 07 16:23:02.663017 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.661142 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1153cddd-f227-4976-956c-db748068bdb4-host-run-k8s-cni-cncf-io\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.663017 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.661170 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1153cddd-f227-4976-956c-db748068bdb4-host-var-lib-kubelet\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.663017 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.661198 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-host-cni-bin\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.663017 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.661200 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e0396be1-58ec-43ad-8d17-668c8218f8e4-lib-modules\") pod \"tuned-x2qr4\" (UID: \"e0396be1-58ec-43ad-8d17-668c8218f8e4\") " pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.663017 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.661113 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1153cddd-f227-4976-956c-db748068bdb4-multus-conf-dir\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.663017 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.661330 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-env-overrides\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.663017 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.661409 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d7badfa9-b86b-4749-bae9-49c20ea917c3-os-release\") pod \"multus-additional-cni-plugins-c8ln2\" (UID: \"d7badfa9-b86b-4749-bae9-49c20ea917c3\") " pod="openshift-multus/multus-additional-cni-plugins-c8ln2" Jul 07 16:23:02.663017 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.661421 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d7badfa9-b86b-4749-bae9-49c20ea917c3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c8ln2\" (UID: \"d7badfa9-b86b-4749-bae9-49c20ea917c3\") " pod="openshift-multus/multus-additional-cni-plugins-c8ln2" Jul 07 16:23:02.663017 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.661452 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw69r\" (UniqueName: \"kubernetes.io/projected/d679cf5e-f509-4cf8-94e0-325f8c4180ea-kube-api-access-bw69r\") pod \"network-metrics-daemon-k2mr5\" (UID: \"d679cf5e-f509-4cf8-94e0-325f8c4180ea\") " pod="openshift-multus/network-metrics-daemon-k2mr5" Jul 07 16:23:02.663017 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.661481 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0396be1-58ec-43ad-8d17-668c8218f8e4-var-lib-kubelet\") pod \"tuned-x2qr4\" (UID: \"e0396be1-58ec-43ad-8d17-668c8218f8e4\") " pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.663017 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.661509 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7262abd9-903a-4ecc-aece-7ede44afecf7-konnectivity-ca\") pod \"konnectivity-agent-dzl6r\" (UID: \"7262abd9-903a-4ecc-aece-7ede44afecf7\") " pod="kube-system/konnectivity-agent-dzl6r" Jul 07 16:23:02.663017 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.661515 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e0396be1-58ec-43ad-8d17-668c8218f8e4-host\") pod \"tuned-x2qr4\" (UID: \"e0396be1-58ec-43ad-8d17-668c8218f8e4\") " pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.663017 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.661538 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-var-lib-openvswitch\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.663017 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.661554 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1153cddd-f227-4976-956c-db748068bdb4-host-run-k8s-cni-cncf-io\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.663909 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.661566 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-etc-openvswitch\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.663909 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.661593 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1153cddd-f227-4976-956c-db748068bdb4-host-var-lib-kubelet\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.663909 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.661596 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-ovnkube-config\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.663909 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.661625 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fbed629e-a8e6-45f4-bad1-47e0bcbac11e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8l5vp\" (UID: \"fbed629e-a8e6-45f4-bad1-47e0bcbac11e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8l5vp" Jul 07 16:23:02.663909 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.661629 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-host-cni-bin\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.663909 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.661654 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fbed629e-a8e6-45f4-bad1-47e0bcbac11e-registration-dir\") pod \"aws-ebs-csi-driver-node-8l5vp\" (UID: \"fbed629e-a8e6-45f4-bad1-47e0bcbac11e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8l5vp" Jul 07 16:23:02.663909 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.661673 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/37491c06-836e-4547-b86c-de4dcf91a433-hosts-file\") pod \"node-resolver-stndg\" (UID: \"37491c06-836e-4547-b86c-de4dcf91a433\") " pod="openshift-dns/node-resolver-stndg" Jul 07 16:23:02.663909 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.661685 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fbed629e-a8e6-45f4-bad1-47e0bcbac11e-sys-fs\") pod \"aws-ebs-csi-driver-node-8l5vp\" (UID: \"fbed629e-a8e6-45f4-bad1-47e0bcbac11e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8l5vp" Jul 07 16:23:02.663909 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.661695 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1153cddd-f227-4976-956c-db748068bdb4-multus-daemon-config\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.663909 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.661712 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e0396be1-58ec-43ad-8d17-668c8218f8e4-sys\") pod \"tuned-x2qr4\" (UID: \"e0396be1-58ec-43ad-8d17-668c8218f8e4\") " pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.663909 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.661723 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1153cddd-f227-4976-956c-db748068bdb4-system-cni-dir\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.663909 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.661801 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-host-run-netns\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.663909 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.661827 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fbed629e-a8e6-45f4-bad1-47e0bcbac11e-sys-fs\") pod \"aws-ebs-csi-driver-node-8l5vp\" (UID: \"fbed629e-a8e6-45f4-bad1-47e0bcbac11e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8l5vp" Jul 07 16:23:02.663909 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.661870 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fbed629e-a8e6-45f4-bad1-47e0bcbac11e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8l5vp\" (UID: \"fbed629e-a8e6-45f4-bad1-47e0bcbac11e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8l5vp" Jul 07 16:23:02.663909 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.661891 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-host-run-netns\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.663909 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.661926 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dc1cd2ef-cb98-430b-bdee-883a3129c2af-kubelet-config\") pod \"global-pull-secret-syncer-5s79k\" (UID: \"dc1cd2ef-cb98-430b-bdee-883a3129c2af\") " pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:23:02.663909 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.661933 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-host-kubelet\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.663909 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.661931 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0a4b79ff-9d4c-44d6-b582-ee10d09e9bbc-serviceca\") pod \"node-ca-dmrqb\" (UID: \"0a4b79ff-9d4c-44d6-b582-ee10d09e9bbc\") " pod="openshift-image-registry/node-ca-dmrqb" Jul 07 16:23:02.664862 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.661974 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0396be1-58ec-43ad-8d17-668c8218f8e4-var-lib-kubelet\") pod \"tuned-x2qr4\" (UID: \"e0396be1-58ec-43ad-8d17-668c8218f8e4\") " pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.664862 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.661973 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-etc-openvswitch\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.664862 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:02.662011 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:23:02.664862 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.662016 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e0396be1-58ec-43ad-8d17-668c8218f8e4-sys\") pod \"tuned-x2qr4\" (UID: \"e0396be1-58ec-43ad-8d17-668c8218f8e4\") " pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.664862 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.662060 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-var-lib-openvswitch\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.664862 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:02.662075 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc1cd2ef-cb98-430b-bdee-883a3129c2af-original-pull-secret podName:dc1cd2ef-cb98-430b-bdee-883a3129c2af nodeName:}" failed. No retries permitted until 2026-07-07 16:23:03.162056886 +0000 UTC m=+3.101566293 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc1cd2ef-cb98-430b-bdee-883a3129c2af-original-pull-secret") pod "global-pull-secret-syncer-5s79k" (UID: "dc1cd2ef-cb98-430b-bdee-883a3129c2af") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:23:02.664862 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.662108 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0396be1-58ec-43ad-8d17-668c8218f8e4-etc-kubernetes\") pod \"tuned-x2qr4\" (UID: \"e0396be1-58ec-43ad-8d17-668c8218f8e4\") " pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.664862 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.662140 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.664862 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.662202 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fbed629e-a8e6-45f4-bad1-47e0bcbac11e-registration-dir\") pod \"aws-ebs-csi-driver-node-8l5vp\" (UID: \"fbed629e-a8e6-45f4-bad1-47e0bcbac11e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8l5vp" Jul 07 16:23:02.664862 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.662240 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7badfa9-b86b-4749-bae9-49c20ea917c3-system-cni-dir\") pod \"multus-additional-cni-plugins-c8ln2\" (UID: \"d7badfa9-b86b-4749-bae9-49c20ea917c3\") " pod="openshift-multus/multus-additional-cni-plugins-c8ln2" Jul 07 16:23:02.664862 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.662486 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-ovnkube-config\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.664862 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.662629 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7262abd9-903a-4ecc-aece-7ede44afecf7-konnectivity-ca\") pod \"konnectivity-agent-dzl6r\" (UID: \"7262abd9-903a-4ecc-aece-7ede44afecf7\") " pod="kube-system/konnectivity-agent-dzl6r" Jul 07 16:23:02.664862 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.662690 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d7badfa9-b86b-4749-bae9-49c20ea917c3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c8ln2\" (UID: \"d7badfa9-b86b-4749-bae9-49c20ea917c3\") " pod="openshift-multus/multus-additional-cni-plugins-c8ln2" Jul 07 16:23:02.664862 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.663679 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e0396be1-58ec-43ad-8d17-668c8218f8e4-etc-tuned\") pod \"tuned-x2qr4\" (UID: \"e0396be1-58ec-43ad-8d17-668c8218f8e4\") " pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.666568 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.666538 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0396be1-58ec-43ad-8d17-668c8218f8e4-tmp\") pod \"tuned-x2qr4\" (UID: \"e0396be1-58ec-43ad-8d17-668c8218f8e4\") " pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.666719 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.666646 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-ovn-node-metrics-cert\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.666826 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.666778 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7262abd9-903a-4ecc-aece-7ede44afecf7-agent-certs\") pod \"konnectivity-agent-dzl6r\" (UID: \"7262abd9-903a-4ecc-aece-7ede44afecf7\") " pod="kube-system/konnectivity-agent-dzl6r" Jul 07 16:23:02.703963 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.703870 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckmkm\" (UniqueName: \"kubernetes.io/projected/d7badfa9-b86b-4749-bae9-49c20ea917c3-kube-api-access-ckmkm\") pod \"multus-additional-cni-plugins-c8ln2\" (UID: \"d7badfa9-b86b-4749-bae9-49c20ea917c3\") " pod="openshift-multus/multus-additional-cni-plugins-c8ln2" Jul 07 16:23:02.705197 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.705027 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g946w\" (UniqueName: \"kubernetes.io/projected/e0396be1-58ec-43ad-8d17-668c8218f8e4-kube-api-access-g946w\") pod \"tuned-x2qr4\" (UID: \"e0396be1-58ec-43ad-8d17-668c8218f8e4\") " pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.706364 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.706174 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cpp2\" (UniqueName: \"kubernetes.io/projected/41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d-kube-api-access-2cpp2\") pod \"ovnkube-node-4llwj\" (UID: \"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.706591 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.706529 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw69r\" (UniqueName: \"kubernetes.io/projected/d679cf5e-f509-4cf8-94e0-325f8c4180ea-kube-api-access-bw69r\") pod \"network-metrics-daemon-k2mr5\" (UID: \"d679cf5e-f509-4cf8-94e0-325f8c4180ea\") " pod="openshift-multus/network-metrics-daemon-k2mr5" Jul 07 16:23:02.709222 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.709189 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqdjk\" (UniqueName: \"kubernetes.io/projected/1153cddd-f227-4976-956c-db748068bdb4-kube-api-access-kqdjk\") pod \"multus-t7dz8\" (UID: \"1153cddd-f227-4976-956c-db748068bdb4\") " pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.709733 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:02.709705 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:23:02.709733 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:02.709732 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:23:02.709882 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:02.709747 2564 projected.go:196] Error preparing data for projected volume kube-api-access-rpxdc for pod openshift-network-diagnostics/network-check-target-ssslq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:23:02.709882 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:02.709828 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d305b801-d058-4ce5-b43b-062c1994a145-kube-api-access-rpxdc podName:d305b801-d058-4ce5-b43b-062c1994a145 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:03.209807288 +0000 UTC m=+3.149316691 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rpxdc" (UniqueName: "kubernetes.io/projected/d305b801-d058-4ce5-b43b-062c1994a145-kube-api-access-rpxdc") pod "network-check-target-ssslq" (UID: "d305b801-d058-4ce5-b43b-062c1994a145") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:23:02.710707 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.710684 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lfzl\" (UniqueName: \"kubernetes.io/projected/fbed629e-a8e6-45f4-bad1-47e0bcbac11e-kube-api-access-9lfzl\") pod \"aws-ebs-csi-driver-node-8l5vp\" (UID: \"fbed629e-a8e6-45f4-bad1-47e0bcbac11e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8l5vp" Jul 07 16:23:02.713047 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.712987 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46cm5\" (UniqueName: \"kubernetes.io/projected/0a4b79ff-9d4c-44d6-b582-ee10d09e9bbc-kube-api-access-46cm5\") pod \"node-ca-dmrqb\" (UID: \"0a4b79ff-9d4c-44d6-b582-ee10d09e9bbc\") " pod="openshift-image-registry/node-ca-dmrqb" Jul 07 16:23:02.714808 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.714785 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zssgm\" (UniqueName: \"kubernetes.io/projected/37491c06-836e-4547-b86c-de4dcf91a433-kube-api-access-zssgm\") pod \"node-resolver-stndg\" (UID: \"37491c06-836e-4547-b86c-de4dcf91a433\") " pod="openshift-dns/node-resolver-stndg" Jul 07 16:23:02.732694 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.732663 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppsdb\" (UniqueName: \"kubernetes.io/projected/58ab2695-8573-4288-8a98-9f4f6b173cf4-kube-api-access-ppsdb\") pod \"iptables-alerter-tcwlz\" (UID: \"58ab2695-8573-4288-8a98-9f4f6b173cf4\") " pod="openshift-network-operator/iptables-alerter-tcwlz" Jul 07 16:23:02.831539 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.831499 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c8ln2" Jul 07 16:23:02.839983 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.839956 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:02.841551 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:02.841522 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7badfa9_b86b_4749_bae9_49c20ea917c3.slice/crio-59b1cdf1d8f7fa312a8739f591bb1a9b9a9eeb46683f0ce49c977e345bd481fa WatchSource:0}: Error finding container 59b1cdf1d8f7fa312a8739f591bb1a9b9a9eeb46683f0ce49c977e345bd481fa: Status 404 returned error can't find the container with id 59b1cdf1d8f7fa312a8739f591bb1a9b9a9eeb46683f0ce49c977e345bd481fa Jul 07 16:23:02.848053 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:02.848027 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41cbeeeb_07fd_4ddc_8979_c9f6c96bfb7d.slice/crio-e1c22c4f00904d03c392ae41fc1b0441384f780355383031e984b776819ff9ab WatchSource:0}: Error finding container e1c22c4f00904d03c392ae41fc1b0441384f780355383031e984b776819ff9ab: Status 404 returned error can't find the container with id e1c22c4f00904d03c392ae41fc1b0441384f780355383031e984b776819ff9ab Jul 07 16:23:02.850495 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.850474 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tcwlz" Jul 07 16:23:02.859042 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:02.859015 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58ab2695_8573_4288_8a98_9f4f6b173cf4.slice/crio-de4b321c37670314a5b4afbd802ca0da52b128a4586a7f65a21fbf49ebdb0c1d WatchSource:0}: Error finding container de4b321c37670314a5b4afbd802ca0da52b128a4586a7f65a21fbf49ebdb0c1d: Status 404 returned error can't find the container with id de4b321c37670314a5b4afbd802ca0da52b128a4586a7f65a21fbf49ebdb0c1d Jul 07 16:23:02.864885 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.864861 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" Jul 07 16:23:02.872958 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:02.872929 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0396be1_58ec_43ad_8d17_668c8218f8e4.slice/crio-4060fabc4454ffd27147ffab4f019dcb020daeaf647fbbd30515c2364d69bbb6 WatchSource:0}: Error finding container 4060fabc4454ffd27147ffab4f019dcb020daeaf647fbbd30515c2364d69bbb6: Status 404 returned error can't find the container with id 4060fabc4454ffd27147ffab4f019dcb020daeaf647fbbd30515c2364d69bbb6 Jul 07 16:23:02.877620 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.877597 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-stndg" Jul 07 16:23:02.883388 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.883364 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:23:02.885824 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.885801 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8l5vp" Jul 07 16:23:02.887878 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:02.887754 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37491c06_836e_4547_b86c_de4dcf91a433.slice/crio-83d55159c47d86300338da046d19ee4e81198f2935462199a2325b8d0879d48f WatchSource:0}: Error finding container 83d55159c47d86300338da046d19ee4e81198f2935462199a2325b8d0879d48f: Status 404 returned error can't find the container with id 83d55159c47d86300338da046d19ee4e81198f2935462199a2325b8d0879d48f Jul 07 16:23:02.893614 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.893442 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dmrqb" Jul 07 16:23:02.895075 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:02.895048 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbed629e_a8e6_45f4_bad1_47e0bcbac11e.slice/crio-e7bc8c80ec1bd8d5b9b8111c2e83a583c547da1a2def8d2edda0e1271fa5ed0e WatchSource:0}: Error finding container e7bc8c80ec1bd8d5b9b8111c2e83a583c547da1a2def8d2edda0e1271fa5ed0e: Status 404 returned error can't find the container with id e7bc8c80ec1bd8d5b9b8111c2e83a583c547da1a2def8d2edda0e1271fa5ed0e Jul 07 16:23:02.902011 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.901985 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t7dz8" Jul 07 16:23:02.904872 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:02.904847 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a4b79ff_9d4c_44d6_b582_ee10d09e9bbc.slice/crio-000bc2195b7143abb1501fb660dab1ca32048eaf7600cd5016c5979cd404a8e4 WatchSource:0}: Error finding container 000bc2195b7143abb1501fb660dab1ca32048eaf7600cd5016c5979cd404a8e4: Status 404 returned error can't find the container with id 000bc2195b7143abb1501fb660dab1ca32048eaf7600cd5016c5979cd404a8e4 Jul 07 16:23:02.907175 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:02.907149 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dzl6r" Jul 07 16:23:02.917105 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:02.917073 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1153cddd_f227_4976_956c_db748068bdb4.slice/crio-987fddefbdc5297d6d099226cb1deadabc806fdba5c3f555f7f3387dfff86e42 WatchSource:0}: Error finding container 987fddefbdc5297d6d099226cb1deadabc806fdba5c3f555f7f3387dfff86e42: Status 404 returned error can't find the container with id 987fddefbdc5297d6d099226cb1deadabc806fdba5c3f555f7f3387dfff86e42 Jul 07 16:23:02.922541 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:02.922513 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7262abd9_903a_4ecc_aece_7ede44afecf7.slice/crio-b6f7f619ab72f19c6e8e4caeb1e90ccf28648ee580e8c277d86945dcaf5e642c WatchSource:0}: Error finding container b6f7f619ab72f19c6e8e4caeb1e90ccf28648ee580e8c277d86945dcaf5e642c: Status 404 returned error can't find the container with id b6f7f619ab72f19c6e8e4caeb1e90ccf28648ee580e8c277d86945dcaf5e642c Jul 07 16:23:03.165843 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:03.165755 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc1cd2ef-cb98-430b-bdee-883a3129c2af-original-pull-secret\") pod \"global-pull-secret-syncer-5s79k\" (UID: \"dc1cd2ef-cb98-430b-bdee-883a3129c2af\") " pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:23:03.165843 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:03.165803 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d679cf5e-f509-4cf8-94e0-325f8c4180ea-metrics-certs\") pod \"network-metrics-daemon-k2mr5\" (UID: \"d679cf5e-f509-4cf8-94e0-325f8c4180ea\") " pod="openshift-multus/network-metrics-daemon-k2mr5" Jul 07 16:23:03.166058 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:03.165932 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:23:03.166058 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:03.165935 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:23:03.166058 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:03.166010 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc1cd2ef-cb98-430b-bdee-883a3129c2af-original-pull-secret podName:dc1cd2ef-cb98-430b-bdee-883a3129c2af nodeName:}" failed. No retries permitted until 2026-07-07 16:23:04.165988056 +0000 UTC m=+4.105497474 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc1cd2ef-cb98-430b-bdee-883a3129c2af-original-pull-secret") pod "global-pull-secret-syncer-5s79k" (UID: "dc1cd2ef-cb98-430b-bdee-883a3129c2af") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:23:03.166058 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:03.166032 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d679cf5e-f509-4cf8-94e0-325f8c4180ea-metrics-certs podName:d679cf5e-f509-4cf8-94e0-325f8c4180ea nodeName:}" failed. No retries permitted until 2026-07-07 16:23:04.166019369 +0000 UTC m=+4.105528783 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d679cf5e-f509-4cf8-94e0-325f8c4180ea-metrics-certs") pod "network-metrics-daemon-k2mr5" (UID: "d679cf5e-f509-4cf8-94e0-325f8c4180ea") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:23:03.266958 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:03.266918 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpxdc\" (UniqueName: \"kubernetes.io/projected/d305b801-d058-4ce5-b43b-062c1994a145-kube-api-access-rpxdc\") pod \"network-check-target-ssslq\" (UID: \"d305b801-d058-4ce5-b43b-062c1994a145\") " pod="openshift-network-diagnostics/network-check-target-ssslq" Jul 07 16:23:03.267152 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:03.267126 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:23:03.267203 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:03.267153 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:23:03.267203 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:03.267164 2564 projected.go:196] Error preparing data for projected volume kube-api-access-rpxdc for pod openshift-network-diagnostics/network-check-target-ssslq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:23:03.267270 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:03.267231 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d305b801-d058-4ce5-b43b-062c1994a145-kube-api-access-rpxdc podName:d305b801-d058-4ce5-b43b-062c1994a145 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:04.26721191 +0000 UTC m=+4.206721529 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rpxdc" (UniqueName: "kubernetes.io/projected/d305b801-d058-4ce5-b43b-062c1994a145-kube-api-access-rpxdc") pod "network-check-target-ssslq" (UID: "d305b801-d058-4ce5-b43b-062c1994a145") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:23:03.601377 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:03.601252 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 16:18:02 +0000 UTC" deadline="2028-02-10 02:16:45.381675888 +0000 UTC" Jul 07 16:23:03.601377 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:03.601318 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13977h53m41.78036347s" Jul 07 16:23:03.644344 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:03.644310 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssslq" Jul 07 16:23:03.644344 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:03.644337 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:23:03.644598 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:03.644455 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssslq" podUID="d305b801-d058-4ce5-b43b-062c1994a145" Jul 07 16:23:03.644598 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:03.644568 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s79k" podUID="dc1cd2ef-cb98-430b-bdee-883a3129c2af" Jul 07 16:23:03.644696 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:03.644644 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2mr5" Jul 07 16:23:03.644782 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:03.644758 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2mr5" podUID="d679cf5e-f509-4cf8-94e0-325f8c4180ea" Jul 07 16:23:03.653658 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:03.653625 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dzl6r" event={"ID":"7262abd9-903a-4ecc-aece-7ede44afecf7","Type":"ContainerStarted","Data":"b6f7f619ab72f19c6e8e4caeb1e90ccf28648ee580e8c277d86945dcaf5e642c"} Jul 07 16:23:03.654978 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:03.654950 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8l5vp" event={"ID":"fbed629e-a8e6-45f4-bad1-47e0bcbac11e","Type":"ContainerStarted","Data":"e7bc8c80ec1bd8d5b9b8111c2e83a583c547da1a2def8d2edda0e1271fa5ed0e"} Jul 07 16:23:03.656390 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:03.656349 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-stndg" event={"ID":"37491c06-836e-4547-b86c-de4dcf91a433","Type":"ContainerStarted","Data":"83d55159c47d86300338da046d19ee4e81198f2935462199a2325b8d0879d48f"} Jul 07 16:23:03.657832 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:03.657810 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tcwlz" event={"ID":"58ab2695-8573-4288-8a98-9f4f6b173cf4","Type":"ContainerStarted","Data":"de4b321c37670314a5b4afbd802ca0da52b128a4586a7f65a21fbf49ebdb0c1d"} Jul 07 16:23:03.659398 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:03.659356 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" event={"ID":"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d","Type":"ContainerStarted","Data":"e1c22c4f00904d03c392ae41fc1b0441384f780355383031e984b776819ff9ab"} Jul 07 16:23:03.661026 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:03.660984 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c8ln2" event={"ID":"d7badfa9-b86b-4749-bae9-49c20ea917c3","Type":"ContainerStarted","Data":"59b1cdf1d8f7fa312a8739f591bb1a9b9a9eeb46683f0ce49c977e345bd481fa"} Jul 07 16:23:03.662462 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:03.662439 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t7dz8" event={"ID":"1153cddd-f227-4976-956c-db748068bdb4","Type":"ContainerStarted","Data":"987fddefbdc5297d6d099226cb1deadabc806fdba5c3f555f7f3387dfff86e42"} Jul 07 16:23:03.663818 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:03.663795 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dmrqb" event={"ID":"0a4b79ff-9d4c-44d6-b582-ee10d09e9bbc","Type":"ContainerStarted","Data":"000bc2195b7143abb1501fb660dab1ca32048eaf7600cd5016c5979cd404a8e4"} Jul 07 16:23:03.665505 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:03.665460 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" event={"ID":"e0396be1-58ec-43ad-8d17-668c8218f8e4","Type":"ContainerStarted","Data":"4060fabc4454ffd27147ffab4f019dcb020daeaf647fbbd30515c2364d69bbb6"} Jul 07 16:23:04.175961 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:04.175925 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc1cd2ef-cb98-430b-bdee-883a3129c2af-original-pull-secret\") pod \"global-pull-secret-syncer-5s79k\" (UID: \"dc1cd2ef-cb98-430b-bdee-883a3129c2af\") " pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:23:04.175961 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:04.175976 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d679cf5e-f509-4cf8-94e0-325f8c4180ea-metrics-certs\") pod \"network-metrics-daemon-k2mr5\" (UID: \"d679cf5e-f509-4cf8-94e0-325f8c4180ea\") " pod="openshift-multus/network-metrics-daemon-k2mr5" Jul 07 16:23:04.176295 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:04.176076 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:23:04.176295 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:04.176123 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d679cf5e-f509-4cf8-94e0-325f8c4180ea-metrics-certs podName:d679cf5e-f509-4cf8-94e0-325f8c4180ea nodeName:}" failed. No retries permitted until 2026-07-07 16:23:06.176109671 +0000 UTC m=+6.115619074 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d679cf5e-f509-4cf8-94e0-325f8c4180ea-metrics-certs") pod "network-metrics-daemon-k2mr5" (UID: "d679cf5e-f509-4cf8-94e0-325f8c4180ea") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:23:04.176541 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:04.176486 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:23:04.176541 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:04.176543 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc1cd2ef-cb98-430b-bdee-883a3129c2af-original-pull-secret podName:dc1cd2ef-cb98-430b-bdee-883a3129c2af nodeName:}" failed. No retries permitted until 2026-07-07 16:23:06.176527339 +0000 UTC m=+6.116036744 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc1cd2ef-cb98-430b-bdee-883a3129c2af-original-pull-secret") pod "global-pull-secret-syncer-5s79k" (UID: "dc1cd2ef-cb98-430b-bdee-883a3129c2af") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:23:04.276544 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:04.276505 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpxdc\" (UniqueName: \"kubernetes.io/projected/d305b801-d058-4ce5-b43b-062c1994a145-kube-api-access-rpxdc\") pod \"network-check-target-ssslq\" (UID: \"d305b801-d058-4ce5-b43b-062c1994a145\") " pod="openshift-network-diagnostics/network-check-target-ssslq" Jul 07 16:23:04.276738 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:04.276716 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:23:04.276738 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:04.276738 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:23:04.276868 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:04.276753 2564 projected.go:196] Error preparing data for projected volume kube-api-access-rpxdc for pod openshift-network-diagnostics/network-check-target-ssslq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:23:04.276868 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:04.276817 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d305b801-d058-4ce5-b43b-062c1994a145-kube-api-access-rpxdc podName:d305b801-d058-4ce5-b43b-062c1994a145 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:06.276797469 +0000 UTC m=+6.216306876 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rpxdc" (UniqueName: "kubernetes.io/projected/d305b801-d058-4ce5-b43b-062c1994a145-kube-api-access-rpxdc") pod "network-check-target-ssslq" (UID: "d305b801-d058-4ce5-b43b-062c1994a145") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:23:04.604778 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:04.604170 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 16:18:02 +0000 UTC" deadline="2028-02-22 13:37:51.267506314 +0000 UTC" Jul 07 16:23:04.604778 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:04.604501 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14277h14m46.663013606s" Jul 07 16:23:04.682645 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:04.682155 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-239.ec2.internal" event={"ID":"4171bb48f6e62864b15f6dcc9fa0fe2a","Type":"ContainerStarted","Data":"b2efca61d9fd2109c59ae861e57b917dc1f598ef75590e6021244332488f7f63"} Jul 07 16:23:04.701780 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:04.701717 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-239.ec2.internal" podStartSLOduration=2.701697386 podStartE2EDuration="2.701697386s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:23:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:04.701549217 +0000 UTC m=+4.641058645" watchObservedRunningTime="2026-07-07 16:23:04.701697386 +0000 UTC m=+4.641206813" Jul 07 16:23:05.643856 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:05.643821 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssslq" Jul 07 16:23:05.644361 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:05.643953 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssslq" podUID="d305b801-d058-4ce5-b43b-062c1994a145" Jul 07 16:23:05.644361 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:05.644308 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:23:05.644493 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:05.644407 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s79k" podUID="dc1cd2ef-cb98-430b-bdee-883a3129c2af" Jul 07 16:23:05.644493 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:05.644474 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2mr5" Jul 07 16:23:05.644597 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:05.644561 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2mr5" podUID="d679cf5e-f509-4cf8-94e0-325f8c4180ea" Jul 07 16:23:05.695345 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:05.693981 2564 generic.go:356] "Generic (PLEG): container finished" podID="5b613f510a320d3ccc3ec79b1f26f861" containerID="babe330b8a43ae7009d3d4d2f302d633a87b0a244bf05d09a1a21e036fd68867" exitCode=0 Jul 07 16:23:05.695345 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:05.694085 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-239.ec2.internal" event={"ID":"5b613f510a320d3ccc3ec79b1f26f861","Type":"ContainerDied","Data":"babe330b8a43ae7009d3d4d2f302d633a87b0a244bf05d09a1a21e036fd68867"} Jul 07 16:23:06.195607 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:06.195523 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d679cf5e-f509-4cf8-94e0-325f8c4180ea-metrics-certs\") pod \"network-metrics-daemon-k2mr5\" (UID: \"d679cf5e-f509-4cf8-94e0-325f8c4180ea\") " pod="openshift-multus/network-metrics-daemon-k2mr5" Jul 07 16:23:06.195607 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:06.195586 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc1cd2ef-cb98-430b-bdee-883a3129c2af-original-pull-secret\") pod \"global-pull-secret-syncer-5s79k\" (UID: \"dc1cd2ef-cb98-430b-bdee-883a3129c2af\") " pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:23:06.195854 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:06.195690 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:23:06.195854 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:06.195740 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc1cd2ef-cb98-430b-bdee-883a3129c2af-original-pull-secret podName:dc1cd2ef-cb98-430b-bdee-883a3129c2af nodeName:}" failed. No retries permitted until 2026-07-07 16:23:10.195726473 +0000 UTC m=+10.135235876 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc1cd2ef-cb98-430b-bdee-883a3129c2af-original-pull-secret") pod "global-pull-secret-syncer-5s79k" (UID: "dc1cd2ef-cb98-430b-bdee-883a3129c2af") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:23:06.195854 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:06.195782 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:23:06.195854 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:06.195806 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d679cf5e-f509-4cf8-94e0-325f8c4180ea-metrics-certs podName:d679cf5e-f509-4cf8-94e0-325f8c4180ea nodeName:}" failed. No retries permitted until 2026-07-07 16:23:10.195798802 +0000 UTC m=+10.135308205 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d679cf5e-f509-4cf8-94e0-325f8c4180ea-metrics-certs") pod "network-metrics-daemon-k2mr5" (UID: "d679cf5e-f509-4cf8-94e0-325f8c4180ea") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:23:06.296732 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:06.296691 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpxdc\" (UniqueName: \"kubernetes.io/projected/d305b801-d058-4ce5-b43b-062c1994a145-kube-api-access-rpxdc\") pod \"network-check-target-ssslq\" (UID: \"d305b801-d058-4ce5-b43b-062c1994a145\") " pod="openshift-network-diagnostics/network-check-target-ssslq" Jul 07 16:23:06.296967 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:06.296944 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:23:06.297072 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:06.296971 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:23:06.297072 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:06.296986 2564 projected.go:196] Error preparing data for projected volume kube-api-access-rpxdc for pod openshift-network-diagnostics/network-check-target-ssslq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:23:06.297072 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:06.297051 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d305b801-d058-4ce5-b43b-062c1994a145-kube-api-access-rpxdc podName:d305b801-d058-4ce5-b43b-062c1994a145 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:10.297031396 +0000 UTC m=+10.236540802 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rpxdc" (UniqueName: "kubernetes.io/projected/d305b801-d058-4ce5-b43b-062c1994a145-kube-api-access-rpxdc") pod "network-check-target-ssslq" (UID: "d305b801-d058-4ce5-b43b-062c1994a145") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:23:06.706501 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:06.706369 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-239.ec2.internal" event={"ID":"5b613f510a320d3ccc3ec79b1f26f861","Type":"ContainerStarted","Data":"f6137578c0c2a279d4a8ed7eac8d20d6672c80e1116f08942a45f3d9957c45f2"} Jul 07 16:23:07.644642 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:07.644605 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssslq" Jul 07 16:23:07.644840 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:07.644746 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssslq" podUID="d305b801-d058-4ce5-b43b-062c1994a145" Jul 07 16:23:07.644840 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:07.644822 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:23:07.644943 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:07.644911 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s79k" podUID="dc1cd2ef-cb98-430b-bdee-883a3129c2af" Jul 07 16:23:07.644978 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:07.644956 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2mr5" Jul 07 16:23:07.645064 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:07.645041 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2mr5" podUID="d679cf5e-f509-4cf8-94e0-325f8c4180ea" Jul 07 16:23:09.643809 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:09.643771 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssslq" Jul 07 16:23:09.644284 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:09.643903 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssslq" podUID="d305b801-d058-4ce5-b43b-062c1994a145" Jul 07 16:23:09.644380 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:09.644363 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:23:09.644473 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:09.644452 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s79k" podUID="dc1cd2ef-cb98-430b-bdee-883a3129c2af" Jul 07 16:23:09.644526 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:09.644510 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2mr5" Jul 07 16:23:09.644579 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:09.644563 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2mr5" podUID="d679cf5e-f509-4cf8-94e0-325f8c4180ea" Jul 07 16:23:10.234337 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:10.234299 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc1cd2ef-cb98-430b-bdee-883a3129c2af-original-pull-secret\") pod \"global-pull-secret-syncer-5s79k\" (UID: \"dc1cd2ef-cb98-430b-bdee-883a3129c2af\") " pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:23:10.234499 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:10.234365 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d679cf5e-f509-4cf8-94e0-325f8c4180ea-metrics-certs\") pod \"network-metrics-daemon-k2mr5\" (UID: \"d679cf5e-f509-4cf8-94e0-325f8c4180ea\") " pod="openshift-multus/network-metrics-daemon-k2mr5" Jul 07 16:23:10.234499 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:10.234471 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:23:10.234499 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:10.234471 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:23:10.234649 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:10.234528 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d679cf5e-f509-4cf8-94e0-325f8c4180ea-metrics-certs podName:d679cf5e-f509-4cf8-94e0-325f8c4180ea nodeName:}" failed. No retries permitted until 2026-07-07 16:23:18.234513954 +0000 UTC m=+18.174023355 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d679cf5e-f509-4cf8-94e0-325f8c4180ea-metrics-certs") pod "network-metrics-daemon-k2mr5" (UID: "d679cf5e-f509-4cf8-94e0-325f8c4180ea") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:23:10.234649 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:10.234544 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc1cd2ef-cb98-430b-bdee-883a3129c2af-original-pull-secret podName:dc1cd2ef-cb98-430b-bdee-883a3129c2af nodeName:}" failed. No retries permitted until 2026-07-07 16:23:18.234535246 +0000 UTC m=+18.174044648 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc1cd2ef-cb98-430b-bdee-883a3129c2af-original-pull-secret") pod "global-pull-secret-syncer-5s79k" (UID: "dc1cd2ef-cb98-430b-bdee-883a3129c2af") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:23:10.335201 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:10.335108 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpxdc\" (UniqueName: \"kubernetes.io/projected/d305b801-d058-4ce5-b43b-062c1994a145-kube-api-access-rpxdc\") pod \"network-check-target-ssslq\" (UID: \"d305b801-d058-4ce5-b43b-062c1994a145\") " pod="openshift-network-diagnostics/network-check-target-ssslq" Jul 07 16:23:10.335386 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:10.335286 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:23:10.335386 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:10.335308 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:23:10.335386 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:10.335318 2564 projected.go:196] Error preparing data for projected volume kube-api-access-rpxdc for pod openshift-network-diagnostics/network-check-target-ssslq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:23:10.335386 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:10.335372 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d305b801-d058-4ce5-b43b-062c1994a145-kube-api-access-rpxdc podName:d305b801-d058-4ce5-b43b-062c1994a145 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:18.335359516 +0000 UTC m=+18.274868917 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rpxdc" (UniqueName: "kubernetes.io/projected/d305b801-d058-4ce5-b43b-062c1994a145-kube-api-access-rpxdc") pod "network-check-target-ssslq" (UID: "d305b801-d058-4ce5-b43b-062c1994a145") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:23:11.644545 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:11.644376 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:23:11.644545 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:11.644415 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2mr5" Jul 07 16:23:11.644545 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:11.644417 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssslq" Jul 07 16:23:11.644545 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:11.644504 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s79k" podUID="dc1cd2ef-cb98-430b-bdee-883a3129c2af" Jul 07 16:23:11.645048 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:11.644609 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2mr5" podUID="d679cf5e-f509-4cf8-94e0-325f8c4180ea" Jul 07 16:23:11.645048 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:11.644691 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssslq" podUID="d305b801-d058-4ce5-b43b-062c1994a145" Jul 07 16:23:13.644486 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:13.644444 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssslq" Jul 07 16:23:13.645017 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:13.644485 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:23:13.645017 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:13.644568 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssslq" podUID="d305b801-d058-4ce5-b43b-062c1994a145" Jul 07 16:23:13.645017 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:13.644619 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s79k" podUID="dc1cd2ef-cb98-430b-bdee-883a3129c2af" Jul 07 16:23:13.645017 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:13.644676 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2mr5" Jul 07 16:23:13.645017 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:13.644762 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2mr5" podUID="d679cf5e-f509-4cf8-94e0-325f8c4180ea" Jul 07 16:23:15.643712 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:15.643679 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssslq" Jul 07 16:23:15.644154 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:15.643789 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:23:15.644154 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:15.643799 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssslq" podUID="d305b801-d058-4ce5-b43b-062c1994a145" Jul 07 16:23:15.644154 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:15.643884 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s79k" podUID="dc1cd2ef-cb98-430b-bdee-883a3129c2af" Jul 07 16:23:15.644154 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:15.643932 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2mr5" Jul 07 16:23:15.644154 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:15.643994 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2mr5" podUID="d679cf5e-f509-4cf8-94e0-325f8c4180ea" Jul 07 16:23:17.644410 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:17.644368 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssslq" Jul 07 16:23:17.644915 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:17.644368 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2mr5" Jul 07 16:23:17.644915 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:17.644492 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssslq" podUID="d305b801-d058-4ce5-b43b-062c1994a145" Jul 07 16:23:17.644915 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:17.644369 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:23:17.644915 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:17.644615 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2mr5" podUID="d679cf5e-f509-4cf8-94e0-325f8c4180ea" Jul 07 16:23:17.644915 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:17.644724 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s79k" podUID="dc1cd2ef-cb98-430b-bdee-883a3129c2af" Jul 07 16:23:18.294271 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:18.294222 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc1cd2ef-cb98-430b-bdee-883a3129c2af-original-pull-secret\") pod \"global-pull-secret-syncer-5s79k\" (UID: \"dc1cd2ef-cb98-430b-bdee-883a3129c2af\") " pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:23:18.294541 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:18.294296 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d679cf5e-f509-4cf8-94e0-325f8c4180ea-metrics-certs\") pod \"network-metrics-daemon-k2mr5\" (UID: \"d679cf5e-f509-4cf8-94e0-325f8c4180ea\") " pod="openshift-multus/network-metrics-daemon-k2mr5" Jul 07 16:23:18.294541 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:18.294356 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:23:18.294541 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:18.294432 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc1cd2ef-cb98-430b-bdee-883a3129c2af-original-pull-secret podName:dc1cd2ef-cb98-430b-bdee-883a3129c2af nodeName:}" failed. No retries permitted until 2026-07-07 16:23:34.294413686 +0000 UTC m=+34.233923102 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc1cd2ef-cb98-430b-bdee-883a3129c2af-original-pull-secret") pod "global-pull-secret-syncer-5s79k" (UID: "dc1cd2ef-cb98-430b-bdee-883a3129c2af") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:23:18.294541 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:18.294440 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:23:18.294541 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:18.294485 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d679cf5e-f509-4cf8-94e0-325f8c4180ea-metrics-certs podName:d679cf5e-f509-4cf8-94e0-325f8c4180ea nodeName:}" failed. No retries permitted until 2026-07-07 16:23:34.294471956 +0000 UTC m=+34.233981357 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d679cf5e-f509-4cf8-94e0-325f8c4180ea-metrics-certs") pod "network-metrics-daemon-k2mr5" (UID: "d679cf5e-f509-4cf8-94e0-325f8c4180ea") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:23:18.395364 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:18.395323 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpxdc\" (UniqueName: \"kubernetes.io/projected/d305b801-d058-4ce5-b43b-062c1994a145-kube-api-access-rpxdc\") pod \"network-check-target-ssslq\" (UID: \"d305b801-d058-4ce5-b43b-062c1994a145\") " pod="openshift-network-diagnostics/network-check-target-ssslq" Jul 07 16:23:18.395561 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:18.395523 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:23:18.395561 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:18.395551 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:23:18.395669 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:18.395564 2564 projected.go:196] Error preparing data for projected volume kube-api-access-rpxdc for pod openshift-network-diagnostics/network-check-target-ssslq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:23:18.395669 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:18.395633 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d305b801-d058-4ce5-b43b-062c1994a145-kube-api-access-rpxdc podName:d305b801-d058-4ce5-b43b-062c1994a145 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:34.395613724 +0000 UTC m=+34.335123128 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rpxdc" (UniqueName: "kubernetes.io/projected/d305b801-d058-4ce5-b43b-062c1994a145-kube-api-access-rpxdc") pod "network-check-target-ssslq" (UID: "d305b801-d058-4ce5-b43b-062c1994a145") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:23:19.644015 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:19.643978 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2mr5" Jul 07 16:23:19.644481 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:19.643987 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssslq" Jul 07 16:23:19.644481 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:19.644143 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2mr5" podUID="d679cf5e-f509-4cf8-94e0-325f8c4180ea" Jul 07 16:23:19.644481 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:19.644184 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:23:19.644481 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:19.644289 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssslq" podUID="d305b801-d058-4ce5-b43b-062c1994a145" Jul 07 16:23:19.644481 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:19.644365 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s79k" podUID="dc1cd2ef-cb98-430b-bdee-883a3129c2af" Jul 07 16:23:21.644352 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:21.644310 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssslq" Jul 07 16:23:21.644787 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:21.644310 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2mr5" Jul 07 16:23:21.644787 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:21.644430 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssslq" podUID="d305b801-d058-4ce5-b43b-062c1994a145" Jul 07 16:23:21.644787 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:21.644312 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:23:21.644787 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:21.644517 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2mr5" podUID="d679cf5e-f509-4cf8-94e0-325f8c4180ea" Jul 07 16:23:21.644787 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:21.644558 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s79k" podUID="dc1cd2ef-cb98-430b-bdee-883a3129c2af" Jul 07 16:23:23.644452 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:23.644285 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssslq" Jul 07 16:23:23.644850 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:23.644291 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:23:23.644850 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:23.644518 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssslq" podUID="d305b801-d058-4ce5-b43b-062c1994a145" Jul 07 16:23:23.644850 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:23.644297 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2mr5" Jul 07 16:23:23.644850 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:23.644593 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s79k" podUID="dc1cd2ef-cb98-430b-bdee-883a3129c2af" Jul 07 16:23:23.644850 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:23.644720 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2mr5" podUID="d679cf5e-f509-4cf8-94e0-325f8c4180ea" Jul 07 16:23:23.752704 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:23.752672 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-stndg" event={"ID":"37491c06-836e-4547-b86c-de4dcf91a433","Type":"ContainerStarted","Data":"9f7e68b7d097e368995cc9efa8a156c3b76573f154acf4cc9e4b7a77a3b851c0"} Jul 07 16:23:23.754096 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:23.754070 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" event={"ID":"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d","Type":"ContainerStarted","Data":"793b4fab4b2ac9aa26a7f1e37267852d725d80eb8dea2b7726b00a8e58e02859"} Jul 07 16:23:23.755960 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:23.755916 2564 generic.go:356] "Generic (PLEG): container finished" podID="d7badfa9-b86b-4749-bae9-49c20ea917c3" containerID="53d59f27fed66fc9782d2dea6cd7062fffd358251ac396cd41e2ae4822b89975" exitCode=0 Jul 07 16:23:23.756067 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:23.756050 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c8ln2" event={"ID":"d7badfa9-b86b-4749-bae9-49c20ea917c3","Type":"ContainerDied","Data":"53d59f27fed66fc9782d2dea6cd7062fffd358251ac396cd41e2ae4822b89975"} Jul 07 16:23:23.760564 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:23.760500 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t7dz8" event={"ID":"1153cddd-f227-4976-956c-db748068bdb4","Type":"ContainerStarted","Data":"6a663201a673893dea697e333186de710892b310daae418e733eb865b6c9f11b"} Jul 07 16:23:23.761876 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:23.761849 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dmrqb" event={"ID":"0a4b79ff-9d4c-44d6-b582-ee10d09e9bbc","Type":"ContainerStarted","Data":"613a52d264f723d879d098a7cd3899ff7f5eeb8aafac2b415ef3082140dedf05"} Jul 07 16:23:23.763069 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:23.763050 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" event={"ID":"e0396be1-58ec-43ad-8d17-668c8218f8e4","Type":"ContainerStarted","Data":"40a24dd3a6ffb0a8ff1006c6e6e0533ca23c54ccb0d8ce9a1bd42a6b36fa27f3"} Jul 07 16:23:23.764370 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:23.764346 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dzl6r" event={"ID":"7262abd9-903a-4ecc-aece-7ede44afecf7","Type":"ContainerStarted","Data":"ee380f91ac099811493117d1e1f55b1d30c86cce5ce6f387162ccc1c90786f97"} Jul 07 16:23:23.765548 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:23.765527 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8l5vp" event={"ID":"fbed629e-a8e6-45f4-bad1-47e0bcbac11e","Type":"ContainerStarted","Data":"19eacb2f5c71beff1f7970f1c81d6ba8d09932b2f6983cfcb4f954c5d0d9abba"} Jul 07 16:23:23.782151 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:23.782112 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-stndg" podStartSLOduration=2.507181819 podStartE2EDuration="22.782100389s" totalImagesPullingTime="20.27491857s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:23:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:23.782028878 +0000 UTC m=+23.721538301" watchObservedRunningTime="2026-07-07 16:23:23.782100389 +0000 UTC m=+23.721609812" Jul 07 16:23:23.782266 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:23.782208 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-239.ec2.internal" podStartSLOduration=21.782204041 podStartE2EDuration="21.782204041s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:23:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:06.743920507 +0000 UTC m=+6.683429936" watchObservedRunningTime="2026-07-07 16:23:23.782204041 +0000 UTC m=+23.721713484" Jul 07 16:23:23.848171 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:23.848091 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dmrqb" podStartSLOduration=2.56023981 podStartE2EDuration="22.848075969s" totalImagesPullingTime="20.287836159s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:23:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:23.847824668 +0000 UTC m=+23.787334091" watchObservedRunningTime="2026-07-07 16:23:23.848075969 +0000 UTC m=+23.787585392" Jul 07 16:23:23.876572 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:23.876526 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-t7dz8" podStartSLOduration=2.531216925 podStartE2EDuration="22.876513202s" totalImagesPullingTime="20.345296277s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:23:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:23.876029667 +0000 UTC m=+23.815539091" watchObservedRunningTime="2026-07-07 16:23:23.876513202 +0000 UTC m=+23.816022624" Jul 07 16:23:23.907349 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:23.907308 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dzl6r" podStartSLOduration=2.635328485 podStartE2EDuration="22.907293676s" totalImagesPullingTime="20.271965191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:23:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:23.90709938 +0000 UTC m=+23.846608805" watchObservedRunningTime="2026-07-07 16:23:23.907293676 +0000 UTC m=+23.846803099" Jul 07 16:23:23.984214 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:23.983978 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dzl6r" Jul 07 16:23:24.059159 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:24.059126 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:24.236363 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:24.236272 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:24.658328 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:24.658288 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:24.765329 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:24.765290 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:24.769358 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:24.769325 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tcwlz" event={"ID":"58ab2695-8573-4288-8a98-9f4f6b173cf4","Type":"ContainerStarted","Data":"eaa2b2063f82128a49fe76dbed9007fb8ded200628ca13cab3ce10527a287b58"} Jul 07 16:23:24.773023 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:24.772955 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4llwj_41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d/ovn-acl-logging/0.log" Jul 07 16:23:24.773427 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:24.773408 2564 generic.go:356] "Generic (PLEG): container finished" podID="41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d" containerID="536add9834c6bb31e89465a053afcf58a634c809ce6ed508f8de643af4fbe939" exitCode=1 Jul 07 16:23:24.773570 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:24.773543 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" event={"ID":"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d","Type":"ContainerStarted","Data":"1f36993de6fb30920b2e50356bb0f337316d1eaa0581fc109173083442175fbe"} Jul 07 16:23:24.773644 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:24.773628 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" event={"ID":"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d","Type":"ContainerStarted","Data":"19c03cec6fd10202fe0d9331f5c42811b882160292eebd51bbccd731375a0e34"} Jul 07 16:23:24.773698 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:24.773683 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" event={"ID":"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d","Type":"ContainerStarted","Data":"e9c428dca428ba428a6754839c7fc282e29b441a60a3f9b3ec5114abcbc61e35"} Jul 07 16:23:24.773778 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:24.773732 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" event={"ID":"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d","Type":"ContainerStarted","Data":"f2d4a098cd57cd10375f9cba9e99ad7d931f19fe1e7ebd75e163a695ac14edab"} Jul 07 16:23:24.773847 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:24.773784 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" event={"ID":"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d","Type":"ContainerDied","Data":"536add9834c6bb31e89465a053afcf58a634c809ce6ed508f8de643af4fbe939"} Jul 07 16:23:24.788775 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:24.788680 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-x2qr4" podStartSLOduration=3.467344542 podStartE2EDuration="23.78866575s" totalImagesPullingTime="20.321321208s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:23:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:23.93677913 +0000 UTC m=+23.876288554" watchObservedRunningTime="2026-07-07 16:23:24.78866575 +0000 UTC m=+24.728175172" Jul 07 16:23:24.789347 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:24.789309 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tcwlz" podStartSLOduration=3.453820455 podStartE2EDuration="23.789298058s" totalImagesPullingTime="20.335477603s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:23:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:24.789008947 +0000 UTC m=+24.728518371" watchObservedRunningTime="2026-07-07 16:23:24.789298058 +0000 UTC m=+24.728807506" Jul 07 16:23:24.812185 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:24.812152 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 16:23:24.965149 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:24.965117 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:25.066023 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:25.065937 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:25.167944 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:25.167899 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:25.353560 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:25.353520 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:25.435690 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:25.435623 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:25.536335 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:25.536224 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T16:23:24.812181262Z","UUID":"4c610496-487b-4520-a2d3-f68b2c411aa3","Handler":null,"Name":"","Endpoint":""} Jul 07 16:23:25.537986 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:25.537962 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 16:23:25.538106 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:25.538010 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 16:23:25.644111 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:25.644030 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssslq" Jul 07 16:23:25.644111 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:25.644057 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2mr5" Jul 07 16:23:25.644476 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:25.644050 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:23:25.644476 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:25.644180 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssslq" podUID="d305b801-d058-4ce5-b43b-062c1994a145" Jul 07 16:23:25.644476 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:25.644325 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s79k" podUID="dc1cd2ef-cb98-430b-bdee-883a3129c2af" Jul 07 16:23:25.644476 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:25.644408 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2mr5" podUID="d679cf5e-f509-4cf8-94e0-325f8c4180ea" Jul 07 16:23:25.777329 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:25.777289 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8l5vp" event={"ID":"fbed629e-a8e6-45f4-bad1-47e0bcbac11e","Type":"ContainerStarted","Data":"57fa3a4449f741de3ba8edc5b19d1e7b70dc6cc643802135d9e79d97c9da6208"} Jul 07 16:23:25.883245 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:25.883187 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:25.994358 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:25.994322 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:26.103905 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:26.103869 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:26.160008 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:26.159935 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-stndg_37491c06-836e-4547-b86c-de4dcf91a433/dns-node-resolver/0.log" Jul 07 16:23:26.352091 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:26.352047 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:26.781996 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:26.781956 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8l5vp" event={"ID":"fbed629e-a8e6-45f4-bad1-47e0bcbac11e","Type":"ContainerStarted","Data":"7791ee7f46ec6a57b71f8f9da02580bded108926ccaea62c6157957999d279de"} Jul 07 16:23:26.786938 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:26.786912 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4llwj_41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d/ovn-acl-logging/0.log" Jul 07 16:23:26.787531 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:26.787463 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" event={"ID":"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d","Type":"ContainerStarted","Data":"0acba628ad9a1dccd82e2c4d6d7ec7d48a6257465d1c069ceff71c7e93a71b1e"} Jul 07 16:23:27.031966 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:27.031794 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:27.147068 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:27.147031 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:27.159355 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:27.159334 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dmrqb_0a4b79ff-9d4c-44d6-b582-ee10d09e9bbc/node-ca/0.log" Jul 07 16:23:27.643772 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:27.643735 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssslq" Jul 07 16:23:27.643987 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:27.643835 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:23:27.643987 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:27.643841 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2mr5" Jul 07 16:23:27.643987 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:27.643920 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s79k" podUID="dc1cd2ef-cb98-430b-bdee-883a3129c2af" Jul 07 16:23:27.644133 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:27.643836 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssslq" podUID="d305b801-d058-4ce5-b43b-062c1994a145" Jul 07 16:23:27.644133 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:27.644027 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2mr5" podUID="d679cf5e-f509-4cf8-94e0-325f8c4180ea" Jul 07 16:23:27.882421 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:27.882365 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:27.982450 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:27.982369 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:28.046292 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:28.046260 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dzl6r" Jul 07 16:23:28.046885 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:28.046862 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dzl6r" Jul 07 16:23:28.065619 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:28.065576 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8l5vp" podStartSLOduration=4.568733001 podStartE2EDuration="27.065561274s" totalImagesPullingTime="22.496828273s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:23:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:26.808331186 +0000 UTC m=+26.747840608" watchObservedRunningTime="2026-07-07 16:23:28.065561274 +0000 UTC m=+28.005070730" Jul 07 16:23:28.072790 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:28.072758 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:28.157169 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:28.157142 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:28.792802 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:28.792771 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dzl6r" Jul 07 16:23:29.316641 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:29.316603 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:29.497441 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:29.497404 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:29.619842 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:29.619810 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:29.644285 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:29.643804 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssslq" Jul 07 16:23:29.644285 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:29.643815 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2mr5" Jul 07 16:23:29.644285 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:29.643815 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:23:29.644285 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:29.643933 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssslq" podUID="d305b801-d058-4ce5-b43b-062c1994a145" Jul 07 16:23:29.644285 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:29.644070 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s79k" podUID="dc1cd2ef-cb98-430b-bdee-883a3129c2af" Jul 07 16:23:29.644285 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:29.644159 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2mr5" podUID="d679cf5e-f509-4cf8-94e0-325f8c4180ea" Jul 07 16:23:29.707211 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:29.707176 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:29.858119 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:29.857950 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:29.962570 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:29.962348 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:30.062224 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:30.062196 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:30.162333 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:30.162208 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:30.653278 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:30.653224 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:30.799973 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:30.799949 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4llwj_41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d/ovn-acl-logging/0.log" Jul 07 16:23:30.800337 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:30.800290 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" event={"ID":"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d","Type":"ContainerStarted","Data":"a6154bb4a77e38ff8f5bef6fca4d641c49a819c0f79c5b9287f7c54124f5b365"} Jul 07 16:23:30.801374 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:30.800577 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:30.801374 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:30.800660 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:30.801374 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:30.800705 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:30.801374 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:30.800714 2564 scope.go:117] "RemoveContainer" containerID="536add9834c6bb31e89465a053afcf58a634c809ce6ed508f8de643af4fbe939" Jul 07 16:23:30.802247 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:30.802201 2564 generic.go:356] "Generic (PLEG): container finished" podID="d7badfa9-b86b-4749-bae9-49c20ea917c3" containerID="ec9f8a0fa44b219afd0d534951c4b6e9ce349f8aa6796010c3bed804b543fee4" exitCode=0 Jul 07 16:23:30.802311 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:30.802273 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c8ln2" event={"ID":"d7badfa9-b86b-4749-bae9-49c20ea917c3","Type":"ContainerDied","Data":"ec9f8a0fa44b219afd0d534951c4b6e9ce349f8aa6796010c3bed804b543fee4"} Jul 07 16:23:30.817851 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:30.817822 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:30.818359 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:30.818345 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:23:31.462224 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:31.462194 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:31.643704 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:31.643676 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssslq" Jul 07 16:23:31.643902 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:31.643781 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:23:31.643902 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:31.643795 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssslq" podUID="d305b801-d058-4ce5-b43b-062c1994a145" Jul 07 16:23:31.643902 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:31.643810 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2mr5" Jul 07 16:23:31.643902 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:31.643881 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s79k" podUID="dc1cd2ef-cb98-430b-bdee-883a3129c2af" Jul 07 16:23:31.644101 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:31.643949 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2mr5" podUID="d679cf5e-f509-4cf8-94e0-325f8c4180ea" Jul 07 16:23:31.658247 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:31.658205 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:31.807110 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:31.807090 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4llwj_41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d/ovn-acl-logging/0.log" Jul 07 16:23:31.807407 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:31.807383 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" event={"ID":"41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d","Type":"ContainerStarted","Data":"107cca844dd27518e3787cb99b751c6e9d265ff1e49792d80de8f5d76489c4cb"} Jul 07 16:23:31.860446 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:31.860384 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" podStartSLOduration=10.076141227 podStartE2EDuration="30.860360173s" totalImagesPullingTime="20.784218946s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:23:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:31.858060143 +0000 UTC m=+31.797569566" watchObservedRunningTime="2026-07-07 16:23:31.860360173 +0000 UTC m=+31.799869597" Jul 07 16:23:31.865903 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:31.865866 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:32.264557 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:32.264518 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:32.811314 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:32.811280 2564 generic.go:356] "Generic (PLEG): container finished" podID="d7badfa9-b86b-4749-bae9-49c20ea917c3" containerID="3cbd5eb3851d083ce0850fa8bca659a33a07be5078e36a23a79ebd0b64054426" exitCode=0 Jul 07 16:23:32.811781 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:32.811370 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c8ln2" event={"ID":"d7badfa9-b86b-4749-bae9-49c20ea917c3","Type":"ContainerDied","Data":"3cbd5eb3851d083ce0850fa8bca659a33a07be5078e36a23a79ebd0b64054426"} Jul 07 16:23:32.980037 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:32.980009 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:33.078862 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:33.078788 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:33.179814 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:33.179779 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:33.280740 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:33.280670 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:33.637951 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:33.637924 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:33.644081 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:33.644065 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssslq" Jul 07 16:23:33.644183 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:33.644169 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:23:33.644222 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:33.644183 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssslq" podUID="d305b801-d058-4ce5-b43b-062c1994a145" Jul 07 16:23:33.644222 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:33.644194 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2mr5" Jul 07 16:23:33.644304 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:33.644281 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s79k" podUID="dc1cd2ef-cb98-430b-bdee-883a3129c2af" Jul 07 16:23:33.644385 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:33.644370 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2mr5" podUID="d679cf5e-f509-4cf8-94e0-325f8c4180ea" Jul 07 16:23:33.815718 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:33.815630 2564 generic.go:356] "Generic (PLEG): container finished" podID="d7badfa9-b86b-4749-bae9-49c20ea917c3" containerID="7c06ae7b99ff5f0fa8ccd8e7e785f886e6c081366d93a7e2b18f34565d296263" exitCode=0 Jul 07 16:23:33.815718 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:33.815679 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c8ln2" event={"ID":"d7badfa9-b86b-4749-bae9-49c20ea917c3","Type":"ContainerDied","Data":"7c06ae7b99ff5f0fa8ccd8e7e785f886e6c081366d93a7e2b18f34565d296263"} Jul 07 16:23:33.844334 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:33.844305 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:33.942114 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:33.942081 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:34.307257 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:34.307207 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc1cd2ef-cb98-430b-bdee-883a3129c2af-original-pull-secret\") pod \"global-pull-secret-syncer-5s79k\" (UID: \"dc1cd2ef-cb98-430b-bdee-883a3129c2af\") " pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:23:34.307449 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:34.307273 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d679cf5e-f509-4cf8-94e0-325f8c4180ea-metrics-certs\") pod \"network-metrics-daemon-k2mr5\" (UID: \"d679cf5e-f509-4cf8-94e0-325f8c4180ea\") " pod="openshift-multus/network-metrics-daemon-k2mr5" Jul 07 16:23:34.307449 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:34.307351 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:23:34.307449 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:34.307363 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:23:34.307449 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:34.307409 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc1cd2ef-cb98-430b-bdee-883a3129c2af-original-pull-secret podName:dc1cd2ef-cb98-430b-bdee-883a3129c2af nodeName:}" failed. No retries permitted until 2026-07-07 16:24:06.307393624 +0000 UTC m=+66.246903035 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc1cd2ef-cb98-430b-bdee-883a3129c2af-original-pull-secret") pod "global-pull-secret-syncer-5s79k" (UID: "dc1cd2ef-cb98-430b-bdee-883a3129c2af") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:23:34.307449 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:34.307429 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d679cf5e-f509-4cf8-94e0-325f8c4180ea-metrics-certs podName:d679cf5e-f509-4cf8-94e0-325f8c4180ea nodeName:}" failed. No retries permitted until 2026-07-07 16:24:06.30741818 +0000 UTC m=+66.246927594 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d679cf5e-f509-4cf8-94e0-325f8c4180ea-metrics-certs") pod "network-metrics-daemon-k2mr5" (UID: "d679cf5e-f509-4cf8-94e0-325f8c4180ea") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:23:34.408119 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:34.408081 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpxdc\" (UniqueName: \"kubernetes.io/projected/d305b801-d058-4ce5-b43b-062c1994a145-kube-api-access-rpxdc\") pod \"network-check-target-ssslq\" (UID: \"d305b801-d058-4ce5-b43b-062c1994a145\") " pod="openshift-network-diagnostics/network-check-target-ssslq" Jul 07 16:23:34.408302 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:34.408269 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:23:34.408302 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:34.408289 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:23:34.408302 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:34.408299 2564 projected.go:196] Error preparing data for projected volume kube-api-access-rpxdc for pod openshift-network-diagnostics/network-check-target-ssslq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:23:34.408459 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:34.408348 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d305b801-d058-4ce5-b43b-062c1994a145-kube-api-access-rpxdc podName:d305b801-d058-4ce5-b43b-062c1994a145 nodeName:}" failed. No retries permitted until 2026-07-07 16:24:06.40833224 +0000 UTC m=+66.347841641 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rpxdc" (UniqueName: "kubernetes.io/projected/d305b801-d058-4ce5-b43b-062c1994a145-kube-api-access-rpxdc") pod "network-check-target-ssslq" (UID: "d305b801-d058-4ce5-b43b-062c1994a145") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:23:34.455870 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:34.455832 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:34.915535 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:34.915476 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:35.229126 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:35.229048 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:35.329420 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:35.329390 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:35.431750 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:35.431715 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:35.530364 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:35.530294 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:35.631494 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:35.631456 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:35.644452 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:35.644417 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssslq" Jul 07 16:23:35.644630 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:35.644528 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:23:35.644630 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:35.644543 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssslq" podUID="d305b801-d058-4ce5-b43b-062c1994a145" Jul 07 16:23:35.644630 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:35.644576 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2mr5" Jul 07 16:23:35.644746 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:35.644676 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s79k" podUID="dc1cd2ef-cb98-430b-bdee-883a3129c2af" Jul 07 16:23:35.644783 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:35.644748 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2mr5" podUID="d679cf5e-f509-4cf8-94e0-325f8c4180ea" Jul 07 16:23:35.832915 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:35.832823 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:36.233217 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:36.233185 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:36.843827 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:36.843795 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:37.246028 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:37.245985 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:37.639017 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:37.638984 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:37.644010 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:37.643984 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssslq" Jul 07 16:23:37.644156 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:37.644086 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:23:37.644156 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:37.644095 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssslq" podUID="d305b801-d058-4ce5-b43b-062c1994a145" Jul 07 16:23:37.644156 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:37.644115 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2mr5" Jul 07 16:23:37.644345 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:37.644205 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s79k" podUID="dc1cd2ef-cb98-430b-bdee-883a3129c2af" Jul 07 16:23:37.644345 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:37.644322 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2mr5" podUID="d679cf5e-f509-4cf8-94e0-325f8c4180ea" Jul 07 16:23:38.037108 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:38.037023 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:38.451038 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:38.451008 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:38.838793 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:38.838627 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:39.245076 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:39.245039 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:39.644028 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:39.643997 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2mr5" Jul 07 16:23:39.644028 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:39.644019 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:23:39.644503 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:39.644039 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssslq" Jul 07 16:23:39.644503 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:39.644127 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2mr5" podUID="d679cf5e-f509-4cf8-94e0-325f8c4180ea" Jul 07 16:23:39.644503 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:39.644291 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s79k" podUID="dc1cd2ef-cb98-430b-bdee-883a3129c2af" Jul 07 16:23:39.644503 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:39.644366 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssslq" podUID="d305b801-d058-4ce5-b43b-062c1994a145" Jul 07 16:23:39.645069 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:39.645050 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:39.808248 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:39.808199 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:39.832349 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:39.832320 2564 generic.go:356] "Generic (PLEG): container finished" podID="d7badfa9-b86b-4749-bae9-49c20ea917c3" containerID="f329b45401f076fbf78e02e35b2da5a48e9e682b25625d9477733725a66554a2" exitCode=0 Jul 07 16:23:39.832479 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:39.832358 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c8ln2" event={"ID":"d7badfa9-b86b-4749-bae9-49c20ea917c3","Type":"ContainerDied","Data":"f329b45401f076fbf78e02e35b2da5a48e9e682b25625d9477733725a66554a2"} Jul 07 16:23:39.980692 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:39.980669 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:40.080059 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:40.080008 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:40.837119 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:40.837088 2564 generic.go:356] "Generic (PLEG): container finished" podID="d7badfa9-b86b-4749-bae9-49c20ea917c3" containerID="ecdc89cdc62dc89f16f74b4b0dbade510e5b21f305c7a9ee501f62d8130f9e58" exitCode=0 Jul 07 16:23:40.837517 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:40.837172 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c8ln2" event={"ID":"d7badfa9-b86b-4749-bae9-49c20ea917c3","Type":"ContainerDied","Data":"ecdc89cdc62dc89f16f74b4b0dbade510e5b21f305c7a9ee501f62d8130f9e58"} Jul 07 16:23:41.644327 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:41.644294 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:23:41.644327 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:41.644313 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssslq" Jul 07 16:23:41.644547 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:41.644344 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2mr5" Jul 07 16:23:41.644547 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:41.644399 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s79k" podUID="dc1cd2ef-cb98-430b-bdee-883a3129c2af" Jul 07 16:23:41.644547 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:41.644461 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssslq" podUID="d305b801-d058-4ce5-b43b-062c1994a145" Jul 07 16:23:41.644639 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:41.644564 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2mr5" podUID="d679cf5e-f509-4cf8-94e0-325f8c4180ea" Jul 07 16:23:41.842198 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:41.842163 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c8ln2" event={"ID":"d7badfa9-b86b-4749-bae9-49c20ea917c3","Type":"ContainerStarted","Data":"03a5d81152478ab982d319e758601efc5f21467b41069810dafa2f5b259bb9ec"} Jul 07 16:23:41.868806 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:41.868767 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-c8ln2" podStartSLOduration=7.64455585 podStartE2EDuration="40.868754029s" totalImagesPullingTime="33.224198179s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:23:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:23:41.868298351 +0000 UTC m=+41.807807776" watchObservedRunningTime="2026-07-07 16:23:41.868754029 +0000 UTC m=+41.808263453" Jul 07 16:23:43.643626 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:43.643601 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssslq" Jul 07 16:23:43.644196 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:43.643688 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:23:43.644196 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:43.643707 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2mr5" Jul 07 16:23:43.644196 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:43.643691 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssslq" podUID="d305b801-d058-4ce5-b43b-062c1994a145" Jul 07 16:23:43.644196 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:43.643799 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s79k" podUID="dc1cd2ef-cb98-430b-bdee-883a3129c2af" Jul 07 16:23:43.644196 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:43.643851 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2mr5" podUID="d679cf5e-f509-4cf8-94e0-325f8c4180ea" Jul 07 16:23:45.643900 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:45.643858 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2mr5" Jul 07 16:23:45.643900 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:45.643881 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssslq" Jul 07 16:23:45.644413 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:45.643859 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:23:45.644413 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:45.643967 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2mr5" podUID="d679cf5e-f509-4cf8-94e0-325f8c4180ea" Jul 07 16:23:45.644413 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:45.644056 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s79k" podUID="dc1cd2ef-cb98-430b-bdee-883a3129c2af" Jul 07 16:23:45.644413 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:45.644149 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssslq" podUID="d305b801-d058-4ce5-b43b-062c1994a145" Jul 07 16:23:47.351186 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:47.351151 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:47.452292 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:47.452254 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:47.583261 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:47.583207 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:47.644492 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:47.644413 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssslq" Jul 07 16:23:47.644492 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:47.644450 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:23:47.644668 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:47.644534 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssslq" podUID="d305b801-d058-4ce5-b43b-062c1994a145" Jul 07 16:23:47.644668 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:47.644564 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s79k" podUID="dc1cd2ef-cb98-430b-bdee-883a3129c2af" Jul 07 16:23:47.644668 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:47.644592 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2mr5" Jul 07 16:23:47.644668 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:47.644650 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2mr5" podUID="d679cf5e-f509-4cf8-94e0-325f8c4180ea" Jul 07 16:23:47.778492 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:47.778459 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:47.956326 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:47.956221 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:48.118902 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:48.118869 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:48.195927 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:48.195900 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:48.295289 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:48.295178 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:48.395079 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:48.395048 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:48.494968 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:48.494940 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:49.214713 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:49.214677 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:49.418856 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:49.418814 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:49.550048 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:49.549974 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:49.644518 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:49.644484 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssslq" Jul 07 16:23:49.644518 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:49.644508 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:23:49.644708 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:49.644591 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2mr5" Jul 07 16:23:49.644708 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:49.644598 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssslq" podUID="d305b801-d058-4ce5-b43b-062c1994a145" Jul 07 16:23:49.644708 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:49.644697 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s79k" podUID="dc1cd2ef-cb98-430b-bdee-883a3129c2af" Jul 07 16:23:49.644804 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:49.644785 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2mr5" podUID="d679cf5e-f509-4cf8-94e0-325f8c4180ea" Jul 07 16:23:49.667793 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:49.667743 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:50.497131 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:50.497104 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k2mr5"] Jul 07 16:23:50.497663 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:50.497203 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2mr5" Jul 07 16:23:50.497663 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:50.497313 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2mr5" podUID="d679cf5e-f509-4cf8-94e0-325f8c4180ea" Jul 07 16:23:50.499594 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:50.499558 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5s79k"] Jul 07 16:23:50.499848 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:50.499821 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:23:50.499949 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:50.499928 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s79k" podUID="dc1cd2ef-cb98-430b-bdee-883a3129c2af" Jul 07 16:23:50.500318 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:50.500294 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ssslq"] Jul 07 16:23:50.500425 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:50.500382 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssslq" Jul 07 16:23:50.500518 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:50.500481 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssslq" podUID="d305b801-d058-4ce5-b43b-062c1994a145" Jul 07 16:23:51.644686 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:51.644509 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssslq" Jul 07 16:23:51.645064 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:51.644761 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssslq" podUID="d305b801-d058-4ce5-b43b-062c1994a145" Jul 07 16:23:51.720896 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:51.720860 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:51.787153 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:51.787119 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:52.644342 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:52.644314 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:23:52.644492 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:52.644448 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s79k" podUID="dc1cd2ef-cb98-430b-bdee-883a3129c2af" Jul 07 16:23:52.644557 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:52.644499 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2mr5" Jul 07 16:23:52.644635 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:52.644614 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2mr5" podUID="d679cf5e-f509-4cf8-94e0-325f8c4180ea" Jul 07 16:23:53.276283 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:53.276250 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:53.383207 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:53.383173 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:53.644250 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:53.644201 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssslq" Jul 07 16:23:53.644407 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:53.644345 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssslq" podUID="d305b801-d058-4ce5-b43b-062c1994a145" Jul 07 16:23:54.119509 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.119478 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:54.218928 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.218894 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:54.295050 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.295024 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeReady" Jul 07 16:23:54.295490 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.295130 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 16:23:54.317381 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.317352 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:54.350646 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.350618 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nf9t6"] Jul 07 16:23:54.365219 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.365187 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-r2plv"] Jul 07 16:23:54.365378 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.365312 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nf9t6" Jul 07 16:23:54.368744 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.368723 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 16:23:54.368872 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.368726 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 16:23:54.368872 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.368858 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 16:23:54.368993 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.368961 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mlgdt\"" Jul 07 16:23:54.387946 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.387923 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nf9t6"] Jul 07 16:23:54.388067 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.387954 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r2plv"] Jul 07 16:23:54.388067 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.387975 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nxh4s"] Jul 07 16:23:54.388187 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.388064 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r2plv" Jul 07 16:23:54.391341 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.391174 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 16:23:54.391341 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.391182 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jgc6k\"" Jul 07 16:23:54.391341 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.391188 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 16:23:54.410607 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.410583 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nxh4s"] Jul 07 16:23:54.410728 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.410675 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nxh4s" Jul 07 16:23:54.413859 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.413834 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 16:23:54.413965 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.413835 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 16:23:54.413965 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.413875 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8qgfn\"" Jul 07 16:23:54.414132 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.414119 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 16:23:54.414275 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.414259 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 16:23:54.458029 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.457998 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6dfb\" (UniqueName: \"kubernetes.io/projected/c22c4cf0-c358-4ab6-bee3-1fd64c11f646-kube-api-access-d6dfb\") pod \"insights-runtime-extractor-nxh4s\" (UID: \"c22c4cf0-c358-4ab6-bee3-1fd64c11f646\") " pod="openshift-insights/insights-runtime-extractor-nxh4s" Jul 07 16:23:54.458178 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.458033 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlxtm\" (UniqueName: \"kubernetes.io/projected/d53c196e-73f3-4146-b810-ef3c741a3ac6-kube-api-access-mlxtm\") pod \"dns-default-r2plv\" (UID: \"d53c196e-73f3-4146-b810-ef3c741a3ac6\") " pod="openshift-dns/dns-default-r2plv" Jul 07 16:23:54.458178 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.458053 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c22c4cf0-c358-4ab6-bee3-1fd64c11f646-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nxh4s\" (UID: \"c22c4cf0-c358-4ab6-bee3-1fd64c11f646\") " pod="openshift-insights/insights-runtime-extractor-nxh4s" Jul 07 16:23:54.458178 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.458131 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e23de48-ba48-4eff-ade3-05b1e1661633-cert\") pod \"ingress-canary-nf9t6\" (UID: \"2e23de48-ba48-4eff-ade3-05b1e1661633\") " pod="openshift-ingress-canary/ingress-canary-nf9t6" Jul 07 16:23:54.458178 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.458169 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh59d\" (UniqueName: \"kubernetes.io/projected/2e23de48-ba48-4eff-ade3-05b1e1661633-kube-api-access-vh59d\") pod \"ingress-canary-nf9t6\" (UID: \"2e23de48-ba48-4eff-ade3-05b1e1661633\") " pod="openshift-ingress-canary/ingress-canary-nf9t6" Jul 07 16:23:54.458334 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.458197 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c22c4cf0-c358-4ab6-bee3-1fd64c11f646-crio-socket\") pod \"insights-runtime-extractor-nxh4s\" (UID: \"c22c4cf0-c358-4ab6-bee3-1fd64c11f646\") " pod="openshift-insights/insights-runtime-extractor-nxh4s" Jul 07 16:23:54.458334 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.458213 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c22c4cf0-c358-4ab6-bee3-1fd64c11f646-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nxh4s\" (UID: \"c22c4cf0-c358-4ab6-bee3-1fd64c11f646\") " pod="openshift-insights/insights-runtime-extractor-nxh4s" Jul 07 16:23:54.458334 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.458290 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d53c196e-73f3-4146-b810-ef3c741a3ac6-metrics-tls\") pod \"dns-default-r2plv\" (UID: \"d53c196e-73f3-4146-b810-ef3c741a3ac6\") " pod="openshift-dns/dns-default-r2plv" Jul 07 16:23:54.458334 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.458318 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d53c196e-73f3-4146-b810-ef3c741a3ac6-config-volume\") pod \"dns-default-r2plv\" (UID: \"d53c196e-73f3-4146-b810-ef3c741a3ac6\") " pod="openshift-dns/dns-default-r2plv" Jul 07 16:23:54.458449 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.458343 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c22c4cf0-c358-4ab6-bee3-1fd64c11f646-data-volume\") pod \"insights-runtime-extractor-nxh4s\" (UID: \"c22c4cf0-c358-4ab6-bee3-1fd64c11f646\") " pod="openshift-insights/insights-runtime-extractor-nxh4s" Jul 07 16:23:54.458449 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.458376 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d53c196e-73f3-4146-b810-ef3c741a3ac6-tmp-dir\") pod \"dns-default-r2plv\" (UID: \"d53c196e-73f3-4146-b810-ef3c741a3ac6\") " pod="openshift-dns/dns-default-r2plv" Jul 07 16:23:54.503753 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.503723 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:54.559562 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.559534 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e23de48-ba48-4eff-ade3-05b1e1661633-cert\") pod \"ingress-canary-nf9t6\" (UID: \"2e23de48-ba48-4eff-ade3-05b1e1661633\") " pod="openshift-ingress-canary/ingress-canary-nf9t6" Jul 07 16:23:54.559562 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.559563 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh59d\" (UniqueName: \"kubernetes.io/projected/2e23de48-ba48-4eff-ade3-05b1e1661633-kube-api-access-vh59d\") pod \"ingress-canary-nf9t6\" (UID: \"2e23de48-ba48-4eff-ade3-05b1e1661633\") " pod="openshift-ingress-canary/ingress-canary-nf9t6" Jul 07 16:23:54.559728 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.559583 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c22c4cf0-c358-4ab6-bee3-1fd64c11f646-crio-socket\") pod \"insights-runtime-extractor-nxh4s\" (UID: \"c22c4cf0-c358-4ab6-bee3-1fd64c11f646\") " pod="openshift-insights/insights-runtime-extractor-nxh4s" Jul 07 16:23:54.559802 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.559777 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c22c4cf0-c358-4ab6-bee3-1fd64c11f646-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nxh4s\" (UID: \"c22c4cf0-c358-4ab6-bee3-1fd64c11f646\") " pod="openshift-insights/insights-runtime-extractor-nxh4s" Jul 07 16:23:54.559859 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.559844 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d53c196e-73f3-4146-b810-ef3c741a3ac6-metrics-tls\") pod \"dns-default-r2plv\" (UID: \"d53c196e-73f3-4146-b810-ef3c741a3ac6\") " pod="openshift-dns/dns-default-r2plv" Jul 07 16:23:54.559893 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.559879 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c22c4cf0-c358-4ab6-bee3-1fd64c11f646-crio-socket\") pod \"insights-runtime-extractor-nxh4s\" (UID: \"c22c4cf0-c358-4ab6-bee3-1fd64c11f646\") " pod="openshift-insights/insights-runtime-extractor-nxh4s" Jul 07 16:23:54.559893 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.559885 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d53c196e-73f3-4146-b810-ef3c741a3ac6-config-volume\") pod \"dns-default-r2plv\" (UID: \"d53c196e-73f3-4146-b810-ef3c741a3ac6\") " pod="openshift-dns/dns-default-r2plv" Jul 07 16:23:54.559986 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.559908 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c22c4cf0-c358-4ab6-bee3-1fd64c11f646-data-volume\") pod \"insights-runtime-extractor-nxh4s\" (UID: \"c22c4cf0-c358-4ab6-bee3-1fd64c11f646\") " pod="openshift-insights/insights-runtime-extractor-nxh4s" Jul 07 16:23:54.560076 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.560050 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d53c196e-73f3-4146-b810-ef3c741a3ac6-tmp-dir\") pod \"dns-default-r2plv\" (UID: \"d53c196e-73f3-4146-b810-ef3c741a3ac6\") " pod="openshift-dns/dns-default-r2plv" Jul 07 16:23:54.560127 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.560113 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6dfb\" (UniqueName: \"kubernetes.io/projected/c22c4cf0-c358-4ab6-bee3-1fd64c11f646-kube-api-access-d6dfb\") pod \"insights-runtime-extractor-nxh4s\" (UID: \"c22c4cf0-c358-4ab6-bee3-1fd64c11f646\") " pod="openshift-insights/insights-runtime-extractor-nxh4s" Jul 07 16:23:54.560191 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.560156 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlxtm\" (UniqueName: \"kubernetes.io/projected/d53c196e-73f3-4146-b810-ef3c741a3ac6-kube-api-access-mlxtm\") pod \"dns-default-r2plv\" (UID: \"d53c196e-73f3-4146-b810-ef3c741a3ac6\") " pod="openshift-dns/dns-default-r2plv" Jul 07 16:23:54.560261 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.560184 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c22c4cf0-c358-4ab6-bee3-1fd64c11f646-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nxh4s\" (UID: \"c22c4cf0-c358-4ab6-bee3-1fd64c11f646\") " pod="openshift-insights/insights-runtime-extractor-nxh4s" Jul 07 16:23:54.560329 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.560307 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c22c4cf0-c358-4ab6-bee3-1fd64c11f646-data-volume\") pod \"insights-runtime-extractor-nxh4s\" (UID: \"c22c4cf0-c358-4ab6-bee3-1fd64c11f646\") " pod="openshift-insights/insights-runtime-extractor-nxh4s" Jul 07 16:23:54.560419 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.560393 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d53c196e-73f3-4146-b810-ef3c741a3ac6-tmp-dir\") pod \"dns-default-r2plv\" (UID: \"d53c196e-73f3-4146-b810-ef3c741a3ac6\") " pod="openshift-dns/dns-default-r2plv" Jul 07 16:23:54.560572 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.560545 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c22c4cf0-c358-4ab6-bee3-1fd64c11f646-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nxh4s\" (UID: \"c22c4cf0-c358-4ab6-bee3-1fd64c11f646\") " pod="openshift-insights/insights-runtime-extractor-nxh4s" Jul 07 16:23:54.560668 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.560575 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d53c196e-73f3-4146-b810-ef3c741a3ac6-config-volume\") pod \"dns-default-r2plv\" (UID: \"d53c196e-73f3-4146-b810-ef3c741a3ac6\") " pod="openshift-dns/dns-default-r2plv" Jul 07 16:23:54.563809 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.563782 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c22c4cf0-c358-4ab6-bee3-1fd64c11f646-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nxh4s\" (UID: \"c22c4cf0-c358-4ab6-bee3-1fd64c11f646\") " pod="openshift-insights/insights-runtime-extractor-nxh4s" Jul 07 16:23:54.563809 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.563792 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d53c196e-73f3-4146-b810-ef3c741a3ac6-metrics-tls\") pod \"dns-default-r2plv\" (UID: \"d53c196e-73f3-4146-b810-ef3c741a3ac6\") " pod="openshift-dns/dns-default-r2plv" Jul 07 16:23:54.563918 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.563907 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e23de48-ba48-4eff-ade3-05b1e1661633-cert\") pod \"ingress-canary-nf9t6\" (UID: \"2e23de48-ba48-4eff-ade3-05b1e1661633\") " pod="openshift-ingress-canary/ingress-canary-nf9t6" Jul 07 16:23:54.571881 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.571859 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6dfb\" (UniqueName: \"kubernetes.io/projected/c22c4cf0-c358-4ab6-bee3-1fd64c11f646-kube-api-access-d6dfb\") pod \"insights-runtime-extractor-nxh4s\" (UID: \"c22c4cf0-c358-4ab6-bee3-1fd64c11f646\") " pod="openshift-insights/insights-runtime-extractor-nxh4s" Jul 07 16:23:54.572767 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.572751 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh59d\" (UniqueName: \"kubernetes.io/projected/2e23de48-ba48-4eff-ade3-05b1e1661633-kube-api-access-vh59d\") pod \"ingress-canary-nf9t6\" (UID: \"2e23de48-ba48-4eff-ade3-05b1e1661633\") " pod="openshift-ingress-canary/ingress-canary-nf9t6" Jul 07 16:23:54.573225 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.573205 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlxtm\" (UniqueName: \"kubernetes.io/projected/d53c196e-73f3-4146-b810-ef3c741a3ac6-kube-api-access-mlxtm\") pod \"dns-default-r2plv\" (UID: \"d53c196e-73f3-4146-b810-ef3c741a3ac6\") " pod="openshift-dns/dns-default-r2plv" Jul 07 16:23:54.580526 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.580501 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:54.647524 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.647461 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:23:54.647640 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.647471 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2mr5" Jul 07 16:23:54.650978 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.650954 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xxp9t\"" Jul 07 16:23:54.651095 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.651049 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 16:23:54.651280 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.651266 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 16:23:54.675769 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.675744 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nf9t6" Jul 07 16:23:54.697724 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.697692 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r2plv" Jul 07 16:23:54.719560 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.719533 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nxh4s" Jul 07 16:23:54.901417 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.901339 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nf9t6"] Jul 07 16:23:54.905085 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.904781 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r2plv"] Jul 07 16:23:54.905640 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:54.905615 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e23de48_ba48_4eff_ade3_05b1e1661633.slice/crio-14a70f563427b0b4ed575c975f435f7b3135549069d9d858ac8ea1facb032427 WatchSource:0}: Error finding container 14a70f563427b0b4ed575c975f435f7b3135549069d9d858ac8ea1facb032427: Status 404 returned error can't find the container with id 14a70f563427b0b4ed575c975f435f7b3135549069d9d858ac8ea1facb032427 Jul 07 16:23:54.905739 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:54.905651 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nxh4s"] Jul 07 16:23:54.907853 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:54.907832 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc22c4cf0_c358_4ab6_bee3_1fd64c11f646.slice/crio-d4fc452e5026942f9d2d0ac82ce5f3007556f2c05bae0fd9e12482a42148cf43 WatchSource:0}: Error finding container d4fc452e5026942f9d2d0ac82ce5f3007556f2c05bae0fd9e12482a42148cf43: Status 404 returned error can't find the container with id d4fc452e5026942f9d2d0ac82ce5f3007556f2c05bae0fd9e12482a42148cf43 Jul 07 16:23:54.909370 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:54.909348 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd53c196e_73f3_4146_b810_ef3c741a3ac6.slice/crio-9c9eaf88be8ba5a8bb6e4a0a328f9833a4daca5f87d6d8f60e5add815ea6f932 WatchSource:0}: Error finding container 9c9eaf88be8ba5a8bb6e4a0a328f9833a4daca5f87d6d8f60e5add815ea6f932: Status 404 returned error can't find the container with id 9c9eaf88be8ba5a8bb6e4a0a328f9833a4daca5f87d6d8f60e5add815ea6f932 Jul 07 16:23:55.005370 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:55.005338 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:55.108714 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:55.108657 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:55.616129 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:55.613649 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c8bbddb44-jvn97"] Jul 07 16:23:55.628621 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:55.627924 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c8bbddb44-jvn97" Jul 07 16:23:55.630391 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:55.630363 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c8bbddb44-jvn97"] Jul 07 16:23:55.635027 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:55.633854 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 07 16:23:55.635027 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:55.634134 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 07 16:23:55.635027 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:55.634353 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 07 16:23:55.635027 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:55.634579 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 07 16:23:55.635027 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:55.634796 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 07 16:23:55.635027 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:55.635020 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 07 16:23:55.635499 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:55.635482 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 07 16:23:55.635792 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:55.635776 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9w2mw\"" Jul 07 16:23:55.644585 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:55.644566 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssslq" Jul 07 16:23:55.650147 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:55.650081 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 16:23:55.650466 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:55.650437 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vjw6s\"" Jul 07 16:23:55.650656 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:55.650641 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 16:23:55.669899 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:55.669627 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4b71436-5a50-45c4-83ef-7e143a1d41c0-service-ca\") pod \"console-7c8bbddb44-jvn97\" (UID: \"d4b71436-5a50-45c4-83ef-7e143a1d41c0\") " pod="openshift-console/console-7c8bbddb44-jvn97" Jul 07 16:23:55.669899 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:55.669669 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4b71436-5a50-45c4-83ef-7e143a1d41c0-console-oauth-config\") pod \"console-7c8bbddb44-jvn97\" (UID: \"d4b71436-5a50-45c4-83ef-7e143a1d41c0\") " pod="openshift-console/console-7c8bbddb44-jvn97" Jul 07 16:23:55.669899 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:55.669713 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4b71436-5a50-45c4-83ef-7e143a1d41c0-console-config\") pod \"console-7c8bbddb44-jvn97\" (UID: \"d4b71436-5a50-45c4-83ef-7e143a1d41c0\") " pod="openshift-console/console-7c8bbddb44-jvn97" Jul 07 16:23:55.669899 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:55.669760 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4b71436-5a50-45c4-83ef-7e143a1d41c0-console-serving-cert\") pod \"console-7c8bbddb44-jvn97\" (UID: \"d4b71436-5a50-45c4-83ef-7e143a1d41c0\") " pod="openshift-console/console-7c8bbddb44-jvn97" Jul 07 16:23:55.669899 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:55.669791 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4b71436-5a50-45c4-83ef-7e143a1d41c0-oauth-serving-cert\") pod \"console-7c8bbddb44-jvn97\" (UID: \"d4b71436-5a50-45c4-83ef-7e143a1d41c0\") " pod="openshift-console/console-7c8bbddb44-jvn97" Jul 07 16:23:55.669899 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:55.669845 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnqpv\" (UniqueName: \"kubernetes.io/projected/d4b71436-5a50-45c4-83ef-7e143a1d41c0-kube-api-access-fnqpv\") pod \"console-7c8bbddb44-jvn97\" (UID: \"d4b71436-5a50-45c4-83ef-7e143a1d41c0\") " pod="openshift-console/console-7c8bbddb44-jvn97" Jul 07 16:23:55.771432 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:55.771096 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4b71436-5a50-45c4-83ef-7e143a1d41c0-console-config\") pod \"console-7c8bbddb44-jvn97\" (UID: \"d4b71436-5a50-45c4-83ef-7e143a1d41c0\") " pod="openshift-console/console-7c8bbddb44-jvn97" Jul 07 16:23:55.771432 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:55.771150 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4b71436-5a50-45c4-83ef-7e143a1d41c0-console-serving-cert\") pod \"console-7c8bbddb44-jvn97\" (UID: \"d4b71436-5a50-45c4-83ef-7e143a1d41c0\") " pod="openshift-console/console-7c8bbddb44-jvn97" Jul 07 16:23:55.771432 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:55.771170 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4b71436-5a50-45c4-83ef-7e143a1d41c0-oauth-serving-cert\") pod \"console-7c8bbddb44-jvn97\" (UID: \"d4b71436-5a50-45c4-83ef-7e143a1d41c0\") " pod="openshift-console/console-7c8bbddb44-jvn97" Jul 07 16:23:55.771432 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:55.771212 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnqpv\" (UniqueName: \"kubernetes.io/projected/d4b71436-5a50-45c4-83ef-7e143a1d41c0-kube-api-access-fnqpv\") pod \"console-7c8bbddb44-jvn97\" (UID: \"d4b71436-5a50-45c4-83ef-7e143a1d41c0\") " pod="openshift-console/console-7c8bbddb44-jvn97" Jul 07 16:23:55.771432 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:55.771275 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4b71436-5a50-45c4-83ef-7e143a1d41c0-service-ca\") pod \"console-7c8bbddb44-jvn97\" (UID: \"d4b71436-5a50-45c4-83ef-7e143a1d41c0\") " pod="openshift-console/console-7c8bbddb44-jvn97" Jul 07 16:23:55.771432 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:55.771301 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4b71436-5a50-45c4-83ef-7e143a1d41c0-console-oauth-config\") pod \"console-7c8bbddb44-jvn97\" (UID: \"d4b71436-5a50-45c4-83ef-7e143a1d41c0\") " pod="openshift-console/console-7c8bbddb44-jvn97" Jul 07 16:23:55.773585 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:55.773491 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4b71436-5a50-45c4-83ef-7e143a1d41c0-console-config\") pod \"console-7c8bbddb44-jvn97\" (UID: \"d4b71436-5a50-45c4-83ef-7e143a1d41c0\") " pod="openshift-console/console-7c8bbddb44-jvn97" Jul 07 16:23:55.773696 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:55.773611 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4b71436-5a50-45c4-83ef-7e143a1d41c0-oauth-serving-cert\") pod \"console-7c8bbddb44-jvn97\" (UID: \"d4b71436-5a50-45c4-83ef-7e143a1d41c0\") " pod="openshift-console/console-7c8bbddb44-jvn97" Jul 07 16:23:55.774199 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:55.774150 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4b71436-5a50-45c4-83ef-7e143a1d41c0-service-ca\") pod \"console-7c8bbddb44-jvn97\" (UID: \"d4b71436-5a50-45c4-83ef-7e143a1d41c0\") " pod="openshift-console/console-7c8bbddb44-jvn97" Jul 07 16:23:55.778906 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:55.778859 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4b71436-5a50-45c4-83ef-7e143a1d41c0-console-serving-cert\") pod \"console-7c8bbddb44-jvn97\" (UID: \"d4b71436-5a50-45c4-83ef-7e143a1d41c0\") " pod="openshift-console/console-7c8bbddb44-jvn97" Jul 07 16:23:55.779063 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:55.779036 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4b71436-5a50-45c4-83ef-7e143a1d41c0-console-oauth-config\") pod \"console-7c8bbddb44-jvn97\" (UID: \"d4b71436-5a50-45c4-83ef-7e143a1d41c0\") " pod="openshift-console/console-7c8bbddb44-jvn97" Jul 07 16:23:55.800497 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:55.800467 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnqpv\" (UniqueName: \"kubernetes.io/projected/d4b71436-5a50-45c4-83ef-7e143a1d41c0-kube-api-access-fnqpv\") pod \"console-7c8bbddb44-jvn97\" (UID: \"d4b71436-5a50-45c4-83ef-7e143a1d41c0\") " pod="openshift-console/console-7c8bbddb44-jvn97" Jul 07 16:23:55.877738 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:55.877592 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nxh4s" event={"ID":"c22c4cf0-c358-4ab6-bee3-1fd64c11f646","Type":"ContainerStarted","Data":"d4fc452e5026942f9d2d0ac82ce5f3007556f2c05bae0fd9e12482a42148cf43"} Jul 07 16:23:55.879342 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:55.879242 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r2plv" event={"ID":"d53c196e-73f3-4146-b810-ef3c741a3ac6","Type":"ContainerStarted","Data":"9c9eaf88be8ba5a8bb6e4a0a328f9833a4daca5f87d6d8f60e5add815ea6f932"} Jul 07 16:23:55.881758 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:55.881705 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nf9t6" event={"ID":"2e23de48-ba48-4eff-ade3-05b1e1661633","Type":"ContainerStarted","Data":"14a70f563427b0b4ed575c975f435f7b3135549069d9d858ac8ea1facb032427"} Jul 07 16:23:55.899205 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:55.899173 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:55.951807 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:55.951770 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c8bbddb44-jvn97" Jul 07 16:23:55.962705 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:55.962444 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:56.159874 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:56.159528 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c8bbddb44-jvn97"] Jul 07 16:23:56.165453 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:23:56.165408 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4b71436_5a50_45c4_83ef_7e143a1d41c0.slice/crio-292bc81499567f5f41d2909766528791bb4aa393a77cbcc456994e794ccbde9d WatchSource:0}: Error finding container 292bc81499567f5f41d2909766528791bb4aa393a77cbcc456994e794ccbde9d: Status 404 returned error can't find the container with id 292bc81499567f5f41d2909766528791bb4aa393a77cbcc456994e794ccbde9d Jul 07 16:23:56.886471 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:56.886426 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c8bbddb44-jvn97" event={"ID":"d4b71436-5a50-45c4-83ef-7e143a1d41c0","Type":"ContainerStarted","Data":"292bc81499567f5f41d2909766528791bb4aa393a77cbcc456994e794ccbde9d"} Jul 07 16:23:56.996183 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:56.996151 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:57.097284 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:57.097251 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:57.276697 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:57.276552 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:57.353051 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:57.352996 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:58.359200 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:58.359168 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:58.406454 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:58.406424 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-v98dg"] Jul 07 16:23:58.410168 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:58.410146 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-v98dg" Jul 07 16:23:58.413274 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:58.413248 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 07 16:23:58.414864 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:58.414838 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 16:23:58.414996 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:58.414881 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 16:23:58.414996 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:58.414881 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 07 16:23:58.415414 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:58.415190 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 16:23:58.415414 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:58.415287 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-lhpqz\"" Jul 07 16:23:58.425173 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:58.425152 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-v98dg"] Jul 07 16:23:58.432057 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:58.432031 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:58.493904 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:58.493865 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/63df574d-5c54-4219-9448-dab8a2ef9229-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-v98dg\" (UID: \"63df574d-5c54-4219-9448-dab8a2ef9229\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-v98dg" Jul 07 16:23:58.494090 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:58.493917 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/63df574d-5c54-4219-9448-dab8a2ef9229-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-v98dg\" (UID: \"63df574d-5c54-4219-9448-dab8a2ef9229\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-v98dg" Jul 07 16:23:58.494090 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:58.493944 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63df574d-5c54-4219-9448-dab8a2ef9229-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-v98dg\" (UID: \"63df574d-5c54-4219-9448-dab8a2ef9229\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-v98dg" Jul 07 16:23:58.494090 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:58.494000 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n89q\" (UniqueName: \"kubernetes.io/projected/63df574d-5c54-4219-9448-dab8a2ef9229-kube-api-access-2n89q\") pod \"prometheus-operator-567f7b8b7c-v98dg\" (UID: \"63df574d-5c54-4219-9448-dab8a2ef9229\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-v98dg" Jul 07 16:23:58.594622 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:58.594581 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/63df574d-5c54-4219-9448-dab8a2ef9229-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-v98dg\" (UID: \"63df574d-5c54-4219-9448-dab8a2ef9229\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-v98dg" Jul 07 16:23:58.594799 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:58.594628 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/63df574d-5c54-4219-9448-dab8a2ef9229-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-v98dg\" (UID: \"63df574d-5c54-4219-9448-dab8a2ef9229\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-v98dg" Jul 07 16:23:58.594799 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:58.594654 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63df574d-5c54-4219-9448-dab8a2ef9229-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-v98dg\" (UID: \"63df574d-5c54-4219-9448-dab8a2ef9229\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-v98dg" Jul 07 16:23:58.594799 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:58.594754 2564 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 07 16:23:58.594973 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:23:58.594842 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63df574d-5c54-4219-9448-dab8a2ef9229-prometheus-operator-tls podName:63df574d-5c54-4219-9448-dab8a2ef9229 nodeName:}" failed. No retries permitted until 2026-07-07 16:23:59.094818572 +0000 UTC m=+59.034327973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/63df574d-5c54-4219-9448-dab8a2ef9229-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-v98dg" (UID: "63df574d-5c54-4219-9448-dab8a2ef9229") : secret "prometheus-operator-tls" not found Jul 07 16:23:58.595530 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:58.595183 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n89q\" (UniqueName: \"kubernetes.io/projected/63df574d-5c54-4219-9448-dab8a2ef9229-kube-api-access-2n89q\") pod \"prometheus-operator-567f7b8b7c-v98dg\" (UID: \"63df574d-5c54-4219-9448-dab8a2ef9229\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-v98dg" Jul 07 16:23:58.595530 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:58.595375 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63df574d-5c54-4219-9448-dab8a2ef9229-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-v98dg\" (UID: \"63df574d-5c54-4219-9448-dab8a2ef9229\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-v98dg" Jul 07 16:23:58.597534 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:58.597515 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/63df574d-5c54-4219-9448-dab8a2ef9229-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-v98dg\" (UID: \"63df574d-5c54-4219-9448-dab8a2ef9229\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-v98dg" Jul 07 16:23:58.604533 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:58.604508 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n89q\" (UniqueName: \"kubernetes.io/projected/63df574d-5c54-4219-9448-dab8a2ef9229-kube-api-access-2n89q\") pod \"prometheus-operator-567f7b8b7c-v98dg\" (UID: \"63df574d-5c54-4219-9448-dab8a2ef9229\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-v98dg" Jul 07 16:23:58.700448 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:58.700322 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:23:59.099018 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:59.098987 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/63df574d-5c54-4219-9448-dab8a2ef9229-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-v98dg\" (UID: \"63df574d-5c54-4219-9448-dab8a2ef9229\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-v98dg" Jul 07 16:23:59.101494 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:59.101467 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/63df574d-5c54-4219-9448-dab8a2ef9229-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-v98dg\" (UID: \"63df574d-5c54-4219-9448-dab8a2ef9229\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-v98dg" Jul 07 16:23:59.321835 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:59.321803 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-v98dg" Jul 07 16:23:59.993775 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:23:59.993702 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:00.061521 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:00.061487 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:00.229939 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:00.229906 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-v98dg"] Jul 07 16:24:01.179875 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:24:01.179792 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63df574d_5c54_4219_9448_dab8a2ef9229.slice/crio-02cbbe5ad62b7de65c4642749ce8d85f897263407aec1f27b733401339765165 WatchSource:0}: Error finding container 02cbbe5ad62b7de65c4642749ce8d85f897263407aec1f27b733401339765165: Status 404 returned error can't find the container with id 02cbbe5ad62b7de65c4642749ce8d85f897263407aec1f27b733401339765165 Jul 07 16:24:01.904071 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:01.904030 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c8bbddb44-jvn97" event={"ID":"d4b71436-5a50-45c4-83ef-7e143a1d41c0","Type":"ContainerStarted","Data":"8ad788aefdf7d257a6f450426c5c1a68266ff1013746f49fb15d1fb8257a6012"} Jul 07 16:24:01.905192 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:01.905162 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-v98dg" event={"ID":"63df574d-5c54-4219-9448-dab8a2ef9229","Type":"ContainerStarted","Data":"02cbbe5ad62b7de65c4642749ce8d85f897263407aec1f27b733401339765165"} Jul 07 16:24:01.906651 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:01.906628 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nxh4s" event={"ID":"c22c4cf0-c358-4ab6-bee3-1fd64c11f646","Type":"ContainerStarted","Data":"513d1a2bf677534a1b8f4da4f5ebc2154e855552b5c10c2db2d431310ad831df"} Jul 07 16:24:01.908395 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:01.908366 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r2plv" event={"ID":"d53c196e-73f3-4146-b810-ef3c741a3ac6","Type":"ContainerStarted","Data":"cafa7bd973ddd0c6f49d09e410ef41c107786161dfffdfa84b40529cd4f7b619"} Jul 07 16:24:01.908490 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:01.908410 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r2plv" event={"ID":"d53c196e-73f3-4146-b810-ef3c741a3ac6","Type":"ContainerStarted","Data":"51f5ab13bd1b98344d8a6954ecebbfef8a084e6b8a99bf426e056bcf391cb36f"} Jul 07 16:24:01.908490 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:01.908440 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-r2plv" Jul 07 16:24:01.909929 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:01.909910 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nf9t6" event={"ID":"2e23de48-ba48-4eff-ade3-05b1e1661633","Type":"ContainerStarted","Data":"c9cecb507cd5597a52ae2caad013f4699495079fe9e22cadc572dd22fe360ca8"} Jul 07 16:24:01.925303 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:01.925258 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c8bbddb44-jvn97" podStartSLOduration=1.8409218520000001 podStartE2EDuration="6.925225494s" totalImagesPullingTime="5.084303642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:23:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:24:01.923470234 +0000 UTC m=+61.862979658" watchObservedRunningTime="2026-07-07 16:24:01.925225494 +0000 UTC m=+61.864734895" Jul 07 16:24:01.929051 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:01.929023 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:01.945149 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:01.945098 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-r2plv" podStartSLOduration=2.782343235 podStartE2EDuration="7.945083768s" totalImagesPullingTime="5.162740533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:23:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:24:01.944395473 +0000 UTC m=+61.883904896" watchObservedRunningTime="2026-07-07 16:24:01.945083768 +0000 UTC m=+61.884593182" Jul 07 16:24:01.969299 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:01.969251 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nf9t6" podStartSLOduration=2.802767828 podStartE2EDuration="7.96920737s" totalImagesPullingTime="5.166439542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:23:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:24:01.968425376 +0000 UTC m=+61.907934800" watchObservedRunningTime="2026-07-07 16:24:01.96920737 +0000 UTC m=+61.908716793" Jul 07 16:24:02.029364 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:02.029330 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:02.830931 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:02.830517 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4llwj" Jul 07 16:24:02.916381 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:02.916346 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nxh4s" event={"ID":"c22c4cf0-c358-4ab6-bee3-1fd64c11f646","Type":"ContainerStarted","Data":"83f260acd4c769a54b1e494634a0fa20093c30f1c2c7b789a592953ad30b2b0e"} Jul 07 16:24:03.025242 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:03.025193 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:03.124126 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:03.124096 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:03.226055 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:03.225954 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:03.465662 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:03.465573 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:03.599411 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:03.599383 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:03.673982 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:03.673951 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:03.922105 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:03.922069 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-v98dg" event={"ID":"63df574d-5c54-4219-9448-dab8a2ef9229","Type":"ContainerStarted","Data":"10d460cc21cc760ea74d4d644be946e6ea37891a774ed79759d6022db64cec20"} Jul 07 16:24:03.922553 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:03.922133 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-v98dg" event={"ID":"63df574d-5c54-4219-9448-dab8a2ef9229","Type":"ContainerStarted","Data":"5d9ea1e174d48995ecbfeb618d58c4ef2e680383bb39f4b755fe4507ebc3475c"} Jul 07 16:24:03.947848 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:03.947786 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-v98dg" podStartSLOduration=3.978938757 podStartE2EDuration="5.947769913s" totalImagesPullingTime="1.968831156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:23:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:24:03.947152292 +0000 UTC m=+63.886661717" watchObservedRunningTime="2026-07-07 16:24:03.947769913 +0000 UTC m=+63.887279336" Jul 07 16:24:05.574057 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.574026 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:05.779415 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.779385 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:05.857436 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.857394 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zlgst"] Jul 07 16:24:05.862533 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.860285 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-c59xv"] Jul 07 16:24:05.862533 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.862293 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zlgst" Jul 07 16:24:05.863431 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.863410 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-c59xv" Jul 07 16:24:05.867631 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.867610 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 07 16:24:05.869967 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.869949 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-2hvbk\"" Jul 07 16:24:05.870074 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.870066 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 07 16:24:05.870435 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.870420 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 07 16:24:05.871327 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.871312 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 07 16:24:05.871410 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.871365 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-t5wdc\"" Jul 07 16:24:05.871410 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.871396 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 07 16:24:05.883938 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.883914 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zlgst"] Jul 07 16:24:05.888841 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.888820 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-c59xv"] Jul 07 16:24:05.899172 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.899151 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:05.912979 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.912951 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6mtx9"] Jul 07 16:24:05.914939 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.914924 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6mtx9" Jul 07 16:24:05.918087 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.918069 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 16:24:05.918200 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.918072 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 16:24:05.918200 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.918070 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 16:24:05.918200 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.918131 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-b7h4n\"" Jul 07 16:24:05.930179 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.930157 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nxh4s" event={"ID":"c22c4cf0-c358-4ab6-bee3-1fd64c11f646","Type":"ContainerStarted","Data":"060aed0e25f11c043a743964785cb7be8b6f60ff9cf20a5ba0e8408925098524"} Jul 07 16:24:05.952936 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.952912 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c8bbddb44-jvn97" Jul 07 16:24:05.953054 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.952955 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c8bbddb44-jvn97" Jul 07 16:24:05.953092 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.953049 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqtpv\" (UniqueName: \"kubernetes.io/projected/f3f99d3e-e147-4dde-82ac-617ac7ce6e6f-kube-api-access-lqtpv\") pod \"kube-state-metrics-7c9dbb8b7d-zlgst\" (UID: \"f3f99d3e-e147-4dde-82ac-617ac7ce6e6f\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zlgst" Jul 07 16:24:05.953129 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.953098 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3fa407f5-fab3-4910-92f0-7b3f2a23e5fa-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-c59xv\" (UID: \"3fa407f5-fab3-4910-92f0-7b3f2a23e5fa\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-c59xv" Jul 07 16:24:05.953268 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.953252 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3f99d3e-e147-4dde-82ac-617ac7ce6e6f-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-zlgst\" (UID: \"f3f99d3e-e147-4dde-82ac-617ac7ce6e6f\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zlgst" Jul 07 16:24:05.953356 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.953316 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f662cb89-c9b0-42d3-8dad-8e2633b887af-node-exporter-accelerators-collector-config\") pod \"node-exporter-6mtx9\" (UID: \"f662cb89-c9b0-42d3-8dad-8e2633b887af\") " pod="openshift-monitoring/node-exporter-6mtx9" Jul 07 16:24:05.953356 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.953347 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f3f99d3e-e147-4dde-82ac-617ac7ce6e6f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-zlgst\" (UID: \"f3f99d3e-e147-4dde-82ac-617ac7ce6e6f\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zlgst" Jul 07 16:24:05.953442 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.953393 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwcrd\" (UniqueName: \"kubernetes.io/projected/3fa407f5-fab3-4910-92f0-7b3f2a23e5fa-kube-api-access-fwcrd\") pod \"openshift-state-metrics-54cf96dfcf-c59xv\" (UID: \"3fa407f5-fab3-4910-92f0-7b3f2a23e5fa\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-c59xv" Jul 07 16:24:05.953442 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.953419 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f662cb89-c9b0-42d3-8dad-8e2633b887af-node-exporter-textfile\") pod \"node-exporter-6mtx9\" (UID: \"f662cb89-c9b0-42d3-8dad-8e2633b887af\") " pod="openshift-monitoring/node-exporter-6mtx9" Jul 07 16:24:05.953536 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.953444 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls8f4\" (UniqueName: \"kubernetes.io/projected/f662cb89-c9b0-42d3-8dad-8e2633b887af-kube-api-access-ls8f4\") pod \"node-exporter-6mtx9\" (UID: \"f662cb89-c9b0-42d3-8dad-8e2633b887af\") " pod="openshift-monitoring/node-exporter-6mtx9" Jul 07 16:24:05.953536 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.953465 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f3f99d3e-e147-4dde-82ac-617ac7ce6e6f-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-zlgst\" (UID: \"f3f99d3e-e147-4dde-82ac-617ac7ce6e6f\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zlgst" Jul 07 16:24:05.953536 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.953490 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f662cb89-c9b0-42d3-8dad-8e2633b887af-metrics-client-ca\") pod \"node-exporter-6mtx9\" (UID: \"f662cb89-c9b0-42d3-8dad-8e2633b887af\") " pod="openshift-monitoring/node-exporter-6mtx9" Jul 07 16:24:05.953670 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.953540 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f662cb89-c9b0-42d3-8dad-8e2633b887af-node-exporter-wtmp\") pod \"node-exporter-6mtx9\" (UID: \"f662cb89-c9b0-42d3-8dad-8e2633b887af\") " pod="openshift-monitoring/node-exporter-6mtx9" Jul 07 16:24:05.953670 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.953571 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f3f99d3e-e147-4dde-82ac-617ac7ce6e6f-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-zlgst\" (UID: \"f3f99d3e-e147-4dde-82ac-617ac7ce6e6f\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zlgst" Jul 07 16:24:05.953670 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.953597 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f662cb89-c9b0-42d3-8dad-8e2633b887af-node-exporter-tls\") pod \"node-exporter-6mtx9\" (UID: \"f662cb89-c9b0-42d3-8dad-8e2633b887af\") " pod="openshift-monitoring/node-exporter-6mtx9" Jul 07 16:24:05.953670 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.953615 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f662cb89-c9b0-42d3-8dad-8e2633b887af-root\") pod \"node-exporter-6mtx9\" (UID: \"f662cb89-c9b0-42d3-8dad-8e2633b887af\") " pod="openshift-monitoring/node-exporter-6mtx9" Jul 07 16:24:05.953670 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.953636 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f3f99d3e-e147-4dde-82ac-617ac7ce6e6f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-zlgst\" (UID: \"f3f99d3e-e147-4dde-82ac-617ac7ce6e6f\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zlgst" Jul 07 16:24:05.953898 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.953674 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f662cb89-c9b0-42d3-8dad-8e2633b887af-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6mtx9\" (UID: \"f662cb89-c9b0-42d3-8dad-8e2633b887af\") " pod="openshift-monitoring/node-exporter-6mtx9" Jul 07 16:24:05.953898 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.953697 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fa407f5-fab3-4910-92f0-7b3f2a23e5fa-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-c59xv\" (UID: \"3fa407f5-fab3-4910-92f0-7b3f2a23e5fa\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-c59xv" Jul 07 16:24:05.953898 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.953720 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f662cb89-c9b0-42d3-8dad-8e2633b887af-sys\") pod \"node-exporter-6mtx9\" (UID: \"f662cb89-c9b0-42d3-8dad-8e2633b887af\") " pod="openshift-monitoring/node-exporter-6mtx9" Jul 07 16:24:05.953898 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.953748 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3fa407f5-fab3-4910-92f0-7b3f2a23e5fa-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-c59xv\" (UID: \"3fa407f5-fab3-4910-92f0-7b3f2a23e5fa\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-c59xv" Jul 07 16:24:05.954435 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.954415 2564 patch_prober.go:28] interesting pod/console-7c8bbddb44-jvn97 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused" start-of-body= Jul 07 16:24:05.954502 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.954460 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7c8bbddb44-jvn97" podUID="d4b71436-5a50-45c4-83ef-7e143a1d41c0" containerName="console" probeResult="failure" output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused" Jul 07 16:24:05.959162 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.959124 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nxh4s" podStartSLOduration=1.455992098 podStartE2EDuration="11.959112381s" totalImagesPullingTime="10.503120283s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:23:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:24:05.958191002 +0000 UTC m=+65.897700426" watchObservedRunningTime="2026-07-07 16:24:05.959112381 +0000 UTC m=+65.898621804" Jul 07 16:24:05.997599 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:05.997580 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:06.054979 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.054949 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3f99d3e-e147-4dde-82ac-617ac7ce6e6f-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-zlgst\" (UID: \"f3f99d3e-e147-4dde-82ac-617ac7ce6e6f\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zlgst" Jul 07 16:24:06.055158 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.055138 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f662cb89-c9b0-42d3-8dad-8e2633b887af-node-exporter-accelerators-collector-config\") pod \"node-exporter-6mtx9\" (UID: \"f662cb89-c9b0-42d3-8dad-8e2633b887af\") " pod="openshift-monitoring/node-exporter-6mtx9" Jul 07 16:24:06.055209 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.055187 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f3f99d3e-e147-4dde-82ac-617ac7ce6e6f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-zlgst\" (UID: \"f3f99d3e-e147-4dde-82ac-617ac7ce6e6f\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zlgst" Jul 07 16:24:06.055294 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.055269 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwcrd\" (UniqueName: \"kubernetes.io/projected/3fa407f5-fab3-4910-92f0-7b3f2a23e5fa-kube-api-access-fwcrd\") pod \"openshift-state-metrics-54cf96dfcf-c59xv\" (UID: \"3fa407f5-fab3-4910-92f0-7b3f2a23e5fa\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-c59xv" Jul 07 16:24:06.055332 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.055311 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f662cb89-c9b0-42d3-8dad-8e2633b887af-node-exporter-textfile\") pod \"node-exporter-6mtx9\" (UID: \"f662cb89-c9b0-42d3-8dad-8e2633b887af\") " pod="openshift-monitoring/node-exporter-6mtx9" Jul 07 16:24:06.055372 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.055339 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls8f4\" (UniqueName: \"kubernetes.io/projected/f662cb89-c9b0-42d3-8dad-8e2633b887af-kube-api-access-ls8f4\") pod \"node-exporter-6mtx9\" (UID: \"f662cb89-c9b0-42d3-8dad-8e2633b887af\") " pod="openshift-monitoring/node-exporter-6mtx9" Jul 07 16:24:06.055372 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.055363 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f3f99d3e-e147-4dde-82ac-617ac7ce6e6f-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-zlgst\" (UID: \"f3f99d3e-e147-4dde-82ac-617ac7ce6e6f\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zlgst" Jul 07 16:24:06.055464 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.055388 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f662cb89-c9b0-42d3-8dad-8e2633b887af-metrics-client-ca\") pod \"node-exporter-6mtx9\" (UID: \"f662cb89-c9b0-42d3-8dad-8e2633b887af\") " pod="openshift-monitoring/node-exporter-6mtx9" Jul 07 16:24:06.055464 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.055432 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f662cb89-c9b0-42d3-8dad-8e2633b887af-node-exporter-wtmp\") pod \"node-exporter-6mtx9\" (UID: \"f662cb89-c9b0-42d3-8dad-8e2633b887af\") " pod="openshift-monitoring/node-exporter-6mtx9" Jul 07 16:24:06.055464 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.055458 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f3f99d3e-e147-4dde-82ac-617ac7ce6e6f-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-zlgst\" (UID: \"f3f99d3e-e147-4dde-82ac-617ac7ce6e6f\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zlgst" Jul 07 16:24:06.055617 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.055482 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f662cb89-c9b0-42d3-8dad-8e2633b887af-node-exporter-tls\") pod \"node-exporter-6mtx9\" (UID: \"f662cb89-c9b0-42d3-8dad-8e2633b887af\") " pod="openshift-monitoring/node-exporter-6mtx9" Jul 07 16:24:06.055617 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.055512 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f662cb89-c9b0-42d3-8dad-8e2633b887af-root\") pod \"node-exporter-6mtx9\" (UID: \"f662cb89-c9b0-42d3-8dad-8e2633b887af\") " pod="openshift-monitoring/node-exporter-6mtx9" Jul 07 16:24:06.055617 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.055538 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f3f99d3e-e147-4dde-82ac-617ac7ce6e6f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-zlgst\" (UID: \"f3f99d3e-e147-4dde-82ac-617ac7ce6e6f\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zlgst" Jul 07 16:24:06.055617 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.055566 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f662cb89-c9b0-42d3-8dad-8e2633b887af-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6mtx9\" (UID: \"f662cb89-c9b0-42d3-8dad-8e2633b887af\") " pod="openshift-monitoring/node-exporter-6mtx9" Jul 07 16:24:06.055617 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.055595 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fa407f5-fab3-4910-92f0-7b3f2a23e5fa-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-c59xv\" (UID: \"3fa407f5-fab3-4910-92f0-7b3f2a23e5fa\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-c59xv" Jul 07 16:24:06.055845 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.055633 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f662cb89-c9b0-42d3-8dad-8e2633b887af-sys\") pod \"node-exporter-6mtx9\" (UID: \"f662cb89-c9b0-42d3-8dad-8e2633b887af\") " pod="openshift-monitoring/node-exporter-6mtx9" Jul 07 16:24:06.055845 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.055697 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3fa407f5-fab3-4910-92f0-7b3f2a23e5fa-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-c59xv\" (UID: \"3fa407f5-fab3-4910-92f0-7b3f2a23e5fa\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-c59xv" Jul 07 16:24:06.055845 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.055728 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqtpv\" (UniqueName: \"kubernetes.io/projected/f3f99d3e-e147-4dde-82ac-617ac7ce6e6f-kube-api-access-lqtpv\") pod \"kube-state-metrics-7c9dbb8b7d-zlgst\" (UID: \"f3f99d3e-e147-4dde-82ac-617ac7ce6e6f\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zlgst" Jul 07 16:24:06.055845 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.055752 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3f99d3e-e147-4dde-82ac-617ac7ce6e6f-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-zlgst\" (UID: \"f3f99d3e-e147-4dde-82ac-617ac7ce6e6f\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zlgst" Jul 07 16:24:06.055845 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.055777 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3fa407f5-fab3-4910-92f0-7b3f2a23e5fa-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-c59xv\" (UID: \"3fa407f5-fab3-4910-92f0-7b3f2a23e5fa\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-c59xv" Jul 07 16:24:06.055845 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.055778 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f662cb89-c9b0-42d3-8dad-8e2633b887af-root\") pod \"node-exporter-6mtx9\" (UID: \"f662cb89-c9b0-42d3-8dad-8e2633b887af\") " pod="openshift-monitoring/node-exporter-6mtx9" Jul 07 16:24:06.055845 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.055811 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f662cb89-c9b0-42d3-8dad-8e2633b887af-sys\") pod \"node-exporter-6mtx9\" (UID: \"f662cb89-c9b0-42d3-8dad-8e2633b887af\") " pod="openshift-monitoring/node-exporter-6mtx9" Jul 07 16:24:06.055845 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.055596 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f662cb89-c9b0-42d3-8dad-8e2633b887af-node-exporter-textfile\") pod \"node-exporter-6mtx9\" (UID: \"f662cb89-c9b0-42d3-8dad-8e2633b887af\") " pod="openshift-monitoring/node-exporter-6mtx9" Jul 07 16:24:06.056265 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.055862 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f3f99d3e-e147-4dde-82ac-617ac7ce6e6f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-zlgst\" (UID: \"f3f99d3e-e147-4dde-82ac-617ac7ce6e6f\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zlgst" Jul 07 16:24:06.056265 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.056002 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f3f99d3e-e147-4dde-82ac-617ac7ce6e6f-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-zlgst\" (UID: \"f3f99d3e-e147-4dde-82ac-617ac7ce6e6f\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zlgst" Jul 07 16:24:06.056265 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.056040 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f662cb89-c9b0-42d3-8dad-8e2633b887af-node-exporter-wtmp\") pod \"node-exporter-6mtx9\" (UID: \"f662cb89-c9b0-42d3-8dad-8e2633b887af\") " pod="openshift-monitoring/node-exporter-6mtx9" Jul 07 16:24:06.056428 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.056331 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f662cb89-c9b0-42d3-8dad-8e2633b887af-node-exporter-accelerators-collector-config\") pod \"node-exporter-6mtx9\" (UID: \"f662cb89-c9b0-42d3-8dad-8e2633b887af\") " pod="openshift-monitoring/node-exporter-6mtx9" Jul 07 16:24:06.056572 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.056550 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f662cb89-c9b0-42d3-8dad-8e2633b887af-metrics-client-ca\") pod \"node-exporter-6mtx9\" (UID: \"f662cb89-c9b0-42d3-8dad-8e2633b887af\") " pod="openshift-monitoring/node-exporter-6mtx9" Jul 07 16:24:06.056629 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:24:06.056589 2564 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 07 16:24:06.056672 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:24:06.056661 2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 07 16:24:06.056714 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:24:06.056706 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f662cb89-c9b0-42d3-8dad-8e2633b887af-node-exporter-tls podName:f662cb89-c9b0-42d3-8dad-8e2633b887af nodeName:}" failed. No retries permitted until 2026-07-07 16:24:06.556694232 +0000 UTC m=+66.496203634 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/f662cb89-c9b0-42d3-8dad-8e2633b887af-node-exporter-tls") pod "node-exporter-6mtx9" (UID: "f662cb89-c9b0-42d3-8dad-8e2633b887af") : secret "node-exporter-tls" not found Jul 07 16:24:06.056842 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:24:06.056823 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fa407f5-fab3-4910-92f0-7b3f2a23e5fa-openshift-state-metrics-tls podName:3fa407f5-fab3-4910-92f0-7b3f2a23e5fa nodeName:}" failed. No retries permitted until 2026-07-07 16:24:06.556807089 +0000 UTC m=+66.496316490 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/3fa407f5-fab3-4910-92f0-7b3f2a23e5fa-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-c59xv" (UID: "3fa407f5-fab3-4910-92f0-7b3f2a23e5fa") : secret "openshift-state-metrics-tls" not found Jul 07 16:24:06.056966 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.056947 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fa407f5-fab3-4910-92f0-7b3f2a23e5fa-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-c59xv\" (UID: \"3fa407f5-fab3-4910-92f0-7b3f2a23e5fa\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-c59xv" Jul 07 16:24:06.058590 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.058567 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3fa407f5-fab3-4910-92f0-7b3f2a23e5fa-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-c59xv\" (UID: \"3fa407f5-fab3-4910-92f0-7b3f2a23e5fa\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-c59xv" Jul 07 16:24:06.058766 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.058750 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f662cb89-c9b0-42d3-8dad-8e2633b887af-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6mtx9\" (UID: \"f662cb89-c9b0-42d3-8dad-8e2633b887af\") " pod="openshift-monitoring/node-exporter-6mtx9" Jul 07 16:24:06.058867 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.058851 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f3f99d3e-e147-4dde-82ac-617ac7ce6e6f-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-zlgst\" (UID: \"f3f99d3e-e147-4dde-82ac-617ac7ce6e6f\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zlgst" Jul 07 16:24:06.059042 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.059022 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f3f99d3e-e147-4dde-82ac-617ac7ce6e6f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-zlgst\" (UID: \"f3f99d3e-e147-4dde-82ac-617ac7ce6e6f\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zlgst" Jul 07 16:24:06.081874 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.081844 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls8f4\" (UniqueName: \"kubernetes.io/projected/f662cb89-c9b0-42d3-8dad-8e2633b887af-kube-api-access-ls8f4\") pod \"node-exporter-6mtx9\" (UID: \"f662cb89-c9b0-42d3-8dad-8e2633b887af\") " pod="openshift-monitoring/node-exporter-6mtx9" Jul 07 16:24:06.081956 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.081940 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwcrd\" (UniqueName: \"kubernetes.io/projected/3fa407f5-fab3-4910-92f0-7b3f2a23e5fa-kube-api-access-fwcrd\") pod \"openshift-state-metrics-54cf96dfcf-c59xv\" (UID: \"3fa407f5-fab3-4910-92f0-7b3f2a23e5fa\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-c59xv" Jul 07 16:24:06.083787 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.083770 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqtpv\" (UniqueName: \"kubernetes.io/projected/f3f99d3e-e147-4dde-82ac-617ac7ce6e6f-kube-api-access-lqtpv\") pod \"kube-state-metrics-7c9dbb8b7d-zlgst\" (UID: \"f3f99d3e-e147-4dde-82ac-617ac7ce6e6f\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zlgst" Jul 07 16:24:06.106633 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.106605 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:06.172363 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.172283 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zlgst" Jul 07 16:24:06.208494 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.208452 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:06.299445 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.299416 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zlgst"] Jul 07 16:24:06.302109 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:24:06.302088 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3f99d3e_e147_4dde_82ac_617ac7ce6e6f.slice/crio-6118328bdee898efff0e04b63ddae54a3bc772e3bee85556218ccf10d86204f6 WatchSource:0}: Error finding container 6118328bdee898efff0e04b63ddae54a3bc772e3bee85556218ccf10d86204f6: Status 404 returned error can't find the container with id 6118328bdee898efff0e04b63ddae54a3bc772e3bee85556218ccf10d86204f6 Jul 07 16:24:06.303334 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.303300 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:06.357681 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.357660 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc1cd2ef-cb98-430b-bdee-883a3129c2af-original-pull-secret\") pod \"global-pull-secret-syncer-5s79k\" (UID: \"dc1cd2ef-cb98-430b-bdee-883a3129c2af\") " pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:24:06.357771 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.357752 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d679cf5e-f509-4cf8-94e0-325f8c4180ea-metrics-certs\") pod \"network-metrics-daemon-k2mr5\" (UID: \"d679cf5e-f509-4cf8-94e0-325f8c4180ea\") " pod="openshift-multus/network-metrics-daemon-k2mr5" Jul 07 16:24:06.361095 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.361079 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 16:24:06.361145 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.361095 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 16:24:06.371207 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.371181 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d679cf5e-f509-4cf8-94e0-325f8c4180ea-metrics-certs\") pod \"network-metrics-daemon-k2mr5\" (UID: \"d679cf5e-f509-4cf8-94e0-325f8c4180ea\") " pod="openshift-multus/network-metrics-daemon-k2mr5" Jul 07 16:24:06.371207 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.371200 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc1cd2ef-cb98-430b-bdee-883a3129c2af-original-pull-secret\") pod \"global-pull-secret-syncer-5s79k\" (UID: \"dc1cd2ef-cb98-430b-bdee-883a3129c2af\") " pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:24:06.415305 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.415278 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:06.458942 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.458856 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpxdc\" (UniqueName: \"kubernetes.io/projected/d305b801-d058-4ce5-b43b-062c1994a145-kube-api-access-rpxdc\") pod \"network-check-target-ssslq\" (UID: \"d305b801-d058-4ce5-b43b-062c1994a145\") " pod="openshift-network-diagnostics/network-check-target-ssslq" Jul 07 16:24:06.462212 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.462186 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 16:24:06.472546 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.472524 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 16:24:06.482640 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.482620 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpxdc\" (UniqueName: \"kubernetes.io/projected/d305b801-d058-4ce5-b43b-062c1994a145-kube-api-access-rpxdc\") pod \"network-check-target-ssslq\" (UID: \"d305b801-d058-4ce5-b43b-062c1994a145\") " pod="openshift-network-diagnostics/network-check-target-ssslq" Jul 07 16:24:06.559842 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.559811 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f662cb89-c9b0-42d3-8dad-8e2633b887af-node-exporter-tls\") pod \"node-exporter-6mtx9\" (UID: \"f662cb89-c9b0-42d3-8dad-8e2633b887af\") " pod="openshift-monitoring/node-exporter-6mtx9" Jul 07 16:24:06.559970 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.559853 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3fa407f5-fab3-4910-92f0-7b3f2a23e5fa-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-c59xv\" (UID: \"3fa407f5-fab3-4910-92f0-7b3f2a23e5fa\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-c59xv" Jul 07 16:24:06.562283 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.562263 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f662cb89-c9b0-42d3-8dad-8e2633b887af-node-exporter-tls\") pod \"node-exporter-6mtx9\" (UID: \"f662cb89-c9b0-42d3-8dad-8e2633b887af\") " pod="openshift-monitoring/node-exporter-6mtx9" Jul 07 16:24:06.562410 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.562393 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3fa407f5-fab3-4910-92f0-7b3f2a23e5fa-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-c59xv\" (UID: \"3fa407f5-fab3-4910-92f0-7b3f2a23e5fa\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-c59xv" Jul 07 16:24:06.579410 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.579379 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:06.657488 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.657462 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s79k" Jul 07 16:24:06.665151 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.665134 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xxp9t\"" Jul 07 16:24:06.672178 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.672159 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2mr5" Jul 07 16:24:06.767239 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.767149 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vjw6s\"" Jul 07 16:24:06.775163 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.774912 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssslq" Jul 07 16:24:06.777284 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.777225 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-c59xv" Jul 07 16:24:06.794624 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.794594 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:06.799997 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.799966 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5s79k"] Jul 07 16:24:06.803849 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:24:06.803812 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc1cd2ef_cb98_430b_bdee_883a3129c2af.slice/crio-7cb1876e0f885d89606bdbaa5e8016a124f58f1ca330e3b13d3d22e937fb73b7 WatchSource:0}: Error finding container 7cb1876e0f885d89606bdbaa5e8016a124f58f1ca330e3b13d3d22e937fb73b7: Status 404 returned error can't find the container with id 7cb1876e0f885d89606bdbaa5e8016a124f58f1ca330e3b13d3d22e937fb73b7 Jul 07 16:24:06.824878 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.824393 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6mtx9" Jul 07 16:24:06.841800 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.841017 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k2mr5"] Jul 07 16:24:06.843374 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:24:06.842803 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf662cb89_c9b0_42d3_8dad_8e2633b887af.slice/crio-cb027205933f79865593c242c0baec236467b3747a18ba9bd5f61707153450ff WatchSource:0}: Error finding container cb027205933f79865593c242c0baec236467b3747a18ba9bd5f61707153450ff: Status 404 returned error can't find the container with id cb027205933f79865593c242c0baec236467b3747a18ba9bd5f61707153450ff Jul 07 16:24:06.856004 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:24:06.855972 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd679cf5e_f509_4cf8_94e0_325f8c4180ea.slice/crio-8b0025922b26adc6d649e183650b011d3a2d50ba38990824df282e495cbaa821 WatchSource:0}: Error finding container 8b0025922b26adc6d649e183650b011d3a2d50ba38990824df282e495cbaa821: Status 404 returned error can't find the container with id 8b0025922b26adc6d649e183650b011d3a2d50ba38990824df282e495cbaa821 Jul 07 16:24:06.937484 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.937447 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k2mr5" event={"ID":"d679cf5e-f509-4cf8-94e0-325f8c4180ea","Type":"ContainerStarted","Data":"8b0025922b26adc6d649e183650b011d3a2d50ba38990824df282e495cbaa821"} Jul 07 16:24:06.938739 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.938707 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5s79k" event={"ID":"dc1cd2ef-cb98-430b-bdee-883a3129c2af","Type":"ContainerStarted","Data":"7cb1876e0f885d89606bdbaa5e8016a124f58f1ca330e3b13d3d22e937fb73b7"} Jul 07 16:24:06.940099 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.940070 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6mtx9" event={"ID":"f662cb89-c9b0-42d3-8dad-8e2633b887af","Type":"ContainerStarted","Data":"cb027205933f79865593c242c0baec236467b3747a18ba9bd5f61707153450ff"} Jul 07 16:24:06.941366 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.941331 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zlgst" event={"ID":"f3f99d3e-e147-4dde-82ac-617ac7ce6e6f","Type":"ContainerStarted","Data":"6118328bdee898efff0e04b63ddae54a3bc772e3bee85556218ccf10d86204f6"} Jul 07 16:24:06.950162 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.950143 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-c59xv"] Jul 07 16:24:06.952885 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:24:06.952861 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fa407f5_fab3_4910_92f0_7b3f2a23e5fa.slice/crio-a7f0a15f89f7d5a74a1cae4d4e1880b89cc8503f654a53c50b75ecb750d5b02f WatchSource:0}: Error finding container a7f0a15f89f7d5a74a1cae4d4e1880b89cc8503f654a53c50b75ecb750d5b02f: Status 404 returned error can't find the container with id a7f0a15f89f7d5a74a1cae4d4e1880b89cc8503f654a53c50b75ecb750d5b02f Jul 07 16:24:06.959888 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.959861 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:06.981010 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:06.980959 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ssslq"] Jul 07 16:24:06.984205 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:24:06.984176 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd305b801_d058_4ce5_b43b_062c1994a145.slice/crio-f6751db35c21688f2714f2900212feb4e5732a59e99ee37584f5db887d87050c WatchSource:0}: Error finding container f6751db35c21688f2714f2900212feb4e5732a59e99ee37584f5db887d87050c: Status 404 returned error can't find the container with id f6751db35c21688f2714f2900212feb4e5732a59e99ee37584f5db887d87050c Jul 07 16:24:07.273386 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:07.273292 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:07.947934 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:07.947672 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6474d5975b-pqtfr"] Jul 07 16:24:07.952877 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:07.951549 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-c59xv" event={"ID":"3fa407f5-fab3-4910-92f0-7b3f2a23e5fa","Type":"ContainerStarted","Data":"77e0b4d729e59f12b996ba358ed797ffbccbf876b6586ffbb8c37f6443687fad"} Jul 07 16:24:07.952877 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:07.951599 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-c59xv" event={"ID":"3fa407f5-fab3-4910-92f0-7b3f2a23e5fa","Type":"ContainerStarted","Data":"f48a98ef0bac9cb886e8344fb2e7eaa2d964d295ee2a26af2b5a64dbe73c98ce"} Jul 07 16:24:07.952877 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:07.951629 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-c59xv" event={"ID":"3fa407f5-fab3-4910-92f0-7b3f2a23e5fa","Type":"ContainerStarted","Data":"a7f0a15f89f7d5a74a1cae4d4e1880b89cc8503f654a53c50b75ecb750d5b02f"} Jul 07 16:24:07.952877 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:07.951737 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6474d5975b-pqtfr" Jul 07 16:24:07.953426 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:07.952944 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ssslq" event={"ID":"d305b801-d058-4ce5-b43b-062c1994a145","Type":"ContainerStarted","Data":"f6751db35c21688f2714f2900212feb4e5732a59e99ee37584f5db887d87050c"} Jul 07 16:24:07.956604 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:07.956580 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 07 16:24:07.956829 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:07.956807 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 07 16:24:07.957089 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:07.957067 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 07 16:24:07.957295 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:07.957276 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 07 16:24:07.957571 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:07.957339 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 07 16:24:07.959364 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:07.958184 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-zlkf7\"" Jul 07 16:24:07.959364 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:07.958427 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-ckie66faiinlb\"" Jul 07 16:24:07.969617 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:07.969589 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6474d5975b-pqtfr"] Jul 07 16:24:08.076726 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:08.076310 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qbrr\" (UniqueName: \"kubernetes.io/projected/9ba005fe-7732-4167-81ca-6f6859cb137d-kube-api-access-4qbrr\") pod \"thanos-querier-6474d5975b-pqtfr\" (UID: \"9ba005fe-7732-4167-81ca-6f6859cb137d\") " pod="openshift-monitoring/thanos-querier-6474d5975b-pqtfr" Jul 07 16:24:08.076726 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:08.076363 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ba005fe-7732-4167-81ca-6f6859cb137d-metrics-client-ca\") pod \"thanos-querier-6474d5975b-pqtfr\" (UID: \"9ba005fe-7732-4167-81ca-6f6859cb137d\") " pod="openshift-monitoring/thanos-querier-6474d5975b-pqtfr" Jul 07 16:24:08.076726 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:08.076396 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9ba005fe-7732-4167-81ca-6f6859cb137d-secret-grpc-tls\") pod \"thanos-querier-6474d5975b-pqtfr\" (UID: \"9ba005fe-7732-4167-81ca-6f6859cb137d\") " pod="openshift-monitoring/thanos-querier-6474d5975b-pqtfr" Jul 07 16:24:08.076726 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:08.076444 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ba005fe-7732-4167-81ca-6f6859cb137d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6474d5975b-pqtfr\" (UID: \"9ba005fe-7732-4167-81ca-6f6859cb137d\") " pod="openshift-monitoring/thanos-querier-6474d5975b-pqtfr" Jul 07 16:24:08.076726 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:08.076503 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ba005fe-7732-4167-81ca-6f6859cb137d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6474d5975b-pqtfr\" (UID: \"9ba005fe-7732-4167-81ca-6f6859cb137d\") " pod="openshift-monitoring/thanos-querier-6474d5975b-pqtfr" Jul 07 16:24:08.076726 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:08.076530 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9ba005fe-7732-4167-81ca-6f6859cb137d-secret-thanos-querier-tls\") pod \"thanos-querier-6474d5975b-pqtfr\" (UID: \"9ba005fe-7732-4167-81ca-6f6859cb137d\") " pod="openshift-monitoring/thanos-querier-6474d5975b-pqtfr" Jul 07 16:24:08.076726 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:08.076566 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9ba005fe-7732-4167-81ca-6f6859cb137d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6474d5975b-pqtfr\" (UID: \"9ba005fe-7732-4167-81ca-6f6859cb137d\") " pod="openshift-monitoring/thanos-querier-6474d5975b-pqtfr" Jul 07 16:24:08.076726 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:08.076597 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9ba005fe-7732-4167-81ca-6f6859cb137d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6474d5975b-pqtfr\" (UID: \"9ba005fe-7732-4167-81ca-6f6859cb137d\") " pod="openshift-monitoring/thanos-querier-6474d5975b-pqtfr" Jul 07 16:24:08.177784 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:08.177738 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ba005fe-7732-4167-81ca-6f6859cb137d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6474d5975b-pqtfr\" (UID: \"9ba005fe-7732-4167-81ca-6f6859cb137d\") " pod="openshift-monitoring/thanos-querier-6474d5975b-pqtfr" Jul 07 16:24:08.177955 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:08.177792 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9ba005fe-7732-4167-81ca-6f6859cb137d-secret-thanos-querier-tls\") pod \"thanos-querier-6474d5975b-pqtfr\" (UID: \"9ba005fe-7732-4167-81ca-6f6859cb137d\") " pod="openshift-monitoring/thanos-querier-6474d5975b-pqtfr" Jul 07 16:24:08.177955 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:08.177834 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9ba005fe-7732-4167-81ca-6f6859cb137d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6474d5975b-pqtfr\" (UID: \"9ba005fe-7732-4167-81ca-6f6859cb137d\") " pod="openshift-monitoring/thanos-querier-6474d5975b-pqtfr" Jul 07 16:24:08.177955 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:08.177866 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9ba005fe-7732-4167-81ca-6f6859cb137d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6474d5975b-pqtfr\" (UID: \"9ba005fe-7732-4167-81ca-6f6859cb137d\") " pod="openshift-monitoring/thanos-querier-6474d5975b-pqtfr" Jul 07 16:24:08.177955 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:08.177899 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qbrr\" (UniqueName: \"kubernetes.io/projected/9ba005fe-7732-4167-81ca-6f6859cb137d-kube-api-access-4qbrr\") pod \"thanos-querier-6474d5975b-pqtfr\" (UID: \"9ba005fe-7732-4167-81ca-6f6859cb137d\") " pod="openshift-monitoring/thanos-querier-6474d5975b-pqtfr" Jul 07 16:24:08.177955 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:08.177931 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ba005fe-7732-4167-81ca-6f6859cb137d-metrics-client-ca\") pod \"thanos-querier-6474d5975b-pqtfr\" (UID: \"9ba005fe-7732-4167-81ca-6f6859cb137d\") " pod="openshift-monitoring/thanos-querier-6474d5975b-pqtfr" Jul 07 16:24:08.178222 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:08.177958 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9ba005fe-7732-4167-81ca-6f6859cb137d-secret-grpc-tls\") pod \"thanos-querier-6474d5975b-pqtfr\" (UID: \"9ba005fe-7732-4167-81ca-6f6859cb137d\") " pod="openshift-monitoring/thanos-querier-6474d5975b-pqtfr" Jul 07 16:24:08.178222 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:08.178011 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ba005fe-7732-4167-81ca-6f6859cb137d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6474d5975b-pqtfr\" (UID: \"9ba005fe-7732-4167-81ca-6f6859cb137d\") " pod="openshift-monitoring/thanos-querier-6474d5975b-pqtfr" Jul 07 16:24:08.179261 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:08.179119 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ba005fe-7732-4167-81ca-6f6859cb137d-metrics-client-ca\") pod \"thanos-querier-6474d5975b-pqtfr\" (UID: \"9ba005fe-7732-4167-81ca-6f6859cb137d\") " pod="openshift-monitoring/thanos-querier-6474d5975b-pqtfr" Jul 07 16:24:08.186950 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:08.186893 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ba005fe-7732-4167-81ca-6f6859cb137d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6474d5975b-pqtfr\" (UID: \"9ba005fe-7732-4167-81ca-6f6859cb137d\") " pod="openshift-monitoring/thanos-querier-6474d5975b-pqtfr" Jul 07 16:24:08.188574 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:08.188523 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9ba005fe-7732-4167-81ca-6f6859cb137d-secret-grpc-tls\") pod \"thanos-querier-6474d5975b-pqtfr\" (UID: \"9ba005fe-7732-4167-81ca-6f6859cb137d\") " pod="openshift-monitoring/thanos-querier-6474d5975b-pqtfr" Jul 07 16:24:08.189689 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:08.189140 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ba005fe-7732-4167-81ca-6f6859cb137d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6474d5975b-pqtfr\" (UID: \"9ba005fe-7732-4167-81ca-6f6859cb137d\") " pod="openshift-monitoring/thanos-querier-6474d5975b-pqtfr" Jul 07 16:24:08.189997 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:08.189954 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9ba005fe-7732-4167-81ca-6f6859cb137d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6474d5975b-pqtfr\" (UID: \"9ba005fe-7732-4167-81ca-6f6859cb137d\") " pod="openshift-monitoring/thanos-querier-6474d5975b-pqtfr" Jul 07 16:24:08.190907 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:08.190865 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9ba005fe-7732-4167-81ca-6f6859cb137d-secret-thanos-querier-tls\") pod \"thanos-querier-6474d5975b-pqtfr\" (UID: \"9ba005fe-7732-4167-81ca-6f6859cb137d\") " pod="openshift-monitoring/thanos-querier-6474d5975b-pqtfr" Jul 07 16:24:08.194951 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:08.194925 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9ba005fe-7732-4167-81ca-6f6859cb137d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6474d5975b-pqtfr\" (UID: \"9ba005fe-7732-4167-81ca-6f6859cb137d\") " pod="openshift-monitoring/thanos-querier-6474d5975b-pqtfr" Jul 07 16:24:08.197078 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:08.197052 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qbrr\" (UniqueName: \"kubernetes.io/projected/9ba005fe-7732-4167-81ca-6f6859cb137d-kube-api-access-4qbrr\") pod \"thanos-querier-6474d5975b-pqtfr\" (UID: \"9ba005fe-7732-4167-81ca-6f6859cb137d\") " pod="openshift-monitoring/thanos-querier-6474d5975b-pqtfr" Jul 07 16:24:08.266083 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:08.265989 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6474d5975b-pqtfr" Jul 07 16:24:08.586664 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:08.586584 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:08.710644 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:08.710610 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:08.813838 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:08.813754 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:08.915659 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:08.915579 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:09.014984 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:09.014949 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:09.058692 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:09.058597 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6474d5975b-pqtfr"] Jul 07 16:24:09.241214 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:09.241171 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:09.807689 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:09.807655 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:09.885571 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:09.885537 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:09.966920 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:09.966881 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k2mr5" event={"ID":"d679cf5e-f509-4cf8-94e0-325f8c4180ea","Type":"ContainerStarted","Data":"379bc1e2f8075d916894844858576627e6bca451123bdb5a883887858bfdab66"} Jul 07 16:24:09.967103 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:09.966985 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k2mr5" event={"ID":"d679cf5e-f509-4cf8-94e0-325f8c4180ea","Type":"ContainerStarted","Data":"32f41e2994e75f0eb3c23f8619d17d3e35171f612f9ad84d5031f22ce41d0c89"} Jul 07 16:24:09.969829 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:09.969688 2564 generic.go:356] "Generic (PLEG): container finished" podID="f662cb89-c9b0-42d3-8dad-8e2633b887af" containerID="1742c344ce25b251f8397187335dd59286a8b1e4c4620f22daf15d33e1fe2f66" exitCode=0 Jul 07 16:24:09.969829 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:09.969777 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6mtx9" event={"ID":"f662cb89-c9b0-42d3-8dad-8e2633b887af","Type":"ContainerDied","Data":"1742c344ce25b251f8397187335dd59286a8b1e4c4620f22daf15d33e1fe2f66"} Jul 07 16:24:09.972321 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:09.972292 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zlgst" event={"ID":"f3f99d3e-e147-4dde-82ac-617ac7ce6e6f","Type":"ContainerStarted","Data":"01efdc62d331c0c7c03f55959d47811317a088e5743c1267a4bad5878e115eaf"} Jul 07 16:24:09.972432 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:09.972356 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zlgst" event={"ID":"f3f99d3e-e147-4dde-82ac-617ac7ce6e6f","Type":"ContainerStarted","Data":"c75e92bc2a19f85a5cade2a57de92e527c89468e27a8b8d56ee448f56897067c"} Jul 07 16:24:09.972432 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:09.972384 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zlgst" event={"ID":"f3f99d3e-e147-4dde-82ac-617ac7ce6e6f","Type":"ContainerStarted","Data":"c4f11e348d28534f9cc2920e2145a3e991b8c93949de2502882881fed33cf3f3"} Jul 07 16:24:09.975598 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:09.975542 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-c59xv" event={"ID":"3fa407f5-fab3-4910-92f0-7b3f2a23e5fa","Type":"ContainerStarted","Data":"1eedcb180d2ab20017b6e11af8a45943511c83e8c0dd94879b0c62cdd321d56b"} Jul 07 16:24:09.976830 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:09.976758 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6474d5975b-pqtfr" event={"ID":"9ba005fe-7732-4167-81ca-6f6859cb137d","Type":"ContainerStarted","Data":"77f86ddb0a2594c0cf2117f810b86648d92f1447805332013304e637af9b6238"} Jul 07 16:24:09.986850 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:09.986320 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-k2mr5" podStartSLOduration=66.975857954 podStartE2EDuration="1m8.986302236s" totalImagesPullingTime="2.010444282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:23:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:24:09.985824873 +0000 UTC m=+69.925334297" watchObservedRunningTime="2026-07-07 16:24:09.986302236 +0000 UTC m=+69.925811720" Jul 07 16:24:10.010795 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:10.009805 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zlgst" podStartSLOduration=2.445383556 podStartE2EDuration="5.009774168s" totalImagesPullingTime="2.564390612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:24:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:24:10.008421554 +0000 UTC m=+69.947930988" watchObservedRunningTime="2026-07-07 16:24:10.009774168 +0000 UTC m=+69.949283594" Jul 07 16:24:10.033141 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:10.033082 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-c59xv" podStartSLOduration=2.992671926 podStartE2EDuration="5.033060095s" totalImagesPullingTime="2.040388169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:24:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:24:10.031773847 +0000 UTC m=+69.971283272" watchObservedRunningTime="2026-07-07 16:24:10.033060095 +0000 UTC m=+69.972569519" Jul 07 16:24:10.113862 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:10.113827 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:10.174933 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:10.174904 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:10.578075 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:10.577998 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:10.585168 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:10.585143 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-867n2"] Jul 07 16:24:10.587159 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:10.587144 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-867n2" Jul 07 16:24:10.589948 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:10.589927 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 07 16:24:10.590271 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:10.590256 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-vhvbz\"" Jul 07 16:24:10.597473 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:10.597452 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-867n2"] Jul 07 16:24:10.654794 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:10.654754 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:10.703221 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:10.703179 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7hb8\" (UniqueName: \"kubernetes.io/projected/559610cb-6966-45f8-9fb2-f6ab147684d9-kube-api-access-s7hb8\") pod \"monitoring-plugin-d5dcff7cf-867n2\" (UID: \"559610cb-6966-45f8-9fb2-f6ab147684d9\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-867n2" Jul 07 16:24:10.703425 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:10.703253 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/559610cb-6966-45f8-9fb2-f6ab147684d9-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-867n2\" (UID: \"559610cb-6966-45f8-9fb2-f6ab147684d9\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-867n2" Jul 07 16:24:10.804035 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:10.804000 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7hb8\" (UniqueName: \"kubernetes.io/projected/559610cb-6966-45f8-9fb2-f6ab147684d9-kube-api-access-s7hb8\") pod \"monitoring-plugin-d5dcff7cf-867n2\" (UID: \"559610cb-6966-45f8-9fb2-f6ab147684d9\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-867n2" Jul 07 16:24:10.804224 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:10.804053 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/559610cb-6966-45f8-9fb2-f6ab147684d9-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-867n2\" (UID: \"559610cb-6966-45f8-9fb2-f6ab147684d9\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-867n2" Jul 07 16:24:10.804317 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:24:10.804281 2564 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 07 16:24:10.804364 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:24:10.804350 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/559610cb-6966-45f8-9fb2-f6ab147684d9-monitoring-plugin-cert podName:559610cb-6966-45f8-9fb2-f6ab147684d9 nodeName:}" failed. No retries permitted until 2026-07-07 16:24:11.304327996 +0000 UTC m=+71.243837399 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/559610cb-6966-45f8-9fb2-f6ab147684d9-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-867n2" (UID: "559610cb-6966-45f8-9fb2-f6ab147684d9") : secret "monitoring-plugin-cert" not found Jul 07 16:24:10.818406 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:10.818343 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7hb8\" (UniqueName: \"kubernetes.io/projected/559610cb-6966-45f8-9fb2-f6ab147684d9-kube-api-access-s7hb8\") pod \"monitoring-plugin-d5dcff7cf-867n2\" (UID: \"559610cb-6966-45f8-9fb2-f6ab147684d9\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-867n2" Jul 07 16:24:11.078146 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:11.078115 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c8bbddb44-jvn97"] Jul 07 16:24:11.105538 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:11.105510 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:11.220425 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:11.220386 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84c7cf668-zddzg"] Jul 07 16:24:11.222715 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:11.222692 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84c7cf668-zddzg" Jul 07 16:24:11.238295 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:11.238267 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 07 16:24:11.247689 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:11.247662 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84c7cf668-zddzg"] Jul 07 16:24:11.307582 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:11.307548 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/559610cb-6966-45f8-9fb2-f6ab147684d9-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-867n2\" (UID: \"559610cb-6966-45f8-9fb2-f6ab147684d9\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-867n2" Jul 07 16:24:11.307750 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:11.307600 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4rhq\" (UniqueName: \"kubernetes.io/projected/ffebc237-d2f1-44b1-8129-b92033c91a3d-kube-api-access-k4rhq\") pod \"console-84c7cf668-zddzg\" (UID: \"ffebc237-d2f1-44b1-8129-b92033c91a3d\") " pod="openshift-console/console-84c7cf668-zddzg" Jul 07 16:24:11.307750 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:11.307629 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffebc237-d2f1-44b1-8129-b92033c91a3d-console-config\") pod \"console-84c7cf668-zddzg\" (UID: \"ffebc237-d2f1-44b1-8129-b92033c91a3d\") " pod="openshift-console/console-84c7cf668-zddzg" Jul 07 16:24:11.307750 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:11.307673 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffebc237-d2f1-44b1-8129-b92033c91a3d-console-serving-cert\") pod \"console-84c7cf668-zddzg\" (UID: \"ffebc237-d2f1-44b1-8129-b92033c91a3d\") " pod="openshift-console/console-84c7cf668-zddzg" Jul 07 16:24:11.307933 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:11.307763 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffebc237-d2f1-44b1-8129-b92033c91a3d-trusted-ca-bundle\") pod \"console-84c7cf668-zddzg\" (UID: \"ffebc237-d2f1-44b1-8129-b92033c91a3d\") " pod="openshift-console/console-84c7cf668-zddzg" Jul 07 16:24:11.307933 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:11.307809 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffebc237-d2f1-44b1-8129-b92033c91a3d-oauth-serving-cert\") pod \"console-84c7cf668-zddzg\" (UID: \"ffebc237-d2f1-44b1-8129-b92033c91a3d\") " pod="openshift-console/console-84c7cf668-zddzg" Jul 07 16:24:11.307933 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:11.307845 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffebc237-d2f1-44b1-8129-b92033c91a3d-service-ca\") pod \"console-84c7cf668-zddzg\" (UID: \"ffebc237-d2f1-44b1-8129-b92033c91a3d\") " pod="openshift-console/console-84c7cf668-zddzg" Jul 07 16:24:11.307933 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:11.307874 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffebc237-d2f1-44b1-8129-b92033c91a3d-console-oauth-config\") pod \"console-84c7cf668-zddzg\" (UID: \"ffebc237-d2f1-44b1-8129-b92033c91a3d\") " pod="openshift-console/console-84c7cf668-zddzg" Jul 07 16:24:11.310425 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:11.310405 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/559610cb-6966-45f8-9fb2-f6ab147684d9-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-867n2\" (UID: \"559610cb-6966-45f8-9fb2-f6ab147684d9\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-867n2" Jul 07 16:24:11.409362 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:11.409012 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4rhq\" (UniqueName: \"kubernetes.io/projected/ffebc237-d2f1-44b1-8129-b92033c91a3d-kube-api-access-k4rhq\") pod \"console-84c7cf668-zddzg\" (UID: \"ffebc237-d2f1-44b1-8129-b92033c91a3d\") " pod="openshift-console/console-84c7cf668-zddzg" Jul 07 16:24:11.409362 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:11.409073 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffebc237-d2f1-44b1-8129-b92033c91a3d-console-config\") pod \"console-84c7cf668-zddzg\" (UID: \"ffebc237-d2f1-44b1-8129-b92033c91a3d\") " pod="openshift-console/console-84c7cf668-zddzg" Jul 07 16:24:11.409362 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:11.409115 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffebc237-d2f1-44b1-8129-b92033c91a3d-console-serving-cert\") pod \"console-84c7cf668-zddzg\" (UID: \"ffebc237-d2f1-44b1-8129-b92033c91a3d\") " pod="openshift-console/console-84c7cf668-zddzg" Jul 07 16:24:11.409362 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:11.409142 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffebc237-d2f1-44b1-8129-b92033c91a3d-trusted-ca-bundle\") pod \"console-84c7cf668-zddzg\" (UID: \"ffebc237-d2f1-44b1-8129-b92033c91a3d\") " pod="openshift-console/console-84c7cf668-zddzg" Jul 07 16:24:11.409362 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:11.409173 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffebc237-d2f1-44b1-8129-b92033c91a3d-oauth-serving-cert\") pod \"console-84c7cf668-zddzg\" (UID: \"ffebc237-d2f1-44b1-8129-b92033c91a3d\") " pod="openshift-console/console-84c7cf668-zddzg" Jul 07 16:24:11.409362 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:11.409206 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffebc237-d2f1-44b1-8129-b92033c91a3d-service-ca\") pod \"console-84c7cf668-zddzg\" (UID: \"ffebc237-d2f1-44b1-8129-b92033c91a3d\") " pod="openshift-console/console-84c7cf668-zddzg" Jul 07 16:24:11.409362 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:11.409247 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffebc237-d2f1-44b1-8129-b92033c91a3d-console-oauth-config\") pod \"console-84c7cf668-zddzg\" (UID: \"ffebc237-d2f1-44b1-8129-b92033c91a3d\") " pod="openshift-console/console-84c7cf668-zddzg" Jul 07 16:24:11.409957 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:11.409917 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffebc237-d2f1-44b1-8129-b92033c91a3d-console-config\") pod \"console-84c7cf668-zddzg\" (UID: \"ffebc237-d2f1-44b1-8129-b92033c91a3d\") " pod="openshift-console/console-84c7cf668-zddzg" Jul 07 16:24:11.410147 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:11.410115 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffebc237-d2f1-44b1-8129-b92033c91a3d-service-ca\") pod \"console-84c7cf668-zddzg\" (UID: \"ffebc237-d2f1-44b1-8129-b92033c91a3d\") " pod="openshift-console/console-84c7cf668-zddzg" Jul 07 16:24:11.410208 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:11.410173 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffebc237-d2f1-44b1-8129-b92033c91a3d-oauth-serving-cert\") pod \"console-84c7cf668-zddzg\" (UID: \"ffebc237-d2f1-44b1-8129-b92033c91a3d\") " pod="openshift-console/console-84c7cf668-zddzg" Jul 07 16:24:11.410271 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:11.410207 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffebc237-d2f1-44b1-8129-b92033c91a3d-trusted-ca-bundle\") pod \"console-84c7cf668-zddzg\" (UID: \"ffebc237-d2f1-44b1-8129-b92033c91a3d\") " pod="openshift-console/console-84c7cf668-zddzg" Jul 07 16:24:11.412680 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:11.412660 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffebc237-d2f1-44b1-8129-b92033c91a3d-console-serving-cert\") pod \"console-84c7cf668-zddzg\" (UID: \"ffebc237-d2f1-44b1-8129-b92033c91a3d\") " pod="openshift-console/console-84c7cf668-zddzg" Jul 07 16:24:11.413274 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:11.413256 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffebc237-d2f1-44b1-8129-b92033c91a3d-console-oauth-config\") pod \"console-84c7cf668-zddzg\" (UID: \"ffebc237-d2f1-44b1-8129-b92033c91a3d\") " pod="openshift-console/console-84c7cf668-zddzg" Jul 07 16:24:11.421922 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:11.421899 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4rhq\" (UniqueName: \"kubernetes.io/projected/ffebc237-d2f1-44b1-8129-b92033c91a3d-kube-api-access-k4rhq\") pod \"console-84c7cf668-zddzg\" (UID: \"ffebc237-d2f1-44b1-8129-b92033c91a3d\") " pod="openshift-console/console-84c7cf668-zddzg" Jul 07 16:24:11.498585 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:11.498553 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-867n2" Jul 07 16:24:11.533340 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:11.533300 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84c7cf668-zddzg" Jul 07 16:24:11.918904 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:11.918871 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-r2plv" Jul 07 16:24:11.948738 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:11.948672 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:12.024773 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:12.024740 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:12.127552 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:12.127522 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:13.102354 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:13.102305 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:13.199799 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:13.199774 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:13.419522 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:13.419488 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84c7cf668-zddzg"] Jul 07 16:24:13.444808 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:13.444671 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-867n2"] Jul 07 16:24:13.451061 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:24:13.451033 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod559610cb_6966_45f8_9fb2_f6ab147684d9.slice/crio-b55365b9c36b9a4cea20d9c3af41c2eea8a5eb68abdfcfae0547a36e80bfdd83 WatchSource:0}: Error finding container b55365b9c36b9a4cea20d9c3af41c2eea8a5eb68abdfcfae0547a36e80bfdd83: Status 404 returned error can't find the container with id b55365b9c36b9a4cea20d9c3af41c2eea8a5eb68abdfcfae0547a36e80bfdd83 Jul 07 16:24:13.998218 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:13.998179 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ssslq" event={"ID":"d305b801-d058-4ce5-b43b-062c1994a145","Type":"ContainerStarted","Data":"871973adc54e938112a665dc5488214503fd6c0b94b730dff35f60b8e344f887"} Jul 07 16:24:13.998435 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:13.998285 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ssslq" Jul 07 16:24:14.000632 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:14.000608 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6474d5975b-pqtfr" event={"ID":"9ba005fe-7732-4167-81ca-6f6859cb137d","Type":"ContainerStarted","Data":"ed118c94f52bc70090439bc103c595fc2a550b14dfdb1957db4b3f37b81c608c"} Jul 07 16:24:14.000762 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:14.000670 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6474d5975b-pqtfr" event={"ID":"9ba005fe-7732-4167-81ca-6f6859cb137d","Type":"ContainerStarted","Data":"6f6dbeea8b647055ba4f0cd36e04793fbb6b22473973278e30190987354f32ac"} Jul 07 16:24:14.000762 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:14.000711 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6474d5975b-pqtfr" event={"ID":"9ba005fe-7732-4167-81ca-6f6859cb137d","Type":"ContainerStarted","Data":"18214d5152a6dd06d9427c67b1f9463daa01d428c237d62d19386a21142bfc59"} Jul 07 16:24:14.002459 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:14.002429 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84c7cf668-zddzg" event={"ID":"ffebc237-d2f1-44b1-8129-b92033c91a3d","Type":"ContainerStarted","Data":"86f74ec21bae16bf9013aa2d82ec6900db06c4d8ef1d8e8b3ed8216382337ed8"} Jul 07 16:24:14.002577 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:14.002473 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84c7cf668-zddzg" event={"ID":"ffebc237-d2f1-44b1-8129-b92033c91a3d","Type":"ContainerStarted","Data":"c5d4dda7b067edd7c9e0e6ff9b1b1d2bb115749c789bb70cea3b6b6463feddd6"} Jul 07 16:24:14.003837 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:14.003815 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-867n2" event={"ID":"559610cb-6966-45f8-9fb2-f6ab147684d9","Type":"ContainerStarted","Data":"b55365b9c36b9a4cea20d9c3af41c2eea8a5eb68abdfcfae0547a36e80bfdd83"} Jul 07 16:24:14.005414 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:14.005363 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5s79k" event={"ID":"dc1cd2ef-cb98-430b-bdee-883a3129c2af","Type":"ContainerStarted","Data":"b5a6014bad551dc3e6d513c00c97c724bce4a4af33658f1948cea77bb0c78240"} Jul 07 16:24:14.007880 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:14.007859 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6mtx9" event={"ID":"f662cb89-c9b0-42d3-8dad-8e2633b887af","Type":"ContainerStarted","Data":"3b9e4ad98a1a2bfd11ede6dd5d346b33f14866700cb3679c31a40c7841a17d98"} Jul 07 16:24:14.007966 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:14.007905 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6mtx9" event={"ID":"f662cb89-c9b0-42d3-8dad-8e2633b887af","Type":"ContainerStarted","Data":"a2e73d82fa0998091933b9469b574676d46ed5dc2afdf8f32f29d69ece91279d"} Jul 07 16:24:14.020202 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:14.020157 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ssslq" podStartSLOduration=66.766495388 podStartE2EDuration="1m13.020132705s" totalImagesPullingTime="6.253637317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:23:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:24:14.019363187 +0000 UTC m=+73.958872615" watchObservedRunningTime="2026-07-07 16:24:14.020132705 +0000 UTC m=+73.959642106" Jul 07 16:24:14.044402 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:14.044350 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84c7cf668-zddzg" podStartSLOduration=3.044330793 podStartE2EDuration="3.044330793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:24:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:24:14.042193059 +0000 UTC m=+73.981702485" watchObservedRunningTime="2026-07-07 16:24:14.044330793 +0000 UTC m=+73.983840216" Jul 07 16:24:14.061160 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:14.061097 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5s79k" podStartSLOduration=66.620438253 podStartE2EDuration="1m13.061076648s" totalImagesPullingTime="6.440638395s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:23:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:24:14.060209537 +0000 UTC m=+73.999718961" watchObservedRunningTime="2026-07-07 16:24:14.061076648 +0000 UTC m=+74.000586072" Jul 07 16:24:14.071569 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:14.071537 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:14.085091 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:14.085050 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6mtx9" podStartSLOduration=6.940042761 podStartE2EDuration="9.085032982s" totalImagesPullingTime="2.018160971s" totalInitContainerRuntime="126.82925ms" isStatefulPod=true podCreationTimestamp="2026-07-07 16:24:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:24:14.08353526 +0000 UTC m=+74.023044683" watchObservedRunningTime="2026-07-07 16:24:14.085032982 +0000 UTC m=+74.024542410" Jul 07 16:24:14.268306 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:14.268202 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:14.365114 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:14.365069 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:15.654565 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:15.654528 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84c7cf668-zddzg"] Jul 07 16:24:15.686139 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:15.686105 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-548fc74956-2n7x6"] Jul 07 16:24:15.689204 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:15.689187 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-548fc74956-2n7x6" Jul 07 16:24:15.700449 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:15.700426 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-548fc74956-2n7x6"] Jul 07 16:24:15.750909 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:15.750872 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84ba4bb3-f418-48d5-8824-e0952ea8523b-service-ca\") pod \"console-548fc74956-2n7x6\" (UID: \"84ba4bb3-f418-48d5-8824-e0952ea8523b\") " pod="openshift-console/console-548fc74956-2n7x6" Jul 07 16:24:15.750909 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:15.750908 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgbnx\" (UniqueName: \"kubernetes.io/projected/84ba4bb3-f418-48d5-8824-e0952ea8523b-kube-api-access-tgbnx\") pod \"console-548fc74956-2n7x6\" (UID: \"84ba4bb3-f418-48d5-8824-e0952ea8523b\") " pod="openshift-console/console-548fc74956-2n7x6" Jul 07 16:24:15.751114 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:15.750941 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84ba4bb3-f418-48d5-8824-e0952ea8523b-console-config\") pod \"console-548fc74956-2n7x6\" (UID: \"84ba4bb3-f418-48d5-8824-e0952ea8523b\") " pod="openshift-console/console-548fc74956-2n7x6" Jul 07 16:24:15.751114 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:15.750968 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84ba4bb3-f418-48d5-8824-e0952ea8523b-console-oauth-config\") pod \"console-548fc74956-2n7x6\" (UID: \"84ba4bb3-f418-48d5-8824-e0952ea8523b\") " pod="openshift-console/console-548fc74956-2n7x6" Jul 07 16:24:15.751114 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:15.750989 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84ba4bb3-f418-48d5-8824-e0952ea8523b-console-serving-cert\") pod \"console-548fc74956-2n7x6\" (UID: \"84ba4bb3-f418-48d5-8824-e0952ea8523b\") " pod="openshift-console/console-548fc74956-2n7x6" Jul 07 16:24:15.751114 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:15.751023 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84ba4bb3-f418-48d5-8824-e0952ea8523b-oauth-serving-cert\") pod \"console-548fc74956-2n7x6\" (UID: \"84ba4bb3-f418-48d5-8824-e0952ea8523b\") " pod="openshift-console/console-548fc74956-2n7x6" Jul 07 16:24:15.751265 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:15.751109 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84ba4bb3-f418-48d5-8824-e0952ea8523b-trusted-ca-bundle\") pod \"console-548fc74956-2n7x6\" (UID: \"84ba4bb3-f418-48d5-8824-e0952ea8523b\") " pod="openshift-console/console-548fc74956-2n7x6" Jul 07 16:24:15.852224 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:15.852185 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84ba4bb3-f418-48d5-8824-e0952ea8523b-console-oauth-config\") pod \"console-548fc74956-2n7x6\" (UID: \"84ba4bb3-f418-48d5-8824-e0952ea8523b\") " pod="openshift-console/console-548fc74956-2n7x6" Jul 07 16:24:15.852224 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:15.852251 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84ba4bb3-f418-48d5-8824-e0952ea8523b-console-serving-cert\") pod \"console-548fc74956-2n7x6\" (UID: \"84ba4bb3-f418-48d5-8824-e0952ea8523b\") " pod="openshift-console/console-548fc74956-2n7x6" Jul 07 16:24:15.852476 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:15.852292 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84ba4bb3-f418-48d5-8824-e0952ea8523b-oauth-serving-cert\") pod \"console-548fc74956-2n7x6\" (UID: \"84ba4bb3-f418-48d5-8824-e0952ea8523b\") " pod="openshift-console/console-548fc74956-2n7x6" Jul 07 16:24:15.852476 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:15.852318 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84ba4bb3-f418-48d5-8824-e0952ea8523b-trusted-ca-bundle\") pod \"console-548fc74956-2n7x6\" (UID: \"84ba4bb3-f418-48d5-8824-e0952ea8523b\") " pod="openshift-console/console-548fc74956-2n7x6" Jul 07 16:24:15.852476 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:15.852362 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84ba4bb3-f418-48d5-8824-e0952ea8523b-service-ca\") pod \"console-548fc74956-2n7x6\" (UID: \"84ba4bb3-f418-48d5-8824-e0952ea8523b\") " pod="openshift-console/console-548fc74956-2n7x6" Jul 07 16:24:15.852476 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:15.852387 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgbnx\" (UniqueName: \"kubernetes.io/projected/84ba4bb3-f418-48d5-8824-e0952ea8523b-kube-api-access-tgbnx\") pod \"console-548fc74956-2n7x6\" (UID: \"84ba4bb3-f418-48d5-8824-e0952ea8523b\") " pod="openshift-console/console-548fc74956-2n7x6" Jul 07 16:24:15.852662 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:15.852553 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84ba4bb3-f418-48d5-8824-e0952ea8523b-console-config\") pod \"console-548fc74956-2n7x6\" (UID: \"84ba4bb3-f418-48d5-8824-e0952ea8523b\") " pod="openshift-console/console-548fc74956-2n7x6" Jul 07 16:24:15.853250 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:15.853206 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84ba4bb3-f418-48d5-8824-e0952ea8523b-console-config\") pod \"console-548fc74956-2n7x6\" (UID: \"84ba4bb3-f418-48d5-8824-e0952ea8523b\") " pod="openshift-console/console-548fc74956-2n7x6" Jul 07 16:24:15.853373 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:15.853205 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84ba4bb3-f418-48d5-8824-e0952ea8523b-service-ca\") pod \"console-548fc74956-2n7x6\" (UID: \"84ba4bb3-f418-48d5-8824-e0952ea8523b\") " pod="openshift-console/console-548fc74956-2n7x6" Jul 07 16:24:15.853373 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:15.853266 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84ba4bb3-f418-48d5-8824-e0952ea8523b-trusted-ca-bundle\") pod \"console-548fc74956-2n7x6\" (UID: \"84ba4bb3-f418-48d5-8824-e0952ea8523b\") " pod="openshift-console/console-548fc74956-2n7x6" Jul 07 16:24:15.853485 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:15.853437 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84ba4bb3-f418-48d5-8824-e0952ea8523b-oauth-serving-cert\") pod \"console-548fc74956-2n7x6\" (UID: \"84ba4bb3-f418-48d5-8824-e0952ea8523b\") " pod="openshift-console/console-548fc74956-2n7x6" Jul 07 16:24:15.854927 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:15.854898 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84ba4bb3-f418-48d5-8824-e0952ea8523b-console-serving-cert\") pod \"console-548fc74956-2n7x6\" (UID: \"84ba4bb3-f418-48d5-8824-e0952ea8523b\") " pod="openshift-console/console-548fc74956-2n7x6" Jul 07 16:24:15.855017 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:15.854905 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84ba4bb3-f418-48d5-8824-e0952ea8523b-console-oauth-config\") pod \"console-548fc74956-2n7x6\" (UID: \"84ba4bb3-f418-48d5-8824-e0952ea8523b\") " pod="openshift-console/console-548fc74956-2n7x6" Jul 07 16:24:15.861784 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:15.861761 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgbnx\" (UniqueName: \"kubernetes.io/projected/84ba4bb3-f418-48d5-8824-e0952ea8523b-kube-api-access-tgbnx\") pod \"console-548fc74956-2n7x6\" (UID: \"84ba4bb3-f418-48d5-8824-e0952ea8523b\") " pod="openshift-console/console-548fc74956-2n7x6" Jul 07 16:24:15.932172 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:15.932080 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:15.998179 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:15.998142 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-548fc74956-2n7x6" Jul 07 16:24:16.023394 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:16.023360 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6474d5975b-pqtfr" event={"ID":"9ba005fe-7732-4167-81ca-6f6859cb137d","Type":"ContainerStarted","Data":"372bcad82eff37c7090964a0b38e8f70ceff1661874b6dc2bcca3b82fb5d87dd"} Jul 07 16:24:16.023566 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:16.023436 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6474d5975b-pqtfr" event={"ID":"9ba005fe-7732-4167-81ca-6f6859cb137d","Type":"ContainerStarted","Data":"f1941ccee5951c878c96132e7675a660d04e86fee3292ac01e9e889e845e65a5"} Jul 07 16:24:16.023566 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:16.023478 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6474d5975b-pqtfr" event={"ID":"9ba005fe-7732-4167-81ca-6f6859cb137d","Type":"ContainerStarted","Data":"b5db8318d3c06d250ba001d607249000157ce0f11e40fda87131c507e72627a7"} Jul 07 16:24:16.023566 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:16.023556 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6474d5975b-pqtfr" Jul 07 16:24:16.025312 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:16.025270 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-867n2" event={"ID":"559610cb-6966-45f8-9fb2-f6ab147684d9","Type":"ContainerStarted","Data":"221e13c8d3dc36f9c971f6f3e2b15d923110e8aa8f51107bd82668c119b09685"} Jul 07 16:24:16.025452 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:16.025400 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-867n2" Jul 07 16:24:16.030955 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:16.030926 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-867n2" Jul 07 16:24:16.035126 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:16.035083 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:16.056646 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:16.056582 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6474d5975b-pqtfr" podStartSLOduration=3.495207909 podStartE2EDuration="9.056556394s" totalImagesPullingTime="5.561348485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:24:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:24:16.054096456 +0000 UTC m=+75.993605920" watchObservedRunningTime="2026-07-07 16:24:16.056556394 +0000 UTC m=+75.996065818" Jul 07 16:24:16.095345 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:16.095292 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-867n2" podStartSLOduration=4.585108416 podStartE2EDuration="6.095270265s" totalImagesPullingTime="1.510161849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:24:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:24:16.093063258 +0000 UTC m=+76.032572682" watchObservedRunningTime="2026-07-07 16:24:16.095270265 +0000 UTC m=+76.034779688" Jul 07 16:24:16.107329 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:16.107295 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:16.142057 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:16.142020 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-548fc74956-2n7x6"] Jul 07 16:24:16.144914 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:24:16.144886 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84ba4bb3_f418_48d5_8824_e0952ea8523b.slice/crio-22ad4f2e879e268155bd762d07418cf09eeefd9b7748393969760fd699b9f466 WatchSource:0}: Error finding container 22ad4f2e879e268155bd762d07418cf09eeefd9b7748393969760fd699b9f466: Status 404 returned error can't find the container with id 22ad4f2e879e268155bd762d07418cf09eeefd9b7748393969760fd699b9f466 Jul 07 16:24:16.221761 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:16.221733 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:16.320161 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:16.320083 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:17.030752 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:17.030715 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-548fc74956-2n7x6" event={"ID":"84ba4bb3-f418-48d5-8824-e0952ea8523b","Type":"ContainerStarted","Data":"3a878c406d9c233e3f2447827250f2bfe00d1ea2015587c34fc14ffe8fefd017"} Jul 07 16:24:17.031258 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:17.030769 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-548fc74956-2n7x6" event={"ID":"84ba4bb3-f418-48d5-8824-e0952ea8523b","Type":"ContainerStarted","Data":"22ad4f2e879e268155bd762d07418cf09eeefd9b7748393969760fd699b9f466"} Jul 07 16:24:17.071590 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:17.071531 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-548fc74956-2n7x6" podStartSLOduration=2.071509367 podStartE2EDuration="2.071509367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:24:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:24:17.07039638 +0000 UTC m=+77.009905805" watchObservedRunningTime="2026-07-07 16:24:17.071509367 +0000 UTC m=+77.011018790" Jul 07 16:24:21.533535 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:21.533498 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84c7cf668-zddzg" Jul 07 16:24:21.713594 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:21.713555 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:21.814828 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:21.814744 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:22.037318 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:22.037287 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6474d5975b-pqtfr" Jul 07 16:24:22.163652 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:22.163602 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:22.265346 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:22.265314 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:25.344056 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:25.344017 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:25.409186 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:25.409101 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:25.998298 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:25.998219 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-548fc74956-2n7x6" Jul 07 16:24:25.998475 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:25.998330 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-548fc74956-2n7x6" Jul 07 16:24:26.002984 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:26.002963 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-548fc74956-2n7x6" Jul 07 16:24:26.070975 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:26.070950 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-548fc74956-2n7x6" Jul 07 16:24:26.266220 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:26.266077 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:26.366584 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:26.366537 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:26.484034 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:26.484004 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:36.099164 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:36.099123 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7c8bbddb44-jvn97" podUID="d4b71436-5a50-45c4-83ef-7e143a1d41c0" containerName="console" containerID="cri-o://8ad788aefdf7d257a6f450426c5c1a68266ff1013746f49fb15d1fb8257a6012" gracePeriod=15 Jul 07 16:24:36.705210 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:36.705177 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:36.786247 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:36.786185 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:36.871594 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:36.871568 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c8bbddb44-jvn97" Jul 07 16:24:37.022586 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:37.022508 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4b71436-5a50-45c4-83ef-7e143a1d41c0-console-serving-cert\") pod \"d4b71436-5a50-45c4-83ef-7e143a1d41c0\" (UID: \"d4b71436-5a50-45c4-83ef-7e143a1d41c0\") " Jul 07 16:24:37.022586 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:37.022562 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnqpv\" (UniqueName: \"kubernetes.io/projected/d4b71436-5a50-45c4-83ef-7e143a1d41c0-kube-api-access-fnqpv\") pod \"d4b71436-5a50-45c4-83ef-7e143a1d41c0\" (UID: \"d4b71436-5a50-45c4-83ef-7e143a1d41c0\") " Jul 07 16:24:37.022786 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:37.022604 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4b71436-5a50-45c4-83ef-7e143a1d41c0-service-ca\") pod \"d4b71436-5a50-45c4-83ef-7e143a1d41c0\" (UID: \"d4b71436-5a50-45c4-83ef-7e143a1d41c0\") " Jul 07 16:24:37.022786 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:37.022638 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4b71436-5a50-45c4-83ef-7e143a1d41c0-console-oauth-config\") pod \"d4b71436-5a50-45c4-83ef-7e143a1d41c0\" (UID: \"d4b71436-5a50-45c4-83ef-7e143a1d41c0\") " Jul 07 16:24:37.022786 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:37.022667 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4b71436-5a50-45c4-83ef-7e143a1d41c0-console-config\") pod \"d4b71436-5a50-45c4-83ef-7e143a1d41c0\" (UID: \"d4b71436-5a50-45c4-83ef-7e143a1d41c0\") " Jul 07 16:24:37.022786 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:37.022719 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4b71436-5a50-45c4-83ef-7e143a1d41c0-oauth-serving-cert\") pod \"d4b71436-5a50-45c4-83ef-7e143a1d41c0\" (UID: \"d4b71436-5a50-45c4-83ef-7e143a1d41c0\") " Jul 07 16:24:37.023205 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:37.023139 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4b71436-5a50-45c4-83ef-7e143a1d41c0-console-config" (OuterVolumeSpecName: "console-config") pod "d4b71436-5a50-45c4-83ef-7e143a1d41c0" (UID: "d4b71436-5a50-45c4-83ef-7e143a1d41c0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:24:37.023205 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:37.023149 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4b71436-5a50-45c4-83ef-7e143a1d41c0-service-ca" (OuterVolumeSpecName: "service-ca") pod "d4b71436-5a50-45c4-83ef-7e143a1d41c0" (UID: "d4b71436-5a50-45c4-83ef-7e143a1d41c0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:24:37.023205 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:37.023175 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4b71436-5a50-45c4-83ef-7e143a1d41c0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d4b71436-5a50-45c4-83ef-7e143a1d41c0" (UID: "d4b71436-5a50-45c4-83ef-7e143a1d41c0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:24:37.025044 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:37.025010 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4b71436-5a50-45c4-83ef-7e143a1d41c0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d4b71436-5a50-45c4-83ef-7e143a1d41c0" (UID: "d4b71436-5a50-45c4-83ef-7e143a1d41c0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:24:37.025135 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:37.025068 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4b71436-5a50-45c4-83ef-7e143a1d41c0-kube-api-access-fnqpv" (OuterVolumeSpecName: "kube-api-access-fnqpv") pod "d4b71436-5a50-45c4-83ef-7e143a1d41c0" (UID: "d4b71436-5a50-45c4-83ef-7e143a1d41c0"). InnerVolumeSpecName "kube-api-access-fnqpv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:24:37.025135 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:37.025077 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4b71436-5a50-45c4-83ef-7e143a1d41c0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d4b71436-5a50-45c4-83ef-7e143a1d41c0" (UID: "d4b71436-5a50-45c4-83ef-7e143a1d41c0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:24:37.108580 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:37.108547 2564 generic.go:356] "Generic (PLEG): container finished" podID="d4b71436-5a50-45c4-83ef-7e143a1d41c0" containerID="8ad788aefdf7d257a6f450426c5c1a68266ff1013746f49fb15d1fb8257a6012" exitCode=0 Jul 07 16:24:37.109038 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:37.108600 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c8bbddb44-jvn97" Jul 07 16:24:37.109038 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:37.108644 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c8bbddb44-jvn97" event={"ID":"d4b71436-5a50-45c4-83ef-7e143a1d41c0","Type":"ContainerDied","Data":"8ad788aefdf7d257a6f450426c5c1a68266ff1013746f49fb15d1fb8257a6012"} Jul 07 16:24:37.109038 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:37.108706 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c8bbddb44-jvn97" event={"ID":"d4b71436-5a50-45c4-83ef-7e143a1d41c0","Type":"ContainerDied","Data":"292bc81499567f5f41d2909766528791bb4aa393a77cbcc456994e794ccbde9d"} Jul 07 16:24:37.109038 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:37.108736 2564 scope.go:117] "RemoveContainer" containerID="8ad788aefdf7d257a6f450426c5c1a68266ff1013746f49fb15d1fb8257a6012" Jul 07 16:24:37.117563 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:37.117545 2564 scope.go:117] "RemoveContainer" containerID="8ad788aefdf7d257a6f450426c5c1a68266ff1013746f49fb15d1fb8257a6012" Jul 07 16:24:37.117805 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:24:37.117780 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ad788aefdf7d257a6f450426c5c1a68266ff1013746f49fb15d1fb8257a6012\": container with ID starting with 8ad788aefdf7d257a6f450426c5c1a68266ff1013746f49fb15d1fb8257a6012 not found: ID does not exist" containerID="8ad788aefdf7d257a6f450426c5c1a68266ff1013746f49fb15d1fb8257a6012" Jul 07 16:24:37.117852 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:37.117815 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ad788aefdf7d257a6f450426c5c1a68266ff1013746f49fb15d1fb8257a6012"} err="failed to get container status \"8ad788aefdf7d257a6f450426c5c1a68266ff1013746f49fb15d1fb8257a6012\": rpc error: code = NotFound desc = could not find container \"8ad788aefdf7d257a6f450426c5c1a68266ff1013746f49fb15d1fb8257a6012\": container with ID starting with 8ad788aefdf7d257a6f450426c5c1a68266ff1013746f49fb15d1fb8257a6012 not found: ID does not exist" Jul 07 16:24:37.123285 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:37.123268 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4b71436-5a50-45c4-83ef-7e143a1d41c0-console-serving-cert\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:24:37.123285 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:37.123286 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnqpv\" (UniqueName: \"kubernetes.io/projected/d4b71436-5a50-45c4-83ef-7e143a1d41c0-kube-api-access-fnqpv\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:24:37.123392 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:37.123296 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4b71436-5a50-45c4-83ef-7e143a1d41c0-service-ca\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:24:37.123392 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:37.123304 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4b71436-5a50-45c4-83ef-7e143a1d41c0-console-oauth-config\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:24:37.123392 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:37.123312 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4b71436-5a50-45c4-83ef-7e143a1d41c0-console-config\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:24:37.123392 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:37.123320 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4b71436-5a50-45c4-83ef-7e143a1d41c0-oauth-serving-cert\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:24:37.130856 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:37.130834 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c8bbddb44-jvn97"] Jul 07 16:24:37.140417 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:37.140398 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c8bbddb44-jvn97"] Jul 07 16:24:38.648809 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:38.648773 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4b71436-5a50-45c4-83ef-7e143a1d41c0" path="/var/lib/kubelet/pods/d4b71436-5a50-45c4-83ef-7e143a1d41c0/volumes" Jul 07 16:24:41.046694 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:41.046654 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-84c7cf668-zddzg" podUID="ffebc237-d2f1-44b1-8129-b92033c91a3d" containerName="console" containerID="cri-o://86f74ec21bae16bf9013aa2d82ec6900db06c4d8ef1d8e8b3ed8216382337ed8" gracePeriod=15 Jul 07 16:24:41.289559 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:41.289534 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84c7cf668-zddzg" Jul 07 16:24:41.456637 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:41.456600 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffebc237-d2f1-44b1-8129-b92033c91a3d-console-oauth-config\") pod \"ffebc237-d2f1-44b1-8129-b92033c91a3d\" (UID: \"ffebc237-d2f1-44b1-8129-b92033c91a3d\") " Jul 07 16:24:41.456870 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:41.456663 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffebc237-d2f1-44b1-8129-b92033c91a3d-service-ca\") pod \"ffebc237-d2f1-44b1-8129-b92033c91a3d\" (UID: \"ffebc237-d2f1-44b1-8129-b92033c91a3d\") " Jul 07 16:24:41.456870 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:41.456702 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffebc237-d2f1-44b1-8129-b92033c91a3d-oauth-serving-cert\") pod \"ffebc237-d2f1-44b1-8129-b92033c91a3d\" (UID: \"ffebc237-d2f1-44b1-8129-b92033c91a3d\") " Jul 07 16:24:41.456994 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:41.456874 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4rhq\" (UniqueName: \"kubernetes.io/projected/ffebc237-d2f1-44b1-8129-b92033c91a3d-kube-api-access-k4rhq\") pod \"ffebc237-d2f1-44b1-8129-b92033c91a3d\" (UID: \"ffebc237-d2f1-44b1-8129-b92033c91a3d\") " Jul 07 16:24:41.456994 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:41.456925 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffebc237-d2f1-44b1-8129-b92033c91a3d-console-config\") pod \"ffebc237-d2f1-44b1-8129-b92033c91a3d\" (UID: \"ffebc237-d2f1-44b1-8129-b92033c91a3d\") " Jul 07 16:24:41.456994 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:41.456967 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffebc237-d2f1-44b1-8129-b92033c91a3d-console-serving-cert\") pod \"ffebc237-d2f1-44b1-8129-b92033c91a3d\" (UID: \"ffebc237-d2f1-44b1-8129-b92033c91a3d\") " Jul 07 16:24:41.457129 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:41.457010 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffebc237-d2f1-44b1-8129-b92033c91a3d-trusted-ca-bundle\") pod \"ffebc237-d2f1-44b1-8129-b92033c91a3d\" (UID: \"ffebc237-d2f1-44b1-8129-b92033c91a3d\") " Jul 07 16:24:41.457129 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:41.457073 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffebc237-d2f1-44b1-8129-b92033c91a3d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ffebc237-d2f1-44b1-8129-b92033c91a3d" (UID: "ffebc237-d2f1-44b1-8129-b92033c91a3d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:24:41.457129 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:41.457081 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffebc237-d2f1-44b1-8129-b92033c91a3d-service-ca" (OuterVolumeSpecName: "service-ca") pod "ffebc237-d2f1-44b1-8129-b92033c91a3d" (UID: "ffebc237-d2f1-44b1-8129-b92033c91a3d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:24:41.457312 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:41.457275 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffebc237-d2f1-44b1-8129-b92033c91a3d-service-ca\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:24:41.457312 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:41.457295 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffebc237-d2f1-44b1-8129-b92033c91a3d-oauth-serving-cert\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:24:41.457462 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:41.457437 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffebc237-d2f1-44b1-8129-b92033c91a3d-console-config" (OuterVolumeSpecName: "console-config") pod "ffebc237-d2f1-44b1-8129-b92033c91a3d" (UID: "ffebc237-d2f1-44b1-8129-b92033c91a3d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:24:41.457730 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:41.457708 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffebc237-d2f1-44b1-8129-b92033c91a3d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ffebc237-d2f1-44b1-8129-b92033c91a3d" (UID: "ffebc237-d2f1-44b1-8129-b92033c91a3d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:24:41.459039 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:41.459010 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffebc237-d2f1-44b1-8129-b92033c91a3d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ffebc237-d2f1-44b1-8129-b92033c91a3d" (UID: "ffebc237-d2f1-44b1-8129-b92033c91a3d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:24:41.459195 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:41.459176 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffebc237-d2f1-44b1-8129-b92033c91a3d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ffebc237-d2f1-44b1-8129-b92033c91a3d" (UID: "ffebc237-d2f1-44b1-8129-b92033c91a3d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:24:41.459268 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:41.459207 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffebc237-d2f1-44b1-8129-b92033c91a3d-kube-api-access-k4rhq" (OuterVolumeSpecName: "kube-api-access-k4rhq") pod "ffebc237-d2f1-44b1-8129-b92033c91a3d" (UID: "ffebc237-d2f1-44b1-8129-b92033c91a3d"). InnerVolumeSpecName "kube-api-access-k4rhq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:24:41.557782 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:41.557742 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffebc237-d2f1-44b1-8129-b92033c91a3d-console-serving-cert\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:24:41.557782 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:41.557775 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffebc237-d2f1-44b1-8129-b92033c91a3d-trusted-ca-bundle\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:24:41.557782 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:41.557784 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffebc237-d2f1-44b1-8129-b92033c91a3d-console-oauth-config\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:24:41.557782 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:41.557792 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4rhq\" (UniqueName: \"kubernetes.io/projected/ffebc237-d2f1-44b1-8129-b92033c91a3d-kube-api-access-k4rhq\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:24:41.558037 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:41.557801 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffebc237-d2f1-44b1-8129-b92033c91a3d-console-config\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:24:42.129751 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:42.129715 2564 generic.go:356] "Generic (PLEG): container finished" podID="ffebc237-d2f1-44b1-8129-b92033c91a3d" containerID="86f74ec21bae16bf9013aa2d82ec6900db06c4d8ef1d8e8b3ed8216382337ed8" exitCode=0 Jul 07 16:24:42.130225 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:42.129768 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84c7cf668-zddzg" event={"ID":"ffebc237-d2f1-44b1-8129-b92033c91a3d","Type":"ContainerDied","Data":"86f74ec21bae16bf9013aa2d82ec6900db06c4d8ef1d8e8b3ed8216382337ed8"} Jul 07 16:24:42.130225 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:42.129773 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84c7cf668-zddzg" Jul 07 16:24:42.130225 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:42.129808 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84c7cf668-zddzg" event={"ID":"ffebc237-d2f1-44b1-8129-b92033c91a3d","Type":"ContainerDied","Data":"c5d4dda7b067edd7c9e0e6ff9b1b1d2bb115749c789bb70cea3b6b6463feddd6"} Jul 07 16:24:42.130225 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:42.129826 2564 scope.go:117] "RemoveContainer" containerID="86f74ec21bae16bf9013aa2d82ec6900db06c4d8ef1d8e8b3ed8216382337ed8" Jul 07 16:24:42.139284 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:42.139267 2564 scope.go:117] "RemoveContainer" containerID="86f74ec21bae16bf9013aa2d82ec6900db06c4d8ef1d8e8b3ed8216382337ed8" Jul 07 16:24:42.139526 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:24:42.139509 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86f74ec21bae16bf9013aa2d82ec6900db06c4d8ef1d8e8b3ed8216382337ed8\": container with ID starting with 86f74ec21bae16bf9013aa2d82ec6900db06c4d8ef1d8e8b3ed8216382337ed8 not found: ID does not exist" containerID="86f74ec21bae16bf9013aa2d82ec6900db06c4d8ef1d8e8b3ed8216382337ed8" Jul 07 16:24:42.139576 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:42.139536 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86f74ec21bae16bf9013aa2d82ec6900db06c4d8ef1d8e8b3ed8216382337ed8"} err="failed to get container status \"86f74ec21bae16bf9013aa2d82ec6900db06c4d8ef1d8e8b3ed8216382337ed8\": rpc error: code = NotFound desc = could not find container \"86f74ec21bae16bf9013aa2d82ec6900db06c4d8ef1d8e8b3ed8216382337ed8\": container with ID starting with 86f74ec21bae16bf9013aa2d82ec6900db06c4d8ef1d8e8b3ed8216382337ed8 not found: ID does not exist" Jul 07 16:24:42.151624 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:42.151599 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84c7cf668-zddzg"] Jul 07 16:24:42.154905 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:42.154883 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84c7cf668-zddzg"] Jul 07 16:24:42.648823 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:42.648793 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffebc237-d2f1-44b1-8129-b92033c91a3d" path="/var/lib/kubelet/pods/ffebc237-d2f1-44b1-8129-b92033c91a3d/volumes" Jul 07 16:24:45.019371 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:45.019340 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ssslq" Jul 07 16:24:51.178570 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:51.178528 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:51.278694 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:51.278663 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:51.706171 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:51.706133 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:24:51.768793 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:24:51.768749 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:25:22.003453 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:22.003416 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:25:22.066062 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:22.066020 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:25:33.954819 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:33.954769 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:25:34.038370 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:34.038323 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:25:36.705258 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:36.705200 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:25:36.806100 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:36.806050 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:25:36.865917 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:36.865889 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:25:37.715598 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:37.715562 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5dc4479dbb-ftlrr"] Jul 07 16:25:37.716067 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:37.715986 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4b71436-5a50-45c4-83ef-7e143a1d41c0" containerName="console" Jul 07 16:25:37.716067 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:37.716003 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4b71436-5a50-45c4-83ef-7e143a1d41c0" containerName="console" Jul 07 16:25:37.716067 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:37.716031 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffebc237-d2f1-44b1-8129-b92033c91a3d" containerName="console" Jul 07 16:25:37.716067 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:37.716038 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffebc237-d2f1-44b1-8129-b92033c91a3d" containerName="console" Jul 07 16:25:37.716312 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:37.716104 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4b71436-5a50-45c4-83ef-7e143a1d41c0" containerName="console" Jul 07 16:25:37.716312 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:37.716115 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffebc237-d2f1-44b1-8129-b92033c91a3d" containerName="console" Jul 07 16:25:37.718064 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:37.718042 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dc4479dbb-ftlrr" Jul 07 16:25:37.742291 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:37.742259 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dc4479dbb-ftlrr"] Jul 07 16:25:37.769423 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:37.769392 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8b677416-0084-4e0d-916e-cd24fc37235f-oauth-serving-cert\") pod \"console-5dc4479dbb-ftlrr\" (UID: \"8b677416-0084-4e0d-916e-cd24fc37235f\") " pod="openshift-console/console-5dc4479dbb-ftlrr" Jul 07 16:25:37.769613 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:37.769427 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8b677416-0084-4e0d-916e-cd24fc37235f-console-serving-cert\") pod \"console-5dc4479dbb-ftlrr\" (UID: \"8b677416-0084-4e0d-916e-cd24fc37235f\") " pod="openshift-console/console-5dc4479dbb-ftlrr" Jul 07 16:25:37.769613 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:37.769446 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8b677416-0084-4e0d-916e-cd24fc37235f-service-ca\") pod \"console-5dc4479dbb-ftlrr\" (UID: \"8b677416-0084-4e0d-916e-cd24fc37235f\") " pod="openshift-console/console-5dc4479dbb-ftlrr" Jul 07 16:25:37.769613 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:37.769541 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b677416-0084-4e0d-916e-cd24fc37235f-trusted-ca-bundle\") pod \"console-5dc4479dbb-ftlrr\" (UID: \"8b677416-0084-4e0d-916e-cd24fc37235f\") " pod="openshift-console/console-5dc4479dbb-ftlrr" Jul 07 16:25:37.769826 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:37.769630 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8b677416-0084-4e0d-916e-cd24fc37235f-console-oauth-config\") pod \"console-5dc4479dbb-ftlrr\" (UID: \"8b677416-0084-4e0d-916e-cd24fc37235f\") " pod="openshift-console/console-5dc4479dbb-ftlrr" Jul 07 16:25:37.769826 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:37.769671 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd8x6\" (UniqueName: \"kubernetes.io/projected/8b677416-0084-4e0d-916e-cd24fc37235f-kube-api-access-xd8x6\") pod \"console-5dc4479dbb-ftlrr\" (UID: \"8b677416-0084-4e0d-916e-cd24fc37235f\") " pod="openshift-console/console-5dc4479dbb-ftlrr" Jul 07 16:25:37.769826 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:37.769732 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8b677416-0084-4e0d-916e-cd24fc37235f-console-config\") pod \"console-5dc4479dbb-ftlrr\" (UID: \"8b677416-0084-4e0d-916e-cd24fc37235f\") " pod="openshift-console/console-5dc4479dbb-ftlrr" Jul 07 16:25:37.799927 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:37.799899 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:25:37.856307 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:37.856269 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:25:37.870407 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:37.870385 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8b677416-0084-4e0d-916e-cd24fc37235f-oauth-serving-cert\") pod \"console-5dc4479dbb-ftlrr\" (UID: \"8b677416-0084-4e0d-916e-cd24fc37235f\") " pod="openshift-console/console-5dc4479dbb-ftlrr" Jul 07 16:25:37.870478 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:37.870415 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8b677416-0084-4e0d-916e-cd24fc37235f-console-serving-cert\") pod \"console-5dc4479dbb-ftlrr\" (UID: \"8b677416-0084-4e0d-916e-cd24fc37235f\") " pod="openshift-console/console-5dc4479dbb-ftlrr" Jul 07 16:25:37.870478 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:37.870432 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8b677416-0084-4e0d-916e-cd24fc37235f-service-ca\") pod \"console-5dc4479dbb-ftlrr\" (UID: \"8b677416-0084-4e0d-916e-cd24fc37235f\") " pod="openshift-console/console-5dc4479dbb-ftlrr" Jul 07 16:25:37.870478 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:37.870447 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b677416-0084-4e0d-916e-cd24fc37235f-trusted-ca-bundle\") pod \"console-5dc4479dbb-ftlrr\" (UID: \"8b677416-0084-4e0d-916e-cd24fc37235f\") " pod="openshift-console/console-5dc4479dbb-ftlrr" Jul 07 16:25:37.870478 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:37.870464 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8b677416-0084-4e0d-916e-cd24fc37235f-console-oauth-config\") pod \"console-5dc4479dbb-ftlrr\" (UID: \"8b677416-0084-4e0d-916e-cd24fc37235f\") " pod="openshift-console/console-5dc4479dbb-ftlrr" Jul 07 16:25:37.870658 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:37.870606 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd8x6\" (UniqueName: \"kubernetes.io/projected/8b677416-0084-4e0d-916e-cd24fc37235f-kube-api-access-xd8x6\") pod \"console-5dc4479dbb-ftlrr\" (UID: \"8b677416-0084-4e0d-916e-cd24fc37235f\") " pod="openshift-console/console-5dc4479dbb-ftlrr" Jul 07 16:25:37.870709 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:37.870656 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8b677416-0084-4e0d-916e-cd24fc37235f-console-config\") pod \"console-5dc4479dbb-ftlrr\" (UID: \"8b677416-0084-4e0d-916e-cd24fc37235f\") " pod="openshift-console/console-5dc4479dbb-ftlrr" Jul 07 16:25:37.871203 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:37.871163 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8b677416-0084-4e0d-916e-cd24fc37235f-service-ca\") pod \"console-5dc4479dbb-ftlrr\" (UID: \"8b677416-0084-4e0d-916e-cd24fc37235f\") " pod="openshift-console/console-5dc4479dbb-ftlrr" Jul 07 16:25:37.871203 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:37.871183 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8b677416-0084-4e0d-916e-cd24fc37235f-oauth-serving-cert\") pod \"console-5dc4479dbb-ftlrr\" (UID: \"8b677416-0084-4e0d-916e-cd24fc37235f\") " pod="openshift-console/console-5dc4479dbb-ftlrr" Jul 07 16:25:37.871541 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:37.871304 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8b677416-0084-4e0d-916e-cd24fc37235f-console-config\") pod \"console-5dc4479dbb-ftlrr\" (UID: \"8b677416-0084-4e0d-916e-cd24fc37235f\") " pod="openshift-console/console-5dc4479dbb-ftlrr" Jul 07 16:25:37.871878 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:37.871855 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b677416-0084-4e0d-916e-cd24fc37235f-trusted-ca-bundle\") pod \"console-5dc4479dbb-ftlrr\" (UID: \"8b677416-0084-4e0d-916e-cd24fc37235f\") " pod="openshift-console/console-5dc4479dbb-ftlrr" Jul 07 16:25:37.872981 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:37.872960 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8b677416-0084-4e0d-916e-cd24fc37235f-console-oauth-config\") pod \"console-5dc4479dbb-ftlrr\" (UID: \"8b677416-0084-4e0d-916e-cd24fc37235f\") " pod="openshift-console/console-5dc4479dbb-ftlrr" Jul 07 16:25:37.873184 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:37.873165 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8b677416-0084-4e0d-916e-cd24fc37235f-console-serving-cert\") pod \"console-5dc4479dbb-ftlrr\" (UID: \"8b677416-0084-4e0d-916e-cd24fc37235f\") " pod="openshift-console/console-5dc4479dbb-ftlrr" Jul 07 16:25:37.878925 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:37.878905 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd8x6\" (UniqueName: \"kubernetes.io/projected/8b677416-0084-4e0d-916e-cd24fc37235f-kube-api-access-xd8x6\") pod \"console-5dc4479dbb-ftlrr\" (UID: \"8b677416-0084-4e0d-916e-cd24fc37235f\") " pod="openshift-console/console-5dc4479dbb-ftlrr" Jul 07 16:25:38.027440 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:38.027343 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dc4479dbb-ftlrr" Jul 07 16:25:38.154095 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:38.154006 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dc4479dbb-ftlrr"] Jul 07 16:25:38.156798 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:25:38.156775 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b677416_0084_4e0d_916e_cd24fc37235f.slice/crio-ae093158a9db985cbbcbc4a54240edf704dacbe58d8fdb60922ff55d6d2e7367 WatchSource:0}: Error finding container ae093158a9db985cbbcbc4a54240edf704dacbe58d8fdb60922ff55d6d2e7367: Status 404 returned error can't find the container with id ae093158a9db985cbbcbc4a54240edf704dacbe58d8fdb60922ff55d6d2e7367 Jul 07 16:25:38.335782 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:38.335695 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dc4479dbb-ftlrr" event={"ID":"8b677416-0084-4e0d-916e-cd24fc37235f","Type":"ContainerStarted","Data":"49c3a1be5f934f2dad07bbf6c5753029f4d5e89204f761a44339045e13040fb9"} Jul 07 16:25:38.335782 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:38.335750 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dc4479dbb-ftlrr" event={"ID":"8b677416-0084-4e0d-916e-cd24fc37235f","Type":"ContainerStarted","Data":"ae093158a9db985cbbcbc4a54240edf704dacbe58d8fdb60922ff55d6d2e7367"} Jul 07 16:25:38.356630 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:38.356585 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5dc4479dbb-ftlrr" podStartSLOduration=1.356570789 podStartE2EDuration="1.356570789s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:25:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:25:38.355248875 +0000 UTC m=+158.294758296" watchObservedRunningTime="2026-07-07 16:25:38.356570789 +0000 UTC m=+158.296080211" Jul 07 16:25:39.480148 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:39.480115 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:25:48.027588 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:48.027553 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5dc4479dbb-ftlrr" Jul 07 16:25:48.028008 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:48.027643 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5dc4479dbb-ftlrr" Jul 07 16:25:48.032290 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:48.032269 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5dc4479dbb-ftlrr" Jul 07 16:25:48.374293 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:48.374268 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5dc4479dbb-ftlrr" Jul 07 16:25:48.425299 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:48.425268 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-548fc74956-2n7x6"] Jul 07 16:25:48.550331 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:48.550299 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:25:48.648639 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:48.648566 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:25:48.750174 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:25:48.750136 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:26:13.450408 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:13.450366 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-548fc74956-2n7x6" podUID="84ba4bb3-f418-48d5-8824-e0952ea8523b" containerName="console" containerID="cri-o://3a878c406d9c233e3f2447827250f2bfe00d1ea2015587c34fc14ffe8fefd017" gracePeriod=15 Jul 07 16:26:13.692435 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:13.692411 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-548fc74956-2n7x6" Jul 07 16:26:13.746887 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:13.746808 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84ba4bb3-f418-48d5-8824-e0952ea8523b-service-ca\") pod \"84ba4bb3-f418-48d5-8824-e0952ea8523b\" (UID: \"84ba4bb3-f418-48d5-8824-e0952ea8523b\") " Jul 07 16:26:13.746887 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:13.746842 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgbnx\" (UniqueName: \"kubernetes.io/projected/84ba4bb3-f418-48d5-8824-e0952ea8523b-kube-api-access-tgbnx\") pod \"84ba4bb3-f418-48d5-8824-e0952ea8523b\" (UID: \"84ba4bb3-f418-48d5-8824-e0952ea8523b\") " Jul 07 16:26:13.746887 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:13.746863 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84ba4bb3-f418-48d5-8824-e0952ea8523b-console-serving-cert\") pod \"84ba4bb3-f418-48d5-8824-e0952ea8523b\" (UID: \"84ba4bb3-f418-48d5-8824-e0952ea8523b\") " Jul 07 16:26:13.747138 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:13.746892 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84ba4bb3-f418-48d5-8824-e0952ea8523b-trusted-ca-bundle\") pod \"84ba4bb3-f418-48d5-8824-e0952ea8523b\" (UID: \"84ba4bb3-f418-48d5-8824-e0952ea8523b\") " Jul 07 16:26:13.747138 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:13.747071 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84ba4bb3-f418-48d5-8824-e0952ea8523b-console-config\") pod \"84ba4bb3-f418-48d5-8824-e0952ea8523b\" (UID: \"84ba4bb3-f418-48d5-8824-e0952ea8523b\") " Jul 07 16:26:13.747138 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:13.747117 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84ba4bb3-f418-48d5-8824-e0952ea8523b-oauth-serving-cert\") pod \"84ba4bb3-f418-48d5-8824-e0952ea8523b\" (UID: \"84ba4bb3-f418-48d5-8824-e0952ea8523b\") " Jul 07 16:26:13.747328 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:13.747151 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84ba4bb3-f418-48d5-8824-e0952ea8523b-console-oauth-config\") pod \"84ba4bb3-f418-48d5-8824-e0952ea8523b\" (UID: \"84ba4bb3-f418-48d5-8824-e0952ea8523b\") " Jul 07 16:26:13.747328 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:13.747206 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84ba4bb3-f418-48d5-8824-e0952ea8523b-service-ca" (OuterVolumeSpecName: "service-ca") pod "84ba4bb3-f418-48d5-8824-e0952ea8523b" (UID: "84ba4bb3-f418-48d5-8824-e0952ea8523b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:26:13.747429 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:13.747337 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84ba4bb3-f418-48d5-8824-e0952ea8523b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "84ba4bb3-f418-48d5-8824-e0952ea8523b" (UID: "84ba4bb3-f418-48d5-8824-e0952ea8523b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:26:13.747514 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:13.747493 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84ba4bb3-f418-48d5-8824-e0952ea8523b-console-config" (OuterVolumeSpecName: "console-config") pod "84ba4bb3-f418-48d5-8824-e0952ea8523b" (UID: "84ba4bb3-f418-48d5-8824-e0952ea8523b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:26:13.747586 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:13.747564 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84ba4bb3-f418-48d5-8824-e0952ea8523b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "84ba4bb3-f418-48d5-8824-e0952ea8523b" (UID: "84ba4bb3-f418-48d5-8824-e0952ea8523b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:26:13.747640 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:13.747589 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84ba4bb3-f418-48d5-8824-e0952ea8523b-service-ca\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:26:13.747640 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:13.747608 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84ba4bb3-f418-48d5-8824-e0952ea8523b-trusted-ca-bundle\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:26:13.747640 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:13.747624 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84ba4bb3-f418-48d5-8824-e0952ea8523b-console-config\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:26:13.749199 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:13.749177 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84ba4bb3-f418-48d5-8824-e0952ea8523b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "84ba4bb3-f418-48d5-8824-e0952ea8523b" (UID: "84ba4bb3-f418-48d5-8824-e0952ea8523b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:26:13.749199 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:13.749185 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84ba4bb3-f418-48d5-8824-e0952ea8523b-kube-api-access-tgbnx" (OuterVolumeSpecName: "kube-api-access-tgbnx") pod "84ba4bb3-f418-48d5-8824-e0952ea8523b" (UID: "84ba4bb3-f418-48d5-8824-e0952ea8523b"). InnerVolumeSpecName "kube-api-access-tgbnx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:26:13.749433 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:13.749419 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84ba4bb3-f418-48d5-8824-e0952ea8523b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "84ba4bb3-f418-48d5-8824-e0952ea8523b" (UID: "84ba4bb3-f418-48d5-8824-e0952ea8523b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:26:13.848705 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:13.848668 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgbnx\" (UniqueName: \"kubernetes.io/projected/84ba4bb3-f418-48d5-8824-e0952ea8523b-kube-api-access-tgbnx\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:26:13.848705 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:13.848699 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84ba4bb3-f418-48d5-8824-e0952ea8523b-console-serving-cert\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:26:13.848705 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:13.848711 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84ba4bb3-f418-48d5-8824-e0952ea8523b-oauth-serving-cert\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:26:13.848936 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:13.848722 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84ba4bb3-f418-48d5-8824-e0952ea8523b-console-oauth-config\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:26:14.468741 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:14.468704 2564 generic.go:356] "Generic (PLEG): container finished" podID="84ba4bb3-f418-48d5-8824-e0952ea8523b" containerID="3a878c406d9c233e3f2447827250f2bfe00d1ea2015587c34fc14ffe8fefd017" exitCode=0 Jul 07 16:26:14.469199 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:14.468757 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-548fc74956-2n7x6" Jul 07 16:26:14.469199 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:14.468795 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-548fc74956-2n7x6" event={"ID":"84ba4bb3-f418-48d5-8824-e0952ea8523b","Type":"ContainerDied","Data":"3a878c406d9c233e3f2447827250f2bfe00d1ea2015587c34fc14ffe8fefd017"} Jul 07 16:26:14.469199 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:14.468886 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-548fc74956-2n7x6" event={"ID":"84ba4bb3-f418-48d5-8824-e0952ea8523b","Type":"ContainerDied","Data":"22ad4f2e879e268155bd762d07418cf09eeefd9b7748393969760fd699b9f466"} Jul 07 16:26:14.469199 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:14.468917 2564 scope.go:117] "RemoveContainer" containerID="3a878c406d9c233e3f2447827250f2bfe00d1ea2015587c34fc14ffe8fefd017" Jul 07 16:26:14.477643 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:14.477627 2564 scope.go:117] "RemoveContainer" containerID="3a878c406d9c233e3f2447827250f2bfe00d1ea2015587c34fc14ffe8fefd017" Jul 07 16:26:14.477893 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:26:14.477876 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a878c406d9c233e3f2447827250f2bfe00d1ea2015587c34fc14ffe8fefd017\": container with ID starting with 3a878c406d9c233e3f2447827250f2bfe00d1ea2015587c34fc14ffe8fefd017 not found: ID does not exist" containerID="3a878c406d9c233e3f2447827250f2bfe00d1ea2015587c34fc14ffe8fefd017" Jul 07 16:26:14.477940 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:14.477900 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a878c406d9c233e3f2447827250f2bfe00d1ea2015587c34fc14ffe8fefd017"} err="failed to get container status \"3a878c406d9c233e3f2447827250f2bfe00d1ea2015587c34fc14ffe8fefd017\": rpc error: code = NotFound desc = could not find container \"3a878c406d9c233e3f2447827250f2bfe00d1ea2015587c34fc14ffe8fefd017\": container with ID starting with 3a878c406d9c233e3f2447827250f2bfe00d1ea2015587c34fc14ffe8fefd017 not found: ID does not exist" Jul 07 16:26:14.489742 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:14.489720 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-548fc74956-2n7x6"] Jul 07 16:26:14.493286 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:14.493267 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-548fc74956-2n7x6"] Jul 07 16:26:14.648874 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:14.648833 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84ba4bb3-f418-48d5-8824-e0952ea8523b" path="/var/lib/kubelet/pods/84ba4bb3-f418-48d5-8824-e0952ea8523b/volumes" Jul 07 16:26:18.003947 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:18.003913 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:26:18.105143 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:18.105105 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:26:18.781153 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:18.781118 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gjj2b"] Jul 07 16:26:18.781414 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:18.781401 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84ba4bb3-f418-48d5-8824-e0952ea8523b" containerName="console" Jul 07 16:26:18.781462 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:18.781415 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="84ba4bb3-f418-48d5-8824-e0952ea8523b" containerName="console" Jul 07 16:26:18.781495 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:18.781467 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="84ba4bb3-f418-48d5-8824-e0952ea8523b" containerName="console" Jul 07 16:26:18.783848 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:18.783832 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gjj2b" Jul 07 16:26:18.787022 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:18.786999 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 16:26:18.788414 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:18.788397 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gzmhr\"" Jul 07 16:26:18.788481 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:18.788399 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 16:26:18.801042 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:18.801020 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gjj2b"] Jul 07 16:26:18.884834 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:18.884804 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc2524db-cd16-4575-a756-0b3e213d41ca-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gjj2b\" (UID: \"cc2524db-cd16-4575-a756-0b3e213d41ca\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gjj2b" Jul 07 16:26:18.885004 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:18.884850 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc2524db-cd16-4575-a756-0b3e213d41ca-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gjj2b\" (UID: \"cc2524db-cd16-4575-a756-0b3e213d41ca\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gjj2b" Jul 07 16:26:18.885004 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:18.884908 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz9x6\" (UniqueName: \"kubernetes.io/projected/cc2524db-cd16-4575-a756-0b3e213d41ca-kube-api-access-bz9x6\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gjj2b\" (UID: \"cc2524db-cd16-4575-a756-0b3e213d41ca\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gjj2b" Jul 07 16:26:18.986225 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:18.986180 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc2524db-cd16-4575-a756-0b3e213d41ca-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gjj2b\" (UID: \"cc2524db-cd16-4575-a756-0b3e213d41ca\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gjj2b" Jul 07 16:26:18.986389 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:18.986266 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc2524db-cd16-4575-a756-0b3e213d41ca-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gjj2b\" (UID: \"cc2524db-cd16-4575-a756-0b3e213d41ca\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gjj2b" Jul 07 16:26:18.986389 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:18.986304 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz9x6\" (UniqueName: \"kubernetes.io/projected/cc2524db-cd16-4575-a756-0b3e213d41ca-kube-api-access-bz9x6\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gjj2b\" (UID: \"cc2524db-cd16-4575-a756-0b3e213d41ca\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gjj2b" Jul 07 16:26:18.986571 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:18.986554 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc2524db-cd16-4575-a756-0b3e213d41ca-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gjj2b\" (UID: \"cc2524db-cd16-4575-a756-0b3e213d41ca\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gjj2b" Jul 07 16:26:18.986639 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:18.986619 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc2524db-cd16-4575-a756-0b3e213d41ca-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gjj2b\" (UID: \"cc2524db-cd16-4575-a756-0b3e213d41ca\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gjj2b" Jul 07 16:26:18.997055 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:18.997028 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz9x6\" (UniqueName: \"kubernetes.io/projected/cc2524db-cd16-4575-a756-0b3e213d41ca-kube-api-access-bz9x6\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gjj2b\" (UID: \"cc2524db-cd16-4575-a756-0b3e213d41ca\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gjj2b" Jul 07 16:26:19.092794 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:19.092694 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gjj2b" Jul 07 16:26:19.226969 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:19.226944 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gjj2b"] Jul 07 16:26:19.229355 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:26:19.229323 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc2524db_cd16_4575_a756_0b3e213d41ca.slice/crio-83a4f60575cd41eb9b254a65a9541dbb6ad860f42939861c0289e3427ab63c34 WatchSource:0}: Error finding container 83a4f60575cd41eb9b254a65a9541dbb6ad860f42939861c0289e3427ab63c34: Status 404 returned error can't find the container with id 83a4f60575cd41eb9b254a65a9541dbb6ad860f42939861c0289e3427ab63c34 Jul 07 16:26:19.488951 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:19.488915 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gjj2b" event={"ID":"cc2524db-cd16-4575-a756-0b3e213d41ca","Type":"ContainerStarted","Data":"83a4f60575cd41eb9b254a65a9541dbb6ad860f42939861c0289e3427ab63c34"} Jul 07 16:26:26.005858 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:26.005823 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:26:26.097054 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:26.097019 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:26:29.527955 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:29.527917 2564 generic.go:356] "Generic (PLEG): container finished" podID="cc2524db-cd16-4575-a756-0b3e213d41ca" containerID="089e4ad0f50a638f164a5796f759c92ccc29f825435be1e2b4368e994bc13919" exitCode=0 Jul 07 16:26:29.528349 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:29.528010 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gjj2b" event={"ID":"cc2524db-cd16-4575-a756-0b3e213d41ca","Type":"ContainerDied","Data":"089e4ad0f50a638f164a5796f759c92ccc29f825435be1e2b4368e994bc13919"} Jul 07 16:26:32.542492 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:32.542456 2564 generic.go:356] "Generic (PLEG): container finished" podID="cc2524db-cd16-4575-a756-0b3e213d41ca" containerID="2c2ba5ace31b5dd2b14d7da9f24c3d6d9c2c1e7926aa6aac38c3840c74f49681" exitCode=0 Jul 07 16:26:32.542931 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:32.542563 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gjj2b" event={"ID":"cc2524db-cd16-4575-a756-0b3e213d41ca","Type":"ContainerDied","Data":"2c2ba5ace31b5dd2b14d7da9f24c3d6d9c2c1e7926aa6aac38c3840c74f49681"} Jul 07 16:26:40.000510 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:40.000464 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:26:42.582095 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:42.582063 2564 generic.go:356] "Generic (PLEG): container finished" podID="cc2524db-cd16-4575-a756-0b3e213d41ca" containerID="1122ace77e38f5c5039df22f4523698a1eb01f9e2a35704705ba1a6c607db124" exitCode=0 Jul 07 16:26:42.582541 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:42.582146 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gjj2b" event={"ID":"cc2524db-cd16-4575-a756-0b3e213d41ca","Type":"ContainerDied","Data":"1122ace77e38f5c5039df22f4523698a1eb01f9e2a35704705ba1a6c607db124"} Jul 07 16:26:43.701606 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:43.701581 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gjj2b" Jul 07 16:26:43.785079 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:43.785050 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc2524db-cd16-4575-a756-0b3e213d41ca-util\") pod \"cc2524db-cd16-4575-a756-0b3e213d41ca\" (UID: \"cc2524db-cd16-4575-a756-0b3e213d41ca\") " Jul 07 16:26:43.785279 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:43.785117 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bz9x6\" (UniqueName: \"kubernetes.io/projected/cc2524db-cd16-4575-a756-0b3e213d41ca-kube-api-access-bz9x6\") pod \"cc2524db-cd16-4575-a756-0b3e213d41ca\" (UID: \"cc2524db-cd16-4575-a756-0b3e213d41ca\") " Jul 07 16:26:43.785279 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:43.785151 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc2524db-cd16-4575-a756-0b3e213d41ca-bundle\") pod \"cc2524db-cd16-4575-a756-0b3e213d41ca\" (UID: \"cc2524db-cd16-4575-a756-0b3e213d41ca\") " Jul 07 16:26:43.785799 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:43.785773 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc2524db-cd16-4575-a756-0b3e213d41ca-bundle" (OuterVolumeSpecName: "bundle") pod "cc2524db-cd16-4575-a756-0b3e213d41ca" (UID: "cc2524db-cd16-4575-a756-0b3e213d41ca"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:26:43.787403 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:43.787380 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc2524db-cd16-4575-a756-0b3e213d41ca-kube-api-access-bz9x6" (OuterVolumeSpecName: "kube-api-access-bz9x6") pod "cc2524db-cd16-4575-a756-0b3e213d41ca" (UID: "cc2524db-cd16-4575-a756-0b3e213d41ca"). InnerVolumeSpecName "kube-api-access-bz9x6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:26:43.790791 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:43.790769 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc2524db-cd16-4575-a756-0b3e213d41ca-util" (OuterVolumeSpecName: "util") pod "cc2524db-cd16-4575-a756-0b3e213d41ca" (UID: "cc2524db-cd16-4575-a756-0b3e213d41ca"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:26:43.886148 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:43.886117 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bz9x6\" (UniqueName: \"kubernetes.io/projected/cc2524db-cd16-4575-a756-0b3e213d41ca-kube-api-access-bz9x6\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:26:43.886148 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:43.886147 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc2524db-cd16-4575-a756-0b3e213d41ca-bundle\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:26:43.886148 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:43.886156 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc2524db-cd16-4575-a756-0b3e213d41ca-util\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:26:44.591387 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:44.591353 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gjj2b" Jul 07 16:26:44.591620 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:44.591359 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gjj2b" event={"ID":"cc2524db-cd16-4575-a756-0b3e213d41ca","Type":"ContainerDied","Data":"83a4f60575cd41eb9b254a65a9541dbb6ad860f42939861c0289e3427ab63c34"} Jul 07 16:26:44.591620 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:44.591474 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="83a4f60575cd41eb9b254a65a9541dbb6ad860f42939861c0289e3427ab63c34" Jul 07 16:26:49.969172 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:49.969138 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:26:50.779611 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:50.779579 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:26:51.982795 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:51.982760 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kcjrq"] Jul 07 16:26:51.983163 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:51.983065 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc2524db-cd16-4575-a756-0b3e213d41ca" containerName="pull" Jul 07 16:26:51.983163 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:51.983076 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc2524db-cd16-4575-a756-0b3e213d41ca" containerName="pull" Jul 07 16:26:51.983163 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:51.983083 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc2524db-cd16-4575-a756-0b3e213d41ca" containerName="util" Jul 07 16:26:51.983163 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:51.983088 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc2524db-cd16-4575-a756-0b3e213d41ca" containerName="util" Jul 07 16:26:51.983163 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:51.983094 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc2524db-cd16-4575-a756-0b3e213d41ca" containerName="extract" Jul 07 16:26:51.983163 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:51.983098 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc2524db-cd16-4575-a756-0b3e213d41ca" containerName="extract" Jul 07 16:26:51.983163 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:51.983141 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc2524db-cd16-4575-a756-0b3e213d41ca" containerName="extract" Jul 07 16:26:51.985392 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:51.985376 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kcjrq" Jul 07 16:26:51.988162 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:51.988138 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-vgrd9\"" Jul 07 16:26:51.988319 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:51.988170 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 07 16:26:51.988319 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:51.988171 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 07 16:26:52.003010 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:52.002987 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kcjrq"] Jul 07 16:26:52.144548 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:52.144490 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb2bb168-3d1a-4c27-85ce-065adc5c908e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-kcjrq\" (UID: \"fb2bb168-3d1a-4c27-85ce-065adc5c908e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kcjrq" Jul 07 16:26:52.144737 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:52.144597 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7855k\" (UniqueName: \"kubernetes.io/projected/fb2bb168-3d1a-4c27-85ce-065adc5c908e-kube-api-access-7855k\") pod \"cert-manager-operator-controller-manager-55c444bf86-kcjrq\" (UID: \"fb2bb168-3d1a-4c27-85ce-065adc5c908e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kcjrq" Jul 07 16:26:52.245826 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:52.245746 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb2bb168-3d1a-4c27-85ce-065adc5c908e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-kcjrq\" (UID: \"fb2bb168-3d1a-4c27-85ce-065adc5c908e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kcjrq" Jul 07 16:26:52.245933 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:52.245849 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7855k\" (UniqueName: \"kubernetes.io/projected/fb2bb168-3d1a-4c27-85ce-065adc5c908e-kube-api-access-7855k\") pod \"cert-manager-operator-controller-manager-55c444bf86-kcjrq\" (UID: \"fb2bb168-3d1a-4c27-85ce-065adc5c908e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kcjrq" Jul 07 16:26:52.246091 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:52.246076 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb2bb168-3d1a-4c27-85ce-065adc5c908e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-kcjrq\" (UID: \"fb2bb168-3d1a-4c27-85ce-065adc5c908e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kcjrq" Jul 07 16:26:52.255689 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:52.255662 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7855k\" (UniqueName: \"kubernetes.io/projected/fb2bb168-3d1a-4c27-85ce-065adc5c908e-kube-api-access-7855k\") pod \"cert-manager-operator-controller-manager-55c444bf86-kcjrq\" (UID: \"fb2bb168-3d1a-4c27-85ce-065adc5c908e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kcjrq" Jul 07 16:26:52.294470 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:52.294442 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kcjrq" Jul 07 16:26:52.427761 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:52.427738 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kcjrq"] Jul 07 16:26:52.430211 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:26:52.430187 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb2bb168_3d1a_4c27_85ce_065adc5c908e.slice/crio-deb5317f13d5495a617c14c7c792b56aa485125036a20ec8a730346a06debaeb WatchSource:0}: Error finding container deb5317f13d5495a617c14c7c792b56aa485125036a20ec8a730346a06debaeb: Status 404 returned error can't find the container with id deb5317f13d5495a617c14c7c792b56aa485125036a20ec8a730346a06debaeb Jul 07 16:26:52.620521 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:52.620485 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kcjrq" event={"ID":"fb2bb168-3d1a-4c27-85ce-065adc5c908e","Type":"ContainerStarted","Data":"deb5317f13d5495a617c14c7c792b56aa485125036a20ec8a730346a06debaeb"} Jul 07 16:26:53.586499 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:53.586448 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:26:53.685974 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:53.685946 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:26:54.633965 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:54.633923 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kcjrq" event={"ID":"fb2bb168-3d1a-4c27-85ce-065adc5c908e","Type":"ContainerStarted","Data":"f328d71cf544f2c1c8ac9acbe6a3669e7b0d14b4c68d25728c66ee2a178c4baa"} Jul 07 16:26:54.658843 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:54.658797 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kcjrq" podStartSLOduration=2.023598346 podStartE2EDuration="3.658781299s" totalImagesPullingTime="1.635182953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:26:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:26:54.656617101 +0000 UTC m=+234.596126523" watchObservedRunningTime="2026-07-07 16:26:54.658781299 +0000 UTC m=+234.598290722" Jul 07 16:26:55.102283 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:55.102240 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:26:55.238177 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:55.238142 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:26:55.741533 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:55.741503 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j6l2"] Jul 07 16:26:55.743983 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:55.743953 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j6l2" Jul 07 16:26:55.747025 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:55.746990 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 16:26:55.747190 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:55.747166 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 16:26:55.748411 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:55.748396 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gzmhr\"" Jul 07 16:26:55.754612 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:55.754593 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j6l2"] Jul 07 16:26:55.787634 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:55.787599 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:26:55.877542 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:55.877505 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9abd4dca-2c50-4a65-b867-dc0aec3d35f3-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j6l2\" (UID: \"9abd4dca-2c50-4a65-b867-dc0aec3d35f3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j6l2" Jul 07 16:26:55.877706 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:55.877558 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hzsp\" (UniqueName: \"kubernetes.io/projected/9abd4dca-2c50-4a65-b867-dc0aec3d35f3-kube-api-access-2hzsp\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j6l2\" (UID: \"9abd4dca-2c50-4a65-b867-dc0aec3d35f3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j6l2" Jul 07 16:26:55.877706 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:55.877611 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9abd4dca-2c50-4a65-b867-dc0aec3d35f3-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j6l2\" (UID: \"9abd4dca-2c50-4a65-b867-dc0aec3d35f3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j6l2" Jul 07 16:26:55.883882 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:55.883848 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:26:55.978555 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:55.978519 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9abd4dca-2c50-4a65-b867-dc0aec3d35f3-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j6l2\" (UID: \"9abd4dca-2c50-4a65-b867-dc0aec3d35f3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j6l2" Jul 07 16:26:55.978725 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:55.978579 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hzsp\" (UniqueName: \"kubernetes.io/projected/9abd4dca-2c50-4a65-b867-dc0aec3d35f3-kube-api-access-2hzsp\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j6l2\" (UID: \"9abd4dca-2c50-4a65-b867-dc0aec3d35f3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j6l2" Jul 07 16:26:55.978725 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:55.978615 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9abd4dca-2c50-4a65-b867-dc0aec3d35f3-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j6l2\" (UID: \"9abd4dca-2c50-4a65-b867-dc0aec3d35f3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j6l2" Jul 07 16:26:55.978979 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:55.978957 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9abd4dca-2c50-4a65-b867-dc0aec3d35f3-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j6l2\" (UID: \"9abd4dca-2c50-4a65-b867-dc0aec3d35f3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j6l2" Jul 07 16:26:55.979020 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:55.978970 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9abd4dca-2c50-4a65-b867-dc0aec3d35f3-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j6l2\" (UID: \"9abd4dca-2c50-4a65-b867-dc0aec3d35f3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j6l2" Jul 07 16:26:55.991731 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:55.991665 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hzsp\" (UniqueName: \"kubernetes.io/projected/9abd4dca-2c50-4a65-b867-dc0aec3d35f3-kube-api-access-2hzsp\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j6l2\" (UID: \"9abd4dca-2c50-4a65-b867-dc0aec3d35f3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j6l2" Jul 07 16:26:56.053378 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:56.053346 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j6l2" Jul 07 16:26:56.182311 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:56.182277 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j6l2"] Jul 07 16:26:56.185710 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:26:56.185685 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9abd4dca_2c50_4a65_b867_dc0aec3d35f3.slice/crio-3385164f0198867695aea69e78d1edfb6ace3dffa650a8d67c940a3b69d96c24 WatchSource:0}: Error finding container 3385164f0198867695aea69e78d1edfb6ace3dffa650a8d67c940a3b69d96c24: Status 404 returned error can't find the container with id 3385164f0198867695aea69e78d1edfb6ace3dffa650a8d67c940a3b69d96c24 Jul 07 16:26:56.644984 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:56.644950 2564 generic.go:356] "Generic (PLEG): container finished" podID="9abd4dca-2c50-4a65-b867-dc0aec3d35f3" containerID="5788c667a3ef406ff16c49c1da19ddc38a21cc615184da871018e116401f4822" exitCode=0 Jul 07 16:26:56.649022 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:56.648999 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j6l2" event={"ID":"9abd4dca-2c50-4a65-b867-dc0aec3d35f3","Type":"ContainerDied","Data":"5788c667a3ef406ff16c49c1da19ddc38a21cc615184da871018e116401f4822"} Jul 07 16:26:56.649107 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:56.649045 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j6l2" event={"ID":"9abd4dca-2c50-4a65-b867-dc0aec3d35f3","Type":"ContainerStarted","Data":"3385164f0198867695aea69e78d1edfb6ace3dffa650a8d67c940a3b69d96c24"} Jul 07 16:26:57.805953 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:57.805921 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:26:58.195032 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:58.194998 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:26:58.654862 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:58.654826 2564 generic.go:356] "Generic (PLEG): container finished" podID="9abd4dca-2c50-4a65-b867-dc0aec3d35f3" containerID="03158693ec6e84dfc9e6398beffd0895c1694e69a39c05e3742c398683986cd7" exitCode=0 Jul 07 16:26:58.654862 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:58.654857 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j6l2" event={"ID":"9abd4dca-2c50-4a65-b867-dc0aec3d35f3","Type":"ContainerDied","Data":"03158693ec6e84dfc9e6398beffd0895c1694e69a39c05e3742c398683986cd7"} Jul 07 16:26:58.688579 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:58.688554 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-pk2x5"] Jul 07 16:26:58.691508 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:58.691490 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pk2x5" Jul 07 16:26:58.694442 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:58.694398 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-2grsc\"" Jul 07 16:26:58.694550 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:58.694440 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 07 16:26:58.694595 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:58.694502 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 07 16:26:58.699687 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:58.699660 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-pk2x5"] Jul 07 16:26:58.799643 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:58.799606 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2ed6d6cf-70cd-4211-9644-85550a9874ff-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-pk2x5\" (UID: \"2ed6d6cf-70cd-4211-9644-85550a9874ff\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pk2x5" Jul 07 16:26:58.799754 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:58.799643 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6mz6\" (UniqueName: \"kubernetes.io/projected/2ed6d6cf-70cd-4211-9644-85550a9874ff-kube-api-access-q6mz6\") pod \"cert-manager-cainjector-559cdd8c87-pk2x5\" (UID: \"2ed6d6cf-70cd-4211-9644-85550a9874ff\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pk2x5" Jul 07 16:26:58.900797 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:58.900755 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2ed6d6cf-70cd-4211-9644-85550a9874ff-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-pk2x5\" (UID: \"2ed6d6cf-70cd-4211-9644-85550a9874ff\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pk2x5" Jul 07 16:26:58.900797 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:58.900795 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6mz6\" (UniqueName: \"kubernetes.io/projected/2ed6d6cf-70cd-4211-9644-85550a9874ff-kube-api-access-q6mz6\") pod \"cert-manager-cainjector-559cdd8c87-pk2x5\" (UID: \"2ed6d6cf-70cd-4211-9644-85550a9874ff\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pk2x5" Jul 07 16:26:58.909605 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:58.909573 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6mz6\" (UniqueName: \"kubernetes.io/projected/2ed6d6cf-70cd-4211-9644-85550a9874ff-kube-api-access-q6mz6\") pod \"cert-manager-cainjector-559cdd8c87-pk2x5\" (UID: \"2ed6d6cf-70cd-4211-9644-85550a9874ff\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pk2x5" Jul 07 16:26:58.909605 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:58.909589 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2ed6d6cf-70cd-4211-9644-85550a9874ff-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-pk2x5\" (UID: \"2ed6d6cf-70cd-4211-9644-85550a9874ff\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pk2x5" Jul 07 16:26:59.007859 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:59.007820 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pk2x5" Jul 07 16:26:59.135795 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:59.135702 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-pk2x5"] Jul 07 16:26:59.139364 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:26:59.139339 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ed6d6cf_70cd_4211_9644_85550a9874ff.slice/crio-2037d50f3664a136c838b4604b114a46ceab5158bc62eee8412780dc301de943 WatchSource:0}: Error finding container 2037d50f3664a136c838b4604b114a46ceab5158bc62eee8412780dc301de943: Status 404 returned error can't find the container with id 2037d50f3664a136c838b4604b114a46ceab5158bc62eee8412780dc301de943 Jul 07 16:26:59.660662 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:59.660626 2564 generic.go:356] "Generic (PLEG): container finished" podID="9abd4dca-2c50-4a65-b867-dc0aec3d35f3" containerID="b378e35c5d4018f724247a2f4bcde266b4a80741bb2734370eeba5e5b9193084" exitCode=0 Jul 07 16:26:59.660863 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:59.660712 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j6l2" event={"ID":"9abd4dca-2c50-4a65-b867-dc0aec3d35f3","Type":"ContainerDied","Data":"b378e35c5d4018f724247a2f4bcde266b4a80741bb2734370eeba5e5b9193084"} Jul 07 16:26:59.661913 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:26:59.661896 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pk2x5" event={"ID":"2ed6d6cf-70cd-4211-9644-85550a9874ff","Type":"ContainerStarted","Data":"2037d50f3664a136c838b4604b114a46ceab5158bc62eee8412780dc301de943"} Jul 07 16:27:00.610854 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:00.610809 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:27:00.707930 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:00.707859 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:27:00.807033 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:00.807006 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j6l2" Jul 07 16:27:00.918248 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:00.918196 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hzsp\" (UniqueName: \"kubernetes.io/projected/9abd4dca-2c50-4a65-b867-dc0aec3d35f3-kube-api-access-2hzsp\") pod \"9abd4dca-2c50-4a65-b867-dc0aec3d35f3\" (UID: \"9abd4dca-2c50-4a65-b867-dc0aec3d35f3\") " Jul 07 16:27:00.918429 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:00.918320 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9abd4dca-2c50-4a65-b867-dc0aec3d35f3-bundle\") pod \"9abd4dca-2c50-4a65-b867-dc0aec3d35f3\" (UID: \"9abd4dca-2c50-4a65-b867-dc0aec3d35f3\") " Jul 07 16:27:00.918429 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:00.918347 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9abd4dca-2c50-4a65-b867-dc0aec3d35f3-util\") pod \"9abd4dca-2c50-4a65-b867-dc0aec3d35f3\" (UID: \"9abd4dca-2c50-4a65-b867-dc0aec3d35f3\") " Jul 07 16:27:00.918852 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:00.918820 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9abd4dca-2c50-4a65-b867-dc0aec3d35f3-bundle" (OuterVolumeSpecName: "bundle") pod "9abd4dca-2c50-4a65-b867-dc0aec3d35f3" (UID: "9abd4dca-2c50-4a65-b867-dc0aec3d35f3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:27:00.920683 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:00.920659 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9abd4dca-2c50-4a65-b867-dc0aec3d35f3-kube-api-access-2hzsp" (OuterVolumeSpecName: "kube-api-access-2hzsp") pod "9abd4dca-2c50-4a65-b867-dc0aec3d35f3" (UID: "9abd4dca-2c50-4a65-b867-dc0aec3d35f3"). InnerVolumeSpecName "kube-api-access-2hzsp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:27:00.925221 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:00.925099 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9abd4dca-2c50-4a65-b867-dc0aec3d35f3-util" (OuterVolumeSpecName: "util") pod "9abd4dca-2c50-4a65-b867-dc0aec3d35f3" (UID: "9abd4dca-2c50-4a65-b867-dc0aec3d35f3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:27:01.019298 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:01.019205 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hzsp\" (UniqueName: \"kubernetes.io/projected/9abd4dca-2c50-4a65-b867-dc0aec3d35f3-kube-api-access-2hzsp\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:27:01.019298 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:01.019256 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9abd4dca-2c50-4a65-b867-dc0aec3d35f3-bundle\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:27:01.019298 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:01.019269 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9abd4dca-2c50-4a65-b867-dc0aec3d35f3-util\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:27:01.672562 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:01.672531 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j6l2" Jul 07 16:27:01.672562 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:01.672548 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j6l2" event={"ID":"9abd4dca-2c50-4a65-b867-dc0aec3d35f3","Type":"ContainerDied","Data":"3385164f0198867695aea69e78d1edfb6ace3dffa650a8d67c940a3b69d96c24"} Jul 07 16:27:01.673029 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:01.672609 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3385164f0198867695aea69e78d1edfb6ace3dffa650a8d67c940a3b69d96c24" Jul 07 16:27:02.678681 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:02.678646 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pk2x5" event={"ID":"2ed6d6cf-70cd-4211-9644-85550a9874ff","Type":"ContainerStarted","Data":"2dedaf38d35d9e9d2f21230068cb2d5193556fd3c8adc528eea8b09d52e3d5e1"} Jul 07 16:27:02.697837 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:02.697784 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pk2x5" podStartSLOduration=1.6056676090000002 podStartE2EDuration="4.697767497s" totalImagesPullingTime="3.092099888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:26:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:27:02.696639297 +0000 UTC m=+242.636148715" watchObservedRunningTime="2026-07-07 16:27:02.697767497 +0000 UTC m=+242.637276919" Jul 07 16:27:02.888349 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:02.888319 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-j7rcg"] Jul 07 16:27:02.888602 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:02.888591 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9abd4dca-2c50-4a65-b867-dc0aec3d35f3" containerName="pull" Jul 07 16:27:02.888659 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:02.888604 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9abd4dca-2c50-4a65-b867-dc0aec3d35f3" containerName="pull" Jul 07 16:27:02.888659 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:02.888614 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9abd4dca-2c50-4a65-b867-dc0aec3d35f3" containerName="extract" Jul 07 16:27:02.888659 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:02.888620 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9abd4dca-2c50-4a65-b867-dc0aec3d35f3" containerName="extract" Jul 07 16:27:02.888659 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:02.888635 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9abd4dca-2c50-4a65-b867-dc0aec3d35f3" containerName="util" Jul 07 16:27:02.888659 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:02.888640 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9abd4dca-2c50-4a65-b867-dc0aec3d35f3" containerName="util" Jul 07 16:27:02.888823 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:02.888683 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9abd4dca-2c50-4a65-b867-dc0aec3d35f3" containerName="extract" Jul 07 16:27:02.890476 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:02.890462 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-j7rcg" Jul 07 16:27:02.893283 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:02.893264 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-b798p\"" Jul 07 16:27:02.899379 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:02.899355 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-j7rcg"] Jul 07 16:27:03.036948 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:03.036859 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phvht\" (UniqueName: \"kubernetes.io/projected/bdc0da28-e00e-4d5e-aaa7-9fd1adfeab84-kube-api-access-phvht\") pod \"cert-manager-webhook-6486ffd997-j7rcg\" (UID: \"bdc0da28-e00e-4d5e-aaa7-9fd1adfeab84\") " pod="cert-manager/cert-manager-webhook-6486ffd997-j7rcg" Jul 07 16:27:03.036948 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:03.036915 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bdc0da28-e00e-4d5e-aaa7-9fd1adfeab84-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-j7rcg\" (UID: \"bdc0da28-e00e-4d5e-aaa7-9fd1adfeab84\") " pod="cert-manager/cert-manager-webhook-6486ffd997-j7rcg" Jul 07 16:27:03.137606 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:03.137573 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phvht\" (UniqueName: \"kubernetes.io/projected/bdc0da28-e00e-4d5e-aaa7-9fd1adfeab84-kube-api-access-phvht\") pod \"cert-manager-webhook-6486ffd997-j7rcg\" (UID: \"bdc0da28-e00e-4d5e-aaa7-9fd1adfeab84\") " pod="cert-manager/cert-manager-webhook-6486ffd997-j7rcg" Jul 07 16:27:03.137750 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:03.137620 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bdc0da28-e00e-4d5e-aaa7-9fd1adfeab84-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-j7rcg\" (UID: \"bdc0da28-e00e-4d5e-aaa7-9fd1adfeab84\") " pod="cert-manager/cert-manager-webhook-6486ffd997-j7rcg" Jul 07 16:27:03.146275 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:03.146222 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bdc0da28-e00e-4d5e-aaa7-9fd1adfeab84-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-j7rcg\" (UID: \"bdc0da28-e00e-4d5e-aaa7-9fd1adfeab84\") " pod="cert-manager/cert-manager-webhook-6486ffd997-j7rcg" Jul 07 16:27:03.146421 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:03.146398 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phvht\" (UniqueName: \"kubernetes.io/projected/bdc0da28-e00e-4d5e-aaa7-9fd1adfeab84-kube-api-access-phvht\") pod \"cert-manager-webhook-6486ffd997-j7rcg\" (UID: \"bdc0da28-e00e-4d5e-aaa7-9fd1adfeab84\") " pod="cert-manager/cert-manager-webhook-6486ffd997-j7rcg" Jul 07 16:27:03.199376 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:03.199338 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-j7rcg" Jul 07 16:27:03.332798 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:03.328361 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-j7rcg"] Jul 07 16:27:03.332798 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:27:03.332331 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbdc0da28_e00e_4d5e_aaa7_9fd1adfeab84.slice/crio-bfd5ff6cc6dce15b02ab11901f4f4233b7d5f6df03b21245d0fdd3b27d06e0e9 WatchSource:0}: Error finding container bfd5ff6cc6dce15b02ab11901f4f4233b7d5f6df03b21245d0fdd3b27d06e0e9: Status 404 returned error can't find the container with id bfd5ff6cc6dce15b02ab11901f4f4233b7d5f6df03b21245d0fdd3b27d06e0e9 Jul 07 16:27:03.604889 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:03.604862 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:27:03.684219 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:03.684180 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-j7rcg" event={"ID":"bdc0da28-e00e-4d5e-aaa7-9fd1adfeab84","Type":"ContainerStarted","Data":"3449690ad9c19fde90922be4c1f4277a141ea933847ddedbb5ac37821a3e0151"} Jul 07 16:27:03.684724 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:03.684254 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-j7rcg" event={"ID":"bdc0da28-e00e-4d5e-aaa7-9fd1adfeab84","Type":"ContainerStarted","Data":"bfd5ff6cc6dce15b02ab11901f4f4233b7d5f6df03b21245d0fdd3b27d06e0e9"} Jul 07 16:27:03.684724 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:03.684493 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-j7rcg" Jul 07 16:27:03.684803 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:03.684728 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:27:03.706774 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:03.706733 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-j7rcg" podStartSLOduration=1.7067166390000001 podStartE2EDuration="1.706716639s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:27:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:27:03.704379765 +0000 UTC m=+243.643889187" watchObservedRunningTime="2026-07-07 16:27:03.706716639 +0000 UTC m=+243.646226062" Jul 07 16:27:04.033437 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:04.033355 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:27:04.160206 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:04.160174 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:27:06.304939 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:06.304905 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lztgh"] Jul 07 16:27:06.306999 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:06.306982 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lztgh" Jul 07 16:27:06.309816 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:06.309777 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 07 16:27:06.309933 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:06.309850 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-hwhkq\"" Jul 07 16:27:06.311186 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:06.311168 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 07 16:27:06.317902 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:06.317882 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lztgh"] Jul 07 16:27:06.401347 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:06.401299 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:27:06.463073 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:06.463041 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stm7z\" (UniqueName: \"kubernetes.io/projected/1212eff6-6c57-4936-adee-b75c5dbc7a37-kube-api-access-stm7z\") pod \"openshift-lws-operator-fd8ccff4c-lztgh\" (UID: \"1212eff6-6c57-4936-adee-b75c5dbc7a37\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lztgh" Jul 07 16:27:06.463222 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:06.463100 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1212eff6-6c57-4936-adee-b75c5dbc7a37-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lztgh\" (UID: \"1212eff6-6c57-4936-adee-b75c5dbc7a37\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lztgh" Jul 07 16:27:06.564388 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:06.564305 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1212eff6-6c57-4936-adee-b75c5dbc7a37-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lztgh\" (UID: \"1212eff6-6c57-4936-adee-b75c5dbc7a37\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lztgh" Jul 07 16:27:06.564531 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:06.564385 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stm7z\" (UniqueName: \"kubernetes.io/projected/1212eff6-6c57-4936-adee-b75c5dbc7a37-kube-api-access-stm7z\") pod \"openshift-lws-operator-fd8ccff4c-lztgh\" (UID: \"1212eff6-6c57-4936-adee-b75c5dbc7a37\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lztgh" Jul 07 16:27:06.564745 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:06.564725 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1212eff6-6c57-4936-adee-b75c5dbc7a37-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lztgh\" (UID: \"1212eff6-6c57-4936-adee-b75c5dbc7a37\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lztgh" Jul 07 16:27:06.573525 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:06.573497 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stm7z\" (UniqueName: \"kubernetes.io/projected/1212eff6-6c57-4936-adee-b75c5dbc7a37-kube-api-access-stm7z\") pod \"openshift-lws-operator-fd8ccff4c-lztgh\" (UID: \"1212eff6-6c57-4936-adee-b75c5dbc7a37\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lztgh" Jul 07 16:27:06.616193 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:06.616151 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lztgh" Jul 07 16:27:06.745224 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:06.745194 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lztgh"] Jul 07 16:27:06.748742 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:27:06.748718 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1212eff6_6c57_4936_adee_b75c5dbc7a37.slice/crio-b2800310bf8839ef0e8153a02687c89e6e89216a269c5693a7b41fd2fd826450 WatchSource:0}: Error finding container b2800310bf8839ef0e8153a02687c89e6e89216a269c5693a7b41fd2fd826450: Status 404 returned error can't find the container with id b2800310bf8839ef0e8153a02687c89e6e89216a269c5693a7b41fd2fd826450 Jul 07 16:27:07.700777 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:07.700744 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lztgh" event={"ID":"1212eff6-6c57-4936-adee-b75c5dbc7a37","Type":"ContainerStarted","Data":"b2800310bf8839ef0e8153a02687c89e6e89216a269c5693a7b41fd2fd826450"} Jul 07 16:27:09.690660 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:09.690537 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-j7rcg" Jul 07 16:27:10.715995 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:10.715946 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lztgh" event={"ID":"1212eff6-6c57-4936-adee-b75c5dbc7a37","Type":"ContainerStarted","Data":"76b44a6dd724a1c734ecc078fc6c252c55bbf3f9070d6492dd52432917d64f35"} Jul 07 16:27:10.737771 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:10.737718 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lztgh" podStartSLOduration=1.446076373 podStartE2EDuration="4.737700466s" totalImagesPullingTime="3.291624093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:27:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:27:10.735444572 +0000 UTC m=+250.674953996" watchObservedRunningTime="2026-07-07 16:27:10.737700466 +0000 UTC m=+250.677209888" Jul 07 16:27:11.602337 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:11.602303 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:27:11.687525 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:11.687490 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:27:13.130346 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:13.130310 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsnqmd"] Jul 07 16:27:13.132652 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:13.132632 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsnqmd" Jul 07 16:27:13.135443 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:13.135417 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 16:27:13.135443 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:13.135441 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 16:27:13.136886 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:13.136869 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gzmhr\"" Jul 07 16:27:13.145179 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:13.145152 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsnqmd"] Jul 07 16:27:13.207721 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:13.207689 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4r94\" (UniqueName: \"kubernetes.io/projected/707a0406-f80b-4b78-aa36-b41b8f3a6ce3-kube-api-access-r4r94\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsnqmd\" (UID: \"707a0406-f80b-4b78-aa36-b41b8f3a6ce3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsnqmd" Jul 07 16:27:13.207878 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:13.207732 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/707a0406-f80b-4b78-aa36-b41b8f3a6ce3-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsnqmd\" (UID: \"707a0406-f80b-4b78-aa36-b41b8f3a6ce3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsnqmd" Jul 07 16:27:13.207878 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:13.207816 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/707a0406-f80b-4b78-aa36-b41b8f3a6ce3-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsnqmd\" (UID: \"707a0406-f80b-4b78-aa36-b41b8f3a6ce3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsnqmd" Jul 07 16:27:13.308597 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:13.308565 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4r94\" (UniqueName: \"kubernetes.io/projected/707a0406-f80b-4b78-aa36-b41b8f3a6ce3-kube-api-access-r4r94\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsnqmd\" (UID: \"707a0406-f80b-4b78-aa36-b41b8f3a6ce3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsnqmd" Jul 07 16:27:13.308757 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:13.308605 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/707a0406-f80b-4b78-aa36-b41b8f3a6ce3-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsnqmd\" (UID: \"707a0406-f80b-4b78-aa36-b41b8f3a6ce3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsnqmd" Jul 07 16:27:13.308757 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:13.308635 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/707a0406-f80b-4b78-aa36-b41b8f3a6ce3-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsnqmd\" (UID: \"707a0406-f80b-4b78-aa36-b41b8f3a6ce3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsnqmd" Jul 07 16:27:13.308957 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:13.308942 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/707a0406-f80b-4b78-aa36-b41b8f3a6ce3-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsnqmd\" (UID: \"707a0406-f80b-4b78-aa36-b41b8f3a6ce3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsnqmd" Jul 07 16:27:13.308997 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:13.308970 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/707a0406-f80b-4b78-aa36-b41b8f3a6ce3-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsnqmd\" (UID: \"707a0406-f80b-4b78-aa36-b41b8f3a6ce3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsnqmd" Jul 07 16:27:13.317497 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:13.317475 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4r94\" (UniqueName: \"kubernetes.io/projected/707a0406-f80b-4b78-aa36-b41b8f3a6ce3-kube-api-access-r4r94\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsnqmd\" (UID: \"707a0406-f80b-4b78-aa36-b41b8f3a6ce3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsnqmd" Jul 07 16:27:13.442180 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:13.442099 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsnqmd" Jul 07 16:27:13.577560 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:13.577529 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsnqmd"] Jul 07 16:27:13.580070 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:27:13.580039 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod707a0406_f80b_4b78_aa36_b41b8f3a6ce3.slice/crio-4c6b18f8776479686e204fbe087d0a92c4b4533d8551a666f1fa1057e9ae9e45 WatchSource:0}: Error finding container 4c6b18f8776479686e204fbe087d0a92c4b4533d8551a666f1fa1057e9ae9e45: Status 404 returned error can't find the container with id 4c6b18f8776479686e204fbe087d0a92c4b4533d8551a666f1fa1057e9ae9e45 Jul 07 16:27:13.624579 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:13.624556 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:27:13.728999 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:13.728923 2564 generic.go:356] "Generic (PLEG): container finished" podID="707a0406-f80b-4b78-aa36-b41b8f3a6ce3" containerID="7c519143d6aab30413fcee3dee7f6eb7250f2720a1e50c509b53c8bf8e7916a3" exitCode=0 Jul 07 16:27:13.728999 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:13.728983 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsnqmd" event={"ID":"707a0406-f80b-4b78-aa36-b41b8f3a6ce3","Type":"ContainerDied","Data":"7c519143d6aab30413fcee3dee7f6eb7250f2720a1e50c509b53c8bf8e7916a3"} Jul 07 16:27:13.729180 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:13.729020 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsnqmd" event={"ID":"707a0406-f80b-4b78-aa36-b41b8f3a6ce3","Type":"ContainerStarted","Data":"4c6b18f8776479686e204fbe087d0a92c4b4533d8551a666f1fa1057e9ae9e45"} Jul 07 16:27:14.737040 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:14.737003 2564 generic.go:356] "Generic (PLEG): container finished" podID="707a0406-f80b-4b78-aa36-b41b8f3a6ce3" containerID="9685d56efbe83f68a8ebc3f21b0fd40528018bccaad19eb4e24bcbb1c981c3a9" exitCode=0 Jul 07 16:27:14.737436 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:14.737089 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsnqmd" event={"ID":"707a0406-f80b-4b78-aa36-b41b8f3a6ce3","Type":"ContainerDied","Data":"9685d56efbe83f68a8ebc3f21b0fd40528018bccaad19eb4e24bcbb1c981c3a9"} Jul 07 16:27:15.386882 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:15.386848 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:27:15.485220 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:15.485184 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:27:15.744136 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:15.744060 2564 generic.go:356] "Generic (PLEG): container finished" podID="707a0406-f80b-4b78-aa36-b41b8f3a6ce3" containerID="1a488c8e0b2a7251734920b796a2972654e848dfb499e01cfd763b3ec8d31f8a" exitCode=0 Jul 07 16:27:15.744136 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:15.744110 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsnqmd" event={"ID":"707a0406-f80b-4b78-aa36-b41b8f3a6ce3","Type":"ContainerDied","Data":"1a488c8e0b2a7251734920b796a2972654e848dfb499e01cfd763b3ec8d31f8a"} Jul 07 16:27:16.892103 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:16.892075 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsnqmd" Jul 07 16:27:16.935706 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:16.935675 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4r94\" (UniqueName: \"kubernetes.io/projected/707a0406-f80b-4b78-aa36-b41b8f3a6ce3-kube-api-access-r4r94\") pod \"707a0406-f80b-4b78-aa36-b41b8f3a6ce3\" (UID: \"707a0406-f80b-4b78-aa36-b41b8f3a6ce3\") " Jul 07 16:27:16.935852 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:16.935736 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/707a0406-f80b-4b78-aa36-b41b8f3a6ce3-util\") pod \"707a0406-f80b-4b78-aa36-b41b8f3a6ce3\" (UID: \"707a0406-f80b-4b78-aa36-b41b8f3a6ce3\") " Jul 07 16:27:16.935852 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:16.935782 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/707a0406-f80b-4b78-aa36-b41b8f3a6ce3-bundle\") pod \"707a0406-f80b-4b78-aa36-b41b8f3a6ce3\" (UID: \"707a0406-f80b-4b78-aa36-b41b8f3a6ce3\") " Jul 07 16:27:16.936620 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:16.936595 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/707a0406-f80b-4b78-aa36-b41b8f3a6ce3-bundle" (OuterVolumeSpecName: "bundle") pod "707a0406-f80b-4b78-aa36-b41b8f3a6ce3" (UID: "707a0406-f80b-4b78-aa36-b41b8f3a6ce3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:27:16.937933 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:16.937915 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/707a0406-f80b-4b78-aa36-b41b8f3a6ce3-kube-api-access-r4r94" (OuterVolumeSpecName: "kube-api-access-r4r94") pod "707a0406-f80b-4b78-aa36-b41b8f3a6ce3" (UID: "707a0406-f80b-4b78-aa36-b41b8f3a6ce3"). InnerVolumeSpecName "kube-api-access-r4r94". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:27:16.941910 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:16.941884 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/707a0406-f80b-4b78-aa36-b41b8f3a6ce3-util" (OuterVolumeSpecName: "util") pod "707a0406-f80b-4b78-aa36-b41b8f3a6ce3" (UID: "707a0406-f80b-4b78-aa36-b41b8f3a6ce3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:27:17.037033 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:17.036960 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/707a0406-f80b-4b78-aa36-b41b8f3a6ce3-util\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:27:17.037033 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:17.036984 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/707a0406-f80b-4b78-aa36-b41b8f3a6ce3-bundle\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:27:17.037033 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:17.036992 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4r94\" (UniqueName: \"kubernetes.io/projected/707a0406-f80b-4b78-aa36-b41b8f3a6ce3-kube-api-access-r4r94\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:27:17.754835 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:17.754804 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsnqmd" event={"ID":"707a0406-f80b-4b78-aa36-b41b8f3a6ce3","Type":"ContainerDied","Data":"4c6b18f8776479686e204fbe087d0a92c4b4533d8551a666f1fa1057e9ae9e45"} Jul 07 16:27:17.754835 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:17.754823 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsnqmd" Jul 07 16:27:17.755034 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:17.754853 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c6b18f8776479686e204fbe087d0a92c4b4533d8551a666f1fa1057e9ae9e45" Jul 07 16:27:24.007703 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:24.007601 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:27:24.058275 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:24.058245 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-96844494c-kczjw"] Jul 07 16:27:24.058541 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:24.058530 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="707a0406-f80b-4b78-aa36-b41b8f3a6ce3" containerName="extract" Jul 07 16:27:24.058583 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:24.058543 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="707a0406-f80b-4b78-aa36-b41b8f3a6ce3" containerName="extract" Jul 07 16:27:24.058583 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:24.058553 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="707a0406-f80b-4b78-aa36-b41b8f3a6ce3" containerName="pull" Jul 07 16:27:24.058583 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:24.058559 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="707a0406-f80b-4b78-aa36-b41b8f3a6ce3" containerName="pull" Jul 07 16:27:24.058583 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:24.058572 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="707a0406-f80b-4b78-aa36-b41b8f3a6ce3" containerName="util" Jul 07 16:27:24.058583 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:24.058577 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="707a0406-f80b-4b78-aa36-b41b8f3a6ce3" containerName="util" Jul 07 16:27:24.058728 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:24.058631 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="707a0406-f80b-4b78-aa36-b41b8f3a6ce3" containerName="extract" Jul 07 16:27:24.060289 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:24.060273 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-96844494c-kczjw" Jul 07 16:27:24.064060 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:24.064029 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 07 16:27:24.065414 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:24.065386 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 07 16:27:24.065526 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:24.065441 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-h9n57\"" Jul 07 16:27:24.065526 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:24.065441 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 07 16:27:24.074787 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:24.074761 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-96844494c-kczjw"] Jul 07 16:27:24.093951 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:24.093908 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5b84c31-7f77-4f0f-a4c4-709936ceda48-cert\") pod \"lws-controller-manager-96844494c-kczjw\" (UID: \"b5b84c31-7f77-4f0f-a4c4-709936ceda48\") " pod="openshift-lws-operator/lws-controller-manager-96844494c-kczjw" Jul 07 16:27:24.094151 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:24.093955 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cc76\" (UniqueName: \"kubernetes.io/projected/b5b84c31-7f77-4f0f-a4c4-709936ceda48-kube-api-access-9cc76\") pod \"lws-controller-manager-96844494c-kczjw\" (UID: \"b5b84c31-7f77-4f0f-a4c4-709936ceda48\") " pod="openshift-lws-operator/lws-controller-manager-96844494c-kczjw" Jul 07 16:27:24.094151 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:24.094067 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b5b84c31-7f77-4f0f-a4c4-709936ceda48-metrics-cert\") pod \"lws-controller-manager-96844494c-kczjw\" (UID: \"b5b84c31-7f77-4f0f-a4c4-709936ceda48\") " pod="openshift-lws-operator/lws-controller-manager-96844494c-kczjw" Jul 07 16:27:24.094151 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:24.094120 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b5b84c31-7f77-4f0f-a4c4-709936ceda48-manager-config\") pod \"lws-controller-manager-96844494c-kczjw\" (UID: \"b5b84c31-7f77-4f0f-a4c4-709936ceda48\") " pod="openshift-lws-operator/lws-controller-manager-96844494c-kczjw" Jul 07 16:27:24.118963 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:24.118909 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:27:24.195246 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:24.195189 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b5b84c31-7f77-4f0f-a4c4-709936ceda48-metrics-cert\") pod \"lws-controller-manager-96844494c-kczjw\" (UID: \"b5b84c31-7f77-4f0f-a4c4-709936ceda48\") " pod="openshift-lws-operator/lws-controller-manager-96844494c-kczjw" Jul 07 16:27:24.195601 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:24.195583 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b5b84c31-7f77-4f0f-a4c4-709936ceda48-manager-config\") pod \"lws-controller-manager-96844494c-kczjw\" (UID: \"b5b84c31-7f77-4f0f-a4c4-709936ceda48\") " pod="openshift-lws-operator/lws-controller-manager-96844494c-kczjw" Jul 07 16:27:24.195745 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:24.195730 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5b84c31-7f77-4f0f-a4c4-709936ceda48-cert\") pod \"lws-controller-manager-96844494c-kczjw\" (UID: \"b5b84c31-7f77-4f0f-a4c4-709936ceda48\") " pod="openshift-lws-operator/lws-controller-manager-96844494c-kczjw" Jul 07 16:27:24.195843 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:24.195830 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cc76\" (UniqueName: \"kubernetes.io/projected/b5b84c31-7f77-4f0f-a4c4-709936ceda48-kube-api-access-9cc76\") pod \"lws-controller-manager-96844494c-kczjw\" (UID: \"b5b84c31-7f77-4f0f-a4c4-709936ceda48\") " pod="openshift-lws-operator/lws-controller-manager-96844494c-kczjw" Jul 07 16:27:24.196688 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:24.196662 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b5b84c31-7f77-4f0f-a4c4-709936ceda48-manager-config\") pod \"lws-controller-manager-96844494c-kczjw\" (UID: \"b5b84c31-7f77-4f0f-a4c4-709936ceda48\") " pod="openshift-lws-operator/lws-controller-manager-96844494c-kczjw" Jul 07 16:27:24.199254 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:24.199190 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b5b84c31-7f77-4f0f-a4c4-709936ceda48-metrics-cert\") pod \"lws-controller-manager-96844494c-kczjw\" (UID: \"b5b84c31-7f77-4f0f-a4c4-709936ceda48\") " pod="openshift-lws-operator/lws-controller-manager-96844494c-kczjw" Jul 07 16:27:24.199385 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:24.199366 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5b84c31-7f77-4f0f-a4c4-709936ceda48-cert\") pod \"lws-controller-manager-96844494c-kczjw\" (UID: \"b5b84c31-7f77-4f0f-a4c4-709936ceda48\") " pod="openshift-lws-operator/lws-controller-manager-96844494c-kczjw" Jul 07 16:27:24.212837 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:24.212809 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cc76\" (UniqueName: \"kubernetes.io/projected/b5b84c31-7f77-4f0f-a4c4-709936ceda48-kube-api-access-9cc76\") pod \"lws-controller-manager-96844494c-kczjw\" (UID: \"b5b84c31-7f77-4f0f-a4c4-709936ceda48\") " pod="openshift-lws-operator/lws-controller-manager-96844494c-kczjw" Jul 07 16:27:24.369767 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:24.369725 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-96844494c-kczjw" Jul 07 16:27:24.510910 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:24.510879 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-96844494c-kczjw"] Jul 07 16:27:24.515044 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:27:24.515018 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5b84c31_7f77_4f0f_a4c4_709936ceda48.slice/crio-fcd90361a56bcf793f254617cf7e19abbf06fba68683aa84fdceea1da988e09a WatchSource:0}: Error finding container fcd90361a56bcf793f254617cf7e19abbf06fba68683aa84fdceea1da988e09a: Status 404 returned error can't find the container with id fcd90361a56bcf793f254617cf7e19abbf06fba68683aa84fdceea1da988e09a Jul 07 16:27:24.785433 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:24.785339 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-96844494c-kczjw" event={"ID":"b5b84c31-7f77-4f0f-a4c4-709936ceda48","Type":"ContainerStarted","Data":"fcd90361a56bcf793f254617cf7e19abbf06fba68683aa84fdceea1da988e09a"} Jul 07 16:27:25.233509 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:25.233474 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:27:25.460955 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:25.460917 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:27:25.828943 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:25.828898 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:27:26.143123 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:26.143085 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:27:26.262908 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:26.262869 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:27:26.350145 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:26.350112 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7"] Jul 07 16:27:26.352421 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:26.352403 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7" Jul 07 16:27:26.356457 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:26.356433 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 07 16:27:26.356598 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:26.356545 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 07 16:27:26.356662 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:26.356644 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 07 16:27:26.356729 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:26.356660 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 07 16:27:26.356788 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:26.356727 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-vkgk9\"" Jul 07 16:27:26.375729 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:26.375702 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7"] Jul 07 16:27:26.414690 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:26.414626 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5a50c784-3e75-4dcf-86e3-a4d0d8c4ee06-manifests\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7\" (UID: \"5a50c784-3e75-4dcf-86e3-a4d0d8c4ee06\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7" Jul 07 16:27:26.414690 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:26.414667 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a50c784-3e75-4dcf-86e3-a4d0d8c4ee06-tmp\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7\" (UID: \"5a50c784-3e75-4dcf-86e3-a4d0d8c4ee06\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7" Jul 07 16:27:26.414690 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:26.414684 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fcmp\" (UniqueName: \"kubernetes.io/projected/5a50c784-3e75-4dcf-86e3-a4d0d8c4ee06-kube-api-access-5fcmp\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7\" (UID: \"5a50c784-3e75-4dcf-86e3-a4d0d8c4ee06\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7" Jul 07 16:27:26.414906 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:26.414772 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5a50c784-3e75-4dcf-86e3-a4d0d8c4ee06-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7\" (UID: \"5a50c784-3e75-4dcf-86e3-a4d0d8c4ee06\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7" Jul 07 16:27:26.414906 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:26.414808 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5a50c784-3e75-4dcf-86e3-a4d0d8c4ee06-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7\" (UID: \"5a50c784-3e75-4dcf-86e3-a4d0d8c4ee06\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7" Jul 07 16:27:26.506739 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:26.506712 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:27:26.516174 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:26.516145 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a50c784-3e75-4dcf-86e3-a4d0d8c4ee06-tmp\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7\" (UID: \"5a50c784-3e75-4dcf-86e3-a4d0d8c4ee06\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7" Jul 07 16:27:26.516341 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:26.516178 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fcmp\" (UniqueName: \"kubernetes.io/projected/5a50c784-3e75-4dcf-86e3-a4d0d8c4ee06-kube-api-access-5fcmp\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7\" (UID: \"5a50c784-3e75-4dcf-86e3-a4d0d8c4ee06\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7" Jul 07 16:27:26.516341 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:26.516216 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5a50c784-3e75-4dcf-86e3-a4d0d8c4ee06-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7\" (UID: \"5a50c784-3e75-4dcf-86e3-a4d0d8c4ee06\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7" Jul 07 16:27:26.516341 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:26.516292 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5a50c784-3e75-4dcf-86e3-a4d0d8c4ee06-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7\" (UID: \"5a50c784-3e75-4dcf-86e3-a4d0d8c4ee06\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7" Jul 07 16:27:26.516500 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:26.516394 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5a50c784-3e75-4dcf-86e3-a4d0d8c4ee06-manifests\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7\" (UID: \"5a50c784-3e75-4dcf-86e3-a4d0d8c4ee06\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7" Jul 07 16:27:26.516728 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:26.516705 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5a50c784-3e75-4dcf-86e3-a4d0d8c4ee06-manifests\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7\" (UID: \"5a50c784-3e75-4dcf-86e3-a4d0d8c4ee06\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7" Jul 07 16:27:26.518528 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:26.518508 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a50c784-3e75-4dcf-86e3-a4d0d8c4ee06-tmp\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7\" (UID: \"5a50c784-3e75-4dcf-86e3-a4d0d8c4ee06\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7" Jul 07 16:27:26.518758 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:26.518742 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5a50c784-3e75-4dcf-86e3-a4d0d8c4ee06-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7\" (UID: \"5a50c784-3e75-4dcf-86e3-a4d0d8c4ee06\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7" Jul 07 16:27:26.518881 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:26.518860 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5a50c784-3e75-4dcf-86e3-a4d0d8c4ee06-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7\" (UID: \"5a50c784-3e75-4dcf-86e3-a4d0d8c4ee06\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7" Jul 07 16:27:26.529482 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:26.529453 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fcmp\" (UniqueName: \"kubernetes.io/projected/5a50c784-3e75-4dcf-86e3-a4d0d8c4ee06-kube-api-access-5fcmp\") pod \"opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7\" (UID: \"5a50c784-3e75-4dcf-86e3-a4d0d8c4ee06\") " pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7" Jul 07 16:27:26.606541 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:26.606513 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:27:26.662388 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:26.662351 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7" Jul 07 16:27:26.706142 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:26.706112 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:27:26.796999 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:26.796959 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-96844494c-kczjw" event={"ID":"b5b84c31-7f77-4f0f-a4c4-709936ceda48","Type":"ContainerStarted","Data":"f4883f1064b64976fb16542e039780eed7eb4c71d2afa171407c0ebd8e2f6158"} Jul 07 16:27:26.797284 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:26.797260 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-96844494c-kczjw" Jul 07 16:27:26.799200 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:26.799180 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7"] Jul 07 16:27:26.801820 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:27:26.801798 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a50c784_3e75_4dcf_86e3_a4d0d8c4ee06.slice/crio-ae06e73999f3e480dba0d9bcfea90d4bf9ef88f915c627905a4619207f76cf7e WatchSource:0}: Error finding container ae06e73999f3e480dba0d9bcfea90d4bf9ef88f915c627905a4619207f76cf7e: Status 404 returned error can't find the container with id ae06e73999f3e480dba0d9bcfea90d4bf9ef88f915c627905a4619207f76cf7e Jul 07 16:27:26.807746 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:26.807726 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:27:26.822583 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:26.822544 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-96844494c-kczjw" podStartSLOduration=1.4400424840000001 podStartE2EDuration="2.822527499s" totalImagesPullingTime="1.382485015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:27:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:27:26.821994122 +0000 UTC m=+266.761503551" watchObservedRunningTime="2026-07-07 16:27:26.822527499 +0000 UTC m=+266.762036924" Jul 07 16:27:26.891175 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:26.891143 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:27:26.993909 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:26.993826 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:27:27.805244 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:27.805185 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7" event={"ID":"5a50c784-3e75-4dcf-86e3-a4d0d8c4ee06","Type":"ContainerStarted","Data":"ae06e73999f3e480dba0d9bcfea90d4bf9ef88f915c627905a4619207f76cf7e"} Jul 07 16:27:30.822888 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:30.822854 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7" event={"ID":"5a50c784-3e75-4dcf-86e3-a4d0d8c4ee06","Type":"ContainerStarted","Data":"f16a214c23d3581ebd4b9d7b242ede22d9bea204958fb3e73405e620684c2a8b"} Jul 07 16:27:31.828909 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:31.828875 2564 generic.go:356] "Generic (PLEG): container finished" podID="5a50c784-3e75-4dcf-86e3-a4d0d8c4ee06" containerID="f16a214c23d3581ebd4b9d7b242ede22d9bea204958fb3e73405e620684c2a8b" exitCode=0 Jul 07 16:27:31.829335 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:31.828942 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7" event={"ID":"5a50c784-3e75-4dcf-86e3-a4d0d8c4ee06","Type":"ContainerDied","Data":"f16a214c23d3581ebd4b9d7b242ede22d9bea204958fb3e73405e620684c2a8b"} Jul 07 16:27:32.835748 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:32.835712 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7" event={"ID":"5a50c784-3e75-4dcf-86e3-a4d0d8c4ee06","Type":"ContainerStarted","Data":"97f93e2bedabc1da9ae4a809b5053cde5fcfcdc5452b2e25aa9a9f9e67fb0adc"} Jul 07 16:27:32.836148 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:32.835875 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7" Jul 07 16:27:32.866891 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:32.866844 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7" podStartSLOduration=2.2869405990000002 podStartE2EDuration="6.866830108s" totalImagesPullingTime="3.564829717s" totalInitContainerRuntime="1.015059792s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:27:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:27:32.866750532 +0000 UTC m=+272.806259967" watchObservedRunningTime="2026-07-07 16:27:32.866830108 +0000 UTC m=+272.806339530" Jul 07 16:27:37.807565 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:37.807537 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-96844494c-kczjw" Jul 07 16:27:43.841843 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:43.841807 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7" Jul 07 16:27:58.663682 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:27:58.663626 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:28:00.461177 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:00.461139 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4llwj_41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d/ovn-acl-logging/0.log" Jul 07 16:28:00.466505 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:00.466477 2564 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 16:28:00.467195 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:00.467170 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4llwj_41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d/ovn-acl-logging/0.log" Jul 07 16:28:00.581208 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:00.581170 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:28:00.781508 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:00.781310 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:28:02.293339 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:02.293301 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-lfnmn"] Jul 07 16:28:02.301959 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:02.301930 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:28:02.356156 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:02.356119 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-lfnmn"] Jul 07 16:28:02.356343 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:02.356281 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfnmn" Jul 07 16:28:02.359439 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:02.359416 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 07 16:28:02.359611 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:02.359444 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-rv674\"" Jul 07 16:28:02.359611 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:02.359417 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 07 16:28:02.359611 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:02.359421 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 07 16:28:02.359611 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:02.359427 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 07 16:28:02.359830 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:02.359631 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 07 16:28:02.359830 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:02.359701 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 07 16:28:02.432053 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:02.432016 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/68dfabd9-6849-4fb8-ad77-c95076a0f34a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-lfnmn\" (UID: \"68dfabd9-6849-4fb8-ad77-c95076a0f34a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfnmn" Jul 07 16:28:02.432257 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:02.432065 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/68dfabd9-6849-4fb8-ad77-c95076a0f34a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-lfnmn\" (UID: \"68dfabd9-6849-4fb8-ad77-c95076a0f34a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfnmn" Jul 07 16:28:02.432257 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:02.432089 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/68dfabd9-6849-4fb8-ad77-c95076a0f34a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-lfnmn\" (UID: \"68dfabd9-6849-4fb8-ad77-c95076a0f34a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfnmn" Jul 07 16:28:02.432257 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:02.432135 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkdbt\" (UniqueName: \"kubernetes.io/projected/68dfabd9-6849-4fb8-ad77-c95076a0f34a-kube-api-access-wkdbt\") pod \"istiod-openshift-gateway-7574459656-lfnmn\" (UID: \"68dfabd9-6849-4fb8-ad77-c95076a0f34a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfnmn" Jul 07 16:28:02.432257 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:02.432166 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/68dfabd9-6849-4fb8-ad77-c95076a0f34a-local-certs\") pod \"istiod-openshift-gateway-7574459656-lfnmn\" (UID: \"68dfabd9-6849-4fb8-ad77-c95076a0f34a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfnmn" Jul 07 16:28:02.432257 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:02.432195 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/68dfabd9-6849-4fb8-ad77-c95076a0f34a-cacerts\") pod \"istiod-openshift-gateway-7574459656-lfnmn\" (UID: \"68dfabd9-6849-4fb8-ad77-c95076a0f34a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfnmn" Jul 07 16:28:02.432257 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:02.432217 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68dfabd9-6849-4fb8-ad77-c95076a0f34a-istio-token\") pod \"istiod-openshift-gateway-7574459656-lfnmn\" (UID: \"68dfabd9-6849-4fb8-ad77-c95076a0f34a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfnmn" Jul 07 16:28:02.443431 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:02.443397 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:28:02.533221 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:02.533190 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/68dfabd9-6849-4fb8-ad77-c95076a0f34a-local-certs\") pod \"istiod-openshift-gateway-7574459656-lfnmn\" (UID: \"68dfabd9-6849-4fb8-ad77-c95076a0f34a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfnmn" Jul 07 16:28:02.533416 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:02.533249 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/68dfabd9-6849-4fb8-ad77-c95076a0f34a-cacerts\") pod \"istiod-openshift-gateway-7574459656-lfnmn\" (UID: \"68dfabd9-6849-4fb8-ad77-c95076a0f34a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfnmn" Jul 07 16:28:02.533416 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:02.533275 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68dfabd9-6849-4fb8-ad77-c95076a0f34a-istio-token\") pod \"istiod-openshift-gateway-7574459656-lfnmn\" (UID: \"68dfabd9-6849-4fb8-ad77-c95076a0f34a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfnmn" Jul 07 16:28:02.533416 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:02.533300 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/68dfabd9-6849-4fb8-ad77-c95076a0f34a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-lfnmn\" (UID: \"68dfabd9-6849-4fb8-ad77-c95076a0f34a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfnmn" Jul 07 16:28:02.533416 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:02.533321 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/68dfabd9-6849-4fb8-ad77-c95076a0f34a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-lfnmn\" (UID: \"68dfabd9-6849-4fb8-ad77-c95076a0f34a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfnmn" Jul 07 16:28:02.533416 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:02.533345 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/68dfabd9-6849-4fb8-ad77-c95076a0f34a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-lfnmn\" (UID: \"68dfabd9-6849-4fb8-ad77-c95076a0f34a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfnmn" Jul 07 16:28:02.533416 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:02.533381 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkdbt\" (UniqueName: \"kubernetes.io/projected/68dfabd9-6849-4fb8-ad77-c95076a0f34a-kube-api-access-wkdbt\") pod \"istiod-openshift-gateway-7574459656-lfnmn\" (UID: \"68dfabd9-6849-4fb8-ad77-c95076a0f34a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfnmn" Jul 07 16:28:02.533946 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:02.533919 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/68dfabd9-6849-4fb8-ad77-c95076a0f34a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-lfnmn\" (UID: \"68dfabd9-6849-4fb8-ad77-c95076a0f34a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfnmn" Jul 07 16:28:02.535800 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:02.535770 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/68dfabd9-6849-4fb8-ad77-c95076a0f34a-local-certs\") pod \"istiod-openshift-gateway-7574459656-lfnmn\" (UID: \"68dfabd9-6849-4fb8-ad77-c95076a0f34a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfnmn" Jul 07 16:28:02.535800 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:02.535791 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/68dfabd9-6849-4fb8-ad77-c95076a0f34a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-lfnmn\" (UID: \"68dfabd9-6849-4fb8-ad77-c95076a0f34a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfnmn" Jul 07 16:28:02.535935 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:02.535836 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/68dfabd9-6849-4fb8-ad77-c95076a0f34a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-lfnmn\" (UID: \"68dfabd9-6849-4fb8-ad77-c95076a0f34a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfnmn" Jul 07 16:28:02.535971 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:02.535933 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/68dfabd9-6849-4fb8-ad77-c95076a0f34a-cacerts\") pod \"istiod-openshift-gateway-7574459656-lfnmn\" (UID: \"68dfabd9-6849-4fb8-ad77-c95076a0f34a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfnmn" Jul 07 16:28:02.541936 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:02.541911 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkdbt\" (UniqueName: \"kubernetes.io/projected/68dfabd9-6849-4fb8-ad77-c95076a0f34a-kube-api-access-wkdbt\") pod \"istiod-openshift-gateway-7574459656-lfnmn\" (UID: \"68dfabd9-6849-4fb8-ad77-c95076a0f34a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfnmn" Jul 07 16:28:02.542406 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:02.542390 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68dfabd9-6849-4fb8-ad77-c95076a0f34a-istio-token\") pod \"istiod-openshift-gateway-7574459656-lfnmn\" (UID: \"68dfabd9-6849-4fb8-ad77-c95076a0f34a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfnmn" Jul 07 16:28:02.666063 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:02.666029 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfnmn" Jul 07 16:28:02.805000 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:02.804922 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-lfnmn"] Jul 07 16:28:02.807269 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:28:02.807200 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68dfabd9_6849_4fb8_ad77_c95076a0f34a.slice/crio-d18115204daa5ef61d62b48883fae470f63b817c51c803149992c7ec3253cc9f WatchSource:0}: Error finding container d18115204daa5ef61d62b48883fae470f63b817c51c803149992c7ec3253cc9f: Status 404 returned error can't find the container with id d18115204daa5ef61d62b48883fae470f63b817c51c803149992c7ec3253cc9f Jul 07 16:28:02.809316 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:02.809299 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 16:28:02.967797 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:02.967710 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfnmn" event={"ID":"68dfabd9-6849-4fb8-ad77-c95076a0f34a","Type":"ContainerStarted","Data":"d18115204daa5ef61d62b48883fae470f63b817c51c803149992c7ec3253cc9f"} Jul 07 16:28:04.440022 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:04.439986 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:28:05.959203 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:05.959165 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 16:28:05.959460 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:05.959246 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 16:28:06.605093 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:06.605057 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:28:06.722653 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:06.722608 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:28:06.989019 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:06.988939 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfnmn" event={"ID":"68dfabd9-6849-4fb8-ad77-c95076a0f34a","Type":"ContainerStarted","Data":"9daa77546234a9f3a19c1c5fa0753890ddfd2968fc22cdcabb75e2b0217e8cea"} Jul 07 16:28:06.989400 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:06.989049 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfnmn" Jul 07 16:28:07.018507 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:07.018456 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfnmn" podStartSLOduration=1.8689421259999999 podStartE2EDuration="5.018441033s" totalImagesPullingTime="3.149498907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:28:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:28:07.017692337 +0000 UTC m=+306.957201763" watchObservedRunningTime="2026-07-07 16:28:07.018441033 +0000 UTC m=+306.957950467" Jul 07 16:28:07.410678 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:07.410637 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:28:07.767294 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:07.767192 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:28:07.888910 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:07.888869 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:28:07.994957 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:07.994925 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfnmn" Jul 07 16:28:10.605396 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:10.605341 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:28:10.736782 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:10.736732 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:28:10.737379 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:10.737361 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6lszr"] Jul 07 16:28:10.740901 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:10.740881 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6lszr" Jul 07 16:28:10.746950 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:10.746925 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 07 16:28:10.747119 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:10.747098 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-lmtqq\"" Jul 07 16:28:10.757193 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:10.757169 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6lszr"] Jul 07 16:28:10.806334 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:10.806293 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dvqn\" (UniqueName: \"kubernetes.io/projected/c98a92d5-8504-4bd4-a8d3-8019ee45d39b-kube-api-access-6dvqn\") pod \"llmisvc-controller-manager-777c6bd7d5-6lszr\" (UID: \"c98a92d5-8504-4bd4-a8d3-8019ee45d39b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6lszr" Jul 07 16:28:10.806512 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:10.806408 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c98a92d5-8504-4bd4-a8d3-8019ee45d39b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6lszr\" (UID: \"c98a92d5-8504-4bd4-a8d3-8019ee45d39b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6lszr" Jul 07 16:28:10.907047 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:10.906961 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c98a92d5-8504-4bd4-a8d3-8019ee45d39b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6lszr\" (UID: \"c98a92d5-8504-4bd4-a8d3-8019ee45d39b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6lszr" Jul 07 16:28:10.907047 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:10.907028 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dvqn\" (UniqueName: \"kubernetes.io/projected/c98a92d5-8504-4bd4-a8d3-8019ee45d39b-kube-api-access-6dvqn\") pod \"llmisvc-controller-manager-777c6bd7d5-6lszr\" (UID: \"c98a92d5-8504-4bd4-a8d3-8019ee45d39b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6lszr" Jul 07 16:28:10.909480 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:10.909450 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c98a92d5-8504-4bd4-a8d3-8019ee45d39b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6lszr\" (UID: \"c98a92d5-8504-4bd4-a8d3-8019ee45d39b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6lszr" Jul 07 16:28:10.910980 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:10.910952 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:28:10.917903 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:10.917883 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dvqn\" (UniqueName: \"kubernetes.io/projected/c98a92d5-8504-4bd4-a8d3-8019ee45d39b-kube-api-access-6dvqn\") pod \"llmisvc-controller-manager-777c6bd7d5-6lszr\" (UID: \"c98a92d5-8504-4bd4-a8d3-8019ee45d39b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6lszr" Jul 07 16:28:11.050614 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:11.050578 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6lszr" Jul 07 16:28:11.062056 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:11.062026 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:28:11.220553 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:11.220462 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6lszr"] Jul 07 16:28:11.223539 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:28:11.223514 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc98a92d5_8504_4bd4_a8d3_8019ee45d39b.slice/crio-bcc29e2f6e4c31017b4566e417b82a9a10cd7bc68e5da82496cf3b775bed0493 WatchSource:0}: Error finding container bcc29e2f6e4c31017b4566e417b82a9a10cd7bc68e5da82496cf3b775bed0493: Status 404 returned error can't find the container with id bcc29e2f6e4c31017b4566e417b82a9a10cd7bc68e5da82496cf3b775bed0493 Jul 07 16:28:12.008640 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:12.008606 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:28:12.011650 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:12.011621 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6lszr" event={"ID":"c98a92d5-8504-4bd4-a8d3-8019ee45d39b","Type":"ContainerStarted","Data":"bcc29e2f6e4c31017b4566e417b82a9a10cd7bc68e5da82496cf3b775bed0493"} Jul 07 16:28:12.195351 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:12.195316 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:28:13.102328 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:13.102290 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-lfnmn"] Jul 07 16:28:13.102780 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:13.102481 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfnmn" podUID="68dfabd9-6849-4fb8-ad77-c95076a0f34a" containerName="discovery" containerID="cri-o://9daa77546234a9f3a19c1c5fa0753890ddfd2968fc22cdcabb75e2b0217e8cea" gracePeriod=30 Jul 07 16:28:13.365801 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:13.365744 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfnmn" Jul 07 16:28:13.429986 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:13.429959 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/68dfabd9-6849-4fb8-ad77-c95076a0f34a-local-certs\") pod \"68dfabd9-6849-4fb8-ad77-c95076a0f34a\" (UID: \"68dfabd9-6849-4fb8-ad77-c95076a0f34a\") " Jul 07 16:28:13.430141 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:13.430000 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/68dfabd9-6849-4fb8-ad77-c95076a0f34a-cacerts\") pod \"68dfabd9-6849-4fb8-ad77-c95076a0f34a\" (UID: \"68dfabd9-6849-4fb8-ad77-c95076a0f34a\") " Jul 07 16:28:13.430141 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:13.430024 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68dfabd9-6849-4fb8-ad77-c95076a0f34a-istio-token\") pod \"68dfabd9-6849-4fb8-ad77-c95076a0f34a\" (UID: \"68dfabd9-6849-4fb8-ad77-c95076a0f34a\") " Jul 07 16:28:13.430141 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:13.430059 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wkdbt\" (UniqueName: \"kubernetes.io/projected/68dfabd9-6849-4fb8-ad77-c95076a0f34a-kube-api-access-wkdbt\") pod \"68dfabd9-6849-4fb8-ad77-c95076a0f34a\" (UID: \"68dfabd9-6849-4fb8-ad77-c95076a0f34a\") " Jul 07 16:28:13.430141 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:13.430091 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/68dfabd9-6849-4fb8-ad77-c95076a0f34a-istio-csr-ca-configmap\") pod \"68dfabd9-6849-4fb8-ad77-c95076a0f34a\" (UID: \"68dfabd9-6849-4fb8-ad77-c95076a0f34a\") " Jul 07 16:28:13.430141 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:13.430105 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/68dfabd9-6849-4fb8-ad77-c95076a0f34a-istio-kubeconfig\") pod \"68dfabd9-6849-4fb8-ad77-c95076a0f34a\" (UID: \"68dfabd9-6849-4fb8-ad77-c95076a0f34a\") " Jul 07 16:28:13.430410 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:13.430179 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/68dfabd9-6849-4fb8-ad77-c95076a0f34a-istio-csr-dns-cert\") pod \"68dfabd9-6849-4fb8-ad77-c95076a0f34a\" (UID: \"68dfabd9-6849-4fb8-ad77-c95076a0f34a\") " Jul 07 16:28:13.430598 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:13.430551 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68dfabd9-6849-4fb8-ad77-c95076a0f34a-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "68dfabd9-6849-4fb8-ad77-c95076a0f34a" (UID: "68dfabd9-6849-4fb8-ad77-c95076a0f34a"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:28:13.432534 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:13.432508 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68dfabd9-6849-4fb8-ad77-c95076a0f34a-istio-token" (OuterVolumeSpecName: "istio-token") pod "68dfabd9-6849-4fb8-ad77-c95076a0f34a" (UID: "68dfabd9-6849-4fb8-ad77-c95076a0f34a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:28:13.432632 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:13.432593 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68dfabd9-6849-4fb8-ad77-c95076a0f34a-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "68dfabd9-6849-4fb8-ad77-c95076a0f34a" (UID: "68dfabd9-6849-4fb8-ad77-c95076a0f34a"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:28:13.432726 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:13.432709 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68dfabd9-6849-4fb8-ad77-c95076a0f34a-cacerts" (OuterVolumeSpecName: "cacerts") pod "68dfabd9-6849-4fb8-ad77-c95076a0f34a" (UID: "68dfabd9-6849-4fb8-ad77-c95076a0f34a"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:28:13.432796 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:13.432781 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68dfabd9-6849-4fb8-ad77-c95076a0f34a-local-certs" (OuterVolumeSpecName: "local-certs") pod "68dfabd9-6849-4fb8-ad77-c95076a0f34a" (UID: "68dfabd9-6849-4fb8-ad77-c95076a0f34a"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:28:13.432921 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:13.432901 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68dfabd9-6849-4fb8-ad77-c95076a0f34a-kube-api-access-wkdbt" (OuterVolumeSpecName: "kube-api-access-wkdbt") pod "68dfabd9-6849-4fb8-ad77-c95076a0f34a" (UID: "68dfabd9-6849-4fb8-ad77-c95076a0f34a"). InnerVolumeSpecName "kube-api-access-wkdbt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:28:13.432960 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:13.432906 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68dfabd9-6849-4fb8-ad77-c95076a0f34a-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "68dfabd9-6849-4fb8-ad77-c95076a0f34a" (UID: "68dfabd9-6849-4fb8-ad77-c95076a0f34a"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:28:13.531696 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:13.531661 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wkdbt\" (UniqueName: \"kubernetes.io/projected/68dfabd9-6849-4fb8-ad77-c95076a0f34a-kube-api-access-wkdbt\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:28:13.531696 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:13.531690 2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/68dfabd9-6849-4fb8-ad77-c95076a0f34a-istio-csr-ca-configmap\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:28:13.531696 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:13.531699 2564 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/68dfabd9-6849-4fb8-ad77-c95076a0f34a-istio-kubeconfig\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:28:13.531906 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:13.531708 2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/68dfabd9-6849-4fb8-ad77-c95076a0f34a-istio-csr-dns-cert\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:28:13.531906 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:13.531716 2564 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/68dfabd9-6849-4fb8-ad77-c95076a0f34a-local-certs\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:28:13.531906 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:13.531725 2564 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/68dfabd9-6849-4fb8-ad77-c95076a0f34a-cacerts\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:28:13.531906 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:13.531732 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68dfabd9-6849-4fb8-ad77-c95076a0f34a-istio-token\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:28:14.024405 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:14.024367 2564 generic.go:356] "Generic (PLEG): container finished" podID="68dfabd9-6849-4fb8-ad77-c95076a0f34a" containerID="9daa77546234a9f3a19c1c5fa0753890ddfd2968fc22cdcabb75e2b0217e8cea" exitCode=0 Jul 07 16:28:14.024623 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:14.024430 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfnmn" Jul 07 16:28:14.024623 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:14.024451 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfnmn" event={"ID":"68dfabd9-6849-4fb8-ad77-c95076a0f34a","Type":"ContainerDied","Data":"9daa77546234a9f3a19c1c5fa0753890ddfd2968fc22cdcabb75e2b0217e8cea"} Jul 07 16:28:14.024623 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:14.024502 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfnmn" event={"ID":"68dfabd9-6849-4fb8-ad77-c95076a0f34a","Type":"ContainerDied","Data":"d18115204daa5ef61d62b48883fae470f63b817c51c803149992c7ec3253cc9f"} Jul 07 16:28:14.024623 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:14.024529 2564 scope.go:117] "RemoveContainer" containerID="9daa77546234a9f3a19c1c5fa0753890ddfd2968fc22cdcabb75e2b0217e8cea" Jul 07 16:28:14.034696 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:14.034679 2564 scope.go:117] "RemoveContainer" containerID="9daa77546234a9f3a19c1c5fa0753890ddfd2968fc22cdcabb75e2b0217e8cea" Jul 07 16:28:14.034953 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:28:14.034934 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9daa77546234a9f3a19c1c5fa0753890ddfd2968fc22cdcabb75e2b0217e8cea\": container with ID starting with 9daa77546234a9f3a19c1c5fa0753890ddfd2968fc22cdcabb75e2b0217e8cea not found: ID does not exist" containerID="9daa77546234a9f3a19c1c5fa0753890ddfd2968fc22cdcabb75e2b0217e8cea" Jul 07 16:28:14.034996 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:14.034962 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9daa77546234a9f3a19c1c5fa0753890ddfd2968fc22cdcabb75e2b0217e8cea"} err="failed to get container status \"9daa77546234a9f3a19c1c5fa0753890ddfd2968fc22cdcabb75e2b0217e8cea\": rpc error: code = NotFound desc = could not find container \"9daa77546234a9f3a19c1c5fa0753890ddfd2968fc22cdcabb75e2b0217e8cea\": container with ID starting with 9daa77546234a9f3a19c1c5fa0753890ddfd2968fc22cdcabb75e2b0217e8cea not found: ID does not exist" Jul 07 16:28:14.054246 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:14.054211 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-lfnmn"] Jul 07 16:28:14.057723 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:14.057703 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-lfnmn"] Jul 07 16:28:14.650096 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:14.650062 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68dfabd9-6849-4fb8-ad77-c95076a0f34a" path="/var/lib/kubelet/pods/68dfabd9-6849-4fb8-ad77-c95076a0f34a/volumes" Jul 07 16:28:16.038589 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:16.038551 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6lszr" event={"ID":"c98a92d5-8504-4bd4-a8d3-8019ee45d39b","Type":"ContainerStarted","Data":"efbb17dfaaed6657e2b5b70b345d8aa5468ce075e33b042a01e79c642238ead8"} Jul 07 16:28:16.039049 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:16.038661 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6lszr" Jul 07 16:28:16.060893 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:16.060838 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6lszr" podStartSLOduration=2.183259024 podStartE2EDuration="6.060822826s" totalImagesPullingTime="3.877563802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:28:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:28:16.060290754 +0000 UTC m=+315.999800171" watchObservedRunningTime="2026-07-07 16:28:16.060822826 +0000 UTC m=+316.000332249" Jul 07 16:28:35.869680 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:35.869642 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:28:47.045533 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:28:47.045502 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6lszr" Jul 07 16:29:00.498245 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:00.498202 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:29:00.653862 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:00.653828 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:29:00.716400 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:00.716369 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tnm69"] Jul 07 16:29:00.716666 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:00.716654 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68dfabd9-6849-4fb8-ad77-c95076a0f34a" containerName="discovery" Jul 07 16:29:00.716711 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:00.716667 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="68dfabd9-6849-4fb8-ad77-c95076a0f34a" containerName="discovery" Jul 07 16:29:00.716755 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:00.716735 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="68dfabd9-6849-4fb8-ad77-c95076a0f34a" containerName="discovery" Jul 07 16:29:00.720680 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:00.720663 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tnm69" Jul 07 16:29:00.726036 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:00.726018 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 16:29:00.727269 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:00.727222 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-cv6x8\"" Jul 07 16:29:00.727342 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:00.727264 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 16:29:00.760532 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:00.760496 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tnm69"] Jul 07 16:29:00.811698 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:00.811622 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:29:00.816861 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:00.816822 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-674mz\" (UniqueName: \"kubernetes.io/projected/14fcbedb-6feb-4997-b7e3-b3d1949d4082-kube-api-access-674mz\") pod \"kuadrant-operator-catalog-tnm69\" (UID: \"14fcbedb-6feb-4997-b7e3-b3d1949d4082\") " pod="kuadrant-system/kuadrant-operator-catalog-tnm69" Jul 07 16:29:00.917364 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:00.917316 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-674mz\" (UniqueName: \"kubernetes.io/projected/14fcbedb-6feb-4997-b7e3-b3d1949d4082-kube-api-access-674mz\") pod \"kuadrant-operator-catalog-tnm69\" (UID: \"14fcbedb-6feb-4997-b7e3-b3d1949d4082\") " pod="kuadrant-system/kuadrant-operator-catalog-tnm69" Jul 07 16:29:00.934707 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:00.934673 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-674mz\" (UniqueName: \"kubernetes.io/projected/14fcbedb-6feb-4997-b7e3-b3d1949d4082-kube-api-access-674mz\") pod \"kuadrant-operator-catalog-tnm69\" (UID: \"14fcbedb-6feb-4997-b7e3-b3d1949d4082\") " pod="kuadrant-system/kuadrant-operator-catalog-tnm69" Jul 07 16:29:00.982838 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:00.982755 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tnm69"] Jul 07 16:29:00.983067 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:00.983054 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tnm69" Jul 07 16:29:01.134546 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:01.134523 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tnm69"] Jul 07 16:29:01.136219 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:29:01.136197 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14fcbedb_6feb_4997_b7e3_b3d1949d4082.slice/crio-7c9bf7660f25d1f9a7e5cdaaecd756ac10a2ae15f2eaf0e5cbe59ca86a171782 WatchSource:0}: Error finding container 7c9bf7660f25d1f9a7e5cdaaecd756ac10a2ae15f2eaf0e5cbe59ca86a171782: Status 404 returned error can't find the container with id 7c9bf7660f25d1f9a7e5cdaaecd756ac10a2ae15f2eaf0e5cbe59ca86a171782 Jul 07 16:29:01.185721 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:01.185696 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-75k4x"] Jul 07 16:29:01.190084 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:01.190069 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-75k4x" Jul 07 16:29:01.207387 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:01.207356 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-75k4x"] Jul 07 16:29:01.220002 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:01.219970 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cs98\" (UniqueName: \"kubernetes.io/projected/4f5c9111-48bb-4c66-bbe0-d5f899526af5-kube-api-access-2cs98\") pod \"kuadrant-operator-catalog-75k4x\" (UID: \"4f5c9111-48bb-4c66-bbe0-d5f899526af5\") " pod="kuadrant-system/kuadrant-operator-catalog-75k4x" Jul 07 16:29:01.243263 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:01.243161 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tnm69" event={"ID":"14fcbedb-6feb-4997-b7e3-b3d1949d4082","Type":"ContainerStarted","Data":"7c9bf7660f25d1f9a7e5cdaaecd756ac10a2ae15f2eaf0e5cbe59ca86a171782"} Jul 07 16:29:01.320631 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:01.320585 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cs98\" (UniqueName: \"kubernetes.io/projected/4f5c9111-48bb-4c66-bbe0-d5f899526af5-kube-api-access-2cs98\") pod \"kuadrant-operator-catalog-75k4x\" (UID: \"4f5c9111-48bb-4c66-bbe0-d5f899526af5\") " pod="kuadrant-system/kuadrant-operator-catalog-75k4x" Jul 07 16:29:01.335758 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:01.335731 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cs98\" (UniqueName: \"kubernetes.io/projected/4f5c9111-48bb-4c66-bbe0-d5f899526af5-kube-api-access-2cs98\") pod \"kuadrant-operator-catalog-75k4x\" (UID: \"4f5c9111-48bb-4c66-bbe0-d5f899526af5\") " pod="kuadrant-system/kuadrant-operator-catalog-75k4x" Jul 07 16:29:01.470164 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:01.470130 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:29:01.499158 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:01.499073 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-75k4x" Jul 07 16:29:01.663971 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:29:01.663933 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f5c9111_48bb_4c66_bbe0_d5f899526af5.slice/crio-3c7ee183b92bf165ec96d2c3ec6d4d3e89f7c211c36f2c077d69c13ac75344b5 WatchSource:0}: Error finding container 3c7ee183b92bf165ec96d2c3ec6d4d3e89f7c211c36f2c077d69c13ac75344b5: Status 404 returned error can't find the container with id 3c7ee183b92bf165ec96d2c3ec6d4d3e89f7c211c36f2c077d69c13ac75344b5 Jul 07 16:29:01.668038 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:01.668018 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-75k4x"] Jul 07 16:29:01.677961 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:01.677924 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:29:02.250329 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:02.250284 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-75k4x" event={"ID":"4f5c9111-48bb-4c66-bbe0-d5f899526af5","Type":"ContainerStarted","Data":"3c7ee183b92bf165ec96d2c3ec6d4d3e89f7c211c36f2c077d69c13ac75344b5"} Jul 07 16:29:03.257757 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:03.257712 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tnm69" event={"ID":"14fcbedb-6feb-4997-b7e3-b3d1949d4082","Type":"ContainerStarted","Data":"9f8ced398133fcc213a4838c8aa9dcde9be95d5e10a5f8b196663b1ed6397897"} Jul 07 16:29:03.258255 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:03.257829 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-tnm69" podUID="14fcbedb-6feb-4997-b7e3-b3d1949d4082" containerName="registry-server" containerID="cri-o://9f8ced398133fcc213a4838c8aa9dcde9be95d5e10a5f8b196663b1ed6397897" gracePeriod=2 Jul 07 16:29:03.260045 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:03.260016 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-75k4x" event={"ID":"4f5c9111-48bb-4c66-bbe0-d5f899526af5","Type":"ContainerStarted","Data":"429be021eb0f5b15a9a4c2f4e9ccc655341f1b69f0cc32e758357c3d216a7f24"} Jul 07 16:29:03.282250 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:03.282170 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-tnm69" podStartSLOduration=1.307123908 podStartE2EDuration="3.282148925s" totalImagesPullingTime="1.975025017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:29:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:29:03.281596589 +0000 UTC m=+363.221106014" watchObservedRunningTime="2026-07-07 16:29:03.282148925 +0000 UTC m=+363.221658350" Jul 07 16:29:03.307505 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:03.307454 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-75k4x" podStartSLOduration=0.859227577 podStartE2EDuration="2.307438698s" totalImagesPullingTime="1.448211121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:29:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:29:03.305214177 +0000 UTC m=+363.244723600" watchObservedRunningTime="2026-07-07 16:29:03.307438698 +0000 UTC m=+363.246948120" Jul 07 16:29:03.515442 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:03.515411 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tnm69" Jul 07 16:29:03.539202 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:03.539176 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-674mz\" (UniqueName: \"kubernetes.io/projected/14fcbedb-6feb-4997-b7e3-b3d1949d4082-kube-api-access-674mz\") pod \"14fcbedb-6feb-4997-b7e3-b3d1949d4082\" (UID: \"14fcbedb-6feb-4997-b7e3-b3d1949d4082\") " Jul 07 16:29:03.541854 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:03.541823 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14fcbedb-6feb-4997-b7e3-b3d1949d4082-kube-api-access-674mz" (OuterVolumeSpecName: "kube-api-access-674mz") pod "14fcbedb-6feb-4997-b7e3-b3d1949d4082" (UID: "14fcbedb-6feb-4997-b7e3-b3d1949d4082"). InnerVolumeSpecName "kube-api-access-674mz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:29:03.640192 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:03.640105 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-674mz\" (UniqueName: \"kubernetes.io/projected/14fcbedb-6feb-4997-b7e3-b3d1949d4082-kube-api-access-674mz\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:29:04.265773 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:04.265738 2564 generic.go:356] "Generic (PLEG): container finished" podID="14fcbedb-6feb-4997-b7e3-b3d1949d4082" containerID="9f8ced398133fcc213a4838c8aa9dcde9be95d5e10a5f8b196663b1ed6397897" exitCode=0 Jul 07 16:29:04.266166 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:04.265779 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tnm69" Jul 07 16:29:04.266166 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:04.265805 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tnm69" event={"ID":"14fcbedb-6feb-4997-b7e3-b3d1949d4082","Type":"ContainerDied","Data":"9f8ced398133fcc213a4838c8aa9dcde9be95d5e10a5f8b196663b1ed6397897"} Jul 07 16:29:04.266166 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:04.265860 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tnm69" event={"ID":"14fcbedb-6feb-4997-b7e3-b3d1949d4082","Type":"ContainerDied","Data":"7c9bf7660f25d1f9a7e5cdaaecd756ac10a2ae15f2eaf0e5cbe59ca86a171782"} Jul 07 16:29:04.266166 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:04.265885 2564 scope.go:117] "RemoveContainer" containerID="9f8ced398133fcc213a4838c8aa9dcde9be95d5e10a5f8b196663b1ed6397897" Jul 07 16:29:04.275194 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:04.275174 2564 scope.go:117] "RemoveContainer" containerID="9f8ced398133fcc213a4838c8aa9dcde9be95d5e10a5f8b196663b1ed6397897" Jul 07 16:29:04.275496 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:29:04.275478 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f8ced398133fcc213a4838c8aa9dcde9be95d5e10a5f8b196663b1ed6397897\": container with ID starting with 9f8ced398133fcc213a4838c8aa9dcde9be95d5e10a5f8b196663b1ed6397897 not found: ID does not exist" containerID="9f8ced398133fcc213a4838c8aa9dcde9be95d5e10a5f8b196663b1ed6397897" Jul 07 16:29:04.275564 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:04.275505 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f8ced398133fcc213a4838c8aa9dcde9be95d5e10a5f8b196663b1ed6397897"} err="failed to get container status \"9f8ced398133fcc213a4838c8aa9dcde9be95d5e10a5f8b196663b1ed6397897\": rpc error: code = NotFound desc = could not find container \"9f8ced398133fcc213a4838c8aa9dcde9be95d5e10a5f8b196663b1ed6397897\": container with ID starting with 9f8ced398133fcc213a4838c8aa9dcde9be95d5e10a5f8b196663b1ed6397897 not found: ID does not exist" Jul 07 16:29:04.289032 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:04.289011 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tnm69"] Jul 07 16:29:04.294244 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:04.294209 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tnm69"] Jul 07 16:29:04.649062 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:04.649028 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14fcbedb-6feb-4997-b7e3-b3d1949d4082" path="/var/lib/kubelet/pods/14fcbedb-6feb-4997-b7e3-b3d1949d4082/volumes" Jul 07 16:29:11.499675 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:11.499632 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-75k4x" Jul 07 16:29:11.500184 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:11.499710 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-75k4x" Jul 07 16:29:11.522474 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:11.522447 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-75k4x" Jul 07 16:29:12.326241 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:12.326198 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-75k4x" Jul 07 16:29:16.236510 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:16.236473 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mt9hs"] Jul 07 16:29:16.236887 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:16.236800 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14fcbedb-6feb-4997-b7e3-b3d1949d4082" containerName="registry-server" Jul 07 16:29:16.236887 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:16.236812 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="14fcbedb-6feb-4997-b7e3-b3d1949d4082" containerName="registry-server" Jul 07 16:29:16.236887 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:16.236862 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="14fcbedb-6feb-4997-b7e3-b3d1949d4082" containerName="registry-server" Jul 07 16:29:16.243180 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:16.243148 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mt9hs" Jul 07 16:29:16.246437 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:16.246415 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-clfdp\"" Jul 07 16:29:16.260498 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:16.260474 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mt9hs"] Jul 07 16:29:16.335422 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:16.335388 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rdn9\" (UniqueName: \"kubernetes.io/projected/1ae378db-3639-4ff3-a042-c04d465d2bcd-kube-api-access-9rdn9\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mt9hs\" (UID: \"1ae378db-3639-4ff3-a042-c04d465d2bcd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mt9hs" Jul 07 16:29:16.335594 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:16.335452 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ae378db-3639-4ff3-a042-c04d465d2bcd-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mt9hs\" (UID: \"1ae378db-3639-4ff3-a042-c04d465d2bcd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mt9hs" Jul 07 16:29:16.335594 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:16.335492 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ae378db-3639-4ff3-a042-c04d465d2bcd-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mt9hs\" (UID: \"1ae378db-3639-4ff3-a042-c04d465d2bcd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mt9hs" Jul 07 16:29:16.436660 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:16.436625 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ae378db-3639-4ff3-a042-c04d465d2bcd-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mt9hs\" (UID: \"1ae378db-3639-4ff3-a042-c04d465d2bcd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mt9hs" Jul 07 16:29:16.436660 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:16.436660 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ae378db-3639-4ff3-a042-c04d465d2bcd-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mt9hs\" (UID: \"1ae378db-3639-4ff3-a042-c04d465d2bcd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mt9hs" Jul 07 16:29:16.436920 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:16.436800 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rdn9\" (UniqueName: \"kubernetes.io/projected/1ae378db-3639-4ff3-a042-c04d465d2bcd-kube-api-access-9rdn9\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mt9hs\" (UID: \"1ae378db-3639-4ff3-a042-c04d465d2bcd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mt9hs" Jul 07 16:29:16.436999 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:16.436975 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ae378db-3639-4ff3-a042-c04d465d2bcd-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mt9hs\" (UID: \"1ae378db-3639-4ff3-a042-c04d465d2bcd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mt9hs" Jul 07 16:29:16.437090 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:16.437069 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ae378db-3639-4ff3-a042-c04d465d2bcd-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mt9hs\" (UID: \"1ae378db-3639-4ff3-a042-c04d465d2bcd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mt9hs" Jul 07 16:29:16.454821 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:16.454790 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rdn9\" (UniqueName: \"kubernetes.io/projected/1ae378db-3639-4ff3-a042-c04d465d2bcd-kube-api-access-9rdn9\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mt9hs\" (UID: \"1ae378db-3639-4ff3-a042-c04d465d2bcd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mt9hs" Jul 07 16:29:16.552980 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:16.552907 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mt9hs" Jul 07 16:29:16.638251 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:16.638203 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsltg"] Jul 07 16:29:16.643115 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:16.643094 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsltg" Jul 07 16:29:16.647689 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:29:16.647655 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsltg\" is forbidden: User \"system:node:ip-10-0-142-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-239.ec2.internal' and this object" podUID="89f11e74-4d0f-4ade-a6eb-b4b0367c5395" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsltg" Jul 07 16:29:16.665394 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:16.665365 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsltg"] Jul 07 16:29:16.707017 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:16.706984 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mt9hs"] Jul 07 16:29:16.713816 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:29:16.713787 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ae378db_3639_4ff3_a042_c04d465d2bcd.slice/crio-7730dcd40f59c4f843f45d2cb98f66456ec04652f3f7c0eac55d69f41b41ed9d WatchSource:0}: Error finding container 7730dcd40f59c4f843f45d2cb98f66456ec04652f3f7c0eac55d69f41b41ed9d: Status 404 returned error can't find the container with id 7730dcd40f59c4f843f45d2cb98f66456ec04652f3f7c0eac55d69f41b41ed9d Jul 07 16:29:16.739537 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:16.739512 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89f11e74-4d0f-4ade-a6eb-b4b0367c5395-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsltg\" (UID: \"89f11e74-4d0f-4ade-a6eb-b4b0367c5395\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsltg" Jul 07 16:29:16.739641 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:16.739548 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb7x8\" (UniqueName: \"kubernetes.io/projected/89f11e74-4d0f-4ade-a6eb-b4b0367c5395-kube-api-access-wb7x8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsltg\" (UID: \"89f11e74-4d0f-4ade-a6eb-b4b0367c5395\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsltg" Jul 07 16:29:16.739641 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:16.739612 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89f11e74-4d0f-4ade-a6eb-b4b0367c5395-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsltg\" (UID: \"89f11e74-4d0f-4ade-a6eb-b4b0367c5395\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsltg" Jul 07 16:29:16.840661 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:16.840625 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89f11e74-4d0f-4ade-a6eb-b4b0367c5395-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsltg\" (UID: \"89f11e74-4d0f-4ade-a6eb-b4b0367c5395\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsltg" Jul 07 16:29:16.840834 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:16.840670 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb7x8\" (UniqueName: \"kubernetes.io/projected/89f11e74-4d0f-4ade-a6eb-b4b0367c5395-kube-api-access-wb7x8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsltg\" (UID: \"89f11e74-4d0f-4ade-a6eb-b4b0367c5395\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsltg" Jul 07 16:29:16.840834 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:16.840726 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89f11e74-4d0f-4ade-a6eb-b4b0367c5395-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsltg\" (UID: \"89f11e74-4d0f-4ade-a6eb-b4b0367c5395\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsltg" Jul 07 16:29:16.841071 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:16.841049 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89f11e74-4d0f-4ade-a6eb-b4b0367c5395-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsltg\" (UID: \"89f11e74-4d0f-4ade-a6eb-b4b0367c5395\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsltg" Jul 07 16:29:16.841141 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:16.841105 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89f11e74-4d0f-4ade-a6eb-b4b0367c5395-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsltg\" (UID: \"89f11e74-4d0f-4ade-a6eb-b4b0367c5395\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsltg" Jul 07 16:29:16.851913 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:16.851889 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb7x8\" (UniqueName: \"kubernetes.io/projected/89f11e74-4d0f-4ade-a6eb-b4b0367c5395-kube-api-access-wb7x8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsltg\" (UID: \"89f11e74-4d0f-4ade-a6eb-b4b0367c5395\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsltg" Jul 07 16:29:16.955344 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:16.955299 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsltg" Jul 07 16:29:17.058213 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:17.058139 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vqnqh"] Jul 07 16:29:17.063646 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:17.063620 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vqnqh" Jul 07 16:29:17.084635 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:17.084603 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vqnqh"] Jul 07 16:29:17.101715 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:17.101673 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsltg"] Jul 07 16:29:17.103034 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:29:17.103009 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89f11e74_4d0f_4ade_a6eb_b4b0367c5395.slice/crio-55e4f21a9677f186723bdc4baa753dcfd355638438f00492b5740225af9bf0ed WatchSource:0}: Error finding container 55e4f21a9677f186723bdc4baa753dcfd355638438f00492b5740225af9bf0ed: Status 404 returned error can't find the container with id 55e4f21a9677f186723bdc4baa753dcfd355638438f00492b5740225af9bf0ed Jul 07 16:29:17.143536 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:17.143508 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63b770d3-837f-4579-974a-d56352404f1d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vqnqh\" (UID: \"63b770d3-837f-4579-974a-d56352404f1d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vqnqh" Jul 07 16:29:17.143536 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:17.143549 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63b770d3-837f-4579-974a-d56352404f1d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vqnqh\" (UID: \"63b770d3-837f-4579-974a-d56352404f1d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vqnqh" Jul 07 16:29:17.143720 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:17.143592 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d9qh\" (UniqueName: \"kubernetes.io/projected/63b770d3-837f-4579-974a-d56352404f1d-kube-api-access-8d9qh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vqnqh\" (UID: \"63b770d3-837f-4579-974a-d56352404f1d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vqnqh" Jul 07 16:29:17.244700 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:17.244662 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63b770d3-837f-4579-974a-d56352404f1d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vqnqh\" (UID: \"63b770d3-837f-4579-974a-d56352404f1d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vqnqh" Jul 07 16:29:17.244700 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:17.244707 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63b770d3-837f-4579-974a-d56352404f1d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vqnqh\" (UID: \"63b770d3-837f-4579-974a-d56352404f1d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vqnqh" Jul 07 16:29:17.245209 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:17.244741 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d9qh\" (UniqueName: \"kubernetes.io/projected/63b770d3-837f-4579-974a-d56352404f1d-kube-api-access-8d9qh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vqnqh\" (UID: \"63b770d3-837f-4579-974a-d56352404f1d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vqnqh" Jul 07 16:29:17.245209 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:17.245060 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63b770d3-837f-4579-974a-d56352404f1d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vqnqh\" (UID: \"63b770d3-837f-4579-974a-d56352404f1d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vqnqh" Jul 07 16:29:17.245209 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:17.245060 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63b770d3-837f-4579-974a-d56352404f1d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vqnqh\" (UID: \"63b770d3-837f-4579-974a-d56352404f1d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vqnqh" Jul 07 16:29:17.258395 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:17.258372 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d9qh\" (UniqueName: \"kubernetes.io/projected/63b770d3-837f-4579-974a-d56352404f1d-kube-api-access-8d9qh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vqnqh\" (UID: \"63b770d3-837f-4579-974a-d56352404f1d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vqnqh" Jul 07 16:29:17.329545 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:17.329454 2564 generic.go:356] "Generic (PLEG): container finished" podID="89f11e74-4d0f-4ade-a6eb-b4b0367c5395" containerID="ddeb3f8657c186f3ede883d250d757b3bf38469f8cdd70e3b09509354168b155" exitCode=0 Jul 07 16:29:17.329545 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:17.329501 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsltg" event={"ID":"89f11e74-4d0f-4ade-a6eb-b4b0367c5395","Type":"ContainerDied","Data":"ddeb3f8657c186f3ede883d250d757b3bf38469f8cdd70e3b09509354168b155"} Jul 07 16:29:17.329729 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:17.329551 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsltg" event={"ID":"89f11e74-4d0f-4ade-a6eb-b4b0367c5395","Type":"ContainerStarted","Data":"55e4f21a9677f186723bdc4baa753dcfd355638438f00492b5740225af9bf0ed"} Jul 07 16:29:17.331218 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:17.331196 2564 generic.go:356] "Generic (PLEG): container finished" podID="1ae378db-3639-4ff3-a042-c04d465d2bcd" containerID="bca93e88b250e12e43661444ea3e640d733c37ad9eb4d215047bcd04bd730a28" exitCode=0 Jul 07 16:29:17.331356 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:17.331271 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mt9hs" event={"ID":"1ae378db-3639-4ff3-a042-c04d465d2bcd","Type":"ContainerDied","Data":"bca93e88b250e12e43661444ea3e640d733c37ad9eb4d215047bcd04bd730a28"} Jul 07 16:29:17.331356 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:17.331310 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mt9hs" event={"ID":"1ae378db-3639-4ff3-a042-c04d465d2bcd","Type":"ContainerStarted","Data":"7730dcd40f59c4f843f45d2cb98f66456ec04652f3f7c0eac55d69f41b41ed9d"} Jul 07 16:29:17.374246 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:17.374211 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vqnqh" Jul 07 16:29:17.524870 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:17.524839 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vqnqh"] Jul 07 16:29:17.528094 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:29:17.528068 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63b770d3_837f_4579_974a_d56352404f1d.slice/crio-4139d5675919c8557bf85b6415b8aa4915af4e8fecbd8560841d430c986b8dc5 WatchSource:0}: Error finding container 4139d5675919c8557bf85b6415b8aa4915af4e8fecbd8560841d430c986b8dc5: Status 404 returned error can't find the container with id 4139d5675919c8557bf85b6415b8aa4915af4e8fecbd8560841d430c986b8dc5 Jul 07 16:29:17.575307 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:17.575149 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qfr4r"] Jul 07 16:29:17.579719 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:17.579675 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qfr4r" Jul 07 16:29:17.592436 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:17.592417 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qfr4r"] Jul 07 16:29:17.648624 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:17.648586 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec4a634e-1f72-4660-a040-f507cd6da3d2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qfr4r\" (UID: \"ec4a634e-1f72-4660-a040-f507cd6da3d2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qfr4r" Jul 07 16:29:17.648739 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:17.648637 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t8d6\" (UniqueName: \"kubernetes.io/projected/ec4a634e-1f72-4660-a040-f507cd6da3d2-kube-api-access-6t8d6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qfr4r\" (UID: \"ec4a634e-1f72-4660-a040-f507cd6da3d2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qfr4r" Jul 07 16:29:17.648781 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:17.648758 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec4a634e-1f72-4660-a040-f507cd6da3d2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qfr4r\" (UID: \"ec4a634e-1f72-4660-a040-f507cd6da3d2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qfr4r" Jul 07 16:29:17.750041 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:17.750007 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t8d6\" (UniqueName: \"kubernetes.io/projected/ec4a634e-1f72-4660-a040-f507cd6da3d2-kube-api-access-6t8d6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qfr4r\" (UID: \"ec4a634e-1f72-4660-a040-f507cd6da3d2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qfr4r" Jul 07 16:29:17.750217 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:17.750103 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec4a634e-1f72-4660-a040-f507cd6da3d2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qfr4r\" (UID: \"ec4a634e-1f72-4660-a040-f507cd6da3d2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qfr4r" Jul 07 16:29:17.750217 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:17.750149 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec4a634e-1f72-4660-a040-f507cd6da3d2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qfr4r\" (UID: \"ec4a634e-1f72-4660-a040-f507cd6da3d2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qfr4r" Jul 07 16:29:17.750498 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:17.750473 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec4a634e-1f72-4660-a040-f507cd6da3d2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qfr4r\" (UID: \"ec4a634e-1f72-4660-a040-f507cd6da3d2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qfr4r" Jul 07 16:29:17.750567 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:17.750498 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec4a634e-1f72-4660-a040-f507cd6da3d2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qfr4r\" (UID: \"ec4a634e-1f72-4660-a040-f507cd6da3d2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qfr4r" Jul 07 16:29:17.759905 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:17.759880 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t8d6\" (UniqueName: \"kubernetes.io/projected/ec4a634e-1f72-4660-a040-f507cd6da3d2-kube-api-access-6t8d6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qfr4r\" (UID: \"ec4a634e-1f72-4660-a040-f507cd6da3d2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qfr4r" Jul 07 16:29:17.888057 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:17.888024 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qfr4r" Jul 07 16:29:18.028184 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:18.028157 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qfr4r"] Jul 07 16:29:18.055530 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:29:18.055494 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec4a634e_1f72_4660_a040_f507cd6da3d2.slice/crio-427c4d672fb2760de130ddcf5b85b5f05d8efae7a4235259bca500aa88930f41 WatchSource:0}: Error finding container 427c4d672fb2760de130ddcf5b85b5f05d8efae7a4235259bca500aa88930f41: Status 404 returned error can't find the container with id 427c4d672fb2760de130ddcf5b85b5f05d8efae7a4235259bca500aa88930f41 Jul 07 16:29:18.337834 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:18.337797 2564 generic.go:356] "Generic (PLEG): container finished" podID="ec4a634e-1f72-4660-a040-f507cd6da3d2" containerID="5dd0d3927558a8f811fc52ac39e1e18e3f86d17562b57e0c3dafbf931109b16b" exitCode=0 Jul 07 16:29:18.338330 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:18.337850 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qfr4r" event={"ID":"ec4a634e-1f72-4660-a040-f507cd6da3d2","Type":"ContainerDied","Data":"5dd0d3927558a8f811fc52ac39e1e18e3f86d17562b57e0c3dafbf931109b16b"} Jul 07 16:29:18.338330 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:18.337905 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qfr4r" event={"ID":"ec4a634e-1f72-4660-a040-f507cd6da3d2","Type":"ContainerStarted","Data":"427c4d672fb2760de130ddcf5b85b5f05d8efae7a4235259bca500aa88930f41"} Jul 07 16:29:18.339504 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:18.339466 2564 generic.go:356] "Generic (PLEG): container finished" podID="63b770d3-837f-4579-974a-d56352404f1d" containerID="cdad8ca3fb2a8a4b6c91bb904658b726ecf039404fa07b7a501ad131e7f54676" exitCode=0 Jul 07 16:29:18.339624 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:18.339552 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vqnqh" event={"ID":"63b770d3-837f-4579-974a-d56352404f1d","Type":"ContainerDied","Data":"cdad8ca3fb2a8a4b6c91bb904658b726ecf039404fa07b7a501ad131e7f54676"} Jul 07 16:29:18.339624 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:18.339596 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vqnqh" event={"ID":"63b770d3-837f-4579-974a-d56352404f1d","Type":"ContainerStarted","Data":"4139d5675919c8557bf85b6415b8aa4915af4e8fecbd8560841d430c986b8dc5"} Jul 07 16:29:18.341643 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:18.341560 2564 generic.go:356] "Generic (PLEG): container finished" podID="1ae378db-3639-4ff3-a042-c04d465d2bcd" containerID="57c5849bf3a0aab87beac8e7492aeee76cdd6b6c42515faccb184f4e13961918" exitCode=0 Jul 07 16:29:18.341643 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:18.341588 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mt9hs" event={"ID":"1ae378db-3639-4ff3-a042-c04d465d2bcd","Type":"ContainerDied","Data":"57c5849bf3a0aab87beac8e7492aeee76cdd6b6c42515faccb184f4e13961918"} Jul 07 16:29:19.349091 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:19.349059 2564 generic.go:356] "Generic (PLEG): container finished" podID="1ae378db-3639-4ff3-a042-c04d465d2bcd" containerID="5f72165513d14e7492d6a38d1d2e53e96565b5a87da88bfd8201d11bf6ee85b9" exitCode=0 Jul 07 16:29:19.349543 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:19.349151 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mt9hs" event={"ID":"1ae378db-3639-4ff3-a042-c04d465d2bcd","Type":"ContainerDied","Data":"5f72165513d14e7492d6a38d1d2e53e96565b5a87da88bfd8201d11bf6ee85b9"} Jul 07 16:29:19.350919 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:19.350898 2564 generic.go:356] "Generic (PLEG): container finished" podID="ec4a634e-1f72-4660-a040-f507cd6da3d2" containerID="bed7bbee02e825bc2b287ad56f425bc1847c213c760feebc033770801907db37" exitCode=0 Jul 07 16:29:19.351031 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:19.350957 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qfr4r" event={"ID":"ec4a634e-1f72-4660-a040-f507cd6da3d2","Type":"ContainerDied","Data":"bed7bbee02e825bc2b287ad56f425bc1847c213c760feebc033770801907db37"} Jul 07 16:29:19.352774 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:19.352753 2564 generic.go:356] "Generic (PLEG): container finished" podID="63b770d3-837f-4579-974a-d56352404f1d" containerID="e454a44aa31af18213c759e2e5875c1547515824c6ee5c2a0fb628aea0aaa426" exitCode=0 Jul 07 16:29:19.352851 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:19.352830 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vqnqh" event={"ID":"63b770d3-837f-4579-974a-d56352404f1d","Type":"ContainerDied","Data":"e454a44aa31af18213c759e2e5875c1547515824c6ee5c2a0fb628aea0aaa426"} Jul 07 16:29:19.354643 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:19.354610 2564 generic.go:356] "Generic (PLEG): container finished" podID="89f11e74-4d0f-4ade-a6eb-b4b0367c5395" containerID="f12294d5a18a3932adeb56807fe3380825d3399734d0db98f3f41709fcffc4fd" exitCode=0 Jul 07 16:29:19.354722 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:19.354656 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsltg" event={"ID":"89f11e74-4d0f-4ade-a6eb-b4b0367c5395","Type":"ContainerDied","Data":"f12294d5a18a3932adeb56807fe3380825d3399734d0db98f3f41709fcffc4fd"} Jul 07 16:29:20.363797 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:20.363763 2564 generic.go:356] "Generic (PLEG): container finished" podID="89f11e74-4d0f-4ade-a6eb-b4b0367c5395" containerID="8bbc93a07a9cf09c0cf910b8d87b5b4f13e6f93a3418153b1fe7ebccb2128e21" exitCode=0 Jul 07 16:29:20.364290 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:20.363839 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsltg" event={"ID":"89f11e74-4d0f-4ade-a6eb-b4b0367c5395","Type":"ContainerDied","Data":"8bbc93a07a9cf09c0cf910b8d87b5b4f13e6f93a3418153b1fe7ebccb2128e21"} Jul 07 16:29:20.365747 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:20.365725 2564 generic.go:356] "Generic (PLEG): container finished" podID="ec4a634e-1f72-4660-a040-f507cd6da3d2" containerID="6660226f06d9e2b89abb9f859b4e44cb9b92f469cbfb0ad6ede8a4dceb7ae30b" exitCode=0 Jul 07 16:29:20.365857 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:20.365788 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qfr4r" event={"ID":"ec4a634e-1f72-4660-a040-f507cd6da3d2","Type":"ContainerDied","Data":"6660226f06d9e2b89abb9f859b4e44cb9b92f469cbfb0ad6ede8a4dceb7ae30b"} Jul 07 16:29:20.367598 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:20.367578 2564 generic.go:356] "Generic (PLEG): container finished" podID="63b770d3-837f-4579-974a-d56352404f1d" containerID="d9d2b454cb2531785359a5e885e82a70ddc10a1e89152a22dcad85c150e359c1" exitCode=0 Jul 07 16:29:20.367700 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:20.367610 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vqnqh" event={"ID":"63b770d3-837f-4579-974a-d56352404f1d","Type":"ContainerDied","Data":"d9d2b454cb2531785359a5e885e82a70ddc10a1e89152a22dcad85c150e359c1"} Jul 07 16:29:20.497950 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:20.497925 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mt9hs" Jul 07 16:29:20.578683 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:20.578649 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rdn9\" (UniqueName: \"kubernetes.io/projected/1ae378db-3639-4ff3-a042-c04d465d2bcd-kube-api-access-9rdn9\") pod \"1ae378db-3639-4ff3-a042-c04d465d2bcd\" (UID: \"1ae378db-3639-4ff3-a042-c04d465d2bcd\") " Jul 07 16:29:20.578854 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:20.578744 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ae378db-3639-4ff3-a042-c04d465d2bcd-util\") pod \"1ae378db-3639-4ff3-a042-c04d465d2bcd\" (UID: \"1ae378db-3639-4ff3-a042-c04d465d2bcd\") " Jul 07 16:29:20.578854 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:20.578770 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ae378db-3639-4ff3-a042-c04d465d2bcd-bundle\") pod \"1ae378db-3639-4ff3-a042-c04d465d2bcd\" (UID: \"1ae378db-3639-4ff3-a042-c04d465d2bcd\") " Jul 07 16:29:20.579353 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:20.579328 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ae378db-3639-4ff3-a042-c04d465d2bcd-bundle" (OuterVolumeSpecName: "bundle") pod "1ae378db-3639-4ff3-a042-c04d465d2bcd" (UID: "1ae378db-3639-4ff3-a042-c04d465d2bcd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:29:20.580981 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:20.580961 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ae378db-3639-4ff3-a042-c04d465d2bcd-kube-api-access-9rdn9" (OuterVolumeSpecName: "kube-api-access-9rdn9") pod "1ae378db-3639-4ff3-a042-c04d465d2bcd" (UID: "1ae378db-3639-4ff3-a042-c04d465d2bcd"). InnerVolumeSpecName "kube-api-access-9rdn9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:29:20.583552 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:20.583520 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ae378db-3639-4ff3-a042-c04d465d2bcd-util" (OuterVolumeSpecName: "util") pod "1ae378db-3639-4ff3-a042-c04d465d2bcd" (UID: "1ae378db-3639-4ff3-a042-c04d465d2bcd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:29:20.679851 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:20.679811 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rdn9\" (UniqueName: \"kubernetes.io/projected/1ae378db-3639-4ff3-a042-c04d465d2bcd-kube-api-access-9rdn9\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:29:20.679851 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:20.679841 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ae378db-3639-4ff3-a042-c04d465d2bcd-util\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:29:20.679851 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:20.679852 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ae378db-3639-4ff3-a042-c04d465d2bcd-bundle\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:29:21.373653 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:21.373622 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mt9hs" Jul 07 16:29:21.373653 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:21.373650 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mt9hs" event={"ID":"1ae378db-3639-4ff3-a042-c04d465d2bcd","Type":"ContainerDied","Data":"7730dcd40f59c4f843f45d2cb98f66456ec04652f3f7c0eac55d69f41b41ed9d"} Jul 07 16:29:21.374052 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:21.373693 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7730dcd40f59c4f843f45d2cb98f66456ec04652f3f7c0eac55d69f41b41ed9d" Jul 07 16:29:21.513490 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:21.513462 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vqnqh" Jul 07 16:29:21.568661 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:21.568639 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsltg" Jul 07 16:29:21.572037 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:21.572013 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qfr4r" Jul 07 16:29:21.588927 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:21.588906 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63b770d3-837f-4579-974a-d56352404f1d-bundle\") pod \"63b770d3-837f-4579-974a-d56352404f1d\" (UID: \"63b770d3-837f-4579-974a-d56352404f1d\") " Jul 07 16:29:21.589018 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:21.588980 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8d9qh\" (UniqueName: \"kubernetes.io/projected/63b770d3-837f-4579-974a-d56352404f1d-kube-api-access-8d9qh\") pod \"63b770d3-837f-4579-974a-d56352404f1d\" (UID: \"63b770d3-837f-4579-974a-d56352404f1d\") " Jul 07 16:29:21.589068 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:21.589023 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63b770d3-837f-4579-974a-d56352404f1d-util\") pod \"63b770d3-837f-4579-974a-d56352404f1d\" (UID: \"63b770d3-837f-4579-974a-d56352404f1d\") " Jul 07 16:29:21.589363 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:21.589340 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63b770d3-837f-4579-974a-d56352404f1d-bundle" (OuterVolumeSpecName: "bundle") pod "63b770d3-837f-4579-974a-d56352404f1d" (UID: "63b770d3-837f-4579-974a-d56352404f1d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:29:21.591153 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:21.591127 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63b770d3-837f-4579-974a-d56352404f1d-kube-api-access-8d9qh" (OuterVolumeSpecName: "kube-api-access-8d9qh") pod "63b770d3-837f-4579-974a-d56352404f1d" (UID: "63b770d3-837f-4579-974a-d56352404f1d"). InnerVolumeSpecName "kube-api-access-8d9qh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:29:21.594697 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:21.594676 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63b770d3-837f-4579-974a-d56352404f1d-util" (OuterVolumeSpecName: "util") pod "63b770d3-837f-4579-974a-d56352404f1d" (UID: "63b770d3-837f-4579-974a-d56352404f1d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:29:21.689966 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:21.689890 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6t8d6\" (UniqueName: \"kubernetes.io/projected/ec4a634e-1f72-4660-a040-f507cd6da3d2-kube-api-access-6t8d6\") pod \"ec4a634e-1f72-4660-a040-f507cd6da3d2\" (UID: \"ec4a634e-1f72-4660-a040-f507cd6da3d2\") " Jul 07 16:29:21.689966 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:21.689925 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec4a634e-1f72-4660-a040-f507cd6da3d2-util\") pod \"ec4a634e-1f72-4660-a040-f507cd6da3d2\" (UID: \"ec4a634e-1f72-4660-a040-f507cd6da3d2\") " Jul 07 16:29:21.689966 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:21.689946 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec4a634e-1f72-4660-a040-f507cd6da3d2-bundle\") pod \"ec4a634e-1f72-4660-a040-f507cd6da3d2\" (UID: \"ec4a634e-1f72-4660-a040-f507cd6da3d2\") " Jul 07 16:29:21.690292 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:21.689981 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89f11e74-4d0f-4ade-a6eb-b4b0367c5395-bundle\") pod \"89f11e74-4d0f-4ade-a6eb-b4b0367c5395\" (UID: \"89f11e74-4d0f-4ade-a6eb-b4b0367c5395\") " Jul 07 16:29:21.690292 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:21.690019 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wb7x8\" (UniqueName: \"kubernetes.io/projected/89f11e74-4d0f-4ade-a6eb-b4b0367c5395-kube-api-access-wb7x8\") pod \"89f11e74-4d0f-4ade-a6eb-b4b0367c5395\" (UID: \"89f11e74-4d0f-4ade-a6eb-b4b0367c5395\") " Jul 07 16:29:21.690292 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:21.690040 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89f11e74-4d0f-4ade-a6eb-b4b0367c5395-util\") pod \"89f11e74-4d0f-4ade-a6eb-b4b0367c5395\" (UID: \"89f11e74-4d0f-4ade-a6eb-b4b0367c5395\") " Jul 07 16:29:21.690292 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:21.690265 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63b770d3-837f-4579-974a-d56352404f1d-bundle\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:29:21.690292 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:21.690283 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8d9qh\" (UniqueName: \"kubernetes.io/projected/63b770d3-837f-4579-974a-d56352404f1d-kube-api-access-8d9qh\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:29:21.690673 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:21.690298 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63b770d3-837f-4579-974a-d56352404f1d-util\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:29:21.690673 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:21.690580 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec4a634e-1f72-4660-a040-f507cd6da3d2-bundle" (OuterVolumeSpecName: "bundle") pod "ec4a634e-1f72-4660-a040-f507cd6da3d2" (UID: "ec4a634e-1f72-4660-a040-f507cd6da3d2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:29:21.690765 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:21.690751 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89f11e74-4d0f-4ade-a6eb-b4b0367c5395-bundle" (OuterVolumeSpecName: "bundle") pod "89f11e74-4d0f-4ade-a6eb-b4b0367c5395" (UID: "89f11e74-4d0f-4ade-a6eb-b4b0367c5395"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:29:21.692739 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:21.692711 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec4a634e-1f72-4660-a040-f507cd6da3d2-kube-api-access-6t8d6" (OuterVolumeSpecName: "kube-api-access-6t8d6") pod "ec4a634e-1f72-4660-a040-f507cd6da3d2" (UID: "ec4a634e-1f72-4660-a040-f507cd6da3d2"). InnerVolumeSpecName "kube-api-access-6t8d6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:29:21.692739 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:21.692724 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89f11e74-4d0f-4ade-a6eb-b4b0367c5395-kube-api-access-wb7x8" (OuterVolumeSpecName: "kube-api-access-wb7x8") pod "89f11e74-4d0f-4ade-a6eb-b4b0367c5395" (UID: "89f11e74-4d0f-4ade-a6eb-b4b0367c5395"). InnerVolumeSpecName "kube-api-access-wb7x8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:29:21.696021 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:21.696000 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89f11e74-4d0f-4ade-a6eb-b4b0367c5395-util" (OuterVolumeSpecName: "util") pod "89f11e74-4d0f-4ade-a6eb-b4b0367c5395" (UID: "89f11e74-4d0f-4ade-a6eb-b4b0367c5395"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:29:21.696299 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:21.696272 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec4a634e-1f72-4660-a040-f507cd6da3d2-util" (OuterVolumeSpecName: "util") pod "ec4a634e-1f72-4660-a040-f507cd6da3d2" (UID: "ec4a634e-1f72-4660-a040-f507cd6da3d2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:29:21.790964 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:21.790930 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6t8d6\" (UniqueName: \"kubernetes.io/projected/ec4a634e-1f72-4660-a040-f507cd6da3d2-kube-api-access-6t8d6\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:29:21.790964 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:21.790960 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec4a634e-1f72-4660-a040-f507cd6da3d2-util\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:29:21.790964 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:21.790971 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec4a634e-1f72-4660-a040-f507cd6da3d2-bundle\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:29:21.791288 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:21.790979 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89f11e74-4d0f-4ade-a6eb-b4b0367c5395-bundle\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:29:21.791288 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:21.790988 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wb7x8\" (UniqueName: \"kubernetes.io/projected/89f11e74-4d0f-4ade-a6eb-b4b0367c5395-kube-api-access-wb7x8\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:29:21.791288 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:21.790996 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89f11e74-4d0f-4ade-a6eb-b4b0367c5395-util\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:29:22.380413 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:22.380376 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qfr4r" event={"ID":"ec4a634e-1f72-4660-a040-f507cd6da3d2","Type":"ContainerDied","Data":"427c4d672fb2760de130ddcf5b85b5f05d8efae7a4235259bca500aa88930f41"} Jul 07 16:29:22.380835 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:22.380435 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="427c4d672fb2760de130ddcf5b85b5f05d8efae7a4235259bca500aa88930f41" Jul 07 16:29:22.380835 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:22.380383 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qfr4r" Jul 07 16:29:22.382383 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:22.382364 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vqnqh" Jul 07 16:29:22.382383 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:22.382375 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vqnqh" event={"ID":"63b770d3-837f-4579-974a-d56352404f1d","Type":"ContainerDied","Data":"4139d5675919c8557bf85b6415b8aa4915af4e8fecbd8560841d430c986b8dc5"} Jul 07 16:29:22.382577 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:22.382416 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4139d5675919c8557bf85b6415b8aa4915af4e8fecbd8560841d430c986b8dc5" Jul 07 16:29:22.384340 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:22.384318 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsltg" event={"ID":"89f11e74-4d0f-4ade-a6eb-b4b0367c5395","Type":"ContainerDied","Data":"55e4f21a9677f186723bdc4baa753dcfd355638438f00492b5740225af9bf0ed"} Jul 07 16:29:22.384460 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:22.384349 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="55e4f21a9677f186723bdc4baa753dcfd355638438f00492b5740225af9bf0ed" Jul 07 16:29:22.384460 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:22.384377 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsltg" Jul 07 16:29:24.075557 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:24.075524 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:29:24.728217 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:24.728177 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:29:28.367260 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:28.367204 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-nhxcd"] Jul 07 16:29:28.367637 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:28.367516 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ae378db-3639-4ff3-a042-c04d465d2bcd" containerName="pull" Jul 07 16:29:28.367637 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:28.367528 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ae378db-3639-4ff3-a042-c04d465d2bcd" containerName="pull" Jul 07 16:29:28.367637 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:28.367536 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63b770d3-837f-4579-974a-d56352404f1d" containerName="pull" Jul 07 16:29:28.367637 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:28.367541 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="63b770d3-837f-4579-974a-d56352404f1d" containerName="pull" Jul 07 16:29:28.367637 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:28.367549 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89f11e74-4d0f-4ade-a6eb-b4b0367c5395" containerName="extract" Jul 07 16:29:28.367637 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:28.367555 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="89f11e74-4d0f-4ade-a6eb-b4b0367c5395" containerName="extract" Jul 07 16:29:28.367637 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:28.367566 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89f11e74-4d0f-4ade-a6eb-b4b0367c5395" containerName="util" Jul 07 16:29:28.367637 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:28.367571 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="89f11e74-4d0f-4ade-a6eb-b4b0367c5395" containerName="util" Jul 07 16:29:28.367637 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:28.367576 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63b770d3-837f-4579-974a-d56352404f1d" containerName="extract" Jul 07 16:29:28.367637 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:28.367582 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="63b770d3-837f-4579-974a-d56352404f1d" containerName="extract" Jul 07 16:29:28.367637 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:28.367590 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ae378db-3639-4ff3-a042-c04d465d2bcd" containerName="util" Jul 07 16:29:28.367637 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:28.367595 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ae378db-3639-4ff3-a042-c04d465d2bcd" containerName="util" Jul 07 16:29:28.367637 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:28.367600 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec4a634e-1f72-4660-a040-f507cd6da3d2" containerName="extract" Jul 07 16:29:28.367637 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:28.367605 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec4a634e-1f72-4660-a040-f507cd6da3d2" containerName="extract" Jul 07 16:29:28.367637 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:28.367612 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec4a634e-1f72-4660-a040-f507cd6da3d2" containerName="util" Jul 07 16:29:28.367637 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:28.367617 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec4a634e-1f72-4660-a040-f507cd6da3d2" containerName="util" Jul 07 16:29:28.367637 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:28.367623 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63b770d3-837f-4579-974a-d56352404f1d" containerName="util" Jul 07 16:29:28.367637 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:28.367628 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="63b770d3-837f-4579-974a-d56352404f1d" containerName="util" Jul 07 16:29:28.367637 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:28.367634 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ae378db-3639-4ff3-a042-c04d465d2bcd" containerName="extract" Jul 07 16:29:28.367637 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:28.367638 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ae378db-3639-4ff3-a042-c04d465d2bcd" containerName="extract" Jul 07 16:29:28.367637 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:28.367646 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec4a634e-1f72-4660-a040-f507cd6da3d2" containerName="pull" Jul 07 16:29:28.368301 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:28.367651 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec4a634e-1f72-4660-a040-f507cd6da3d2" containerName="pull" Jul 07 16:29:28.368301 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:28.367659 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89f11e74-4d0f-4ade-a6eb-b4b0367c5395" containerName="pull" Jul 07 16:29:28.368301 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:28.367665 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="89f11e74-4d0f-4ade-a6eb-b4b0367c5395" containerName="pull" Jul 07 16:29:28.368301 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:28.367717 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ae378db-3639-4ff3-a042-c04d465d2bcd" containerName="extract" Jul 07 16:29:28.368301 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:28.367726 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec4a634e-1f72-4660-a040-f507cd6da3d2" containerName="extract" Jul 07 16:29:28.368301 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:28.367733 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="89f11e74-4d0f-4ade-a6eb-b4b0367c5395" containerName="extract" Jul 07 16:29:28.368301 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:28.367738 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="63b770d3-837f-4579-974a-d56352404f1d" containerName="extract" Jul 07 16:29:28.370596 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:28.370578 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nhxcd" Jul 07 16:29:28.373463 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:28.373444 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-jwlc8\"" Jul 07 16:29:28.411739 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:28.411707 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-nhxcd"] Jul 07 16:29:28.445535 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:28.445503 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn8dh\" (UniqueName: \"kubernetes.io/projected/cfb97d67-643a-4a19-8ebe-553ea14d5e52-kube-api-access-dn8dh\") pod \"authorino-operator-75cc8d5cb7-nhxcd\" (UID: \"cfb97d67-643a-4a19-8ebe-553ea14d5e52\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-nhxcd" Jul 07 16:29:28.546569 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:28.546537 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn8dh\" (UniqueName: \"kubernetes.io/projected/cfb97d67-643a-4a19-8ebe-553ea14d5e52-kube-api-access-dn8dh\") pod \"authorino-operator-75cc8d5cb7-nhxcd\" (UID: \"cfb97d67-643a-4a19-8ebe-553ea14d5e52\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-nhxcd" Jul 07 16:29:28.560883 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:28.560855 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn8dh\" (UniqueName: \"kubernetes.io/projected/cfb97d67-643a-4a19-8ebe-553ea14d5e52-kube-api-access-dn8dh\") pod \"authorino-operator-75cc8d5cb7-nhxcd\" (UID: \"cfb97d67-643a-4a19-8ebe-553ea14d5e52\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-nhxcd" Jul 07 16:29:28.680088 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:28.680009 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nhxcd" Jul 07 16:29:28.851082 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:28.851048 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-nhxcd"] Jul 07 16:29:28.852218 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:29:28.852192 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfb97d67_643a_4a19_8ebe_553ea14d5e52.slice/crio-56f7a0361763c8df61f64c487d9b414a821a06ca5a64b547cbc3f97e12b8ef90 WatchSource:0}: Error finding container 56f7a0361763c8df61f64c487d9b414a821a06ca5a64b547cbc3f97e12b8ef90: Status 404 returned error can't find the container with id 56f7a0361763c8df61f64c487d9b414a821a06ca5a64b547cbc3f97e12b8ef90 Jul 07 16:29:29.418522 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:29.418487 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nhxcd" event={"ID":"cfb97d67-643a-4a19-8ebe-553ea14d5e52","Type":"ContainerStarted","Data":"56f7a0361763c8df61f64c487d9b414a821a06ca5a64b547cbc3f97e12b8ef90"} Jul 07 16:29:29.489811 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:29.489776 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:29:31.430893 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:31.430794 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nhxcd" event={"ID":"cfb97d67-643a-4a19-8ebe-553ea14d5e52","Type":"ContainerStarted","Data":"67297292b8465c88ca9d20edcbe9dc14a5e435993491bf19ad52c97ae9bc40c1"} Jul 07 16:29:31.431346 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:31.430954 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nhxcd" Jul 07 16:29:31.455433 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:31.455376 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nhxcd" podStartSLOduration=1.201807847 podStartE2EDuration="3.455363205s" totalImagesPullingTime="2.253555358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:29:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:29:31.453278992 +0000 UTC m=+391.392788415" watchObservedRunningTime="2026-07-07 16:29:31.455363205 +0000 UTC m=+391.394872628" Jul 07 16:29:31.631395 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:31.631354 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxtjj"] Jul 07 16:29:31.634742 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:31.634711 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxtjj" Jul 07 16:29:31.635108 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:31.635070 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:29:31.645837 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:31.645808 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-zbfwv\"" Jul 07 16:29:31.669240 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:31.669210 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxtjj"] Jul 07 16:29:31.764478 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:31.764398 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:29:31.774570 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:31.774545 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq8tl\" (UniqueName: \"kubernetes.io/projected/45241cc3-89f7-498a-b61b-e0c847a1b85a-kube-api-access-vq8tl\") pod \"limitador-operator-controller-manager-859d7b78bd-rxtjj\" (UID: \"45241cc3-89f7-498a-b61b-e0c847a1b85a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxtjj" Jul 07 16:29:31.875470 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:31.875440 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq8tl\" (UniqueName: \"kubernetes.io/projected/45241cc3-89f7-498a-b61b-e0c847a1b85a-kube-api-access-vq8tl\") pod \"limitador-operator-controller-manager-859d7b78bd-rxtjj\" (UID: \"45241cc3-89f7-498a-b61b-e0c847a1b85a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxtjj" Jul 07 16:29:31.888655 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:31.888629 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq8tl\" (UniqueName: \"kubernetes.io/projected/45241cc3-89f7-498a-b61b-e0c847a1b85a-kube-api-access-vq8tl\") pod \"limitador-operator-controller-manager-859d7b78bd-rxtjj\" (UID: \"45241cc3-89f7-498a-b61b-e0c847a1b85a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxtjj" Jul 07 16:29:31.944172 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:31.944139 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxtjj" Jul 07 16:29:32.094678 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:32.094654 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxtjj"] Jul 07 16:29:32.096595 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:29:32.096574 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45241cc3_89f7_498a_b61b_e0c847a1b85a.slice/crio-ca22d163d92cce7d7e9e3bc142ecc32d41fb7047342eb87baf0a4af9b32fc3ea WatchSource:0}: Error finding container ca22d163d92cce7d7e9e3bc142ecc32d41fb7047342eb87baf0a4af9b32fc3ea: Status 404 returned error can't find the container with id ca22d163d92cce7d7e9e3bc142ecc32d41fb7047342eb87baf0a4af9b32fc3ea Jul 07 16:29:32.438411 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:32.438376 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxtjj" event={"ID":"45241cc3-89f7-498a-b61b-e0c847a1b85a","Type":"ContainerStarted","Data":"ca22d163d92cce7d7e9e3bc142ecc32d41fb7047342eb87baf0a4af9b32fc3ea"} Jul 07 16:29:32.479713 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:32.479681 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:29:33.749008 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:33.748972 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:29:34.449101 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:34.449059 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxtjj" event={"ID":"45241cc3-89f7-498a-b61b-e0c847a1b85a","Type":"ContainerStarted","Data":"8ff5f939083b245a9df2436efc8cb94d2248e0601acb7dacab3a54450c63b97c"} Jul 07 16:29:34.449304 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:34.449127 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxtjj" Jul 07 16:29:34.472770 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:34.472719 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxtjj" podStartSLOduration=1.624516888 podStartE2EDuration="3.472704263s" totalImagesPullingTime="1.848187375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:29:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:29:34.471781064 +0000 UTC m=+394.411290487" watchObservedRunningTime="2026-07-07 16:29:34.472704263 +0000 UTC m=+394.412213686" Jul 07 16:29:35.576872 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:35.576839 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:29:37.282332 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:37.282298 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:29:38.068506 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:38.068476 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:29:39.187251 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:39.187204 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-njncp"] Jul 07 16:29:39.193997 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:39.193975 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-njncp" Jul 07 16:29:39.198834 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:39.198811 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 07 16:29:39.206450 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:39.206429 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-mz7kn\"" Jul 07 16:29:39.207201 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:39.207101 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-njncp"] Jul 07 16:29:39.346482 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:39.346450 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-865ml\" (UniqueName: \"kubernetes.io/projected/a9f7efcc-5826-4777-98ac-1c40563f1d29-kube-api-access-865ml\") pod \"dns-operator-controller-manager-864dd78c4c-njncp\" (UID: \"a9f7efcc-5826-4777-98ac-1c40563f1d29\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-njncp" Jul 07 16:29:39.447669 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:39.447584 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-865ml\" (UniqueName: \"kubernetes.io/projected/a9f7efcc-5826-4777-98ac-1c40563f1d29-kube-api-access-865ml\") pod \"dns-operator-controller-manager-864dd78c4c-njncp\" (UID: \"a9f7efcc-5826-4777-98ac-1c40563f1d29\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-njncp" Jul 07 16:29:39.478293 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:39.478261 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-865ml\" (UniqueName: \"kubernetes.io/projected/a9f7efcc-5826-4777-98ac-1c40563f1d29-kube-api-access-865ml\") pod \"dns-operator-controller-manager-864dd78c4c-njncp\" (UID: \"a9f7efcc-5826-4777-98ac-1c40563f1d29\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-njncp" Jul 07 16:29:39.511092 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:39.511060 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-njncp" Jul 07 16:29:39.669134 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:39.669105 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-njncp"] Jul 07 16:29:39.670544 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:29:39.670514 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9f7efcc_5826_4777_98ac_1c40563f1d29.slice/crio-5e5112ac3b0468130ad2047bf6eee4d2716ec189067489a4caa90b7c92f15c5c WatchSource:0}: Error finding container 5e5112ac3b0468130ad2047bf6eee4d2716ec189067489a4caa90b7c92f15c5c: Status 404 returned error can't find the container with id 5e5112ac3b0468130ad2047bf6eee4d2716ec189067489a4caa90b7c92f15c5c Jul 07 16:29:40.408240 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:40.408192 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:29:40.479197 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:40.479165 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-njncp" event={"ID":"a9f7efcc-5826-4777-98ac-1c40563f1d29","Type":"ContainerStarted","Data":"5e5112ac3b0468130ad2047bf6eee4d2716ec189067489a4caa90b7c92f15c5c"} Jul 07 16:29:40.532499 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:40.532467 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:29:40.709307 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:40.709217 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:29:40.814596 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:40.814562 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:29:42.440764 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:42.440735 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nhxcd" Jul 07 16:29:42.491343 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:42.491245 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-njncp" event={"ID":"a9f7efcc-5826-4777-98ac-1c40563f1d29","Type":"ContainerStarted","Data":"15f2950d93b4f237787106da0a1a9692f90c2452983d7f6d28d8639b7237f4ae"} Jul 07 16:29:42.491343 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:42.491321 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-njncp" Jul 07 16:29:42.527963 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:42.527898 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-njncp" podStartSLOduration=0.987692763 podStartE2EDuration="3.527878457s" totalImagesPullingTime="2.540185694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:29:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:29:42.526248503 +0000 UTC m=+402.465757927" watchObservedRunningTime="2026-07-07 16:29:42.527878457 +0000 UTC m=+402.467387881" Jul 07 16:29:43.769124 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:43.769090 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:29:44.123988 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:44.123954 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:29:44.219671 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:44.219634 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:29:45.457113 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:45.457080 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxtjj" Jul 07 16:29:47.699627 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:47.699596 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:29:47.799142 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:47.799113 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:29:51.660338 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:51.660303 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:29:51.975345 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:51.975263 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:29:53.498301 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:53.498273 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-njncp" Jul 07 16:29:53.829271 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:53.829158 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:29:53.934676 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:53.934639 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:29:59.553698 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:59.553663 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:29:59.653646 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:29:59.653613 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:30:00.159579 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:00.159549 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:30:00.265070 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:00.265037 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:30:02.329107 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.329073 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-srn9g"] Jul 07 16:30:02.334147 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.334125 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-srn9g" Jul 07 16:30:02.337391 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.337371 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-h9k6t\"" Jul 07 16:30:02.358545 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.358524 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-srn9g"] Jul 07 16:30:02.428859 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.428816 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvx59\" (UniqueName: \"kubernetes.io/projected/f9f67475-70db-4e3a-a378-26c08711af94-kube-api-access-kvx59\") pod \"kuadrant-operator-controller-manager-86878c769f-srn9g\" (UID: \"f9f67475-70db-4e3a-a378-26c08711af94\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-srn9g" Jul 07 16:30:02.428859 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.428859 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9f67475-70db-4e3a-a378-26c08711af94-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-srn9g\" (UID: \"f9f67475-70db-4e3a-a378-26c08711af94\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-srn9g" Jul 07 16:30:02.491505 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.491473 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-srn9g"] Jul 07 16:30:02.491785 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:30:02.491760 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-kvx59], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-srn9g" podUID="f9f67475-70db-4e3a-a378-26c08711af94" Jul 07 16:30:02.503395 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.503366 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-srn9g"] Jul 07 16:30:02.526046 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.526018 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxtjj"] Jul 07 16:30:02.526238 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.526206 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxtjj" podUID="45241cc3-89f7-498a-b61b-e0c847a1b85a" containerName="manager" containerID="cri-o://8ff5f939083b245a9df2436efc8cb94d2248e0601acb7dacab3a54450c63b97c" gracePeriod=2 Jul 07 16:30:02.530032 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.530006 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvx59\" (UniqueName: \"kubernetes.io/projected/f9f67475-70db-4e3a-a378-26c08711af94-kube-api-access-kvx59\") pod \"kuadrant-operator-controller-manager-86878c769f-srn9g\" (UID: \"f9f67475-70db-4e3a-a378-26c08711af94\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-srn9g" Jul 07 16:30:02.530131 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.530039 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9f67475-70db-4e3a-a378-26c08711af94-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-srn9g\" (UID: \"f9f67475-70db-4e3a-a378-26c08711af94\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-srn9g" Jul 07 16:30:02.530419 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.530403 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9f67475-70db-4e3a-a378-26c08711af94-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-srn9g\" (UID: \"f9f67475-70db-4e3a-a378-26c08711af94\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-srn9g" Jul 07 16:30:02.540018 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:30:02.539997 2564 projected.go:196] Error preparing data for projected volume kube-api-access-kvx59 for pod kuadrant-system/kuadrant-operator-controller-manager-86878c769f-srn9g: failed to fetch token: serviceaccounts "kuadrant-operator-controller-manager" is forbidden: User "system:node:ip-10-0-142-239.ec2.internal" cannot create resource "serviceaccounts/token" in API group "" in the namespace "kuadrant-system": no relationship found between node 'ip-10-0-142-239.ec2.internal' and this object Jul 07 16:30:02.540096 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:30:02.540085 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f9f67475-70db-4e3a-a378-26c08711af94-kube-api-access-kvx59 podName:f9f67475-70db-4e3a-a378-26c08711af94 nodeName:}" failed. No retries permitted until 2026-07-07 16:30:03.04004222 +0000 UTC m=+422.979551620 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kvx59" (UniqueName: "kubernetes.io/projected/f9f67475-70db-4e3a-a378-26c08711af94-kube-api-access-kvx59") pod "kuadrant-operator-controller-manager-86878c769f-srn9g" (UID: "f9f67475-70db-4e3a-a378-26c08711af94") : failed to fetch token: serviceaccounts "kuadrant-operator-controller-manager" is forbidden: User "system:node:ip-10-0-142-239.ec2.internal" cannot create resource "serviceaccounts/token" in API group "" in the namespace "kuadrant-system": no relationship found between node 'ip-10-0-142-239.ec2.internal' and this object Jul 07 16:30:02.544435 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.544412 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ldh8q"] Jul 07 16:30:02.547613 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.547594 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ldh8q" Jul 07 16:30:02.557989 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.557969 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxtjj"] Jul 07 16:30:02.567994 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:30:02.567966 2564 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"45241cc3-89f7-498a-b61b-e0c847a1b85a\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-rxtjj\": pods \"limitador-operator-controller-manager-859d7b78bd-rxtjj\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxtjj" Jul 07 16:30:02.575589 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:30:02.575554 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rxtjj\" is forbidden: User \"system:node:ip-10-0-142-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-239.ec2.internal' and this object" podUID="45241cc3-89f7-498a-b61b-e0c847a1b85a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxtjj" Jul 07 16:30:02.593377 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.593353 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-srn9g" Jul 07 16:30:02.600980 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.600959 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-srn9g" Jul 07 16:30:02.608247 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.608195 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcxk7"] Jul 07 16:30:02.608675 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.608657 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45241cc3-89f7-498a-b61b-e0c847a1b85a" containerName="manager" Jul 07 16:30:02.608675 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.608674 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="45241cc3-89f7-498a-b61b-e0c847a1b85a" containerName="manager" Jul 07 16:30:02.608828 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.608775 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="45241cc3-89f7-498a-b61b-e0c847a1b85a" containerName="manager" Jul 07 16:30:02.611551 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.611533 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ldh8q"] Jul 07 16:30:02.611644 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.611630 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcxk7" Jul 07 16:30:02.631173 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.631146 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9f67475-70db-4e3a-a378-26c08711af94-extensions-socket-volume\") pod \"f9f67475-70db-4e3a-a378-26c08711af94\" (UID: \"f9f67475-70db-4e3a-a378-26c08711af94\") " Jul 07 16:30:02.631413 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.631391 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/da18393b-92af-450b-aea0-c78121277b3d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ldh8q\" (UID: \"da18393b-92af-450b-aea0-c78121277b3d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ldh8q" Jul 07 16:30:02.631529 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.631392 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9f67475-70db-4e3a-a378-26c08711af94-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f9f67475-70db-4e3a-a378-26c08711af94" (UID: "f9f67475-70db-4e3a-a378-26c08711af94"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:30:02.631529 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.631488 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cfx8\" (UniqueName: \"kubernetes.io/projected/756e72da-5228-4d70-b757-7f6f5c8d1060-kube-api-access-4cfx8\") pod \"limitador-operator-controller-manager-859d7b78bd-jcxk7\" (UID: \"756e72da-5228-4d70-b757-7f6f5c8d1060\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcxk7" Jul 07 16:30:02.631656 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.631562 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gx24\" (UniqueName: \"kubernetes.io/projected/da18393b-92af-450b-aea0-c78121277b3d-kube-api-access-5gx24\") pod \"kuadrant-operator-controller-manager-86878c769f-ldh8q\" (UID: \"da18393b-92af-450b-aea0-c78121277b3d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ldh8q" Jul 07 16:30:02.631710 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.631663 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9f67475-70db-4e3a-a378-26c08711af94-extensions-socket-volume\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:30:02.631710 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.631679 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvx59\" (UniqueName: \"kubernetes.io/projected/f9f67475-70db-4e3a-a378-26c08711af94-kube-api-access-kvx59\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:30:02.631710 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:30:02.631671 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-srn9g\" is forbidden: User \"system:node:ip-10-0-142-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-239.ec2.internal' and this object" podUID="f9f67475-70db-4e3a-a378-26c08711af94" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-srn9g" Jul 07 16:30:02.634215 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:30:02.634140 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rxtjj\" is forbidden: User \"system:node:ip-10-0-142-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-239.ec2.internal' and this object" podUID="45241cc3-89f7-498a-b61b-e0c847a1b85a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxtjj" Jul 07 16:30:02.651092 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.651058 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9f67475-70db-4e3a-a378-26c08711af94" path="/var/lib/kubelet/pods/f9f67475-70db-4e3a-a378-26c08711af94/volumes" Jul 07 16:30:02.682133 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.682097 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcxk7"] Jul 07 16:30:02.732790 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.732761 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/da18393b-92af-450b-aea0-c78121277b3d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ldh8q\" (UID: \"da18393b-92af-450b-aea0-c78121277b3d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ldh8q" Jul 07 16:30:02.732912 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.732816 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cfx8\" (UniqueName: \"kubernetes.io/projected/756e72da-5228-4d70-b757-7f6f5c8d1060-kube-api-access-4cfx8\") pod \"limitador-operator-controller-manager-859d7b78bd-jcxk7\" (UID: \"756e72da-5228-4d70-b757-7f6f5c8d1060\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcxk7" Jul 07 16:30:02.732912 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.732857 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gx24\" (UniqueName: \"kubernetes.io/projected/da18393b-92af-450b-aea0-c78121277b3d-kube-api-access-5gx24\") pod \"kuadrant-operator-controller-manager-86878c769f-ldh8q\" (UID: \"da18393b-92af-450b-aea0-c78121277b3d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ldh8q" Jul 07 16:30:02.733119 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.733102 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/da18393b-92af-450b-aea0-c78121277b3d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ldh8q\" (UID: \"da18393b-92af-450b-aea0-c78121277b3d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ldh8q" Jul 07 16:30:02.754919 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.754886 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gx24\" (UniqueName: \"kubernetes.io/projected/da18393b-92af-450b-aea0-c78121277b3d-kube-api-access-5gx24\") pod \"kuadrant-operator-controller-manager-86878c769f-ldh8q\" (UID: \"da18393b-92af-450b-aea0-c78121277b3d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ldh8q" Jul 07 16:30:02.756631 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.756604 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cfx8\" (UniqueName: \"kubernetes.io/projected/756e72da-5228-4d70-b757-7f6f5c8d1060-kube-api-access-4cfx8\") pod \"limitador-operator-controller-manager-859d7b78bd-jcxk7\" (UID: \"756e72da-5228-4d70-b757-7f6f5c8d1060\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcxk7" Jul 07 16:30:02.793471 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.793442 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxtjj" Jul 07 16:30:02.833758 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.833730 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vq8tl\" (UniqueName: \"kubernetes.io/projected/45241cc3-89f7-498a-b61b-e0c847a1b85a-kube-api-access-vq8tl\") pod \"45241cc3-89f7-498a-b61b-e0c847a1b85a\" (UID: \"45241cc3-89f7-498a-b61b-e0c847a1b85a\") " Jul 07 16:30:02.835756 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.835731 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45241cc3-89f7-498a-b61b-e0c847a1b85a-kube-api-access-vq8tl" (OuterVolumeSpecName: "kube-api-access-vq8tl") pod "45241cc3-89f7-498a-b61b-e0c847a1b85a" (UID: "45241cc3-89f7-498a-b61b-e0c847a1b85a"). InnerVolumeSpecName "kube-api-access-vq8tl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:30:02.896257 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.896206 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ldh8q" Jul 07 16:30:02.921855 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.921804 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcxk7" Jul 07 16:30:02.935102 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:02.935075 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vq8tl\" (UniqueName: \"kubernetes.io/projected/45241cc3-89f7-498a-b61b-e0c847a1b85a-kube-api-access-vq8tl\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:30:03.069510 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:03.069481 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ldh8q"] Jul 07 16:30:03.073556 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:30:03.073530 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda18393b_92af_450b_aea0_c78121277b3d.slice/crio-8064d2f86294a31ae72a1e6c416da4aa6d0737a15c21ad9e730eb9b680b5c3be WatchSource:0}: Error finding container 8064d2f86294a31ae72a1e6c416da4aa6d0737a15c21ad9e730eb9b680b5c3be: Status 404 returned error can't find the container with id 8064d2f86294a31ae72a1e6c416da4aa6d0737a15c21ad9e730eb9b680b5c3be Jul 07 16:30:03.096422 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:03.096402 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcxk7"] Jul 07 16:30:03.098445 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:30:03.098417 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod756e72da_5228_4d70_b757_7f6f5c8d1060.slice/crio-630b4a0b6217aa680ff7c5dc62dbd8b0398d484d0dc18a85ae98a9b1805302ff WatchSource:0}: Error finding container 630b4a0b6217aa680ff7c5dc62dbd8b0398d484d0dc18a85ae98a9b1805302ff: Status 404 returned error can't find the container with id 630b4a0b6217aa680ff7c5dc62dbd8b0398d484d0dc18a85ae98a9b1805302ff Jul 07 16:30:03.576874 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:03.576832 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:30:03.599863 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:03.599830 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcxk7" event={"ID":"756e72da-5228-4d70-b757-7f6f5c8d1060","Type":"ContainerStarted","Data":"fba54e533198b262f3b5ff2d3b4076d461e544daa56287e476b1ec72fc6a257e"} Jul 07 16:30:03.600039 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:03.599892 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcxk7" Jul 07 16:30:03.600039 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:03.599917 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcxk7" event={"ID":"756e72da-5228-4d70-b757-7f6f5c8d1060","Type":"ContainerStarted","Data":"630b4a0b6217aa680ff7c5dc62dbd8b0398d484d0dc18a85ae98a9b1805302ff"} Jul 07 16:30:03.601206 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:03.601180 2564 generic.go:356] "Generic (PLEG): container finished" podID="45241cc3-89f7-498a-b61b-e0c847a1b85a" containerID="8ff5f939083b245a9df2436efc8cb94d2248e0601acb7dacab3a54450c63b97c" exitCode=0 Jul 07 16:30:03.601283 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:03.601223 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxtjj" Jul 07 16:30:03.601283 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:03.601272 2564 scope.go:117] "RemoveContainer" containerID="8ff5f939083b245a9df2436efc8cb94d2248e0601acb7dacab3a54450c63b97c" Jul 07 16:30:03.602841 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:03.602822 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-srn9g" Jul 07 16:30:03.603065 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:03.602833 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ldh8q" event={"ID":"da18393b-92af-450b-aea0-c78121277b3d","Type":"ContainerStarted","Data":"8064d2f86294a31ae72a1e6c416da4aa6d0737a15c21ad9e730eb9b680b5c3be"} Jul 07 16:30:03.610210 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:03.610194 2564 scope.go:117] "RemoveContainer" containerID="8ff5f939083b245a9df2436efc8cb94d2248e0601acb7dacab3a54450c63b97c" Jul 07 16:30:03.610462 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:30:03.610445 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ff5f939083b245a9df2436efc8cb94d2248e0601acb7dacab3a54450c63b97c\": container with ID starting with 8ff5f939083b245a9df2436efc8cb94d2248e0601acb7dacab3a54450c63b97c not found: ID does not exist" containerID="8ff5f939083b245a9df2436efc8cb94d2248e0601acb7dacab3a54450c63b97c" Jul 07 16:30:03.610518 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:03.610472 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ff5f939083b245a9df2436efc8cb94d2248e0601acb7dacab3a54450c63b97c"} err="failed to get container status \"8ff5f939083b245a9df2436efc8cb94d2248e0601acb7dacab3a54450c63b97c\": rpc error: code = NotFound desc = could not find container \"8ff5f939083b245a9df2436efc8cb94d2248e0601acb7dacab3a54450c63b97c\": container with ID starting with 8ff5f939083b245a9df2436efc8cb94d2248e0601acb7dacab3a54450c63b97c not found: ID does not exist" Jul 07 16:30:03.644225 ip-10-0-142-239 kubenswrapper[2564]: E0707 16:30:03.644190 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-srn9g\" is forbidden: User \"system:node:ip-10-0-142-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-239.ec2.internal' and this object" podUID="f9f67475-70db-4e3a-a378-26c08711af94" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-srn9g" Jul 07 16:30:03.739778 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:03.739729 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:30:04.649813 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:04.649780 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45241cc3-89f7-498a-b61b-e0c847a1b85a" path="/var/lib/kubelet/pods/45241cc3-89f7-498a-b61b-e0c847a1b85a/volumes" Jul 07 16:30:07.206314 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:07.206280 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:30:07.314732 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:07.314693 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:30:10.649875 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:10.649847 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ldh8q" Jul 07 16:30:10.650294 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:10.649889 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ldh8q" event={"ID":"da18393b-92af-450b-aea0-c78121277b3d","Type":"ContainerStarted","Data":"1e25cc2bd470b2c61412331a75d7c197f8f5236bfb4b9629249caaf14f973f88"} Jul 07 16:30:10.682294 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:10.682244 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ldh8q" podStartSLOduration=1.790506026 podStartE2EDuration="8.682209786s" totalImagesPullingTime="6.89170376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:30:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:30:10.679476188 +0000 UTC m=+430.618985614" watchObservedRunningTime="2026-07-07 16:30:10.682209786 +0000 UTC m=+430.621719209" Jul 07 16:30:10.682570 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:10.682551 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcxk7" podStartSLOduration=8.682546626 podStartE2EDuration="8.682546626s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:30:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:30:03.638742081 +0000 UTC m=+423.578251503" watchObservedRunningTime="2026-07-07 16:30:10.682546626 +0000 UTC m=+430.622056049" Jul 07 16:30:14.362380 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:14.362346 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:30:14.432405 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:14.432369 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:30:14.613729 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:14.613655 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcxk7" Jul 07 16:30:21.654822 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:21.654750 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ldh8q" Jul 07 16:30:38.423541 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:38.423503 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:30:38.527406 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:38.527366 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:30:40.844443 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:40.844414 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:30:40.977798 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:40.977757 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:30:41.203140 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:41.203106 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-px8m8"] Jul 07 16:30:41.226925 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:41.226897 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-px8m8"] Jul 07 16:30:41.227098 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:41.226988 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-px8m8" Jul 07 16:30:41.230297 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:41.230273 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 07 16:30:41.230472 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:41.230454 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-clfdp\"" Jul 07 16:30:41.246686 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:41.246658 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-px8m8"] Jul 07 16:30:41.261887 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:41.261855 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0330448b-3c28-48b2-a19c-22fe57b39ef4-config-file\") pod \"limitador-limitador-54d6d988d5-px8m8\" (UID: \"0330448b-3c28-48b2-a19c-22fe57b39ef4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-px8m8" Jul 07 16:30:41.262024 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:41.261901 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzfmw\" (UniqueName: \"kubernetes.io/projected/0330448b-3c28-48b2-a19c-22fe57b39ef4-kube-api-access-vzfmw\") pod \"limitador-limitador-54d6d988d5-px8m8\" (UID: \"0330448b-3c28-48b2-a19c-22fe57b39ef4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-px8m8" Jul 07 16:30:41.363164 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:41.363131 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0330448b-3c28-48b2-a19c-22fe57b39ef4-config-file\") pod \"limitador-limitador-54d6d988d5-px8m8\" (UID: \"0330448b-3c28-48b2-a19c-22fe57b39ef4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-px8m8" Jul 07 16:30:41.363351 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:41.363178 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzfmw\" (UniqueName: \"kubernetes.io/projected/0330448b-3c28-48b2-a19c-22fe57b39ef4-kube-api-access-vzfmw\") pod \"limitador-limitador-54d6d988d5-px8m8\" (UID: \"0330448b-3c28-48b2-a19c-22fe57b39ef4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-px8m8" Jul 07 16:30:41.363741 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:41.363723 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0330448b-3c28-48b2-a19c-22fe57b39ef4-config-file\") pod \"limitador-limitador-54d6d988d5-px8m8\" (UID: \"0330448b-3c28-48b2-a19c-22fe57b39ef4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-px8m8" Jul 07 16:30:41.372741 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:41.372711 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzfmw\" (UniqueName: \"kubernetes.io/projected/0330448b-3c28-48b2-a19c-22fe57b39ef4-kube-api-access-vzfmw\") pod \"limitador-limitador-54d6d988d5-px8m8\" (UID: \"0330448b-3c28-48b2-a19c-22fe57b39ef4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-px8m8" Jul 07 16:30:41.537159 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:41.537080 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-px8m8" Jul 07 16:30:41.540138 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:41.540105 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:30:41.683505 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:41.683342 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-px8m8"] Jul 07 16:30:41.685842 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:30:41.685815 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0330448b_3c28_48b2_a19c_22fe57b39ef4.slice/crio-36dc074a101b1818d1417f5c5f1954ea7ff5fd48075a0d7e4aa2cf0013776041 WatchSource:0}: Error finding container 36dc074a101b1818d1417f5c5f1954ea7ff5fd48075a0d7e4aa2cf0013776041: Status 404 returned error can't find the container with id 36dc074a101b1818d1417f5c5f1954ea7ff5fd48075a0d7e4aa2cf0013776041 Jul 07 16:30:41.772050 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:41.772014 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:30:41.803509 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:41.803425 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-px8m8" event={"ID":"0330448b-3c28-48b2-a19c-22fe57b39ef4","Type":"ContainerStarted","Data":"36dc074a101b1818d1417f5c5f1954ea7ff5fd48075a0d7e4aa2cf0013776041"} Jul 07 16:30:41.893849 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:41.893813 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:30:44.821428 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:44.821389 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-px8m8" event={"ID":"0330448b-3c28-48b2-a19c-22fe57b39ef4","Type":"ContainerStarted","Data":"b2d2ee999f15079b4a57466b6de32b439e2a4875a729b1336a1436375788cc7c"} Jul 07 16:30:44.821917 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:44.821505 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-px8m8" Jul 07 16:30:44.846443 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:44.846400 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-px8m8" podStartSLOduration=1.246827234 podStartE2EDuration="3.846384799s" totalImagesPullingTime="2.599557565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:30:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:30:44.845092561 +0000 UTC m=+464.784601983" watchObservedRunningTime="2026-07-07 16:30:44.846384799 +0000 UTC m=+464.785894222" Jul 07 16:30:47.310420 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:47.310371 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:30:47.390598 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:47.390569 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:30:55.672606 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:55.672569 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:30:55.828199 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:30:55.828166 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-px8m8" Jul 07 16:31:02.490429 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:02.490394 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:31:15.233741 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:15.233708 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:31:15.339840 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:15.339811 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:31:15.519913 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:15.519828 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:31:16.923391 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:16.923356 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8xqk7p"] Jul 07 16:31:16.928352 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:16.928334 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8xqk7p" Jul 07 16:31:16.932396 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:16.932373 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 16:31:16.933591 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:16.933565 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 16:31:16.933689 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:16.933565 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gzmhr\"" Jul 07 16:31:16.950153 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:16.950131 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8xqk7p"] Jul 07 16:31:17.078471 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:17.078439 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11a0dd5f-928b-40af-af7d-e6b46477d0a6-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8xqk7p\" (UID: \"11a0dd5f-928b-40af-af7d-e6b46477d0a6\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8xqk7p" Jul 07 16:31:17.078650 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:17.078512 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11a0dd5f-928b-40af-af7d-e6b46477d0a6-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8xqk7p\" (UID: \"11a0dd5f-928b-40af-af7d-e6b46477d0a6\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8xqk7p" Jul 07 16:31:17.078650 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:17.078593 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t9j9\" (UniqueName: \"kubernetes.io/projected/11a0dd5f-928b-40af-af7d-e6b46477d0a6-kube-api-access-9t9j9\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8xqk7p\" (UID: \"11a0dd5f-928b-40af-af7d-e6b46477d0a6\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8xqk7p" Jul 07 16:31:17.179351 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:17.179259 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11a0dd5f-928b-40af-af7d-e6b46477d0a6-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8xqk7p\" (UID: \"11a0dd5f-928b-40af-af7d-e6b46477d0a6\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8xqk7p" Jul 07 16:31:17.179500 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:17.179349 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t9j9\" (UniqueName: \"kubernetes.io/projected/11a0dd5f-928b-40af-af7d-e6b46477d0a6-kube-api-access-9t9j9\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8xqk7p\" (UID: \"11a0dd5f-928b-40af-af7d-e6b46477d0a6\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8xqk7p" Jul 07 16:31:17.179500 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:17.179376 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11a0dd5f-928b-40af-af7d-e6b46477d0a6-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8xqk7p\" (UID: \"11a0dd5f-928b-40af-af7d-e6b46477d0a6\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8xqk7p" Jul 07 16:31:17.179665 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:17.179644 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11a0dd5f-928b-40af-af7d-e6b46477d0a6-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8xqk7p\" (UID: \"11a0dd5f-928b-40af-af7d-e6b46477d0a6\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8xqk7p" Jul 07 16:31:17.179713 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:17.179690 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11a0dd5f-928b-40af-af7d-e6b46477d0a6-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8xqk7p\" (UID: \"11a0dd5f-928b-40af-af7d-e6b46477d0a6\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8xqk7p" Jul 07 16:31:17.200163 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:17.200132 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t9j9\" (UniqueName: \"kubernetes.io/projected/11a0dd5f-928b-40af-af7d-e6b46477d0a6-kube-api-access-9t9j9\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8xqk7p\" (UID: \"11a0dd5f-928b-40af-af7d-e6b46477d0a6\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8xqk7p" Jul 07 16:31:17.236808 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:17.236780 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8xqk7p" Jul 07 16:31:17.383194 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:17.383152 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8xqk7p"] Jul 07 16:31:17.388283 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:31:17.388255 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11a0dd5f_928b_40af_af7d_e6b46477d0a6.slice/crio-a13a5c37c6a2572030305cd1d6ce1753dd6d5224b3e9aec193320d9ccab43c32 WatchSource:0}: Error finding container a13a5c37c6a2572030305cd1d6ce1753dd6d5224b3e9aec193320d9ccab43c32: Status 404 returned error can't find the container with id a13a5c37c6a2572030305cd1d6ce1753dd6d5224b3e9aec193320d9ccab43c32 Jul 07 16:31:17.994794 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:17.994758 2564 generic.go:356] "Generic (PLEG): container finished" podID="11a0dd5f-928b-40af-af7d-e6b46477d0a6" containerID="57c704e406e20f9bce33173eb3576bd40e9514ca00d6d6e8fa096b927af46a5c" exitCode=0 Jul 07 16:31:17.995209 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:17.994826 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8xqk7p" event={"ID":"11a0dd5f-928b-40af-af7d-e6b46477d0a6","Type":"ContainerDied","Data":"57c704e406e20f9bce33173eb3576bd40e9514ca00d6d6e8fa096b927af46a5c"} Jul 07 16:31:17.995209 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:17.994876 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8xqk7p" event={"ID":"11a0dd5f-928b-40af-af7d-e6b46477d0a6","Type":"ContainerStarted","Data":"a13a5c37c6a2572030305cd1d6ce1753dd6d5224b3e9aec193320d9ccab43c32"} Jul 07 16:31:19.001870 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:19.001788 2564 generic.go:356] "Generic (PLEG): container finished" podID="11a0dd5f-928b-40af-af7d-e6b46477d0a6" containerID="29808b08e3910777c48616e7824777072a8b06ea1106a321ca20dc04ac5bcb9e" exitCode=0 Jul 07 16:31:19.001870 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:19.001852 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8xqk7p" event={"ID":"11a0dd5f-928b-40af-af7d-e6b46477d0a6","Type":"ContainerDied","Data":"29808b08e3910777c48616e7824777072a8b06ea1106a321ca20dc04ac5bcb9e"} Jul 07 16:31:20.010355 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:20.010320 2564 generic.go:356] "Generic (PLEG): container finished" podID="11a0dd5f-928b-40af-af7d-e6b46477d0a6" containerID="fefca24fe1049cb21cae89b4e4e16653045d90b1e9ec31f97ee8cb4c4ab40e03" exitCode=0 Jul 07 16:31:20.010774 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:20.010413 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8xqk7p" event={"ID":"11a0dd5f-928b-40af-af7d-e6b46477d0a6","Type":"ContainerDied","Data":"fefca24fe1049cb21cae89b4e4e16653045d90b1e9ec31f97ee8cb4c4ab40e03"} Jul 07 16:31:21.148506 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:21.148484 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8xqk7p" Jul 07 16:31:21.314627 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:21.314551 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11a0dd5f-928b-40af-af7d-e6b46477d0a6-bundle\") pod \"11a0dd5f-928b-40af-af7d-e6b46477d0a6\" (UID: \"11a0dd5f-928b-40af-af7d-e6b46477d0a6\") " Jul 07 16:31:21.314627 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:21.314594 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11a0dd5f-928b-40af-af7d-e6b46477d0a6-util\") pod \"11a0dd5f-928b-40af-af7d-e6b46477d0a6\" (UID: \"11a0dd5f-928b-40af-af7d-e6b46477d0a6\") " Jul 07 16:31:21.314627 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:21.314625 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9t9j9\" (UniqueName: \"kubernetes.io/projected/11a0dd5f-928b-40af-af7d-e6b46477d0a6-kube-api-access-9t9j9\") pod \"11a0dd5f-928b-40af-af7d-e6b46477d0a6\" (UID: \"11a0dd5f-928b-40af-af7d-e6b46477d0a6\") " Jul 07 16:31:21.315189 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:21.315155 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11a0dd5f-928b-40af-af7d-e6b46477d0a6-bundle" (OuterVolumeSpecName: "bundle") pod "11a0dd5f-928b-40af-af7d-e6b46477d0a6" (UID: "11a0dd5f-928b-40af-af7d-e6b46477d0a6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:31:21.316874 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:21.316853 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11a0dd5f-928b-40af-af7d-e6b46477d0a6-kube-api-access-9t9j9" (OuterVolumeSpecName: "kube-api-access-9t9j9") pod "11a0dd5f-928b-40af-af7d-e6b46477d0a6" (UID: "11a0dd5f-928b-40af-af7d-e6b46477d0a6"). InnerVolumeSpecName "kube-api-access-9t9j9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:31:21.320392 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:21.320365 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11a0dd5f-928b-40af-af7d-e6b46477d0a6-util" (OuterVolumeSpecName: "util") pod "11a0dd5f-928b-40af-af7d-e6b46477d0a6" (UID: "11a0dd5f-928b-40af-af7d-e6b46477d0a6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:31:21.415602 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:21.415555 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11a0dd5f-928b-40af-af7d-e6b46477d0a6-bundle\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:31:21.415602 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:21.415595 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11a0dd5f-928b-40af-af7d-e6b46477d0a6-util\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:31:21.415602 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:21.415606 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9t9j9\" (UniqueName: \"kubernetes.io/projected/11a0dd5f-928b-40af-af7d-e6b46477d0a6-kube-api-access-9t9j9\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\"" Jul 07 16:31:22.022592 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:22.022556 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8xqk7p" event={"ID":"11a0dd5f-928b-40af-af7d-e6b46477d0a6","Type":"ContainerDied","Data":"a13a5c37c6a2572030305cd1d6ce1753dd6d5224b3e9aec193320d9ccab43c32"} Jul 07 16:31:22.022755 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:22.022610 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a13a5c37c6a2572030305cd1d6ce1753dd6d5224b3e9aec193320d9ccab43c32" Jul 07 16:31:22.022755 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:22.022568 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8xqk7p" Jul 07 16:31:33.537524 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:33.537458 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:31:40.385620 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:40.385585 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:31:40.486067 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:40.486039 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:31:41.359585 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:41.359548 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:31:41.430982 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:31:41.430948 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:32:13.967187 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:32:13.967151 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:32:14.132043 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:32:14.132017 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:32:20.627976 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:32:20.627943 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:32:20.763170 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:32:20.763134 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:32:20.913668 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:32:20.913574 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:32:23.816518 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:32:23.816485 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:32:23.921107 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:32:23.921078 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:32:46.337162 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:32:46.337129 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:32:55.087874 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:32:55.087836 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:32:55.807542 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:32:55.807509 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:32:56.225098 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:32:56.225070 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:32:56.329813 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:32:56.329784 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:32:56.427623 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:32:56.427584 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:32:56.492014 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:32:56.491931 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-cn9tt"] Jul 07 16:32:56.492311 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:32:56.492298 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11a0dd5f-928b-40af-af7d-e6b46477d0a6" containerName="extract" Jul 07 16:32:56.492381 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:32:56.492313 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="11a0dd5f-928b-40af-af7d-e6b46477d0a6" containerName="extract" Jul 07 16:32:56.492381 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:32:56.492321 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11a0dd5f-928b-40af-af7d-e6b46477d0a6" containerName="pull" Jul 07 16:32:56.492381 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:32:56.492326 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="11a0dd5f-928b-40af-af7d-e6b46477d0a6" containerName="pull" Jul 07 16:32:56.492381 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:32:56.492360 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11a0dd5f-928b-40af-af7d-e6b46477d0a6" containerName="util" Jul 07 16:32:56.492381 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:32:56.492366 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="11a0dd5f-928b-40af-af7d-e6b46477d0a6" containerName="util" Jul 07 16:32:56.492535 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:32:56.492423 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="11a0dd5f-928b-40af-af7d-e6b46477d0a6" containerName="extract" Jul 07 16:32:56.495418 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:32:56.495399 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-cn9tt" Jul 07 16:32:56.520866 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:32:56.520831 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 07 16:32:56.522295 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:32:56.522269 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-fhj9z\"" Jul 07 16:32:56.522420 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:32:56.522298 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 07 16:32:56.522420 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:32:56.522333 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 07 16:32:56.524694 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:32:56.524675 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-cn9tt"] Jul 07 16:32:56.541809 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:32:56.541786 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-px8m8"] Jul 07 16:32:56.609097 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:32:56.609055 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1d48e68-f240-4273-90ad-4c629f393cf3-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-cn9tt\" (UID: \"d1d48e68-f240-4273-90ad-4c629f393cf3\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-cn9tt" Jul 07 16:32:56.609320 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:32:56.609258 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkwhh\" (UniqueName: \"kubernetes.io/projected/d1d48e68-f240-4273-90ad-4c629f393cf3-kube-api-access-mkwhh\") pod \"payload-pre-processing-59f49fd4f6-cn9tt\" (UID: \"d1d48e68-f240-4273-90ad-4c629f393cf3\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-cn9tt" Jul 07 16:32:56.710418 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:32:56.710387 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1d48e68-f240-4273-90ad-4c629f393cf3-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-cn9tt\" (UID: \"d1d48e68-f240-4273-90ad-4c629f393cf3\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-cn9tt" Jul 07 16:32:56.710607 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:32:56.710441 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkwhh\" (UniqueName: \"kubernetes.io/projected/d1d48e68-f240-4273-90ad-4c629f393cf3-kube-api-access-mkwhh\") pod \"payload-pre-processing-59f49fd4f6-cn9tt\" (UID: \"d1d48e68-f240-4273-90ad-4c629f393cf3\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-cn9tt" Jul 07 16:32:56.711198 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:32:56.711178 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1d48e68-f240-4273-90ad-4c629f393cf3-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-cn9tt\" (UID: \"d1d48e68-f240-4273-90ad-4c629f393cf3\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-cn9tt" Jul 07 16:32:56.720069 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:32:56.720039 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkwhh\" (UniqueName: \"kubernetes.io/projected/d1d48e68-f240-4273-90ad-4c629f393cf3-kube-api-access-mkwhh\") pod \"payload-pre-processing-59f49fd4f6-cn9tt\" (UID: \"d1d48e68-f240-4273-90ad-4c629f393cf3\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-cn9tt" Jul 07 16:32:56.806286 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:32:56.806181 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-cn9tt" Jul 07 16:32:56.942498 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:32:56.942476 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-cn9tt"] Jul 07 16:32:56.944070 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:32:56.944042 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1d48e68_f240_4273_90ad_4c629f393cf3.slice/crio-90ec2dd13ea31c6c97dc722dbd5b4e99684c916b0134fa22b363eb2061f40839 WatchSource:0}: Error finding container 90ec2dd13ea31c6c97dc722dbd5b4e99684c916b0134fa22b363eb2061f40839: Status 404 returned error can't find the container with id 90ec2dd13ea31c6c97dc722dbd5b4e99684c916b0134fa22b363eb2061f40839 Jul 07 16:32:57.520333 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:32:57.520295 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-cn9tt" event={"ID":"d1d48e68-f240-4273-90ad-4c629f393cf3","Type":"ContainerStarted","Data":"90ec2dd13ea31c6c97dc722dbd5b4e99684c916b0134fa22b363eb2061f40839"} Jul 07 16:33:00.962668 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:33:00.962640 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4llwj_41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d/ovn-acl-logging/0.log" Jul 07 16:33:00.965082 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:33:00.963190 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4llwj_41cbeeeb-07fd-4ddc-8979-c9f6c96bfb7d/ovn-acl-logging/0.log" Jul 07 16:33:01.543298 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:33:01.543260 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-cn9tt" event={"ID":"d1d48e68-f240-4273-90ad-4c629f393cf3","Type":"ContainerStarted","Data":"2be977d8ab33dde2560e75c59bf35ac0870c0515b9abb8ea5ead4c486584446a"} Jul 07 16:33:01.543483 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:33:01.543372 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-cn9tt" Jul 07 16:33:01.565262 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:33:01.565196 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-cn9tt" podStartSLOduration=1.523451844 podStartE2EDuration="5.565182547s" totalImagesPullingTime="4.041730703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:32:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:33:01.563062786 +0000 UTC m=+601.502572209" watchObservedRunningTime="2026-07-07 16:33:01.565182547 +0000 UTC m=+601.504691969" Jul 07 16:33:08.070005 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:33:08.069963 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:33:09.469241 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:33:09.469205 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:33:12.550417 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:33:12.550386 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-cn9tt" Jul 07 16:33:25.120404 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:33:25.120321 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:33:48.237611 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:33:48.237574 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:33:48.394159 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:33:48.394124 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:33:53.135185 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:33:53.135139 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:33:53.654138 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:33:53.654103 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-px8m8"] Jul 07 16:34:05.008682 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:05.008648 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:34:05.837845 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:05.837809 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-px8m8"] Jul 07 16:34:14.513298 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:14.513259 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:34:15.576193 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:15.576155 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-px8m8"] Jul 07 16:34:20.916768 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:20.916709 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:34:22.394257 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:22.394208 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-px8m8"] Jul 07 16:34:31.795768 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:31.795735 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-djhfg"] Jul 07 16:34:31.799222 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:31.799200 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-djhfg" Jul 07 16:34:31.802223 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:31.802200 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 07 16:34:31.802457 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:31.802290 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 07 16:34:31.803913 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:31.803891 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 07 16:34:31.804032 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:31.803947 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-bkj8k\"" Jul 07 16:34:31.812833 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:31.812809 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-djhfg"] Jul 07 16:34:31.822579 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:31.822553 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:34:31.831531 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:31.831501 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abe41c31-6a8a-49ba-bb1c-8e3f60a09fe6-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-djhfg\" (UID: \"abe41c31-6a8a-49ba-bb1c-8e3f60a09fe6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-djhfg" Jul 07 16:34:31.831747 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:31.831729 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abe41c31-6a8a-49ba-bb1c-8e3f60a09fe6-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-djhfg\" (UID: \"abe41c31-6a8a-49ba-bb1c-8e3f60a09fe6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-djhfg" Jul 07 16:34:31.831874 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:31.831861 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abe41c31-6a8a-49ba-bb1c-8e3f60a09fe6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-djhfg\" (UID: \"abe41c31-6a8a-49ba-bb1c-8e3f60a09fe6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-djhfg" Jul 07 16:34:31.831968 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:31.831956 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abe41c31-6a8a-49ba-bb1c-8e3f60a09fe6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-djhfg\" (UID: \"abe41c31-6a8a-49ba-bb1c-8e3f60a09fe6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-djhfg" Jul 07 16:34:31.832102 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:31.832088 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abe41c31-6a8a-49ba-bb1c-8e3f60a09fe6-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-djhfg\" (UID: \"abe41c31-6a8a-49ba-bb1c-8e3f60a09fe6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-djhfg" Jul 07 16:34:31.832220 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:31.832206 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrnc6\" (UniqueName: \"kubernetes.io/projected/abe41c31-6a8a-49ba-bb1c-8e3f60a09fe6-kube-api-access-zrnc6\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-djhfg\" (UID: \"abe41c31-6a8a-49ba-bb1c-8e3f60a09fe6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-djhfg" Jul 07 16:34:31.933021 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:31.932984 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abe41c31-6a8a-49ba-bb1c-8e3f60a09fe6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-djhfg\" (UID: \"abe41c31-6a8a-49ba-bb1c-8e3f60a09fe6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-djhfg" Jul 07 16:34:31.933021 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:31.933020 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abe41c31-6a8a-49ba-bb1c-8e3f60a09fe6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-djhfg\" (UID: \"abe41c31-6a8a-49ba-bb1c-8e3f60a09fe6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-djhfg" Jul 07 16:34:31.933301 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:31.933062 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abe41c31-6a8a-49ba-bb1c-8e3f60a09fe6-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-djhfg\" (UID: \"abe41c31-6a8a-49ba-bb1c-8e3f60a09fe6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-djhfg" Jul 07 16:34:31.933301 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:31.933107 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrnc6\" (UniqueName: \"kubernetes.io/projected/abe41c31-6a8a-49ba-bb1c-8e3f60a09fe6-kube-api-access-zrnc6\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-djhfg\" (UID: \"abe41c31-6a8a-49ba-bb1c-8e3f60a09fe6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-djhfg" Jul 07 16:34:31.933301 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:31.933132 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abe41c31-6a8a-49ba-bb1c-8e3f60a09fe6-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-djhfg\" (UID: \"abe41c31-6a8a-49ba-bb1c-8e3f60a09fe6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-djhfg" Jul 07 16:34:31.933301 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:31.933287 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abe41c31-6a8a-49ba-bb1c-8e3f60a09fe6-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-djhfg\" (UID: \"abe41c31-6a8a-49ba-bb1c-8e3f60a09fe6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-djhfg" Jul 07 16:34:31.933520 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:31.933440 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abe41c31-6a8a-49ba-bb1c-8e3f60a09fe6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-djhfg\" (UID: \"abe41c31-6a8a-49ba-bb1c-8e3f60a09fe6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-djhfg" Jul 07 16:34:31.933570 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:31.933547 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abe41c31-6a8a-49ba-bb1c-8e3f60a09fe6-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-djhfg\" (UID: \"abe41c31-6a8a-49ba-bb1c-8e3f60a09fe6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-djhfg" Jul 07 16:34:31.933642 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:31.933624 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abe41c31-6a8a-49ba-bb1c-8e3f60a09fe6-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-djhfg\" (UID: \"abe41c31-6a8a-49ba-bb1c-8e3f60a09fe6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-djhfg" Jul 07 16:34:31.935517 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:31.935493 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abe41c31-6a8a-49ba-bb1c-8e3f60a09fe6-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-djhfg\" (UID: \"abe41c31-6a8a-49ba-bb1c-8e3f60a09fe6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-djhfg" Jul 07 16:34:31.935851 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:31.935829 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abe41c31-6a8a-49ba-bb1c-8e3f60a09fe6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-djhfg\" (UID: \"abe41c31-6a8a-49ba-bb1c-8e3f60a09fe6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-djhfg" Jul 07 16:34:31.941521 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:31.941500 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrnc6\" (UniqueName: \"kubernetes.io/projected/abe41c31-6a8a-49ba-bb1c-8e3f60a09fe6-kube-api-access-zrnc6\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-djhfg\" (UID: \"abe41c31-6a8a-49ba-bb1c-8e3f60a09fe6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-djhfg" Jul 07 16:34:32.111823 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:32.111735 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-djhfg" Jul 07 16:34:32.252582 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:32.252553 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-djhfg"] Jul 07 16:34:32.253944 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:34:32.253914 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabe41c31_6a8a_49ba_bb1c_8e3f60a09fe6.slice/crio-1274c405b2432edadbdc31e549ec803d29c549969586453f1bad762b0e6ade9c WatchSource:0}: Error finding container 1274c405b2432edadbdc31e549ec803d29c549969586453f1bad762b0e6ade9c: Status 404 returned error can't find the container with id 1274c405b2432edadbdc31e549ec803d29c549969586453f1bad762b0e6ade9c Jul 07 16:34:32.255337 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:32.255316 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 16:34:33.052733 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:33.052694 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-djhfg" event={"ID":"abe41c31-6a8a-49ba-bb1c-8e3f60a09fe6","Type":"ContainerStarted","Data":"1274c405b2432edadbdc31e549ec803d29c549969586453f1bad762b0e6ade9c"} Jul 07 16:34:34.038683 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:34.038648 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-px8m8"] Jul 07 16:34:34.059827 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:34.059789 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-djhfg" event={"ID":"abe41c31-6a8a-49ba-bb1c-8e3f60a09fe6","Type":"ContainerStarted","Data":"f1db9c758be782f4ef66f07b21edb27c084ce20edc49265ea0ca3e9e0e30a8ae"} Jul 07 16:34:34.086466 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:34.086421 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-djhfg" podStartSLOduration=2.010340022 podStartE2EDuration="3.08640692s" totalImagesPullingTime="1.076066898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:34:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:34:34.083432858 +0000 UTC m=+694.022942283" watchObservedRunningTime="2026-07-07 16:34:34.08640692 +0000 UTC m=+694.025916343" Jul 07 16:34:37.964346 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:37.964314 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98"] Jul 07 16:34:37.968116 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:37.968100 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98" Jul 07 16:34:37.971003 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:37.970982 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 07 16:34:37.976524 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:37.976504 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98"] Jul 07 16:34:37.986566 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:37.986544 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/25ea0c54-4682-429f-9c96-8a64438a6458-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98\" (UID: \"25ea0c54-4682-429f-9c96-8a64438a6458\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98" Jul 07 16:34:37.986658 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:37.986601 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/25ea0c54-4682-429f-9c96-8a64438a6458-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98\" (UID: \"25ea0c54-4682-429f-9c96-8a64438a6458\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98" Jul 07 16:34:37.986658 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:37.986631 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25ea0c54-4682-429f-9c96-8a64438a6458-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98\" (UID: \"25ea0c54-4682-429f-9c96-8a64438a6458\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98" Jul 07 16:34:37.986658 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:37.986648 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4czh\" (UniqueName: \"kubernetes.io/projected/25ea0c54-4682-429f-9c96-8a64438a6458-kube-api-access-r4czh\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98\" (UID: \"25ea0c54-4682-429f-9c96-8a64438a6458\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98" Jul 07 16:34:37.986763 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:37.986675 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25ea0c54-4682-429f-9c96-8a64438a6458-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98\" (UID: \"25ea0c54-4682-429f-9c96-8a64438a6458\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98" Jul 07 16:34:37.986810 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:37.986785 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/25ea0c54-4682-429f-9c96-8a64438a6458-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98\" (UID: \"25ea0c54-4682-429f-9c96-8a64438a6458\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98" Jul 07 16:34:38.075976 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:38.075935 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:34:38.087862 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:38.087833 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/25ea0c54-4682-429f-9c96-8a64438a6458-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98\" (UID: \"25ea0c54-4682-429f-9c96-8a64438a6458\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98" Jul 07 16:34:38.088036 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:38.087902 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/25ea0c54-4682-429f-9c96-8a64438a6458-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98\" (UID: \"25ea0c54-4682-429f-9c96-8a64438a6458\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98" Jul 07 16:34:38.088036 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:38.087942 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/25ea0c54-4682-429f-9c96-8a64438a6458-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98\" (UID: \"25ea0c54-4682-429f-9c96-8a64438a6458\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98" Jul 07 16:34:38.088036 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:38.087976 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25ea0c54-4682-429f-9c96-8a64438a6458-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98\" (UID: \"25ea0c54-4682-429f-9c96-8a64438a6458\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98" Jul 07 16:34:38.088036 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:38.088000 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4czh\" (UniqueName: \"kubernetes.io/projected/25ea0c54-4682-429f-9c96-8a64438a6458-kube-api-access-r4czh\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98\" (UID: \"25ea0c54-4682-429f-9c96-8a64438a6458\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98" Jul 07 16:34:38.088036 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:38.088035 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25ea0c54-4682-429f-9c96-8a64438a6458-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98\" (UID: \"25ea0c54-4682-429f-9c96-8a64438a6458\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98" Jul 07 16:34:38.088393 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:38.088350 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/25ea0c54-4682-429f-9c96-8a64438a6458-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98\" (UID: \"25ea0c54-4682-429f-9c96-8a64438a6458\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98" Jul 07 16:34:38.088484 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:38.088393 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/25ea0c54-4682-429f-9c96-8a64438a6458-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98\" (UID: \"25ea0c54-4682-429f-9c96-8a64438a6458\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98" Jul 07 16:34:38.088484 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:38.088414 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25ea0c54-4682-429f-9c96-8a64438a6458-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98\" (UID: \"25ea0c54-4682-429f-9c96-8a64438a6458\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98" Jul 07 16:34:38.090250 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:38.090213 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/25ea0c54-4682-429f-9c96-8a64438a6458-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98\" (UID: \"25ea0c54-4682-429f-9c96-8a64438a6458\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98" Jul 07 16:34:38.090505 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:38.090486 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25ea0c54-4682-429f-9c96-8a64438a6458-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98\" (UID: \"25ea0c54-4682-429f-9c96-8a64438a6458\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98" Jul 07 16:34:38.096733 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:38.096715 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4czh\" (UniqueName: \"kubernetes.io/projected/25ea0c54-4682-429f-9c96-8a64438a6458-kube-api-access-r4czh\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98\" (UID: \"25ea0c54-4682-429f-9c96-8a64438a6458\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98" Jul 07 16:34:38.277846 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:38.277761 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98" Jul 07 16:34:38.435977 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:38.435946 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98"] Jul 07 16:34:38.437694 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:34:38.437666 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod25ea0c54_4682_429f_9c96_8a64438a6458.slice/crio-a266f900c68cc9f29563c0505a3614c57db65bdad2895eab7d1e45049432eb77 WatchSource:0}: Error finding container a266f900c68cc9f29563c0505a3614c57db65bdad2895eab7d1e45049432eb77: Status 404 returned error can't find the container with id a266f900c68cc9f29563c0505a3614c57db65bdad2895eab7d1e45049432eb77 Jul 07 16:34:39.087284 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:39.087169 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98" event={"ID":"25ea0c54-4682-429f-9c96-8a64438a6458","Type":"ContainerStarted","Data":"38744086622d770cc16b614e0fb35a6e050fd5422083912c5213a57e67236b21"} Jul 07 16:34:39.087284 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:39.087216 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98" event={"ID":"25ea0c54-4682-429f-9c96-8a64438a6458","Type":"ContainerStarted","Data":"a266f900c68cc9f29563c0505a3614c57db65bdad2895eab7d1e45049432eb77"} Jul 07 16:34:42.112261 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:42.112199 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-djhfg" Jul 07 16:34:42.112738 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:42.112290 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-djhfg" Jul 07 16:34:42.126092 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:42.126070 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-djhfg" Jul 07 16:34:42.156963 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:42.156908 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98" podStartSLOduration=4.970588892 podStartE2EDuration="5.156892789s" totalImagesPullingTime="186.303897ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:34:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:34:39.132436321 +0000 UTC m=+699.071945744" watchObservedRunningTime="2026-07-07 16:34:42.156892789 +0000 UTC m=+702.096402226" Jul 07 16:34:43.120619 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:43.120586 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-djhfg" Jul 07 16:34:45.087677 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:45.087641 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-px8m8"] Jul 07 16:34:48.277937 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:48.277896 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98" Jul 07 16:34:48.278369 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:48.277951 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98" Jul 07 16:34:48.290465 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:48.290443 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98" Jul 07 16:34:49.154082 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:34:49.154048 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98" Jul 07 16:35:19.072544 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:35:19.072510 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:35:29.098036 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:35:29.098000 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:35:29.194943 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:35:29.194905 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:35:30.381185 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:35:30.381136 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:35:30.472678 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:35:30.472640 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:35:38.636673 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:35:38.636640 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:35:38.737273 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:35:38.737212 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:09.131002 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:09.130966 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:09.192205 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:09.192177 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:44.576819 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:44.576748 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-6lszr_c98a92d5-8504-4bd4-a8d3-8019ee45d39b/manager/0.log" Jul 07 16:36:45.575753 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:45.575728 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7_5a50c784-3e75-4dcf-86e3-a4d0d8c4ee06/copy-manifests/0.log" Jul 07 16:36:45.585899 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:45.585874 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7_5a50c784-3e75-4dcf-86e3-a4d0d8c4ee06/manager/0.log" Jul 07 16:36:46.574317 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:46.574287 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vqnqh_63b770d3-837f-4579-974a-d56352404f1d/util/0.log" Jul 07 16:36:46.586690 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:46.586669 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vqnqh_63b770d3-837f-4579-974a-d56352404f1d/pull/0.log" Jul 07 16:36:46.594794 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:46.594775 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vqnqh_63b770d3-837f-4579-974a-d56352404f1d/extract/0.log" Jul 07 16:36:46.715504 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:46.715479 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qfr4r_ec4a634e-1f72-4660-a040-f507cd6da3d2/util/0.log" Jul 07 16:36:46.726464 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:46.726438 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qfr4r_ec4a634e-1f72-4660-a040-f507cd6da3d2/pull/0.log" Jul 07 16:36:46.734484 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:46.734462 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qfr4r_ec4a634e-1f72-4660-a040-f507cd6da3d2/extract/0.log" Jul 07 16:36:46.864065 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:46.864030 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsltg_89f11e74-4d0f-4ade-a6eb-b4b0367c5395/util/0.log" Jul 07 16:36:46.873216 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:46.873193 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsltg_89f11e74-4d0f-4ade-a6eb-b4b0367c5395/pull/0.log" Jul 07 16:36:46.881505 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:46.881483 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsltg_89f11e74-4d0f-4ade-a6eb-b4b0367c5395/extract/0.log" Jul 07 16:36:47.020724 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:47.020694 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mt9hs_1ae378db-3639-4ff3-a042-c04d465d2bcd/util/0.log" Jul 07 16:36:47.042211 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:47.042182 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mt9hs_1ae378db-3639-4ff3-a042-c04d465d2bcd/pull/0.log" Jul 07 16:36:47.053351 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:47.053335 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mt9hs_1ae378db-3639-4ff3-a042-c04d465d2bcd/extract/0.log" Jul 07 16:36:47.330149 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:47.330076 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-nhxcd_cfb97d67-643a-4a19-8ebe-553ea14d5e52/manager/0.log" Jul 07 16:36:47.399716 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:47.399679 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:47.459196 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:47.459163 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-njncp_a9f7efcc-5826-4777-98ac-1c40563f1d29/manager/0.log" Jul 07 16:36:47.577853 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:47.577825 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:47.718303 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:47.718279 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-75k4x_4f5c9111-48bb-4c66-bbe0-d5f899526af5/registry-server/0.log" Jul 07 16:36:47.858821 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:47.858791 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-ldh8q_da18393b-92af-450b-aea0-c78121277b3d/manager/0.log" Jul 07 16:36:47.997413 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:47.997334 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-px8m8_0330448b-3c28-48b2-a19c-22fe57b39ef4/limitador/0.log" Jul 07 16:36:48.125346 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:48.125321 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-jcxk7_756e72da-5228-4d70-b757-7f6f5c8d1060/manager/0.log" Jul 07 16:36:49.122862 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:49.122833 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-cn9tt_d1d48e68-f240-4273-90ad-4c629f393cf3/payload-pre-processing/0.log" Jul 07 16:36:50.298841 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:50.298814 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-djhfg_abe41c31-6a8a-49ba-bb1c-8e3f60a09fe6/main/0.log" Jul 07 16:36:50.435681 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:50.435651 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-b9x98_25ea0c54-4682-429f-9c96-8a64438a6458/main/0.log" Jul 07 16:36:54.823282 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:54.823251 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-t6vzc/must-gather-b2v8h"] Jul 07 16:36:54.826718 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:54.826700 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t6vzc/must-gather-b2v8h" Jul 07 16:36:54.829989 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:54.829965 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t6vzc\"/\"kube-root-ca.crt\"" Jul 07 16:36:54.830100 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:54.830024 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-t6vzc\"/\"default-dockercfg-pzc5s\"" Jul 07 16:36:54.830100 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:54.830067 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t6vzc\"/\"openshift-service-ca.crt\"" Jul 07 16:36:54.838121 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:54.838099 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t6vzc/must-gather-b2v8h"] Jul 07 16:36:54.860315 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:54.860284 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:54.912825 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:54.912795 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7cb66c3d-e175-44af-8665-dd7e092af913-must-gather-output\") pod \"must-gather-b2v8h\" (UID: \"7cb66c3d-e175-44af-8665-dd7e092af913\") " pod="openshift-must-gather-t6vzc/must-gather-b2v8h" Jul 07 16:36:54.912959 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:54.912831 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnkzd\" (UniqueName: \"kubernetes.io/projected/7cb66c3d-e175-44af-8665-dd7e092af913-kube-api-access-jnkzd\") pod \"must-gather-b2v8h\" (UID: \"7cb66c3d-e175-44af-8665-dd7e092af913\") " pod="openshift-must-gather-t6vzc/must-gather-b2v8h" Jul 07 16:36:54.958899 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:54.958870 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:55.013872 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:55.013838 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7cb66c3d-e175-44af-8665-dd7e092af913-must-gather-output\") pod \"must-gather-b2v8h\" (UID: \"7cb66c3d-e175-44af-8665-dd7e092af913\") " pod="openshift-must-gather-t6vzc/must-gather-b2v8h" Jul 07 16:36:55.014009 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:55.013885 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnkzd\" (UniqueName: \"kubernetes.io/projected/7cb66c3d-e175-44af-8665-dd7e092af913-kube-api-access-jnkzd\") pod \"must-gather-b2v8h\" (UID: \"7cb66c3d-e175-44af-8665-dd7e092af913\") " pod="openshift-must-gather-t6vzc/must-gather-b2v8h" Jul 07 16:36:55.014185 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:55.014169 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7cb66c3d-e175-44af-8665-dd7e092af913-must-gather-output\") pod \"must-gather-b2v8h\" (UID: \"7cb66c3d-e175-44af-8665-dd7e092af913\") " pod="openshift-must-gather-t6vzc/must-gather-b2v8h" Jul 07 16:36:55.029504 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:55.029479 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnkzd\" (UniqueName: \"kubernetes.io/projected/7cb66c3d-e175-44af-8665-dd7e092af913-kube-api-access-jnkzd\") pod \"must-gather-b2v8h\" (UID: \"7cb66c3d-e175-44af-8665-dd7e092af913\") " pod="openshift-must-gather-t6vzc/must-gather-b2v8h" Jul 07 16:36:55.136374 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:55.136340 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t6vzc/must-gather-b2v8h" Jul 07 16:36:55.274987 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:55.274963 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t6vzc/must-gather-b2v8h"] Jul 07 16:36:55.277609 ip-10-0-142-239 kubenswrapper[2564]: W0707 16:36:55.277579 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7cb66c3d_e175_44af_8665_dd7e092af913.slice/crio-f7a282379b907f70644a6a915b9dca3a8dbf16083ad70a40bbd215b2114f6be3 WatchSource:0}: Error finding container f7a282379b907f70644a6a915b9dca3a8dbf16083ad70a40bbd215b2114f6be3: Status 404 returned error can't find the container with id f7a282379b907f70644a6a915b9dca3a8dbf16083ad70a40bbd215b2114f6be3 Jul 07 16:36:55.836470 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:55.836433 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t6vzc/must-gather-b2v8h" event={"ID":"7cb66c3d-e175-44af-8665-dd7e092af913","Type":"ContainerStarted","Data":"f7a282379b907f70644a6a915b9dca3a8dbf16083ad70a40bbd215b2114f6be3"} Jul 07 16:36:56.847987 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:56.847940 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t6vzc/must-gather-b2v8h" event={"ID":"7cb66c3d-e175-44af-8665-dd7e092af913","Type":"ContainerStarted","Data":"930dec2c06ee4679918cc42e5ffe83bdeb2a89ebd54aa2bb2b597c2707fb8a80"} Jul 07 16:36:56.848444 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:56.848000 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t6vzc/must-gather-b2v8h" event={"ID":"7cb66c3d-e175-44af-8665-dd7e092af913","Type":"ContainerStarted","Data":"9e549321270894fb44887ac47fdf10f294c802cef2febe88420d3b0b24efefa8"} Jul 07 16:36:56.883434 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:56.883362 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-t6vzc/must-gather-b2v8h" podStartSLOduration=2.142708684 podStartE2EDuration="2.883338924s" totalImagesPullingTime="740.63024ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:36:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:36:56.880267345 +0000 UTC m=+836.819776769" watchObservedRunningTime="2026-07-07 16:36:56.883338924 +0000 UTC m=+836.822848348" Jul 07 16:36:58.066809 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:58.066777 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5s79k_dc1cd2ef-cb98-430b-bdee-883a3129c2af/global-pull-secret-syncer/0.log" Jul 07 16:36:58.285657 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:58.285626 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dzl6r_7262abd9-903a-4ecc-aece-7ede44afecf7/konnectivity-agent/0.log" Jul 07 16:36:58.521744 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:36:58.521712 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-239.ec2.internal_4171bb48f6e62864b15f6dcc9fa0fe2a/haproxy/0.log" Jul 07 16:37:02.202982 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:02.202939 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vqnqh_63b770d3-837f-4579-974a-d56352404f1d/extract/0.log" Jul 07 16:37:02.254074 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:02.254043 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vqnqh_63b770d3-837f-4579-974a-d56352404f1d/util/0.log" Jul 07 16:37:02.300403 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:02.300376 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vqnqh_63b770d3-837f-4579-974a-d56352404f1d/pull/0.log" Jul 07 16:37:02.361101 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:02.361067 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qfr4r_ec4a634e-1f72-4660-a040-f507cd6da3d2/extract/0.log" Jul 07 16:37:02.399753 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:02.399719 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qfr4r_ec4a634e-1f72-4660-a040-f507cd6da3d2/util/0.log" Jul 07 16:37:02.443276 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:02.443215 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qfr4r_ec4a634e-1f72-4660-a040-f507cd6da3d2/pull/0.log" Jul 07 16:37:02.480940 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:02.480854 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsltg_89f11e74-4d0f-4ade-a6eb-b4b0367c5395/extract/0.log" Jul 07 16:37:02.521781 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:02.521746 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsltg_89f11e74-4d0f-4ade-a6eb-b4b0367c5395/util/0.log" Jul 07 16:37:02.556114 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:02.556062 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsltg_89f11e74-4d0f-4ade-a6eb-b4b0367c5395/pull/0.log" Jul 07 16:37:02.598200 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:02.598166 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mt9hs_1ae378db-3639-4ff3-a042-c04d465d2bcd/extract/0.log" Jul 07 16:37:02.642125 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:02.642044 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mt9hs_1ae378db-3639-4ff3-a042-c04d465d2bcd/util/0.log" Jul 07 16:37:02.687777 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:02.687739 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mt9hs_1ae378db-3639-4ff3-a042-c04d465d2bcd/pull/0.log" Jul 07 16:37:03.145053 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:03.145022 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-nhxcd_cfb97d67-643a-4a19-8ebe-553ea14d5e52/manager/0.log" Jul 07 16:37:03.202605 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:03.202572 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-njncp_a9f7efcc-5826-4777-98ac-1c40563f1d29/manager/0.log" Jul 07 16:37:03.379714 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:03.379684 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-75k4x_4f5c9111-48bb-4c66-bbe0-d5f899526af5/registry-server/0.log" Jul 07 16:37:03.445027 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:03.444937 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-ldh8q_da18393b-92af-450b-aea0-c78121277b3d/manager/0.log" Jul 07 16:37:03.493891 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:03.493858 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-px8m8_0330448b-3c28-48b2-a19c-22fe57b39ef4/limitador/0.log" Jul 07 16:37:03.534081 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:03.534052 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-jcxk7_756e72da-5228-4d70-b757-7f6f5c8d1060/manager/0.log" Jul 07 16:37:05.715969 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:05.715933 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-zlgst_f3f99d3e-e147-4dde-82ac-617ac7ce6e6f/kube-state-metrics/0.log" Jul 07 16:37:05.745392 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:05.745355 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-zlgst_f3f99d3e-e147-4dde-82ac-617ac7ce6e6f/kube-rbac-proxy-main/0.log" Jul 07 16:37:05.781150 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:05.781094 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-zlgst_f3f99d3e-e147-4dde-82ac-617ac7ce6e6f/kube-rbac-proxy-self/0.log" Jul 07 16:37:05.873648 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:05.873622 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-867n2_559610cb-6966-45f8-9fb2-f6ab147684d9/monitoring-plugin/0.log" Jul 07 16:37:05.920784 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:05.920732 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6mtx9_f662cb89-c9b0-42d3-8dad-8e2633b887af/node-exporter/0.log" Jul 07 16:37:05.951835 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:05.951790 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6mtx9_f662cb89-c9b0-42d3-8dad-8e2633b887af/kube-rbac-proxy/0.log" Jul 07 16:37:05.988728 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:05.988639 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6mtx9_f662cb89-c9b0-42d3-8dad-8e2633b887af/init-textfile/0.log" Jul 07 16:37:06.255701 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:06.255625 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-c59xv_3fa407f5-fab3-4910-92f0-7b3f2a23e5fa/kube-rbac-proxy-main/0.log" Jul 07 16:37:06.288422 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:06.288392 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-c59xv_3fa407f5-fab3-4910-92f0-7b3f2a23e5fa/kube-rbac-proxy-self/0.log" Jul 07 16:37:06.334958 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:06.334918 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-c59xv_3fa407f5-fab3-4910-92f0-7b3f2a23e5fa/openshift-state-metrics/0.log" Jul 07 16:37:06.612920 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:06.612891 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-v98dg_63df574d-5c54-4219-9448-dab8a2ef9229/prometheus-operator/0.log" Jul 07 16:37:06.639997 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:06.639972 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-v98dg_63df574d-5c54-4219-9448-dab8a2ef9229/kube-rbac-proxy/0.log" Jul 07 16:37:06.825104 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:06.825059 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6474d5975b-pqtfr_9ba005fe-7732-4167-81ca-6f6859cb137d/thanos-query/0.log" Jul 07 16:37:06.853114 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:06.853076 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6474d5975b-pqtfr_9ba005fe-7732-4167-81ca-6f6859cb137d/kube-rbac-proxy-web/0.log" Jul 07 16:37:06.880349 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:06.880258 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6474d5975b-pqtfr_9ba005fe-7732-4167-81ca-6f6859cb137d/kube-rbac-proxy/0.log" Jul 07 16:37:06.909094 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:06.909067 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6474d5975b-pqtfr_9ba005fe-7732-4167-81ca-6f6859cb137d/prom-label-proxy/0.log" Jul 07 16:37:06.936600 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:06.936575 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6474d5975b-pqtfr_9ba005fe-7732-4167-81ca-6f6859cb137d/kube-rbac-proxy-rules/0.log" Jul 07 16:37:06.968687 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:06.968651 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6474d5975b-pqtfr_9ba005fe-7732-4167-81ca-6f6859cb137d/kube-rbac-proxy-metrics/0.log" Jul 07 16:37:07.790211 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:07.790178 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-t6vzc/perf-node-gather-daemonset-zvpld"] Jul 07 16:37:07.797045 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:07.797014 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-zvpld" Jul 07 16:37:07.815310 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:07.815277 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t6vzc/perf-node-gather-daemonset-zvpld"] Jul 07 16:37:07.963021 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:07.962982 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/45e393b9-a3a0-4df9-aea3-905d81efd5ec-proc\") pod \"perf-node-gather-daemonset-zvpld\" (UID: \"45e393b9-a3a0-4df9-aea3-905d81efd5ec\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-zvpld" Jul 07 16:37:07.963524 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:07.963047 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/45e393b9-a3a0-4df9-aea3-905d81efd5ec-lib-modules\") pod \"perf-node-gather-daemonset-zvpld\" (UID: \"45e393b9-a3a0-4df9-aea3-905d81efd5ec\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-zvpld" Jul 07 16:37:07.963524 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:07.963098 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/45e393b9-a3a0-4df9-aea3-905d81efd5ec-podres\") pod \"perf-node-gather-daemonset-zvpld\" (UID: \"45e393b9-a3a0-4df9-aea3-905d81efd5ec\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-zvpld" Jul 07 16:37:07.963524 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:07.963140 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrz4x\" (UniqueName: \"kubernetes.io/projected/45e393b9-a3a0-4df9-aea3-905d81efd5ec-kube-api-access-lrz4x\") pod \"perf-node-gather-daemonset-zvpld\" (UID: \"45e393b9-a3a0-4df9-aea3-905d81efd5ec\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-zvpld" Jul 07 16:37:07.963524 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:07.963213 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/45e393b9-a3a0-4df9-aea3-905d81efd5ec-sys\") pod \"perf-node-gather-daemonset-zvpld\" (UID: \"45e393b9-a3a0-4df9-aea3-905d81efd5ec\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-zvpld" Jul 07 16:37:08.064023 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:08.063915 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/45e393b9-a3a0-4df9-aea3-905d81efd5ec-proc\") pod \"perf-node-gather-daemonset-zvpld\" (UID: \"45e393b9-a3a0-4df9-aea3-905d81efd5ec\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-zvpld" Jul 07 16:37:08.064023 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:08.063983 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/45e393b9-a3a0-4df9-aea3-905d81efd5ec-lib-modules\") pod \"perf-node-gather-daemonset-zvpld\" (UID: \"45e393b9-a3a0-4df9-aea3-905d81efd5ec\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-zvpld" Jul 07 16:37:08.064304 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:08.064031 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/45e393b9-a3a0-4df9-aea3-905d81efd5ec-podres\") pod \"perf-node-gather-daemonset-zvpld\" (UID: \"45e393b9-a3a0-4df9-aea3-905d81efd5ec\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-zvpld" Jul 07 16:37:08.064304 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:08.064071 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrz4x\" (UniqueName: \"kubernetes.io/projected/45e393b9-a3a0-4df9-aea3-905d81efd5ec-kube-api-access-lrz4x\") pod \"perf-node-gather-daemonset-zvpld\" (UID: \"45e393b9-a3a0-4df9-aea3-905d81efd5ec\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-zvpld" Jul 07 16:37:08.064304 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:08.064140 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/45e393b9-a3a0-4df9-aea3-905d81efd5ec-sys\") pod \"perf-node-gather-daemonset-zvpld\" (UID: \"45e393b9-a3a0-4df9-aea3-905d81efd5ec\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-zvpld" Jul 07 16:37:08.064304 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:08.064274 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/45e393b9-a3a0-4df9-aea3-905d81efd5ec-sys\") pod \"perf-node-gather-daemonset-zvpld\" (UID: \"45e393b9-a3a0-4df9-aea3-905d81efd5ec\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-zvpld" Jul 07 16:37:08.064529 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:08.064331 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/45e393b9-a3a0-4df9-aea3-905d81efd5ec-proc\") pod \"perf-node-gather-daemonset-zvpld\" (UID: \"45e393b9-a3a0-4df9-aea3-905d81efd5ec\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-zvpld" Jul 07 16:37:08.064529 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:08.064438 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/45e393b9-a3a0-4df9-aea3-905d81efd5ec-lib-modules\") pod \"perf-node-gather-daemonset-zvpld\" (UID: \"45e393b9-a3a0-4df9-aea3-905d81efd5ec\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-zvpld" Jul 07 16:37:08.064529 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:08.064500 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/45e393b9-a3a0-4df9-aea3-905d81efd5ec-podres\") pod \"perf-node-gather-daemonset-zvpld\" (UID: \"45e393b9-a3a0-4df9-aea3-905d81efd5ec\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-zvpld" Jul 07 16:37:08.081281 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:08.081247 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrz4x\" (UniqueName: \"kubernetes.io/projected/45e393b9-a3a0-4df9-aea3-905d81efd5ec-kube-api-access-lrz4x\") pod \"perf-node-gather-daemonset-zvpld\" (UID: \"45e393b9-a3a0-4df9-aea3-905d81efd5ec\") " pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-zvpld" Jul 07 16:37:08.109950 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:08.109917 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-zvpld" Jul 07 16:37:08.313308 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:08.313272 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t6vzc/perf-node-gather-daemonset-zvpld"] Jul 07 16:37:08.948288 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:08.948245 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-zvpld" event={"ID":"45e393b9-a3a0-4df9-aea3-905d81efd5ec","Type":"ContainerStarted","Data":"f57bc6fb30103c717ce406c289bd14a6881510346d59967201a5130a44e83dfc"} Jul 07 16:37:08.948597 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:08.948556 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-zvpld" event={"ID":"45e393b9-a3a0-4df9-aea3-905d81efd5ec","Type":"ContainerStarted","Data":"57a2e503655ef6ef3f9c41d7b6ac5aaf6af43ead8bf35082723accc1afc6c909"} Jul 07 16:37:08.948979 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:08.948961 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-zvpld" Jul 07 16:37:08.983709 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:08.983652 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-zvpld" podStartSLOduration=1.983629377 podStartE2EDuration="1.983629377s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:37:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:37:08.982415076 +0000 UTC m=+848.921924500" watchObservedRunningTime="2026-07-07 16:37:08.983629377 +0000 UTC m=+848.923138801" Jul 07 16:37:09.508770 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:09.508733 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5dc4479dbb-ftlrr_8b677416-0084-4e0d-916e-cd24fc37235f/console/0.log" Jul 07 16:37:11.543281 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:11.543257 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r2plv_d53c196e-73f3-4146-b810-ef3c741a3ac6/dns/0.log" Jul 07 16:37:11.571630 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:11.571605 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r2plv_d53c196e-73f3-4146-b810-ef3c741a3ac6/kube-rbac-proxy/0.log" Jul 07 16:37:11.676687 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:11.676661 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-stndg_37491c06-836e-4547-b86c-de4dcf91a433/dns-node-resolver/0.log" Jul 07 16:37:12.349958 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:12.349930 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dmrqb_0a4b79ff-9d4c-44d6-b582-ee10d09e9bbc/node-ca/0.log" Jul 07 16:37:13.780758 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:13.780726 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-cn9tt_d1d48e68-f240-4273-90ad-4c629f393cf3/payload-pre-processing/0.log" Jul 07 16:37:14.574089 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:14.574063 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nf9t6_2e23de48-ba48-4eff-ade3-05b1e1661633/serve-healthcheck-canary/0.log" Jul 07 16:37:14.969804 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:14.969775 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-t6vzc/perf-node-gather-daemonset-zvpld" Jul 07 16:37:15.402655 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:15.402629 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nxh4s_c22c4cf0-c358-4ab6-bee3-1fd64c11f646/kube-rbac-proxy/0.log" Jul 07 16:37:15.436698 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:15.436674 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nxh4s_c22c4cf0-c358-4ab6-bee3-1fd64c11f646/exporter/0.log" Jul 07 16:37:15.473191 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:15.473161 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nxh4s_c22c4cf0-c358-4ab6-bee3-1fd64c11f646/extractor/0.log" Jul 07 16:37:18.203468 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:18.203440 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-6lszr_c98a92d5-8504-4bd4-a8d3-8019ee45d39b/manager/0.log" Jul 07 16:37:18.547949 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:18.547922 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7_5a50c784-3e75-4dcf-86e3-a4d0d8c4ee06/manager/0.log" Jul 07 16:37:18.579300 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:18.579273 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b65b5fdbc-lrwz7_5a50c784-3e75-4dcf-86e3-a4d0d8c4ee06/copy-manifests/0.log" Jul 07 16:37:18.790030 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:18.789991 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-cn9tt_d1d48e68-f240-4273-90ad-4c629f393cf3/payload-pre-processing/0.log" Jul 07 16:37:20.194004 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:20.193926 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-96844494c-kczjw_b5b84c31-7f77-4f0f-a4c4-709936ceda48/manager/0.log" Jul 07 16:37:20.231693 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:20.231664 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-lztgh_1212eff6-6c57-4936-adee-b75c5dbc7a37/openshift-lws-operator/0.log" Jul 07 16:37:20.251654 ip-10-0-142-239 kubenswrapper[2564]: I0707 16:37:20.251629 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-cn9tt_d1d48e68-f240-4273-90ad-4c629f393cf3/payload-pre-processing/0.log"