Jul 09 13:47:52.421158 ip-10-0-143-92 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 09 13:47:52.421169 ip-10-0-143-92 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 09 13:47:52.421176 ip-10-0-143-92 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 09 13:47:52.421388 ip-10-0-143-92 systemd[1]: Failed to start Kubernetes Kubelet. Jul 09 13:48:02.346142 ip-10-0-143-92 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jul 09 13:48:02.346159 ip-10-0-143-92 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 9f906e0a40504dd5aeb440934fae3b6c -- Jul 09 13:49:33.282103 ip-10-0-143-92 systemd[1]: Starting Kubernetes Kubelet... Jul 09 13:49:33.719259 ip-10-0-143-92 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 13:49:33.719259 ip-10-0-143-92 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 13:49:33.719259 ip-10-0-143-92 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 13:49:33.719259 ip-10-0-143-92 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 13:49:33.719259 ip-10-0-143-92 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 13:49:33.720264 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.720150 2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 13:49:33.726481 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726463 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 13:49:33.726524 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726482 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 13:49:33.726524 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726486 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 13:49:33.726524 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726489 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 13:49:33.726524 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726493 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 13:49:33.726524 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726496 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 13:49:33.726524 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726498 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 13:49:33.726524 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726501 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 13:49:33.726524 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726504 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 13:49:33.726524 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726507 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 13:49:33.726524 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726510 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 13:49:33.726524 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726513 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 13:49:33.726524 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726515 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 13:49:33.726524 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726518 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 13:49:33.726524 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726520 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 13:49:33.726524 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726523 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 13:49:33.726524 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726526 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 13:49:33.726524 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726529 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 13:49:33.726524 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726532 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 13:49:33.726973 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726540 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 13:49:33.726973 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726543 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 13:49:33.726973 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726546 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 13:49:33.726973 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726549 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 13:49:33.726973 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726551 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 13:49:33.726973 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726554 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 13:49:33.726973 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726556 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 13:49:33.726973 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726558 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 13:49:33.726973 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726561 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 13:49:33.726973 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726563 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 13:49:33.726973 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726566 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 13:49:33.726973 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726568 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 13:49:33.726973 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726571 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 13:49:33.726973 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726573 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 13:49:33.726973 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726576 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 13:49:33.726973 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726579 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 13:49:33.726973 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726581 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 13:49:33.726973 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726584 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 13:49:33.726973 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726586 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 13:49:33.727425 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726591 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 13:49:33.727425 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726594 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 13:49:33.727425 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726598 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 13:49:33.727425 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726600 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 13:49:33.727425 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726603 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 13:49:33.727425 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726607 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 13:49:33.727425 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726611 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 13:49:33.727425 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726613 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 13:49:33.727425 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726615 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 13:49:33.727425 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726618 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 13:49:33.727425 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726621 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 13:49:33.727425 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726623 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 13:49:33.727425 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726625 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 13:49:33.727425 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726628 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 13:49:33.727425 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726631 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 13:49:33.727425 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726634 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 13:49:33.727425 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726636 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 13:49:33.727425 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726639 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 13:49:33.727425 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726641 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 13:49:33.727904 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726644 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 13:49:33.727904 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726647 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 09 13:49:33.727904 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726649 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 13:49:33.727904 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726651 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 13:49:33.727904 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726654 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 13:49:33.727904 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726656 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 13:49:33.727904 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726658 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 13:49:33.727904 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726661 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 13:49:33.727904 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726664 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 13:49:33.727904 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726673 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 13:49:33.727904 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726676 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 13:49:33.727904 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726678 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 13:49:33.727904 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726681 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 13:49:33.727904 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726683 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 13:49:33.727904 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726686 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 13:49:33.727904 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726689 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 13:49:33.727904 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726691 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 13:49:33.727904 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726694 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 13:49:33.727904 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726697 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 13:49:33.727904 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726699 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 13:49:33.728387 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726702 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 13:49:33.728387 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726704 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 13:49:33.728387 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726707 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 13:49:33.728387 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726709 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 13:49:33.728387 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726712 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 13:49:33.728387 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726714 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 13:49:33.728387 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726717 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 13:49:33.728387 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726720 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 13:49:33.728387 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726723 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 13:49:33.728387 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726725 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 13:49:33.728387 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726728 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 13:49:33.728387 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726730 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 13:49:33.728387 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726733 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 13:49:33.728387 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726735 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 13:49:33.728387 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726738 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 13:49:33.728387 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726740 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 13:49:33.728387 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726744 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 13:49:33.728387 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726747 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 13:49:33.728387 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726750 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 13:49:33.728387 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726753 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 13:49:33.728979 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726756 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 13:49:33.728979 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.726758 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 13:49:33.728979 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727546 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 13:49:33.728979 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727559 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 13:49:33.728979 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727562 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 13:49:33.728979 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727566 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 13:49:33.728979 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727570 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 13:49:33.728979 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727573 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 13:49:33.728979 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727576 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 13:49:33.728979 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727578 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 13:49:33.728979 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727581 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 13:49:33.728979 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727584 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 13:49:33.728979 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727586 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 13:49:33.728979 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727589 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 13:49:33.728979 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727592 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 09 13:49:33.728979 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727595 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 13:49:33.728979 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727597 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 13:49:33.728979 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727600 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 13:49:33.728979 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727602 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 13:49:33.728979 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727605 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 13:49:33.729474 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727608 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 13:49:33.729474 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727611 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 13:49:33.729474 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727615 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 13:49:33.729474 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727619 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 13:49:33.729474 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727623 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 13:49:33.729474 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727626 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 13:49:33.729474 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727628 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 13:49:33.729474 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727632 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 13:49:33.729474 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727636 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 13:49:33.729474 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727639 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 13:49:33.729474 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727642 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 13:49:33.729474 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727645 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 13:49:33.729474 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727647 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 13:49:33.729474 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727650 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 13:49:33.729474 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727653 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 13:49:33.729474 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727657 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 13:49:33.729474 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727660 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 13:49:33.729474 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727662 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 13:49:33.729474 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727665 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 13:49:33.729960 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727667 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 13:49:33.729960 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727670 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 13:49:33.729960 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727672 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 13:49:33.729960 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727674 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 13:49:33.729960 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727677 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 13:49:33.729960 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727679 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 13:49:33.729960 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727682 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 13:49:33.729960 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727684 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 13:49:33.729960 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727686 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 13:49:33.729960 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727690 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 13:49:33.729960 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727692 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 13:49:33.729960 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727695 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 13:49:33.729960 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727697 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 13:49:33.729960 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727701 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 13:49:33.729960 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727703 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 13:49:33.729960 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727706 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 13:49:33.729960 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727708 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 13:49:33.729960 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727710 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 13:49:33.729960 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727713 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 13:49:33.729960 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727715 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 13:49:33.730472 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727718 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 13:49:33.730472 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727720 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 13:49:33.730472 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727723 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 13:49:33.730472 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727725 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 13:49:33.730472 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727728 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 13:49:33.730472 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727730 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 13:49:33.730472 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727732 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 13:49:33.730472 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727735 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 13:49:33.730472 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727738 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 13:49:33.730472 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727742 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 13:49:33.730472 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727744 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 13:49:33.730472 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727747 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 13:49:33.730472 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727749 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 13:49:33.730472 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727751 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 13:49:33.730472 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727754 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 13:49:33.730472 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727756 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 13:49:33.730472 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727759 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 13:49:33.730472 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727761 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 13:49:33.730472 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727764 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 13:49:33.730472 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727766 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 13:49:33.730995 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727768 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 13:49:33.730995 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727771 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 13:49:33.730995 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727773 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 13:49:33.730995 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727776 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 13:49:33.730995 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727778 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 13:49:33.730995 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727781 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 13:49:33.730995 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727784 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 13:49:33.730995 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727786 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 13:49:33.730995 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727789 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 13:49:33.730995 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727791 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 13:49:33.730995 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727793 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 13:49:33.730995 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727796 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 13:49:33.730995 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727798 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 13:49:33.730995 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727800 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 13:49:33.730995 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727804 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 13:49:33.730995 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727806 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 13:49:33.730995 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727809 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 13:49:33.730995 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727827 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 13:49:33.730995 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727830 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 13:49:33.730995 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727834 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 13:49:33.731491 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727838 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 13:49:33.731491 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.727841 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 13:49:33.731491 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729864 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 13:49:33.731491 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729871 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 13:49:33.731491 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729874 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 13:49:33.731491 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729877 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 13:49:33.731491 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729880 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 13:49:33.731491 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729883 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 13:49:33.731491 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729885 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 13:49:33.731491 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729888 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 13:49:33.731491 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729891 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 13:49:33.731491 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729893 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 13:49:33.731491 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729896 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 13:49:33.731491 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729898 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 13:49:33.731491 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729901 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 13:49:33.731491 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729903 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 13:49:33.731491 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729906 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 13:49:33.731491 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729909 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 13:49:33.731491 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729912 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 13:49:33.731491 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729914 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 13:49:33.732030 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729917 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 13:49:33.732030 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729919 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 13:49:33.732030 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729921 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 13:49:33.732030 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729924 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 13:49:33.732030 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729926 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 13:49:33.732030 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729929 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 13:49:33.732030 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729931 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 09 13:49:33.732030 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729934 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 13:49:33.732030 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729936 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 13:49:33.732030 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729939 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 13:49:33.732030 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729941 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 13:49:33.732030 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729943 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 13:49:33.732030 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729947 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 13:49:33.732030 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729949 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 13:49:33.732030 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729953 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 13:49:33.732030 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729955 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 13:49:33.732030 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729958 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 13:49:33.732030 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729960 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 13:49:33.732030 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729962 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 13:49:33.732030 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729965 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 13:49:33.732518 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729968 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 13:49:33.732518 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729971 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 13:49:33.732518 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729973 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 13:49:33.732518 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729976 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 13:49:33.732518 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729979 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 13:49:33.732518 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729982 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 13:49:33.732518 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729984 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 13:49:33.732518 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729987 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 13:49:33.732518 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729989 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 13:49:33.732518 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729992 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 13:49:33.732518 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729995 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 13:49:33.732518 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.729998 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 13:49:33.732518 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730000 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 13:49:33.732518 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730003 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 13:49:33.732518 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730005 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 13:49:33.732518 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730008 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 13:49:33.732518 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730011 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 13:49:33.732518 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730013 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 13:49:33.732518 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730015 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 13:49:33.732999 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730019 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 13:49:33.732999 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730023 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 13:49:33.732999 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730026 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 13:49:33.732999 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730028 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 13:49:33.732999 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730031 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 13:49:33.732999 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730034 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 13:49:33.732999 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730037 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 13:49:33.732999 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730039 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 13:49:33.732999 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730042 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 13:49:33.732999 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730045 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 13:49:33.732999 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730047 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 13:49:33.732999 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730049 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 13:49:33.732999 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730052 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 13:49:33.732999 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730054 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 13:49:33.732999 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730057 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 13:49:33.732999 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730059 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 13:49:33.732999 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730061 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 13:49:33.732999 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730064 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 13:49:33.732999 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730066 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 13:49:33.733450 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730069 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 13:49:33.733450 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730071 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 13:49:33.733450 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730073 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 13:49:33.733450 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730076 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 13:49:33.733450 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730078 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 13:49:33.733450 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730080 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 13:49:33.733450 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730083 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 13:49:33.733450 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730085 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 13:49:33.733450 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730088 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 13:49:33.733450 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730090 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 13:49:33.733450 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730093 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 13:49:33.733450 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730098 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 13:49:33.733450 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730101 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 13:49:33.733450 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730104 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 13:49:33.733450 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730106 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 13:49:33.733450 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730109 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 13:49:33.733450 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730111 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 13:49:33.733450 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730114 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 13:49:33.733450 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730118 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 13:49:33.733928 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730121 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 13:49:33.733928 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730124 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 13:49:33.733928 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730126 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 13:49:33.733928 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730129 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 13:49:33.733928 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730212 2573 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 13:49:33.733928 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730219 2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 13:49:33.733928 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730226 2573 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 13:49:33.733928 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730231 2573 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 13:49:33.733928 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730235 2573 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 13:49:33.733928 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730238 2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 13:49:33.733928 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730241 2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 13:49:33.733928 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730245 2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 13:49:33.733928 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730249 2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 13:49:33.733928 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730252 2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 13:49:33.733928 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730258 2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 13:49:33.733928 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730261 2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 13:49:33.733928 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730264 2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 13:49:33.733928 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730267 2573 flags.go:64] FLAG: --cgroup-root="" Jul 09 13:49:33.733928 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730269 2573 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 13:49:33.733928 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730272 2573 flags.go:64] FLAG: --client-ca-file="" Jul 09 13:49:33.733928 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730275 2573 flags.go:64] FLAG: --cloud-provider="external" Jul 09 13:49:33.733928 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730278 2573 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 13:49:33.733928 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730282 2573 flags.go:64] FLAG: --cluster-domain="" Jul 09 13:49:33.733928 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730285 2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 13:49:33.734497 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730288 2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 13:49:33.734497 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730291 2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 13:49:33.734497 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730294 2573 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 13:49:33.734497 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730298 2573 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 13:49:33.734497 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730301 2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 13:49:33.734497 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730304 2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 13:49:33.734497 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730307 2573 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 13:49:33.734497 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730311 2573 flags.go:64] FLAG: --contention-profiling="false" Jul 09 13:49:33.734497 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730314 2573 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 13:49:33.734497 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730317 2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 13:49:33.734497 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730320 2573 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 13:49:33.734497 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730323 2573 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 13:49:33.734497 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730328 2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 13:49:33.734497 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730331 2573 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 13:49:33.734497 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730333 2573 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 13:49:33.734497 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730336 2573 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 13:49:33.734497 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730339 2573 flags.go:64] FLAG: --enable-server="true" Jul 09 13:49:33.734497 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730342 2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 13:49:33.734497 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730346 2573 flags.go:64] FLAG: --event-burst="100" Jul 09 13:49:33.734497 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730349 2573 flags.go:64] FLAG: --event-qps="50" Jul 09 13:49:33.734497 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730352 2573 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 13:49:33.734497 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730355 2573 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 13:49:33.734497 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730359 2573 flags.go:64] FLAG: --eviction-hard="" Jul 09 13:49:33.734497 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730363 2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 13:49:33.735093 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730365 2573 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 13:49:33.735093 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730368 2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 13:49:33.735093 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730371 2573 flags.go:64] FLAG: --eviction-soft="" Jul 09 13:49:33.735093 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730374 2573 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 13:49:33.735093 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730376 2573 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 13:49:33.735093 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730380 2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 13:49:33.735093 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730382 2573 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 13:49:33.735093 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730385 2573 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 13:49:33.735093 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730388 2573 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 13:49:33.735093 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730391 2573 flags.go:64] FLAG: --feature-gates="" Jul 09 13:49:33.735093 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730394 2573 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 13:49:33.735093 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730398 2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 13:49:33.735093 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730401 2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 13:49:33.735093 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730404 2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 13:49:33.735093 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730407 2573 flags.go:64] FLAG: --healthz-port="10248" Jul 09 13:49:33.735093 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730409 2573 flags.go:64] FLAG: --help="false" Jul 09 13:49:33.735093 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730412 2573 flags.go:64] FLAG: --hostname-override="ip-10-0-143-92.ec2.internal" Jul 09 13:49:33.735093 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730415 2573 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 13:49:33.735093 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730418 2573 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 13:49:33.735093 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730421 2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 13:49:33.735093 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730424 2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 13:49:33.735093 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730427 2573 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 13:49:33.735093 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730430 2573 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 13:49:33.735093 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730433 2573 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 13:49:33.735733 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730435 2573 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 13:49:33.735733 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730438 2573 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 13:49:33.735733 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730441 2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 13:49:33.735733 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730444 2573 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 13:49:33.735733 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730446 2573 flags.go:64] FLAG: --kube-reserved="" Jul 09 13:49:33.735733 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730449 2573 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 13:49:33.735733 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730453 2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 13:49:33.735733 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730456 2573 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 13:49:33.735733 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730459 2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 13:49:33.735733 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730461 2573 flags.go:64] FLAG: --lock-file="" Jul 09 13:49:33.735733 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730464 2573 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 13:49:33.735733 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730467 2573 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 13:49:33.735733 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730470 2573 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 13:49:33.735733 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730475 2573 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 13:49:33.735733 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730478 2573 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 13:49:33.735733 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730481 2573 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 13:49:33.735733 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730484 2573 flags.go:64] FLAG: --logging-format="text" Jul 09 13:49:33.735733 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730486 2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 13:49:33.735733 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730490 2573 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 13:49:33.735733 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730492 2573 flags.go:64] FLAG: --manifest-url="" Jul 09 13:49:33.735733 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730495 2573 flags.go:64] FLAG: --manifest-url-header="" Jul 09 13:49:33.735733 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730499 2573 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 13:49:33.735733 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730504 2573 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 13:49:33.735733 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730508 2573 flags.go:64] FLAG: --max-pods="110" Jul 09 13:49:33.735733 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730511 2573 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 13:49:33.736368 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730513 2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 13:49:33.736368 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730516 2573 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 13:49:33.736368 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730519 2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 13:49:33.736368 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730522 2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 13:49:33.736368 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730525 2573 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 13:49:33.736368 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730528 2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 13:49:33.736368 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730535 2573 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 13:49:33.736368 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730538 2573 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 13:49:33.736368 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730540 2573 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 13:49:33.736368 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730543 2573 flags.go:64] FLAG: --pod-cidr="" Jul 09 13:49:33.736368 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730546 2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 09 13:49:33.736368 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730551 2573 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 13:49:33.736368 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730554 2573 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 13:49:33.736368 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730558 2573 flags.go:64] FLAG: --pods-per-core="0" Jul 09 13:49:33.736368 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730561 2573 flags.go:64] FLAG: --port="10250" Jul 09 13:49:33.736368 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730564 2573 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 13:49:33.736368 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730567 2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e438f8ae9eeb2a42" Jul 09 13:49:33.736368 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730570 2573 flags.go:64] FLAG: --qos-reserved="" Jul 09 13:49:33.736368 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730573 2573 flags.go:64] FLAG: --read-only-port="10255" Jul 09 13:49:33.736368 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730575 2573 flags.go:64] FLAG: --register-node="true" Jul 09 13:49:33.736368 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730578 2573 flags.go:64] FLAG: --register-with-taints="" Jul 09 13:49:33.736368 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730582 2573 flags.go:64] FLAG: --registry-burst="10" Jul 09 13:49:33.736368 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730584 2573 flags.go:64] FLAG: --registry-qps="5" Jul 09 13:49:33.736368 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730587 2573 flags.go:64] FLAG: --reserved-cpus="" Jul 09 13:49:33.737374 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730589 2573 flags.go:64] FLAG: --reserved-memory="" Jul 09 13:49:33.737374 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730593 2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 13:49:33.737374 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730596 2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 13:49:33.737374 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730599 2573 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 13:49:33.737374 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730601 2573 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 13:49:33.737374 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730604 2573 flags.go:64] FLAG: --runonce="false" Jul 09 13:49:33.737374 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730608 2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 13:49:33.737374 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730611 2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 13:49:33.737374 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730613 2573 flags.go:64] FLAG: --seccomp-default="false" Jul 09 13:49:33.737374 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730616 2573 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 13:49:33.737374 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730619 2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 13:49:33.737374 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730621 2573 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 13:49:33.737374 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730624 2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 13:49:33.737374 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730627 2573 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 13:49:33.737374 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730631 2573 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 13:49:33.737374 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730633 2573 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 13:49:33.737374 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730636 2573 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 13:49:33.737374 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730638 2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 13:49:33.737374 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730641 2573 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 13:49:33.737374 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730644 2573 flags.go:64] FLAG: --system-cgroups="" Jul 09 13:49:33.737374 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730646 2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 13:49:33.737374 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730653 2573 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 13:49:33.737374 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730656 2573 flags.go:64] FLAG: --tls-cert-file="" Jul 09 13:49:33.737374 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730659 2573 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 13:49:33.737374 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730663 2573 flags.go:64] FLAG: --tls-min-version="" Jul 09 13:49:33.738446 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730665 2573 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 13:49:33.738446 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730668 2573 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 13:49:33.738446 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730671 2573 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 13:49:33.738446 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730674 2573 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 13:49:33.738446 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730677 2573 flags.go:64] FLAG: --v="2" Jul 09 13:49:33.738446 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730680 2573 flags.go:64] FLAG: --version="false" Jul 09 13:49:33.738446 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730684 2573 flags.go:64] FLAG: --vmodule="" Jul 09 13:49:33.738446 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730687 2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 13:49:33.738446 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.730690 2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 13:49:33.738446 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730841 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 13:49:33.738446 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730846 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 13:49:33.738446 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730849 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 13:49:33.738446 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730852 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 13:49:33.738446 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730859 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 13:49:33.738446 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730861 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 13:49:33.738446 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730864 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 13:49:33.738446 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730867 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 13:49:33.738446 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730869 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 13:49:33.738446 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730872 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 13:49:33.738446 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730874 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 13:49:33.738446 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730877 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 13:49:33.738446 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730879 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 13:49:33.739413 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730882 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 13:49:33.739413 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730885 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 13:49:33.739413 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730887 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 13:49:33.739413 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730890 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 13:49:33.739413 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730892 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 13:49:33.739413 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730895 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 13:49:33.739413 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730898 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 13:49:33.739413 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730901 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 13:49:33.739413 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730903 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 13:49:33.739413 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730905 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 13:49:33.739413 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730908 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 13:49:33.739413 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730910 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 13:49:33.739413 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730914 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 13:49:33.739413 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730918 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 13:49:33.739413 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730920 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 13:49:33.739413 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730922 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 13:49:33.739413 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730925 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 13:49:33.739413 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730927 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 13:49:33.739413 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730930 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 13:49:33.740239 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730932 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 13:49:33.740239 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730935 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 13:49:33.740239 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730937 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 13:49:33.740239 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730939 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 13:49:33.740239 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730943 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 13:49:33.740239 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730946 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 13:49:33.740239 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730948 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 13:49:33.740239 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730951 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 13:49:33.740239 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730953 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 13:49:33.740239 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730956 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 13:49:33.740239 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730958 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 13:49:33.740239 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730961 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 13:49:33.740239 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730963 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 13:49:33.740239 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730966 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 13:49:33.740239 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730969 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 13:49:33.740239 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730971 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 13:49:33.740239 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730974 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 13:49:33.740239 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730977 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 13:49:33.740239 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730979 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 13:49:33.740239 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730982 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 13:49:33.741104 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730985 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 13:49:33.741104 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730987 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 13:49:33.741104 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730990 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 13:49:33.741104 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730992 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 13:49:33.741104 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730995 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 13:49:33.741104 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.730998 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 13:49:33.741104 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.731000 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 13:49:33.741104 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.731003 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 13:49:33.741104 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.731007 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 13:49:33.741104 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.731010 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 13:49:33.741104 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.731014 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 13:49:33.741104 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.731016 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 13:49:33.741104 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.731019 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 13:49:33.741104 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.731022 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 13:49:33.741104 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.731024 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 13:49:33.741104 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.731027 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 13:49:33.741104 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.731030 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 13:49:33.741104 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.731033 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 13:49:33.741104 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.731036 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 13:49:33.741666 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.731039 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 13:49:33.741666 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.731041 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 13:49:33.741666 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.731044 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 13:49:33.741666 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.731046 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 13:49:33.741666 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.731049 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 13:49:33.741666 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.731052 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 13:49:33.741666 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.731054 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 13:49:33.741666 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.731057 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 13:49:33.741666 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.731059 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 13:49:33.741666 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.731062 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 13:49:33.741666 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.731064 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 13:49:33.741666 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.731067 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 13:49:33.741666 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.731070 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 13:49:33.741666 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.731073 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 13:49:33.741666 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.731075 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 13:49:33.741666 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.731078 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 13:49:33.741666 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.731080 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 13:49:33.741666 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.731082 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 13:49:33.741666 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.731084 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 13:49:33.741666 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.731087 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 13:49:33.742515 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.731089 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 13:49:33.742515 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.731092 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 13:49:33.742515 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.731094 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 09 13:49:33.742515 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.731097 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 13:49:33.742515 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.731099 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 13:49:33.742515 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.731102 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 13:49:33.742515 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.731106 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 13:49:33.742515 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.731109 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 13:49:33.742515 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.731114 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 13:49:33.742515 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.739459 2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 09 13:49:33.742515 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.739481 2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 13:49:33.742515 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.739506 2573 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 13:49:33.742515 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.739514 2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 13:49:33.742515 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739624 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 13:49:33.743286 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739633 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 13:49:33.743286 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739638 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 13:49:33.743286 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739642 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 13:49:33.743286 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739647 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 13:49:33.743286 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739651 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 13:49:33.743286 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739655 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 13:49:33.743286 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739667 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 13:49:33.743286 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739672 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 13:49:33.743286 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739676 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 13:49:33.743286 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739680 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 13:49:33.743286 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739684 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 13:49:33.743286 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739688 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 13:49:33.743286 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739692 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 13:49:33.743286 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739697 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 13:49:33.743286 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739701 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 13:49:33.743286 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739706 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 13:49:33.743286 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739711 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 13:49:33.743286 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739715 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 13:49:33.743286 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739719 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 13:49:33.743286 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739723 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 13:49:33.743785 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739727 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 13:49:33.743785 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739732 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 13:49:33.743785 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739736 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 13:49:33.743785 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739740 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 09 13:49:33.743785 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739744 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 13:49:33.743785 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739748 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 13:49:33.743785 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739752 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 13:49:33.743785 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739756 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 13:49:33.743785 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739761 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 13:49:33.743785 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739765 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 13:49:33.743785 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739769 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 13:49:33.743785 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739773 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 13:49:33.743785 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739777 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 13:49:33.743785 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739784 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 13:49:33.743785 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739790 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 13:49:33.743785 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739794 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 13:49:33.743785 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739801 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 13:49:33.743785 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739807 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 13:49:33.743785 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739831 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 13:49:33.743785 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739847 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 13:49:33.744429 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739852 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 13:49:33.744429 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739856 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 13:49:33.744429 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739861 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 13:49:33.744429 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739866 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 13:49:33.744429 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739870 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 13:49:33.744429 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739874 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 13:49:33.744429 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739878 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 13:49:33.744429 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739883 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 13:49:33.744429 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739887 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 13:49:33.744429 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739891 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 13:49:33.744429 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739895 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 13:49:33.744429 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739899 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 13:49:33.744429 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739903 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 13:49:33.744429 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739907 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 13:49:33.744429 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739911 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 13:49:33.744429 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739915 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 13:49:33.744429 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739919 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 13:49:33.744429 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739924 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 13:49:33.744429 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739928 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 13:49:33.744429 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739932 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 13:49:33.744960 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739936 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 13:49:33.744960 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739941 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 13:49:33.744960 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739945 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 13:49:33.744960 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739948 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 13:49:33.744960 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739953 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 13:49:33.744960 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739957 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 13:49:33.744960 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739961 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 13:49:33.744960 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739966 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 13:49:33.744960 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739971 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 13:49:33.744960 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739977 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 13:49:33.744960 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739982 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 13:49:33.744960 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739986 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 13:49:33.744960 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.739998 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 13:49:33.744960 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740004 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 13:49:33.744960 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740008 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 13:49:33.744960 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740012 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 13:49:33.744960 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740017 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 13:49:33.744960 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740022 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 13:49:33.744960 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740026 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 13:49:33.745430 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740030 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 13:49:33.745430 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740034 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 13:49:33.745430 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740038 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 13:49:33.745430 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740042 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 13:49:33.745430 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740046 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 13:49:33.745430 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740050 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 13:49:33.745430 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740054 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 13:49:33.745430 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740058 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 13:49:33.745430 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740062 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 13:49:33.745430 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740066 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 13:49:33.745430 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740070 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 13:49:33.745430 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740074 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 13:49:33.745430 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740079 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 13:49:33.745430 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740083 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 13:49:33.745430 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740087 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 13:49:33.745430 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740092 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 13:49:33.745430 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740096 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 13:49:33.745430 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740100 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 13:49:33.745430 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740104 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 13:49:33.746068 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.740112 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 13:49:33.746068 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740345 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 13:49:33.746068 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740354 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 13:49:33.746068 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740359 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 13:49:33.746068 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740363 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 13:49:33.746068 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740367 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 13:49:33.746068 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740371 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 13:49:33.746068 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740383 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 13:49:33.746068 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740388 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 13:49:33.746068 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740391 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 13:49:33.746068 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740396 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 13:49:33.746068 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740400 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 13:49:33.746068 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740404 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 13:49:33.746068 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740409 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 13:49:33.746068 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740413 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 13:49:33.746506 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740417 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 13:49:33.746506 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740421 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 13:49:33.746506 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740425 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 13:49:33.746506 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740429 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 13:49:33.746506 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740433 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 13:49:33.746506 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740437 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 13:49:33.746506 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740441 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 13:49:33.746506 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740445 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 13:49:33.746506 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740451 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 13:49:33.746506 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740457 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 13:49:33.746506 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740461 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 13:49:33.746506 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740466 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 13:49:33.746506 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740470 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 13:49:33.746506 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740474 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 13:49:33.746506 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740478 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 13:49:33.746506 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740482 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 13:49:33.746506 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740486 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 13:49:33.746506 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740491 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 13:49:33.746506 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740495 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 13:49:33.746506 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740499 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 13:49:33.747016 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740503 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 13:49:33.747016 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740507 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 13:49:33.747016 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740511 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 13:49:33.747016 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740515 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 13:49:33.747016 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740519 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 13:49:33.747016 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740535 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 13:49:33.747016 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740540 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 13:49:33.747016 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740544 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 13:49:33.747016 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740550 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 13:49:33.747016 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740556 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 13:49:33.747016 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740561 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 13:49:33.747016 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740565 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 13:49:33.747016 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740570 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 13:49:33.747016 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740575 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 13:49:33.747016 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740579 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 13:49:33.747016 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740583 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 13:49:33.747016 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740588 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 13:49:33.747016 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740592 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 13:49:33.747016 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740596 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 13:49:33.747513 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740600 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 13:49:33.747513 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740604 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 13:49:33.747513 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740608 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 13:49:33.747513 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740613 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 13:49:33.747513 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740618 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 13:49:33.747513 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740622 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 13:49:33.747513 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740626 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 13:49:33.747513 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740630 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 13:49:33.747513 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740634 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 13:49:33.747513 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740638 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 13:49:33.747513 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740642 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 13:49:33.747513 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740646 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 13:49:33.747513 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740650 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 13:49:33.747513 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740654 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 13:49:33.747513 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740658 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 13:49:33.747513 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740662 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 13:49:33.747513 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740666 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 13:49:33.747513 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740670 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 13:49:33.747513 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740674 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 13:49:33.747513 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740685 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 13:49:33.748053 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740690 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 13:49:33.748053 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740695 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 13:49:33.748053 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740699 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 13:49:33.748053 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740703 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 13:49:33.748053 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740707 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 13:49:33.748053 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740711 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 13:49:33.748053 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740715 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 13:49:33.748053 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740719 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 13:49:33.748053 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740723 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 13:49:33.748053 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740727 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 13:49:33.748053 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740731 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 13:49:33.748053 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740735 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 13:49:33.748053 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740742 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 13:49:33.748053 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740747 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 13:49:33.748053 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740752 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 13:49:33.748053 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740756 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 09 13:49:33.748053 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740761 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 13:49:33.748053 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740766 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 13:49:33.748053 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740770 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 13:49:33.748507 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740774 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 13:49:33.748507 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740778 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 13:49:33.748507 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740782 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 13:49:33.748507 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740786 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 13:49:33.748507 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740790 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 13:49:33.748507 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740794 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 13:49:33.748507 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:33.740798 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 13:49:33.748507 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.740807 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 13:49:33.748507 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.741009 2573 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 13:49:33.748507 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.743938 2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 13:49:33.748507 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.745456 2573 server.go:1019] "Starting client certificate rotation" Jul 09 13:49:33.748507 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.745561 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 13:49:33.748507 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.745599 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 13:49:33.749332 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.749310 2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 13:49:33.756501 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.756479 2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 13:49:33.764188 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.764170 2573 log.go:25] "Validated CRI v1 runtime API" Jul 09 13:49:33.766230 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.766213 2573 log.go:25] "Validated CRI v1 image API" Jul 09 13:49:33.767053 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.767036 2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 13:49:33.773449 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.773425 2573 fs.go:135] Filesystem UUIDs: map[5458f9e1-c7ff-4588-826a-6b27e6ec44f1:/dev/nvme0n1p3 745fc2f1-265c-4cd6-81ce-940cc47a6a4f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 09 13:49:33.773527 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.773446 2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 13:49:33.777897 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.777762 2573 manager.go:216] Machine: {Timestamp:2026-07-09 13:49:33.777255683 +0000 UTC m=+0.369822037 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3138645 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c1ccc944d0905d2708cfa0b7372a8 SystemUUID:ec2c1ccc-944d-0905-d270-8cfa0b7372a8 BootID:9f906e0a-4050-4dd5-aeb4-40934fae3b6c Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6d:33:7e:5c:e9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6d:33:7e:5c:e9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:02:57:fe:8c:a4:6e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 13:49:33.777897 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.777883 2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 13:49:33.778059 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.777989 2573 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 13:49:33.780337 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.780319 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 13:49:33.780539 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.780510 2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 13:49:33.780685 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.780545 2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-92.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 13:49:33.781328 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.781318 2573 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 13:49:33.781369 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.781331 2573 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 13:49:33.781369 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.781339 2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 13:49:33.782089 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.782079 2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 13:49:33.783562 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.783551 2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 13:49:33.786859 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.786847 2573 state_mem.go:36] "Initialized new in-memory state store" Jul 09 13:49:33.787009 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.787000 2573 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 13:49:33.787039 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.787032 2573 kubelet.go:486] "Attempting to sync node with API server" Jul 09 13:49:33.787072 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.787048 2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 13:49:33.787072 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.787061 2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 13:49:33.787072 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.787071 2573 kubelet.go:398] "Adding apiserver pod source" Jul 09 13:49:33.787176 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.787079 2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 13:49:33.787495 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.787482 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 13:49:33.787557 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.787505 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 13:49:33.790496 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.790479 2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 09 13:49:33.793461 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.793445 2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 13:49:33.793539 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.793476 2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 13:49:33.794578 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.794564 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 13:49:33.794625 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.794584 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 13:49:33.794625 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.794593 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 13:49:33.794625 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.794599 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 13:49:33.794625 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.794607 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 13:49:33.794625 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.794612 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 13:49:33.794625 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.794620 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 13:49:33.794625 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.794626 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 13:49:33.794808 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.794632 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 13:49:33.794808 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.794638 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 13:49:33.794808 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.794646 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 13:49:33.794808 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.794652 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 13:49:33.795316 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.795307 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 13:49:33.795316 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.795316 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 13:49:33.798555 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.798531 2573 server.go:1268] "Started kubelet" Jul 09 13:49:33.801466 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.801287 2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-92.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 13:49:33.801806 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:33.801776 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 13:49:33.801944 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:33.801853 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-92.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 13:49:33.802087 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.802039 2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 13:49:33.802213 ip-10-0-143-92 systemd[1]: Started Kubernetes Kubelet. Jul 09 13:49:33.802951 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.802622 2573 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 13:49:33.803213 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.803103 2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 13:49:33.804070 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.804053 2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 13:49:33.805845 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.805806 2573 server.go:310] "Adding debug handlers to kubelet server" Jul 09 13:49:33.806673 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:33.806652 2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 13:49:33.810122 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:33.808625 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-92.ec2.internal.18c0a34612e12591 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-92.ec2.internal,UID:ip-10-0-143-92.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-92.ec2.internal,},FirstTimestamp:2026-07-09 13:49:33.798499729 +0000 UTC m=+0.391066140,LastTimestamp:2026-07-09 13:49:33.798499729 +0000 UTC m=+0.391066140,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-92.ec2.internal,}" Jul 09 13:49:33.810396 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.810368 2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 13:49:33.810396 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.810386 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 13:49:33.810540 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:33.810506 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-92.ec2.internal\" not found" Jul 09 13:49:33.811108 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.811054 2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 13:49:33.811108 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.811100 2573 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 13:49:33.811245 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.811114 2573 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 13:49:33.811245 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.811164 2573 factory.go:55] Registering systemd factory Jul 09 13:49:33.811245 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.811181 2573 factory.go:223] Registration of the systemd container factory successfully Jul 09 13:49:33.811245 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.811237 2573 reconstruct.go:97] "Volume reconstruction finished" Jul 09 13:49:33.811565 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.811250 2573 reconciler.go:29] "Reconciler: start to sync state" Jul 09 13:49:33.811716 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.811699 2573 factory.go:153] Registering CRI-O factory Jul 09 13:49:33.811716 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.811719 2573 factory.go:223] Registration of the crio container factory successfully Jul 09 13:49:33.811889 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.811775 2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 13:49:33.811889 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.811799 2573 factory.go:103] Registering Raw factory Jul 09 13:49:33.811889 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.811845 2573 manager.go:1196] Started watching for new ooms in manager Jul 09 13:49:33.812544 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.812526 2573 manager.go:349] Starting recovery of all containers Jul 09 13:49:33.820144 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.820109 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 13:49:33.821387 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:33.821361 2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-92.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 09 13:49:33.821493 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:33.821375 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 09 13:49:33.822746 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.822732 2573 manager.go:354] Recovery completed Jul 09 13:49:33.827878 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.827744 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:49:33.829866 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.829846 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-92.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:49:33.829943 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.829883 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-92.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:49:33.829943 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.829896 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-92.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:49:33.830418 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.830404 2573 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 13:49:33.830418 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.830418 2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 13:49:33.830499 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.830425 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:49:33.830499 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.830440 2573 state_mem.go:36] "Initialized new in-memory state store" Jul 09 13:49:33.831222 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.831205 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-92.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:49:33.831309 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.831240 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-92.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:49:33.831309 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.831255 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-92.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:49:33.831918 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.831906 2573 policy_none.go:49] "None policy: Start" Jul 09 13:49:33.831983 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.831923 2573 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 13:49:33.831983 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.831937 2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 13:49:33.832220 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:33.832143 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-92.ec2.internal.18c0a34614bfb85a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-92.ec2.internal,UID:ip-10-0-143-92.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-92.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-92.ec2.internal,},FirstTimestamp:2026-07-09 13:49:33.829863514 +0000 UTC m=+0.422429867,LastTimestamp:2026-07-09 13:49:33.829863514 +0000 UTC m=+0.422429867,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-92.ec2.internal,}" Jul 09 13:49:33.833212 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.833202 2573 policy_none.go:47] "Start" Jul 09 13:49:33.838160 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.838140 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h69j9" Jul 09 13:49:33.840872 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:33.840782 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-92.ec2.internal.18c0a34614c01c1e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-92.ec2.internal,UID:ip-10-0-143-92.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-92.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-92.ec2.internal,},FirstTimestamp:2026-07-09 13:49:33.829889054 +0000 UTC m=+0.422455407,LastTimestamp:2026-07-09 13:49:33.829889054 +0000 UTC m=+0.422455407,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-92.ec2.internal,}" Jul 09 13:49:33.845873 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.845857 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h69j9" Jul 09 13:49:33.851896 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:33.851833 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-92.ec2.internal.18c0a34614c04634 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-92.ec2.internal,UID:ip-10-0-143-92.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-92.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-92.ec2.internal,},FirstTimestamp:2026-07-09 13:49:33.829899828 +0000 UTC m=+0.422466182,LastTimestamp:2026-07-09 13:49:33.829899828 +0000 UTC m=+0.422466182,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-92.ec2.internal,}" Jul 09 13:49:33.877411 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.877394 2573 manager.go:337] "Starting Device Plugin manager" Jul 09 13:49:33.884285 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:33.877434 2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 13:49:33.884285 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.877461 2573 server.go:87] "Starting device plugin registration server" Jul 09 13:49:33.884285 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.877856 2573 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 13:49:33.884285 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.877867 2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 13:49:33.884285 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.877958 2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 13:49:33.884285 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.878058 2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 13:49:33.884285 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.878069 2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 13:49:33.884285 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:33.878559 2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 13:49:33.884285 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:33.878611 2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-92.ec2.internal\" not found" Jul 09 13:49:33.920387 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.920368 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 13:49:33.920477 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.920404 2573 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 13:49:33.920477 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.920422 2573 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 13:49:33.920477 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:33.920451 2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 13:49:33.923318 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.923300 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 13:49:33.978590 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.978529 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:49:33.979803 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.979788 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-92.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:49:33.979880 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.979828 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-92.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:49:33.979880 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.979839 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-92.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:49:33.979880 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.979859 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-92.ec2.internal" Jul 09 13:49:33.986482 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:33.986466 2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-92.ec2.internal" Jul 09 13:49:33.986560 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:33.986490 2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-92.ec2.internal\": node \"ip-10-0-143-92.ec2.internal\" not found" Jul 09 13:49:34.018401 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:34.018377 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-92.ec2.internal\" not found" Jul 09 13:49:34.021977 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.021956 2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-92.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-92.ec2.internal"] Jul 09 13:49:34.022068 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.022019 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:49:34.022870 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.022856 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-92.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:49:34.022965 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.022887 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-92.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:49:34.022965 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.022901 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-92.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:49:34.024509 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.024494 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:49:34.024674 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.024661 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-92.ec2.internal" Jul 09 13:49:34.024722 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.024689 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:49:34.025204 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.025180 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-92.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:49:34.025204 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.025188 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-92.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:49:34.025300 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.025210 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-92.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:49:34.025300 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.025214 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-92.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:49:34.025300 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.025226 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-92.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:49:34.025385 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.025225 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-92.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:49:34.026340 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.026325 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-92.ec2.internal" Jul 09 13:49:34.026419 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.026350 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:49:34.026978 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.026963 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-92.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:49:34.027065 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.026991 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-92.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:49:34.027065 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.027006 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-92.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:49:34.054399 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:34.054378 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-92.ec2.internal\" not found" node="ip-10-0-143-92.ec2.internal" Jul 09 13:49:34.058772 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:34.058758 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-92.ec2.internal\" not found" node="ip-10-0-143-92.ec2.internal" Jul 09 13:49:34.113286 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.113255 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/963a639aab59673e2b60d423e0aa7762-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-92.ec2.internal\" (UID: \"963a639aab59673e2b60d423e0aa7762\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-92.ec2.internal" Jul 09 13:49:34.113286 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.113285 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/963a639aab59673e2b60d423e0aa7762-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-92.ec2.internal\" (UID: \"963a639aab59673e2b60d423e0aa7762\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-92.ec2.internal" Jul 09 13:49:34.113458 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.113300 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/34bea405b2b687d739a81e962ab7a92d-config\") pod \"kube-apiserver-proxy-ip-10-0-143-92.ec2.internal\" (UID: \"34bea405b2b687d739a81e962ab7a92d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-92.ec2.internal" Jul 09 13:49:34.118747 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:34.118729 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-92.ec2.internal\" not found" Jul 09 13:49:34.213985 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.213947 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/963a639aab59673e2b60d423e0aa7762-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-92.ec2.internal\" (UID: \"963a639aab59673e2b60d423e0aa7762\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-92.ec2.internal" Jul 09 13:49:34.213985 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.213993 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/34bea405b2b687d739a81e962ab7a92d-config\") pod \"kube-apiserver-proxy-ip-10-0-143-92.ec2.internal\" (UID: \"34bea405b2b687d739a81e962ab7a92d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-92.ec2.internal" Jul 09 13:49:34.214176 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.214042 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/34bea405b2b687d739a81e962ab7a92d-config\") pod \"kube-apiserver-proxy-ip-10-0-143-92.ec2.internal\" (UID: \"34bea405b2b687d739a81e962ab7a92d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-92.ec2.internal" Jul 09 13:49:34.214176 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.214045 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/963a639aab59673e2b60d423e0aa7762-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-92.ec2.internal\" (UID: \"963a639aab59673e2b60d423e0aa7762\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-92.ec2.internal" Jul 09 13:49:34.214176 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.214078 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/963a639aab59673e2b60d423e0aa7762-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-92.ec2.internal\" (UID: \"963a639aab59673e2b60d423e0aa7762\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-92.ec2.internal" Jul 09 13:49:34.214176 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.214110 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/963a639aab59673e2b60d423e0aa7762-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-92.ec2.internal\" (UID: \"963a639aab59673e2b60d423e0aa7762\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-92.ec2.internal" Jul 09 13:49:34.219077 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:34.219060 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-92.ec2.internal\" not found" Jul 09 13:49:34.319874 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:34.319780 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-92.ec2.internal\" not found" Jul 09 13:49:34.357970 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.357946 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-92.ec2.internal" Jul 09 13:49:34.362460 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.362320 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-92.ec2.internal" Jul 09 13:49:34.420064 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:34.420028 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-92.ec2.internal\" not found" Jul 09 13:49:34.520526 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:34.520501 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-92.ec2.internal\" not found" Jul 09 13:49:34.621109 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:34.621044 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-92.ec2.internal\" not found" Jul 09 13:49:34.711515 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.711494 2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 13:49:34.744893 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.744863 2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 13:49:34.745343 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.744980 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 13:49:34.745343 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.745017 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 13:49:34.788191 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.788163 2573 apiserver.go:52] "Watching apiserver" Jul 09 13:49:34.805967 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.805941 2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 13:49:34.806267 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.806247 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-lth82","kube-system/konnectivity-agent-txs25","openshift-cluster-node-tuning-operator/tuned-8pjpx","openshift-multus/network-metrics-daemon-5rs66","openshift-ovn-kubernetes/ovnkube-node-wlg95","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9m82w","openshift-dns/node-resolver-gcld7","openshift-image-registry/node-ca-l6z74","openshift-multus/multus-additional-cni-plugins-dgjhm","openshift-multus/multus-xl2jp","openshift-network-diagnostics/network-check-target-7btnh","openshift-network-operator/iptables-alerter-fll8g"] Jul 09 13:49:34.807831 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.807799 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.808995 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.808976 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.809896 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.809876 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 13:49:34.809990 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.809961 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 13:49:34.809990 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.809981 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-whzwf\"" Jul 09 13:49:34.810630 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.810615 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-92.ec2.internal" Jul 09 13:49:34.810630 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.810627 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 13:49:34.810945 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.810927 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 13:49:34.811053 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.811011 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kqcxk\"" Jul 09 13:49:34.811053 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.811038 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9m82w" Jul 09 13:49:34.811164 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.811097 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 13:49:34.811237 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.811213 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 13:49:34.811376 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.811357 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 13:49:34.811418 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.811397 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 13:49:34.811450 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.811438 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 13:49:34.812311 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.812295 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gcld7" Jul 09 13:49:34.813258 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.813237 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 13:49:34.813345 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.813313 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 13:49:34.813462 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.813447 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l6z74" Jul 09 13:49:34.813633 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.813616 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 13:49:34.813741 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.813674 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-th42c\"" Jul 09 13:49:34.814284 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.814271 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 13:49:34.814500 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.814486 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zgjlm\"" Jul 09 13:49:34.814533 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.814490 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 13:49:34.814994 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.814981 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dgjhm" Jul 09 13:49:34.815295 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.815279 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 13:49:34.815585 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.815571 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 13:49:34.815653 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.815591 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 13:49:34.815653 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.815597 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7nqrs\"" Jul 09 13:49:34.816375 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.816360 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xl2jp" Jul 09 13:49:34.817212 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.817196 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-etc-openvswitch\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.817286 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.817218 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-run-openvswitch\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.817286 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.817236 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-run-ovn\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.817286 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.817265 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-host-cni-bin\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.817436 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.817283 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fe725cde-9e4a-4b8f-b96e-90fb61415652-ovn-node-metrics-cert\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.817436 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.817309 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ad8f280e-d164-45c9-88eb-40428803312c-sys-fs\") pod \"aws-ebs-csi-driver-node-9m82w\" (UID: \"ad8f280e-d164-45c9-88eb-40428803312c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9m82w" Jul 09 13:49:34.817436 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.817342 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 13:49:34.817436 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.817346 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3a07c917-a189-45a1-be43-1f672c0e7a36-etc-modprobe-d\") pod \"tuned-8pjpx\" (UID: \"3a07c917-a189-45a1-be43-1f672c0e7a36\") " pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.817436 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.817377 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a07c917-a189-45a1-be43-1f672c0e7a36-sys\") pod \"tuned-8pjpx\" (UID: \"3a07c917-a189-45a1-be43-1f672c0e7a36\") " pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.817436 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.817406 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfwbq\" (UniqueName: \"kubernetes.io/projected/3a07c917-a189-45a1-be43-1f672c0e7a36-kube-api-access-rfwbq\") pod \"tuned-8pjpx\" (UID: \"3a07c917-a189-45a1-be43-1f672c0e7a36\") " pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.817436 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.817424 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ncpk\" (UniqueName: \"kubernetes.io/projected/fe725cde-9e4a-4b8f-b96e-90fb61415652-kube-api-access-6ncpk\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.817436 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.817439 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ad8f280e-d164-45c9-88eb-40428803312c-registration-dir\") pod \"aws-ebs-csi-driver-node-9m82w\" (UID: \"ad8f280e-d164-45c9-88eb-40428803312c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9m82w" Jul 09 13:49:34.817719 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.817477 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3a07c917-a189-45a1-be43-1f672c0e7a36-etc-sysctl-d\") pod \"tuned-8pjpx\" (UID: \"3a07c917-a189-45a1-be43-1f672c0e7a36\") " pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.817719 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.817539 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3a07c917-a189-45a1-be43-1f672c0e7a36-etc-systemd\") pod \"tuned-8pjpx\" (UID: \"3a07c917-a189-45a1-be43-1f672c0e7a36\") " pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.817719 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.817567 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-host-run-netns\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.817719 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.817598 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-host-cni-netd\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.817719 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.817627 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fe725cde-9e4a-4b8f-b96e-90fb61415652-ovnkube-config\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.817719 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.817668 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ad8f280e-d164-45c9-88eb-40428803312c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9m82w\" (UID: \"ad8f280e-d164-45c9-88eb-40428803312c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9m82w" Jul 09 13:49:34.817719 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.817691 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ad8f280e-d164-45c9-88eb-40428803312c-device-dir\") pod \"aws-ebs-csi-driver-node-9m82w\" (UID: \"ad8f280e-d164-45c9-88eb-40428803312c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9m82w" Jul 09 13:49:34.818027 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.817724 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 13:49:34.818027 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.817742 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3a07c917-a189-45a1-be43-1f672c0e7a36-etc-sysconfig\") pod \"tuned-8pjpx\" (UID: \"3a07c917-a189-45a1-be43-1f672c0e7a36\") " pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.818027 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.817793 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a07c917-a189-45a1-be43-1f672c0e7a36-lib-modules\") pod \"tuned-8pjpx\" (UID: \"3a07c917-a189-45a1-be43-1f672c0e7a36\") " pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.818027 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.817797 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-spvgp\"" Jul 09 13:49:34.818027 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.817836 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7btnh" Jul 09 13:49:34.818254 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.818067 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 13:49:34.818387 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.818366 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a07c917-a189-45a1-be43-1f672c0e7a36-tmp\") pod \"tuned-8pjpx\" (UID: \"3a07c917-a189-45a1-be43-1f672c0e7a36\") " pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.819164 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.818385 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 13:49:34.819164 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.818407 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fe725cde-9e4a-4b8f-b96e-90fb61415652-env-overrides\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.819164 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.818501 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ad8f280e-d164-45c9-88eb-40428803312c-socket-dir\") pod \"aws-ebs-csi-driver-node-9m82w\" (UID: \"ad8f280e-d164-45c9-88eb-40428803312c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9m82w" Jul 09 13:49:34.819164 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.818522 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-chct6\"" Jul 09 13:49:34.819164 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.818534 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3d676a82-9c69-4065-b7e0-87787f3cc7bd-hosts-file\") pod \"node-resolver-gcld7\" (UID: \"3d676a82-9c69-4065-b7e0-87787f3cc7bd\") " pod="openshift-dns/node-resolver-gcld7" Jul 09 13:49:34.819164 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.818564 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3a07c917-a189-45a1-be43-1f672c0e7a36-run\") pod \"tuned-8pjpx\" (UID: \"3a07c917-a189-45a1-be43-1f672c0e7a36\") " pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.819164 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.818746 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 13:49:34.819164 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.818933 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a07c917-a189-45a1-be43-1f672c0e7a36-var-lib-kubelet\") pod \"tuned-8pjpx\" (UID: \"3a07c917-a189-45a1-be43-1f672c0e7a36\") " pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.819164 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.818960 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3a07c917-a189-45a1-be43-1f672c0e7a36-etc-tuned\") pod \"tuned-8pjpx\" (UID: \"3a07c917-a189-45a1-be43-1f672c0e7a36\") " pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.819164 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.819025 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-host-kubelet\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.819164 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.819062 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-host-slash\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.819164 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:34.819060 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7btnh" podUID="60191bf6-e7d9-4411-85a0-f1cc73dcc646" Jul 09 13:49:34.819164 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.819113 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ad8f280e-d164-45c9-88eb-40428803312c-etc-selinux\") pod \"aws-ebs-csi-driver-node-9m82w\" (UID: \"ad8f280e-d164-45c9-88eb-40428803312c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9m82w" Jul 09 13:49:34.819857 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.819185 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwgvv\" (UniqueName: \"kubernetes.io/projected/ad8f280e-d164-45c9-88eb-40428803312c-kube-api-access-nwgvv\") pod \"aws-ebs-csi-driver-node-9m82w\" (UID: \"ad8f280e-d164-45c9-88eb-40428803312c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9m82w" Jul 09 13:49:34.819857 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.819242 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3a07c917-a189-45a1-be43-1f672c0e7a36-etc-sysctl-conf\") pod \"tuned-8pjpx\" (UID: \"3a07c917-a189-45a1-be43-1f672c0e7a36\") " pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.819857 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.819268 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 13:49:34.819857 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.819314 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a07c917-a189-45a1-be43-1f672c0e7a36-host\") pod \"tuned-8pjpx\" (UID: \"3a07c917-a189-45a1-be43-1f672c0e7a36\") " pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.819857 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.819350 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-log-socket\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.820088 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.819868 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fll8g" Jul 09 13:49:34.820220 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.820198 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-host-run-ovn-kubernetes\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.820285 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.820248 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.820339 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.820299 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fe725cde-9e4a-4b8f-b96e-90fb61415652-ovnkube-script-lib\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.820397 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.820333 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-systemd-units\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.820397 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.820385 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-run-systemd\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.820505 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.820446 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-var-lib-openvswitch\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.820557 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.820504 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d676a82-9c69-4065-b7e0-87787f3cc7bd-tmp-dir\") pod \"node-resolver-gcld7\" (UID: \"3d676a82-9c69-4065-b7e0-87787f3cc7bd\") " pod="openshift-dns/node-resolver-gcld7" Jul 09 13:49:34.820604 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.820557 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fv2l\" (UniqueName: \"kubernetes.io/projected/3d676a82-9c69-4065-b7e0-87787f3cc7bd-kube-api-access-2fv2l\") pod \"node-resolver-gcld7\" (UID: \"3d676a82-9c69-4065-b7e0-87787f3cc7bd\") " pod="openshift-dns/node-resolver-gcld7" Jul 09 13:49:34.820659 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.820604 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a07c917-a189-45a1-be43-1f672c0e7a36-etc-kubernetes\") pod \"tuned-8pjpx\" (UID: \"3a07c917-a189-45a1-be43-1f672c0e7a36\") " pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.820707 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.820654 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 13:49:34.820707 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.820647 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-node-log\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.821769 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.821749 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lth82" Jul 09 13:49:34.821888 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:34.821845 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lth82" podUID="36917a3c-dc1c-4371-8a99-f3fd743cfd9a" Jul 09 13:49:34.821965 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.821955 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 13:49:34.822045 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.821990 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ktfnn\"" Jul 09 13:49:34.822185 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.822171 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 13:49:34.822254 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.822173 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 13:49:34.823131 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.823114 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-txs25" Jul 09 13:49:34.824133 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.824118 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 13:49:34.824215 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.824177 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-92.ec2.internal" Jul 09 13:49:34.824406 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.824388 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-92.ec2.internal"] Jul 09 13:49:34.824480 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.824451 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rs66" Jul 09 13:49:34.824518 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:34.824493 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rs66" podUID="37ebd359-357d-4d89-b1b0-ce746eedeec9" Jul 09 13:49:34.825073 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.825053 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 13:49:34.825325 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.825310 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 13:49:34.825411 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.825395 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-c6l7k\"" Jul 09 13:49:34.837667 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.837649 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-143-92.ec2.internal"] Jul 09 13:49:34.837762 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.837687 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 13:49:34.843463 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.843448 2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 13:49:34.851233 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.851170 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 13:44:35 +0000 UTC" deadline="2028-03-21 22:19:36.062310394 +0000 UTC" Jul 09 13:49:34.851233 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.851233 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14912h30m1.211081s" Jul 09 13:49:34.854460 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.854442 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-x52ht" Jul 09 13:49:34.863382 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.863365 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-x52ht" Jul 09 13:49:34.912009 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.911989 2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 13:49:34.921678 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.921652 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-etc-openvswitch\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.921678 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.921687 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-run-openvswitch\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.921867 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.921711 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-run-ovn\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.921867 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.921732 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-host-cni-bin\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.921867 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.921755 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fe725cde-9e4a-4b8f-b96e-90fb61415652-ovn-node-metrics-cert\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.921867 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.921776 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ad8f280e-d164-45c9-88eb-40428803312c-sys-fs\") pod \"aws-ebs-csi-driver-node-9m82w\" (UID: \"ad8f280e-d164-45c9-88eb-40428803312c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9m82w" Jul 09 13:49:34.921867 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.921800 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3a07c917-a189-45a1-be43-1f672c0e7a36-etc-modprobe-d\") pod \"tuned-8pjpx\" (UID: \"3a07c917-a189-45a1-be43-1f672c0e7a36\") " pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.921867 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.921831 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-run-openvswitch\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.921867 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.921841 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ad8f280e-d164-45c9-88eb-40428803312c-registration-dir\") pod \"aws-ebs-csi-driver-node-9m82w\" (UID: \"ad8f280e-d164-45c9-88eb-40428803312c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9m82w" Jul 09 13:49:34.922184 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.921876 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-etc-openvswitch\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.922184 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.921888 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ad8f280e-d164-45c9-88eb-40428803312c-registration-dir\") pod \"aws-ebs-csi-driver-node-9m82w\" (UID: \"ad8f280e-d164-45c9-88eb-40428803312c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9m82w" Jul 09 13:49:34.922184 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.921898 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0-cni-binary-copy\") pod \"multus-additional-cni-plugins-dgjhm\" (UID: \"d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0\") " pod="openshift-multus/multus-additional-cni-plugins-dgjhm" Jul 09 13:49:34.922184 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.921928 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dgjhm\" (UID: \"d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0\") " pod="openshift-multus/multus-additional-cni-plugins-dgjhm" Jul 09 13:49:34.922184 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.921954 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-os-release\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:34.922184 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.921977 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-host-run-k8s-cni-cncf-io\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:34.922184 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.921933 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ad8f280e-d164-45c9-88eb-40428803312c-sys-fs\") pod \"aws-ebs-csi-driver-node-9m82w\" (UID: \"ad8f280e-d164-45c9-88eb-40428803312c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9m82w" Jul 09 13:49:34.922184 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.921995 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-host-run-netns\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:34.922184 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922000 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3a07c917-a189-45a1-be43-1f672c0e7a36-etc-modprobe-d\") pod \"tuned-8pjpx\" (UID: \"3a07c917-a189-45a1-be43-1f672c0e7a36\") " pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.922184 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922051 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-run-ovn\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.922184 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922059 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-host-cni-bin\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.922184 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922094 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3a07c917-a189-45a1-be43-1f672c0e7a36-etc-sysctl-d\") pod \"tuned-8pjpx\" (UID: \"3a07c917-a189-45a1-be43-1f672c0e7a36\") " pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.922184 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922130 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3a07c917-a189-45a1-be43-1f672c0e7a36-etc-sysctl-d\") pod \"tuned-8pjpx\" (UID: \"3a07c917-a189-45a1-be43-1f672c0e7a36\") " pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.922184 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922132 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3a07c917-a189-45a1-be43-1f672c0e7a36-etc-systemd\") pod \"tuned-8pjpx\" (UID: \"3a07c917-a189-45a1-be43-1f672c0e7a36\") " pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.922184 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922168 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fe725cde-9e4a-4b8f-b96e-90fb61415652-ovnkube-config\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.922184 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922179 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3a07c917-a189-45a1-be43-1f672c0e7a36-etc-systemd\") pod \"tuned-8pjpx\" (UID: \"3a07c917-a189-45a1-be43-1f672c0e7a36\") " pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.922184 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922192 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ad8f280e-d164-45c9-88eb-40428803312c-device-dir\") pod \"aws-ebs-csi-driver-node-9m82w\" (UID: \"ad8f280e-d164-45c9-88eb-40428803312c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9m82w" Jul 09 13:49:34.923028 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922219 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-multus-cni-dir\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:34.923028 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922247 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0-cnibin\") pod \"multus-additional-cni-plugins-dgjhm\" (UID: \"d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0\") " pod="openshift-multus/multus-additional-cni-plugins-dgjhm" Jul 09 13:49:34.923028 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922271 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a07c917-a189-45a1-be43-1f672c0e7a36-lib-modules\") pod \"tuned-8pjpx\" (UID: \"3a07c917-a189-45a1-be43-1f672c0e7a36\") " pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.923028 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922259 2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 13:49:34.923028 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922286 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ad8f280e-d164-45c9-88eb-40428803312c-device-dir\") pod \"aws-ebs-csi-driver-node-9m82w\" (UID: \"ad8f280e-d164-45c9-88eb-40428803312c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9m82w" Jul 09 13:49:34.923028 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922296 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a07c917-a189-45a1-be43-1f672c0e7a36-tmp\") pod \"tuned-8pjpx\" (UID: \"3a07c917-a189-45a1-be43-1f672c0e7a36\") " pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.923028 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922320 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fe725cde-9e4a-4b8f-b96e-90fb61415652-env-overrides\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.923028 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922344 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-cnibin\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:34.923028 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922369 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-host-var-lib-cni-bin\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:34.923028 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922393 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dgjhm\" (UID: \"d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0\") " pod="openshift-multus/multus-additional-cni-plugins-dgjhm" Jul 09 13:49:34.923028 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922393 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a07c917-a189-45a1-be43-1f672c0e7a36-lib-modules\") pod \"tuned-8pjpx\" (UID: \"3a07c917-a189-45a1-be43-1f672c0e7a36\") " pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.923028 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922415 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3a07c917-a189-45a1-be43-1f672c0e7a36-run\") pod \"tuned-8pjpx\" (UID: \"3a07c917-a189-45a1-be43-1f672c0e7a36\") " pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.923028 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922438 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-host-kubelet\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.923028 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922462 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-host-slash\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.923028 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922483 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ad8f280e-d164-45c9-88eb-40428803312c-etc-selinux\") pod \"aws-ebs-csi-driver-node-9m82w\" (UID: \"ad8f280e-d164-45c9-88eb-40428803312c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9m82w" Jul 09 13:49:34.923028 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922507 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwgvv\" (UniqueName: \"kubernetes.io/projected/ad8f280e-d164-45c9-88eb-40428803312c-kube-api-access-nwgvv\") pod \"aws-ebs-csi-driver-node-9m82w\" (UID: \"ad8f280e-d164-45c9-88eb-40428803312c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9m82w" Jul 09 13:49:34.923028 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922533 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9046684a-1e0f-4aae-b27d-04ab8a44aedb-host-slash\") pod \"iptables-alerter-fll8g\" (UID: \"9046684a-1e0f-4aae-b27d-04ab8a44aedb\") " pod="openshift-network-operator/iptables-alerter-fll8g" Jul 09 13:49:34.923804 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922575 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3a07c917-a189-45a1-be43-1f672c0e7a36-etc-sysctl-conf\") pod \"tuned-8pjpx\" (UID: \"3a07c917-a189-45a1-be43-1f672c0e7a36\") " pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.923804 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922597 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a07c917-a189-45a1-be43-1f672c0e7a36-host\") pod \"tuned-8pjpx\" (UID: \"3a07c917-a189-45a1-be43-1f672c0e7a36\") " pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.923804 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922621 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-log-socket\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.923804 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922642 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-host-run-ovn-kubernetes\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.923804 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922666 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.923804 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922647 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-host-slash\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.923804 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922693 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-var-lib-openvswitch\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.923804 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922721 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxv9q\" (UniqueName: \"kubernetes.io/projected/60191bf6-e7d9-4411-85a0-f1cc73dcc646-kube-api-access-cxv9q\") pod \"network-check-target-7btnh\" (UID: \"60191bf6-e7d9-4411-85a0-f1cc73dcc646\") " pod="openshift-network-diagnostics/network-check-target-7btnh" Jul 09 13:49:34.923804 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922748 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a07c917-a189-45a1-be43-1f672c0e7a36-etc-kubernetes\") pod \"tuned-8pjpx\" (UID: \"3a07c917-a189-45a1-be43-1f672c0e7a36\") " pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.923804 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922762 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3a07c917-a189-45a1-be43-1f672c0e7a36-run\") pod \"tuned-8pjpx\" (UID: \"3a07c917-a189-45a1-be43-1f672c0e7a36\") " pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.923804 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922771 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-node-log\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.923804 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922778 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a07c917-a189-45a1-be43-1f672c0e7a36-host\") pod \"tuned-8pjpx\" (UID: \"3a07c917-a189-45a1-be43-1f672c0e7a36\") " pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.923804 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922832 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-host-run-multus-certs\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:34.923804 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922829 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-host-kubelet\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.923804 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922858 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fe725cde-9e4a-4b8f-b96e-90fb61415652-ovnkube-config\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.923804 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922859 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/36917a3c-dc1c-4371-8a99-f3fd743cfd9a-dbus\") pod \"global-pull-secret-syncer-lth82\" (UID: \"36917a3c-dc1c-4371-8a99-f3fd743cfd9a\") " pod="kube-system/global-pull-secret-syncer-lth82" Jul 09 13:49:34.923804 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922888 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ad8f280e-d164-45c9-88eb-40428803312c-etc-selinux\") pod \"aws-ebs-csi-driver-node-9m82w\" (UID: \"ad8f280e-d164-45c9-88eb-40428803312c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9m82w" Jul 09 13:49:34.924618 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922909 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a07c917-a189-45a1-be43-1f672c0e7a36-sys\") pod \"tuned-8pjpx\" (UID: \"3a07c917-a189-45a1-be43-1f672c0e7a36\") " pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.924618 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922936 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfwbq\" (UniqueName: \"kubernetes.io/projected/3a07c917-a189-45a1-be43-1f672c0e7a36-kube-api-access-rfwbq\") pod \"tuned-8pjpx\" (UID: \"3a07c917-a189-45a1-be43-1f672c0e7a36\") " pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.924618 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922941 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-host-run-ovn-kubernetes\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.924618 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922961 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-log-socket\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.924618 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922963 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ncpk\" (UniqueName: \"kubernetes.io/projected/fe725cde-9e4a-4b8f-b96e-90fb61415652-kube-api-access-6ncpk\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.924618 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922966 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.924618 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922961 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-var-lib-openvswitch\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.924618 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922909 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fe725cde-9e4a-4b8f-b96e-90fb61415652-env-overrides\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.924618 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.922990 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a07c917-a189-45a1-be43-1f672c0e7a36-etc-kubernetes\") pod \"tuned-8pjpx\" (UID: \"3a07c917-a189-45a1-be43-1f672c0e7a36\") " pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.924618 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.923016 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8fae885f-7d7e-4ffa-ac4b-8521097c9cb4-konnectivity-ca\") pod \"konnectivity-agent-txs25\" (UID: \"8fae885f-7d7e-4ffa-ac4b-8521097c9cb4\") " pod="kube-system/konnectivity-agent-txs25" Jul 09 13:49:34.924618 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.923032 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/36917a3c-dc1c-4371-8a99-f3fd743cfd9a-original-pull-secret\") pod \"global-pull-secret-syncer-lth82\" (UID: \"36917a3c-dc1c-4371-8a99-f3fd743cfd9a\") " pod="kube-system/global-pull-secret-syncer-lth82" Jul 09 13:49:34.924618 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.923052 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-host-run-netns\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.924618 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.923093 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a07c917-a189-45a1-be43-1f672c0e7a36-sys\") pod \"tuned-8pjpx\" (UID: \"3a07c917-a189-45a1-be43-1f672c0e7a36\") " pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.924618 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.923091 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3a07c917-a189-45a1-be43-1f672c0e7a36-etc-sysctl-conf\") pod \"tuned-8pjpx\" (UID: \"3a07c917-a189-45a1-be43-1f672c0e7a36\") " pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.924618 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.923131 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-host-cni-netd\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.924618 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.923157 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ad8f280e-d164-45c9-88eb-40428803312c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9m82w\" (UID: \"ad8f280e-d164-45c9-88eb-40428803312c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9m82w" Jul 09 13:49:34.924618 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.923158 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-host-run-netns\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.925568 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.923221 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0bec2f7c-c273-4005-993e-0aa98a8d95dd-serviceca\") pod \"node-ca-l6z74\" (UID: \"0bec2f7c-c273-4005-993e-0aa98a8d95dd\") " pod="openshift-image-registry/node-ca-l6z74" Jul 09 13:49:34.925568 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.923258 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-host-cni-netd\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.925568 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.923263 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-node-log\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.925568 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.923265 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0-os-release\") pod \"multus-additional-cni-plugins-dgjhm\" (UID: \"d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0\") " pod="openshift-multus/multus-additional-cni-plugins-dgjhm" Jul 09 13:49:34.925568 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.923404 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-multus-conf-dir\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:34.925568 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.923435 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-multus-daemon-config\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:34.925568 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.923461 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8fae885f-7d7e-4ffa-ac4b-8521097c9cb4-agent-certs\") pod \"konnectivity-agent-txs25\" (UID: \"8fae885f-7d7e-4ffa-ac4b-8521097c9cb4\") " pod="kube-system/konnectivity-agent-txs25" Jul 09 13:49:34.925568 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.923486 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dgjhm\" (UID: \"d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0\") " pod="openshift-multus/multus-additional-cni-plugins-dgjhm" Jul 09 13:49:34.925568 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.923554 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3a07c917-a189-45a1-be43-1f672c0e7a36-etc-sysconfig\") pod \"tuned-8pjpx\" (UID: \"3a07c917-a189-45a1-be43-1f672c0e7a36\") " pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.925568 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.923584 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ad8f280e-d164-45c9-88eb-40428803312c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9m82w\" (UID: \"ad8f280e-d164-45c9-88eb-40428803312c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9m82w" Jul 09 13:49:34.925568 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.923627 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ad8f280e-d164-45c9-88eb-40428803312c-socket-dir\") pod \"aws-ebs-csi-driver-node-9m82w\" (UID: \"ad8f280e-d164-45c9-88eb-40428803312c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9m82w" Jul 09 13:49:34.925568 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.923655 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3d676a82-9c69-4065-b7e0-87787f3cc7bd-hosts-file\") pod \"node-resolver-gcld7\" (UID: \"3d676a82-9c69-4065-b7e0-87787f3cc7bd\") " pod="openshift-dns/node-resolver-gcld7" Jul 09 13:49:34.925568 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.923678 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0bec2f7c-c273-4005-993e-0aa98a8d95dd-host\") pod \"node-ca-l6z74\" (UID: \"0bec2f7c-c273-4005-993e-0aa98a8d95dd\") " pod="openshift-image-registry/node-ca-l6z74" Jul 09 13:49:34.925568 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.923703 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8x8z\" (UniqueName: \"kubernetes.io/projected/0bec2f7c-c273-4005-993e-0aa98a8d95dd-kube-api-access-j8x8z\") pod \"node-ca-l6z74\" (UID: \"0bec2f7c-c273-4005-993e-0aa98a8d95dd\") " pod="openshift-image-registry/node-ca-l6z74" Jul 09 13:49:34.925568 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.923756 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37ebd359-357d-4d89-b1b0-ce746eedeec9-metrics-certs\") pod \"network-metrics-daemon-5rs66\" (UID: \"37ebd359-357d-4d89-b1b0-ce746eedeec9\") " pod="openshift-multus/network-metrics-daemon-5rs66" Jul 09 13:49:34.925568 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.923782 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a07c917-a189-45a1-be43-1f672c0e7a36-var-lib-kubelet\") pod \"tuned-8pjpx\" (UID: \"3a07c917-a189-45a1-be43-1f672c0e7a36\") " pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.925568 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.923806 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3a07c917-a189-45a1-be43-1f672c0e7a36-etc-tuned\") pod \"tuned-8pjpx\" (UID: \"3a07c917-a189-45a1-be43-1f672c0e7a36\") " pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.926216 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.923852 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hmkq\" (UniqueName: \"kubernetes.io/projected/d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0-kube-api-access-9hmkq\") pod \"multus-additional-cni-plugins-dgjhm\" (UID: \"d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0\") " pod="openshift-multus/multus-additional-cni-plugins-dgjhm" Jul 09 13:49:34.926216 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.923878 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-etc-kubernetes\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:34.926216 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.923901 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/36917a3c-dc1c-4371-8a99-f3fd743cfd9a-kubelet-config\") pod \"global-pull-secret-syncer-lth82\" (UID: \"36917a3c-dc1c-4371-8a99-f3fd743cfd9a\") " pod="kube-system/global-pull-secret-syncer-lth82" Jul 09 13:49:34.926216 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.923927 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4xnt\" (UniqueName: \"kubernetes.io/projected/37ebd359-357d-4d89-b1b0-ce746eedeec9-kube-api-access-p4xnt\") pod \"network-metrics-daemon-5rs66\" (UID: \"37ebd359-357d-4d89-b1b0-ce746eedeec9\") " pod="openshift-multus/network-metrics-daemon-5rs66" Jul 09 13:49:34.926216 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.923941 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3d676a82-9c69-4065-b7e0-87787f3cc7bd-hosts-file\") pod \"node-resolver-gcld7\" (UID: \"3d676a82-9c69-4065-b7e0-87787f3cc7bd\") " pod="openshift-dns/node-resolver-gcld7" Jul 09 13:49:34.926216 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.924013 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fe725cde-9e4a-4b8f-b96e-90fb61415652-ovnkube-script-lib\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.926216 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.924047 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0-system-cni-dir\") pod \"multus-additional-cni-plugins-dgjhm\" (UID: \"d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0\") " pod="openshift-multus/multus-additional-cni-plugins-dgjhm" Jul 09 13:49:34.926216 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.924074 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-host-var-lib-kubelet\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:34.926216 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.924099 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9046684a-1e0f-4aae-b27d-04ab8a44aedb-iptables-alerter-script\") pod \"iptables-alerter-fll8g\" (UID: \"9046684a-1e0f-4aae-b27d-04ab8a44aedb\") " pod="openshift-network-operator/iptables-alerter-fll8g" Jul 09 13:49:34.926216 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.924120 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a07c917-a189-45a1-be43-1f672c0e7a36-var-lib-kubelet\") pod \"tuned-8pjpx\" (UID: \"3a07c917-a189-45a1-be43-1f672c0e7a36\") " pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.926216 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.924127 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-systemd-units\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.926216 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.924154 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-run-systemd\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.926216 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.924179 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d676a82-9c69-4065-b7e0-87787f3cc7bd-tmp-dir\") pod \"node-resolver-gcld7\" (UID: \"3d676a82-9c69-4065-b7e0-87787f3cc7bd\") " pod="openshift-dns/node-resolver-gcld7" Jul 09 13:49:34.926216 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.924224 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fv2l\" (UniqueName: \"kubernetes.io/projected/3d676a82-9c69-4065-b7e0-87787f3cc7bd-kube-api-access-2fv2l\") pod \"node-resolver-gcld7\" (UID: \"3d676a82-9c69-4065-b7e0-87787f3cc7bd\") " pod="openshift-dns/node-resolver-gcld7" Jul 09 13:49:34.926216 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.924304 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3a07c917-a189-45a1-be43-1f672c0e7a36-etc-sysconfig\") pod \"tuned-8pjpx\" (UID: \"3a07c917-a189-45a1-be43-1f672c0e7a36\") " pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.926216 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.924373 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ad8f280e-d164-45c9-88eb-40428803312c-socket-dir\") pod \"aws-ebs-csi-driver-node-9m82w\" (UID: \"ad8f280e-d164-45c9-88eb-40428803312c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9m82w" Jul 09 13:49:34.926216 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.924456 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-cni-binary-copy\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:34.926683 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.924487 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-multus-socket-dir-parent\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:34.926683 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.924514 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-host-var-lib-cni-multus\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:34.926683 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.924533 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d676a82-9c69-4065-b7e0-87787f3cc7bd-tmp-dir\") pod \"node-resolver-gcld7\" (UID: \"3d676a82-9c69-4065-b7e0-87787f3cc7bd\") " pod="openshift-dns/node-resolver-gcld7" Jul 09 13:49:34.926683 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.924552 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-system-cni-dir\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:34.926683 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.924590 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-hostroot\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:34.926683 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.924599 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-systemd-units\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.926683 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.924613 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4lzk\" (UniqueName: \"kubernetes.io/projected/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-kube-api-access-n4lzk\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:34.926683 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.924647 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fe725cde-9e4a-4b8f-b96e-90fb61415652-run-systemd\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.926683 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.924654 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9csj\" (UniqueName: \"kubernetes.io/projected/9046684a-1e0f-4aae-b27d-04ab8a44aedb-kube-api-access-v9csj\") pod \"iptables-alerter-fll8g\" (UID: \"9046684a-1e0f-4aae-b27d-04ab8a44aedb\") " pod="openshift-network-operator/iptables-alerter-fll8g" Jul 09 13:49:34.926683 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.924791 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fe725cde-9e4a-4b8f-b96e-90fb61415652-ovnkube-script-lib\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.926683 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.925989 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a07c917-a189-45a1-be43-1f672c0e7a36-tmp\") pod \"tuned-8pjpx\" (UID: \"3a07c917-a189-45a1-be43-1f672c0e7a36\") " pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.926683 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.926111 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fe725cde-9e4a-4b8f-b96e-90fb61415652-ovn-node-metrics-cert\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.927043 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.927024 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3a07c917-a189-45a1-be43-1f672c0e7a36-etc-tuned\") pod \"tuned-8pjpx\" (UID: \"3a07c917-a189-45a1-be43-1f672c0e7a36\") " pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.931509 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.931484 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwgvv\" (UniqueName: \"kubernetes.io/projected/ad8f280e-d164-45c9-88eb-40428803312c-kube-api-access-nwgvv\") pod \"aws-ebs-csi-driver-node-9m82w\" (UID: \"ad8f280e-d164-45c9-88eb-40428803312c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9m82w" Jul 09 13:49:34.931686 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.931669 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfwbq\" (UniqueName: \"kubernetes.io/projected/3a07c917-a189-45a1-be43-1f672c0e7a36-kube-api-access-rfwbq\") pod \"tuned-8pjpx\" (UID: \"3a07c917-a189-45a1-be43-1f672c0e7a36\") " pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:34.932031 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.932010 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fv2l\" (UniqueName: \"kubernetes.io/projected/3d676a82-9c69-4065-b7e0-87787f3cc7bd-kube-api-access-2fv2l\") pod \"node-resolver-gcld7\" (UID: \"3d676a82-9c69-4065-b7e0-87787f3cc7bd\") " pod="openshift-dns/node-resolver-gcld7" Jul 09 13:49:34.932094 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.932052 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ncpk\" (UniqueName: \"kubernetes.io/projected/fe725cde-9e4a-4b8f-b96e-90fb61415652-kube-api-access-6ncpk\") pod \"ovnkube-node-wlg95\" (UID: \"fe725cde-9e4a-4b8f-b96e-90fb61415652\") " pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:34.984697 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:34.984657 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod963a639aab59673e2b60d423e0aa7762.slice/crio-bef0c53a97e1a01a795e97bc4fd6392ab9f2f7beb928dc4da9899cd078d1b590 WatchSource:0}: Error finding container bef0c53a97e1a01a795e97bc4fd6392ab9f2f7beb928dc4da9899cd078d1b590: Status 404 returned error can't find the container with id bef0c53a97e1a01a795e97bc4fd6392ab9f2f7beb928dc4da9899cd078d1b590 Jul 09 13:49:34.985037 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:34.985020 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34bea405b2b687d739a81e962ab7a92d.slice/crio-1b0f24289f7fdbf161559330605ccbdf3b0ab82769e64a41b7d5d50ba13e5fa5 WatchSource:0}: Error finding container 1b0f24289f7fdbf161559330605ccbdf3b0ab82769e64a41b7d5d50ba13e5fa5: Status 404 returned error can't find the container with id 1b0f24289f7fdbf161559330605ccbdf3b0ab82769e64a41b7d5d50ba13e5fa5 Jul 09 13:49:34.989484 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:34.989464 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 13:49:35.025627 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.025588 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/36917a3c-dc1c-4371-8a99-f3fd743cfd9a-dbus\") pod \"global-pull-secret-syncer-lth82\" (UID: \"36917a3c-dc1c-4371-8a99-f3fd743cfd9a\") " pod="kube-system/global-pull-secret-syncer-lth82" Jul 09 13:49:35.025627 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.025629 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8fae885f-7d7e-4ffa-ac4b-8521097c9cb4-konnectivity-ca\") pod \"konnectivity-agent-txs25\" (UID: \"8fae885f-7d7e-4ffa-ac4b-8521097c9cb4\") " pod="kube-system/konnectivity-agent-txs25" Jul 09 13:49:35.025767 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.025646 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/36917a3c-dc1c-4371-8a99-f3fd743cfd9a-original-pull-secret\") pod \"global-pull-secret-syncer-lth82\" (UID: \"36917a3c-dc1c-4371-8a99-f3fd743cfd9a\") " pod="kube-system/global-pull-secret-syncer-lth82" Jul 09 13:49:35.025767 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.025708 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0bec2f7c-c273-4005-993e-0aa98a8d95dd-serviceca\") pod \"node-ca-l6z74\" (UID: \"0bec2f7c-c273-4005-993e-0aa98a8d95dd\") " pod="openshift-image-registry/node-ca-l6z74" Jul 09 13:49:35.025767 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:35.025737 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 13:49:35.025909 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.025796 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0-os-release\") pod \"multus-additional-cni-plugins-dgjhm\" (UID: \"d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0\") " pod="openshift-multus/multus-additional-cni-plugins-dgjhm" Jul 09 13:49:35.025909 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:35.025808 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36917a3c-dc1c-4371-8a99-f3fd743cfd9a-original-pull-secret podName:36917a3c-dc1c-4371-8a99-f3fd743cfd9a nodeName:}" failed. No retries permitted until 2026-07-09 13:49:35.525787982 +0000 UTC m=+2.118354324 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/36917a3c-dc1c-4371-8a99-f3fd743cfd9a-original-pull-secret") pod "global-pull-secret-syncer-lth82" (UID: "36917a3c-dc1c-4371-8a99-f3fd743cfd9a") : object "kube-system"/"original-pull-secret" not registered Jul 09 13:49:35.025909 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.025740 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0-os-release\") pod \"multus-additional-cni-plugins-dgjhm\" (UID: \"d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0\") " pod="openshift-multus/multus-additional-cni-plugins-dgjhm" Jul 09 13:49:35.025909 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.025854 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-multus-conf-dir\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:35.025909 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.025829 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/36917a3c-dc1c-4371-8a99-f3fd743cfd9a-dbus\") pod \"global-pull-secret-syncer-lth82\" (UID: \"36917a3c-dc1c-4371-8a99-f3fd743cfd9a\") " pod="kube-system/global-pull-secret-syncer-lth82" Jul 09 13:49:35.025909 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.025877 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-multus-daemon-config\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:35.025909 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.025899 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8fae885f-7d7e-4ffa-ac4b-8521097c9cb4-agent-certs\") pod \"konnectivity-agent-txs25\" (UID: \"8fae885f-7d7e-4ffa-ac4b-8521097c9cb4\") " pod="kube-system/konnectivity-agent-txs25" Jul 09 13:49:35.026253 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.025913 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-multus-conf-dir\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:35.026253 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.025923 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dgjhm\" (UID: \"d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0\") " pod="openshift-multus/multus-additional-cni-plugins-dgjhm" Jul 09 13:49:35.026253 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.025949 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0bec2f7c-c273-4005-993e-0aa98a8d95dd-host\") pod \"node-ca-l6z74\" (UID: \"0bec2f7c-c273-4005-993e-0aa98a8d95dd\") " pod="openshift-image-registry/node-ca-l6z74" Jul 09 13:49:35.026253 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.025970 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8x8z\" (UniqueName: \"kubernetes.io/projected/0bec2f7c-c273-4005-993e-0aa98a8d95dd-kube-api-access-j8x8z\") pod \"node-ca-l6z74\" (UID: \"0bec2f7c-c273-4005-993e-0aa98a8d95dd\") " pod="openshift-image-registry/node-ca-l6z74" Jul 09 13:49:35.026253 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.026008 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0bec2f7c-c273-4005-993e-0aa98a8d95dd-host\") pod \"node-ca-l6z74\" (UID: \"0bec2f7c-c273-4005-993e-0aa98a8d95dd\") " pod="openshift-image-registry/node-ca-l6z74" Jul 09 13:49:35.026253 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.026055 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37ebd359-357d-4d89-b1b0-ce746eedeec9-metrics-certs\") pod \"network-metrics-daemon-5rs66\" (UID: \"37ebd359-357d-4d89-b1b0-ce746eedeec9\") " pod="openshift-multus/network-metrics-daemon-5rs66" Jul 09 13:49:35.026253 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.026083 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hmkq\" (UniqueName: \"kubernetes.io/projected/d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0-kube-api-access-9hmkq\") pod \"multus-additional-cni-plugins-dgjhm\" (UID: \"d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0\") " pod="openshift-multus/multus-additional-cni-plugins-dgjhm" Jul 09 13:49:35.026253 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.026108 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-etc-kubernetes\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:35.026253 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.026130 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/36917a3c-dc1c-4371-8a99-f3fd743cfd9a-kubelet-config\") pod \"global-pull-secret-syncer-lth82\" (UID: \"36917a3c-dc1c-4371-8a99-f3fd743cfd9a\") " pod="kube-system/global-pull-secret-syncer-lth82" Jul 09 13:49:35.026253 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.026160 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4xnt\" (UniqueName: \"kubernetes.io/projected/37ebd359-357d-4d89-b1b0-ce746eedeec9-kube-api-access-p4xnt\") pod \"network-metrics-daemon-5rs66\" (UID: \"37ebd359-357d-4d89-b1b0-ce746eedeec9\") " pod="openshift-multus/network-metrics-daemon-5rs66" Jul 09 13:49:35.026253 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.026187 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0-system-cni-dir\") pod \"multus-additional-cni-plugins-dgjhm\" (UID: \"d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0\") " pod="openshift-multus/multus-additional-cni-plugins-dgjhm" Jul 09 13:49:35.026253 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.026209 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-host-var-lib-kubelet\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:35.026253 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.026235 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0bec2f7c-c273-4005-993e-0aa98a8d95dd-serviceca\") pod \"node-ca-l6z74\" (UID: \"0bec2f7c-c273-4005-993e-0aa98a8d95dd\") " pod="openshift-image-registry/node-ca-l6z74" Jul 09 13:49:35.026253 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.026253 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9046684a-1e0f-4aae-b27d-04ab8a44aedb-iptables-alerter-script\") pod \"iptables-alerter-fll8g\" (UID: \"9046684a-1e0f-4aae-b27d-04ab8a44aedb\") " pod="openshift-network-operator/iptables-alerter-fll8g" Jul 09 13:49:35.026253 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.026258 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-etc-kubernetes\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:35.027185 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.026260 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8fae885f-7d7e-4ffa-ac4b-8521097c9cb4-konnectivity-ca\") pod \"konnectivity-agent-txs25\" (UID: \"8fae885f-7d7e-4ffa-ac4b-8521097c9cb4\") " pod="kube-system/konnectivity-agent-txs25" Jul 09 13:49:35.027185 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.026283 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-cni-binary-copy\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:35.027185 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.026307 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-multus-socket-dir-parent\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:35.027185 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.026329 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-host-var-lib-kubelet\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:35.027185 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.026330 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-host-var-lib-cni-multus\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:35.027185 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.026365 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-host-var-lib-cni-multus\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:35.027185 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.026369 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-system-cni-dir\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:35.027185 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.026399 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-hostroot\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:35.027185 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.026413 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-system-cni-dir\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:35.027185 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.026423 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4lzk\" (UniqueName: \"kubernetes.io/projected/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-kube-api-access-n4lzk\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:35.027185 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.026429 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-multus-daemon-config\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:35.027185 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.026449 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9csj\" (UniqueName: \"kubernetes.io/projected/9046684a-1e0f-4aae-b27d-04ab8a44aedb-kube-api-access-v9csj\") pod \"iptables-alerter-fll8g\" (UID: \"9046684a-1e0f-4aae-b27d-04ab8a44aedb\") " pod="openshift-network-operator/iptables-alerter-fll8g" Jul 09 13:49:35.027185 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.026461 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0-system-cni-dir\") pod \"multus-additional-cni-plugins-dgjhm\" (UID: \"d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0\") " pod="openshift-multus/multus-additional-cni-plugins-dgjhm" Jul 09 13:49:35.027185 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.026484 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0-cni-binary-copy\") pod \"multus-additional-cni-plugins-dgjhm\" (UID: \"d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0\") " pod="openshift-multus/multus-additional-cni-plugins-dgjhm" Jul 09 13:49:35.027185 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:35.026496 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:49:35.027185 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.026510 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dgjhm\" (UID: \"d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0\") " pod="openshift-multus/multus-additional-cni-plugins-dgjhm" Jul 09 13:49:35.027185 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.026514 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-multus-socket-dir-parent\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:35.028055 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:35.026548 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37ebd359-357d-4d89-b1b0-ce746eedeec9-metrics-certs podName:37ebd359-357d-4d89-b1b0-ce746eedeec9 nodeName:}" failed. No retries permitted until 2026-07-09 13:49:35.526533341 +0000 UTC m=+2.119099707 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/37ebd359-357d-4d89-b1b0-ce746eedeec9-metrics-certs") pod "network-metrics-daemon-5rs66" (UID: "37ebd359-357d-4d89-b1b0-ce746eedeec9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:49:35.028055 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.026659 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-hostroot\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:35.028055 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.026434 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/36917a3c-dc1c-4371-8a99-f3fd743cfd9a-kubelet-config\") pod \"global-pull-secret-syncer-lth82\" (UID: \"36917a3c-dc1c-4371-8a99-f3fd743cfd9a\") " pod="kube-system/global-pull-secret-syncer-lth82" Jul 09 13:49:35.028055 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.026834 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-os-release\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:35.028055 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.026855 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-host-run-k8s-cni-cncf-io\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:35.028055 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.026871 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-host-run-netns\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:35.028055 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.026897 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-multus-cni-dir\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:35.028055 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.026922 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0-cnibin\") pod \"multus-additional-cni-plugins-dgjhm\" (UID: \"d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0\") " pod="openshift-multus/multus-additional-cni-plugins-dgjhm" Jul 09 13:49:35.028055 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.026946 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-cnibin\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:35.028055 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.026969 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-host-var-lib-cni-bin\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:35.028055 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.026993 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-multus-cni-dir\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:35.028055 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.026994 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dgjhm\" (UID: \"d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0\") " pod="openshift-multus/multus-additional-cni-plugins-dgjhm" Jul 09 13:49:35.028055 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.027011 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dgjhm\" (UID: \"d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0\") " pod="openshift-multus/multus-additional-cni-plugins-dgjhm" Jul 09 13:49:35.028055 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.027039 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-cni-binary-copy\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:35.028055 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.027041 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9046684a-1e0f-4aae-b27d-04ab8a44aedb-host-slash\") pod \"iptables-alerter-fll8g\" (UID: \"9046684a-1e0f-4aae-b27d-04ab8a44aedb\") " pod="openshift-network-operator/iptables-alerter-fll8g" Jul 09 13:49:35.028055 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.027069 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9046684a-1e0f-4aae-b27d-04ab8a44aedb-host-slash\") pod \"iptables-alerter-fll8g\" (UID: \"9046684a-1e0f-4aae-b27d-04ab8a44aedb\") " pod="openshift-network-operator/iptables-alerter-fll8g" Jul 09 13:49:35.028055 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.027076 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-cnibin\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:35.028728 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.027069 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9046684a-1e0f-4aae-b27d-04ab8a44aedb-iptables-alerter-script\") pod \"iptables-alerter-fll8g\" (UID: \"9046684a-1e0f-4aae-b27d-04ab8a44aedb\") " pod="openshift-network-operator/iptables-alerter-fll8g" Jul 09 13:49:35.028728 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.027105 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0-cnibin\") pod \"multus-additional-cni-plugins-dgjhm\" (UID: \"d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0\") " pod="openshift-multus/multus-additional-cni-plugins-dgjhm" Jul 09 13:49:35.028728 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.027108 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-host-run-k8s-cni-cncf-io\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:35.028728 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.027105 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxv9q\" (UniqueName: \"kubernetes.io/projected/60191bf6-e7d9-4411-85a0-f1cc73dcc646-kube-api-access-cxv9q\") pod \"network-check-target-7btnh\" (UID: \"60191bf6-e7d9-4411-85a0-f1cc73dcc646\") " pod="openshift-network-diagnostics/network-check-target-7btnh" Jul 09 13:49:35.028728 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.026944 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-os-release\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:35.028728 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.027130 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-host-run-netns\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:35.028728 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.027124 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dgjhm\" (UID: \"d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0\") " pod="openshift-multus/multus-additional-cni-plugins-dgjhm" Jul 09 13:49:35.028728 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.027139 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0-cni-binary-copy\") pod \"multus-additional-cni-plugins-dgjhm\" (UID: \"d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0\") " pod="openshift-multus/multus-additional-cni-plugins-dgjhm" Jul 09 13:49:35.028728 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.027151 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-host-run-multus-certs\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:35.028728 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.027155 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-host-var-lib-cni-bin\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:35.028728 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.027206 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-host-run-multus-certs\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:35.028728 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.027428 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dgjhm\" (UID: \"d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0\") " pod="openshift-multus/multus-additional-cni-plugins-dgjhm" Jul 09 13:49:35.029121 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.028801 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8fae885f-7d7e-4ffa-ac4b-8521097c9cb4-agent-certs\") pod \"konnectivity-agent-txs25\" (UID: \"8fae885f-7d7e-4ffa-ac4b-8521097c9cb4\") " pod="kube-system/konnectivity-agent-txs25" Jul 09 13:49:35.043143 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:35.043105 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 13:49:35.043245 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:35.043149 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 13:49:35.043245 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:35.043163 2573 projected.go:196] Error preparing data for projected volume kube-api-access-cxv9q for pod openshift-network-diagnostics/network-check-target-7btnh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:49:35.043245 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:35.043238 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60191bf6-e7d9-4411-85a0-f1cc73dcc646-kube-api-access-cxv9q podName:60191bf6-e7d9-4411-85a0-f1cc73dcc646 nodeName:}" failed. No retries permitted until 2026-07-09 13:49:35.543222367 +0000 UTC m=+2.135788710 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cxv9q" (UniqueName: "kubernetes.io/projected/60191bf6-e7d9-4411-85a0-f1cc73dcc646-kube-api-access-cxv9q") pod "network-check-target-7btnh" (UID: "60191bf6-e7d9-4411-85a0-f1cc73dcc646") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:49:35.044692 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.044671 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8x8z\" (UniqueName: \"kubernetes.io/projected/0bec2f7c-c273-4005-993e-0aa98a8d95dd-kube-api-access-j8x8z\") pod \"node-ca-l6z74\" (UID: \"0bec2f7c-c273-4005-993e-0aa98a8d95dd\") " pod="openshift-image-registry/node-ca-l6z74" Jul 09 13:49:35.044775 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.044703 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hmkq\" (UniqueName: \"kubernetes.io/projected/d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0-kube-api-access-9hmkq\") pod \"multus-additional-cni-plugins-dgjhm\" (UID: \"d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0\") " pod="openshift-multus/multus-additional-cni-plugins-dgjhm" Jul 09 13:49:35.044868 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.044848 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4lzk\" (UniqueName: \"kubernetes.io/projected/ad02c56f-c72c-49ff-9bfb-fc188743cfcb-kube-api-access-n4lzk\") pod \"multus-xl2jp\" (UID: \"ad02c56f-c72c-49ff-9bfb-fc188743cfcb\") " pod="openshift-multus/multus-xl2jp" Jul 09 13:49:35.045494 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.045475 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9csj\" (UniqueName: \"kubernetes.io/projected/9046684a-1e0f-4aae-b27d-04ab8a44aedb-kube-api-access-v9csj\") pod \"iptables-alerter-fll8g\" (UID: \"9046684a-1e0f-4aae-b27d-04ab8a44aedb\") " pod="openshift-network-operator/iptables-alerter-fll8g" Jul 09 13:49:35.045559 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.045544 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4xnt\" (UniqueName: \"kubernetes.io/projected/37ebd359-357d-4d89-b1b0-ce746eedeec9-kube-api-access-p4xnt\") pod \"network-metrics-daemon-5rs66\" (UID: \"37ebd359-357d-4d89-b1b0-ce746eedeec9\") " pod="openshift-multus/network-metrics-daemon-5rs66" Jul 09 13:49:35.140399 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.140318 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" Jul 09 13:49:35.148712 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:35.148686 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a07c917_a189_45a1_be43_1f672c0e7a36.slice/crio-9bc0a27f375c75f1f6d4e62ec30456401d7bddcb9843b31a1780badd36d8af8c WatchSource:0}: Error finding container 9bc0a27f375c75f1f6d4e62ec30456401d7bddcb9843b31a1780badd36d8af8c: Status 404 returned error can't find the container with id 9bc0a27f375c75f1f6d4e62ec30456401d7bddcb9843b31a1780badd36d8af8c Jul 09 13:49:35.163290 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.163270 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:49:35.171617 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:35.171591 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe725cde_9e4a_4b8f_b96e_90fb61415652.slice/crio-3205ce9d55c51bf0625035ffd2b4f6e54596953f33de35f10f4f3301cc7d545c WatchSource:0}: Error finding container 3205ce9d55c51bf0625035ffd2b4f6e54596953f33de35f10f4f3301cc7d545c: Status 404 returned error can't find the container with id 3205ce9d55c51bf0625035ffd2b4f6e54596953f33de35f10f4f3301cc7d545c Jul 09 13:49:35.181903 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.181883 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9m82w" Jul 09 13:49:35.185045 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.185026 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gcld7" Jul 09 13:49:35.192863 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:35.192839 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad8f280e_d164_45c9_88eb_40428803312c.slice/crio-766f93839131a5e6f91c62fb3eb8d5c7e03477cdd42fe1589c42580833ae7aaa WatchSource:0}: Error finding container 766f93839131a5e6f91c62fb3eb8d5c7e03477cdd42fe1589c42580833ae7aaa: Status 404 returned error can't find the container with id 766f93839131a5e6f91c62fb3eb8d5c7e03477cdd42fe1589c42580833ae7aaa Jul 09 13:49:35.193998 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:35.193975 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d676a82_9c69_4065_b7e0_87787f3cc7bd.slice/crio-2210f49dd4234eb6d6fd8067521e908567a29ebabef98c08e41a7a023445a9a0 WatchSource:0}: Error finding container 2210f49dd4234eb6d6fd8067521e908567a29ebabef98c08e41a7a023445a9a0: Status 404 returned error can't find the container with id 2210f49dd4234eb6d6fd8067521e908567a29ebabef98c08e41a7a023445a9a0 Jul 09 13:49:35.195305 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.195293 2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 13:49:35.202197 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.202183 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l6z74" Jul 09 13:49:35.209310 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:35.209290 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bec2f7c_c273_4005_993e_0aa98a8d95dd.slice/crio-ff1aad1c4cb01d9388ff543265d030993c3100c392bd50aee755a11acc436eb9 WatchSource:0}: Error finding container ff1aad1c4cb01d9388ff543265d030993c3100c392bd50aee755a11acc436eb9: Status 404 returned error can't find the container with id ff1aad1c4cb01d9388ff543265d030993c3100c392bd50aee755a11acc436eb9 Jul 09 13:49:35.215942 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.215925 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dgjhm" Jul 09 13:49:35.222487 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:35.222468 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8cf6dc8_f653_4c6a_abc4_94f6a4df08c0.slice/crio-d9bf0d548af09399f8830b7f4ef9be90d6ac8807b830999c8734886603ca6b94 WatchSource:0}: Error finding container d9bf0d548af09399f8830b7f4ef9be90d6ac8807b830999c8734886603ca6b94: Status 404 returned error can't find the container with id d9bf0d548af09399f8830b7f4ef9be90d6ac8807b830999c8734886603ca6b94 Jul 09 13:49:35.223089 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.223070 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xl2jp" Jul 09 13:49:35.229869 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:35.229845 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad02c56f_c72c_49ff_9bfb_fc188743cfcb.slice/crio-c99a02f824bbd1938dbb0472326888ac238e666f797239ea142450d6bcee718f WatchSource:0}: Error finding container c99a02f824bbd1938dbb0472326888ac238e666f797239ea142450d6bcee718f: Status 404 returned error can't find the container with id c99a02f824bbd1938dbb0472326888ac238e666f797239ea142450d6bcee718f Jul 09 13:49:35.242225 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.242210 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fll8g" Jul 09 13:49:35.249558 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:35.249536 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9046684a_1e0f_4aae_b27d_04ab8a44aedb.slice/crio-3ff4aa43d4c5b316c1a5a34741edc6f7589feaa205ce34861acfe4df7a9a78fd WatchSource:0}: Error finding container 3ff4aa43d4c5b316c1a5a34741edc6f7589feaa205ce34861acfe4df7a9a78fd: Status 404 returned error can't find the container with id 3ff4aa43d4c5b316c1a5a34741edc6f7589feaa205ce34861acfe4df7a9a78fd Jul 09 13:49:35.256469 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:35.256447 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-txs25" Jul 09 13:49:35.263460 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:49:35.263441 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fae885f_7d7e_4ffa_ac4b_8521097c9cb4.slice/crio-b0d243c0ba379da02128add55040b9fea4fbd0132d7e2073b58d2a661c31f795 WatchSource:0}: Error finding container b0d243c0ba379da02128add55040b9fea4fbd0132d7e2073b58d2a661c31f795: Status 404 returned error can't find the container with id b0d243c0ba379da02128add55040b9fea4fbd0132d7e2073b58d2a661c31f795 Jul 09 13:49:37.217250 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:37.217165 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/36917a3c-dc1c-4371-8a99-f3fd743cfd9a-original-pull-secret\") pod \"global-pull-secret-syncer-lth82\" (UID: \"36917a3c-dc1c-4371-8a99-f3fd743cfd9a\") " pod="kube-system/global-pull-secret-syncer-lth82" Jul 09 13:49:37.217250 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:37.217211 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37ebd359-357d-4d89-b1b0-ce746eedeec9-metrics-certs\") pod \"network-metrics-daemon-5rs66\" (UID: \"37ebd359-357d-4d89-b1b0-ce746eedeec9\") " pod="openshift-multus/network-metrics-daemon-5rs66" Jul 09 13:49:37.217511 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:37.217334 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:49:37.217511 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:37.217336 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 13:49:37.217511 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:37.217403 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37ebd359-357d-4d89-b1b0-ce746eedeec9-metrics-certs podName:37ebd359-357d-4d89-b1b0-ce746eedeec9 nodeName:}" failed. No retries permitted until 2026-07-09 13:49:38.21738667 +0000 UTC m=+3.123960845 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/37ebd359-357d-4d89-b1b0-ce746eedeec9-metrics-certs") pod "network-metrics-daemon-5rs66" (UID: "37ebd359-357d-4d89-b1b0-ce746eedeec9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:49:37.217511 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:37.217423 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36917a3c-dc1c-4371-8a99-f3fd743cfd9a-original-pull-secret podName:36917a3c-dc1c-4371-8a99-f3fd743cfd9a nodeName:}" failed. No retries permitted until 2026-07-09 13:49:38.217412809 +0000 UTC m=+3.123986979 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/36917a3c-dc1c-4371-8a99-f3fd743cfd9a-original-pull-secret") pod "global-pull-secret-syncer-lth82" (UID: "36917a3c-dc1c-4371-8a99-f3fd743cfd9a") : object "kube-system"/"original-pull-secret" not registered Jul 09 13:49:37.318042 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:37.317995 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxv9q\" (UniqueName: \"kubernetes.io/projected/60191bf6-e7d9-4411-85a0-f1cc73dcc646-kube-api-access-cxv9q\") pod \"network-check-target-7btnh\" (UID: \"60191bf6-e7d9-4411-85a0-f1cc73dcc646\") " pod="openshift-network-diagnostics/network-check-target-7btnh" Jul 09 13:49:37.318267 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:37.318243 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 13:49:37.318267 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:37.318271 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 13:49:37.318427 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:37.318283 2573 projected.go:196] Error preparing data for projected volume kube-api-access-cxv9q for pod openshift-network-diagnostics/network-check-target-7btnh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:49:37.318427 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:37.318339 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60191bf6-e7d9-4411-85a0-f1cc73dcc646-kube-api-access-cxv9q podName:60191bf6-e7d9-4411-85a0-f1cc73dcc646 nodeName:}" failed. No retries permitted until 2026-07-09 13:49:38.31832127 +0000 UTC m=+3.224895457 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cxv9q" (UniqueName: "kubernetes.io/projected/60191bf6-e7d9-4411-85a0-f1cc73dcc646-kube-api-access-cxv9q") pod "network-check-target-7btnh" (UID: "60191bf6-e7d9-4411-85a0-f1cc73dcc646") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:49:37.552330 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:37.552211 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 13:44:36 +0000 UTC" deadline="2028-03-04 23:38:44.507911564 +0000 UTC" Jul 09 13:49:37.552330 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:37.552279 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14505h49m6.955637039s" Jul 09 13:49:37.616404 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:37.616363 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 13:49:37.620790 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:37.620493 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xl2jp" event={"ID":"ad02c56f-c72c-49ff-9bfb-fc188743cfcb","Type":"ContainerStarted","Data":"c99a02f824bbd1938dbb0472326888ac238e666f797239ea142450d6bcee718f"} Jul 09 13:49:37.632554 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:37.632396 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dgjhm" event={"ID":"d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0","Type":"ContainerStarted","Data":"d9bf0d548af09399f8830b7f4ef9be90d6ac8807b830999c8734886603ca6b94"} Jul 09 13:49:37.660119 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:37.660072 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l6z74" event={"ID":"0bec2f7c-c273-4005-993e-0aa98a8d95dd","Type":"ContainerStarted","Data":"ff1aad1c4cb01d9388ff543265d030993c3100c392bd50aee755a11acc436eb9"} Jul 09 13:49:37.671227 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:37.671163 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gcld7" event={"ID":"3d676a82-9c69-4065-b7e0-87787f3cc7bd","Type":"ContainerStarted","Data":"2210f49dd4234eb6d6fd8067521e908567a29ebabef98c08e41a7a023445a9a0"} Jul 09 13:49:37.676182 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:37.676152 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" event={"ID":"fe725cde-9e4a-4b8f-b96e-90fb61415652","Type":"ContainerStarted","Data":"3205ce9d55c51bf0625035ffd2b4f6e54596953f33de35f10f4f3301cc7d545c"} Jul 09 13:49:37.695304 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:37.695269 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-92.ec2.internal" event={"ID":"963a639aab59673e2b60d423e0aa7762","Type":"ContainerStarted","Data":"bef0c53a97e1a01a795e97bc4fd6392ab9f2f7beb928dc4da9899cd078d1b590"} Jul 09 13:49:37.728481 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:37.728445 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fll8g" event={"ID":"9046684a-1e0f-4aae-b27d-04ab8a44aedb","Type":"ContainerStarted","Data":"3ff4aa43d4c5b316c1a5a34741edc6f7589feaa205ce34861acfe4df7a9a78fd"} Jul 09 13:49:37.736190 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:37.736136 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9m82w" event={"ID":"ad8f280e-d164-45c9-88eb-40428803312c","Type":"ContainerStarted","Data":"766f93839131a5e6f91c62fb3eb8d5c7e03477cdd42fe1589c42580833ae7aaa"} Jul 09 13:49:37.753533 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:37.753492 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" event={"ID":"3a07c917-a189-45a1-be43-1f672c0e7a36","Type":"ContainerStarted","Data":"9bc0a27f375c75f1f6d4e62ec30456401d7bddcb9843b31a1780badd36d8af8c"} Jul 09 13:49:37.780795 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:37.780725 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-92.ec2.internal" event={"ID":"34bea405b2b687d739a81e962ab7a92d","Type":"ContainerStarted","Data":"1b0f24289f7fdbf161559330605ccbdf3b0ab82769e64a41b7d5d50ba13e5fa5"} Jul 09 13:49:37.796359 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:37.796114 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-txs25" event={"ID":"8fae885f-7d7e-4ffa-ac4b-8521097c9cb4","Type":"ContainerStarted","Data":"b0d243c0ba379da02128add55040b9fea4fbd0132d7e2073b58d2a661c31f795"} Jul 09 13:49:38.226794 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:38.226755 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/36917a3c-dc1c-4371-8a99-f3fd743cfd9a-original-pull-secret\") pod \"global-pull-secret-syncer-lth82\" (UID: \"36917a3c-dc1c-4371-8a99-f3fd743cfd9a\") " pod="kube-system/global-pull-secret-syncer-lth82" Jul 09 13:49:38.227027 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:38.226833 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37ebd359-357d-4d89-b1b0-ce746eedeec9-metrics-certs\") pod \"network-metrics-daemon-5rs66\" (UID: \"37ebd359-357d-4d89-b1b0-ce746eedeec9\") " pod="openshift-multus/network-metrics-daemon-5rs66" Jul 09 13:49:38.227027 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:38.226970 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:49:38.227143 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:38.227030 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37ebd359-357d-4d89-b1b0-ce746eedeec9-metrics-certs podName:37ebd359-357d-4d89-b1b0-ce746eedeec9 nodeName:}" failed. No retries permitted until 2026-07-09 13:49:40.227011545 +0000 UTC m=+5.133585722 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/37ebd359-357d-4d89-b1b0-ce746eedeec9-metrics-certs") pod "network-metrics-daemon-5rs66" (UID: "37ebd359-357d-4d89-b1b0-ce746eedeec9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:49:38.227422 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:38.227402 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 13:49:38.227492 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:38.227461 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36917a3c-dc1c-4371-8a99-f3fd743cfd9a-original-pull-secret podName:36917a3c-dc1c-4371-8a99-f3fd743cfd9a nodeName:}" failed. No retries permitted until 2026-07-09 13:49:40.22744376 +0000 UTC m=+5.134017933 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/36917a3c-dc1c-4371-8a99-f3fd743cfd9a-original-pull-secret") pod "global-pull-secret-syncer-lth82" (UID: "36917a3c-dc1c-4371-8a99-f3fd743cfd9a") : object "kube-system"/"original-pull-secret" not registered Jul 09 13:49:38.327257 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:38.327220 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxv9q\" (UniqueName: \"kubernetes.io/projected/60191bf6-e7d9-4411-85a0-f1cc73dcc646-kube-api-access-cxv9q\") pod \"network-check-target-7btnh\" (UID: \"60191bf6-e7d9-4411-85a0-f1cc73dcc646\") " pod="openshift-network-diagnostics/network-check-target-7btnh" Jul 09 13:49:38.327479 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:38.327393 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 13:49:38.327479 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:38.327414 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 13:49:38.327479 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:38.327427 2573 projected.go:196] Error preparing data for projected volume kube-api-access-cxv9q for pod openshift-network-diagnostics/network-check-target-7btnh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:49:38.327654 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:38.327487 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60191bf6-e7d9-4411-85a0-f1cc73dcc646-kube-api-access-cxv9q podName:60191bf6-e7d9-4411-85a0-f1cc73dcc646 nodeName:}" failed. No retries permitted until 2026-07-09 13:49:40.327469513 +0000 UTC m=+5.234043699 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cxv9q" (UniqueName: "kubernetes.io/projected/60191bf6-e7d9-4411-85a0-f1cc73dcc646-kube-api-access-cxv9q") pod "network-check-target-7btnh" (UID: "60191bf6-e7d9-4411-85a0-f1cc73dcc646") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:49:38.553311 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:38.553221 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 13:44:36 +0000 UTC" deadline="2028-03-03 09:37:22.858357029 +0000 UTC" Jul 09 13:49:38.553311 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:38.553264 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14467h47m44.305097982s" Jul 09 13:49:38.607795 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:38.607695 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rs66" Jul 09 13:49:38.607959 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:38.607859 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rs66" podUID="37ebd359-357d-4d89-b1b0-ce746eedeec9" Jul 09 13:49:38.607959 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:38.607941 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7btnh" Jul 09 13:49:38.608069 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:38.608005 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7btnh" podUID="60191bf6-e7d9-4411-85a0-f1cc73dcc646" Jul 09 13:49:38.608069 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:38.608057 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lth82" Jul 09 13:49:38.608173 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:38.608121 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lth82" podUID="36917a3c-dc1c-4371-8a99-f3fd743cfd9a" Jul 09 13:49:39.086118 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:39.086087 2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 13:49:40.244460 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:40.244417 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/36917a3c-dc1c-4371-8a99-f3fd743cfd9a-original-pull-secret\") pod \"global-pull-secret-syncer-lth82\" (UID: \"36917a3c-dc1c-4371-8a99-f3fd743cfd9a\") " pod="kube-system/global-pull-secret-syncer-lth82" Jul 09 13:49:40.244995 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:40.244481 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37ebd359-357d-4d89-b1b0-ce746eedeec9-metrics-certs\") pod \"network-metrics-daemon-5rs66\" (UID: \"37ebd359-357d-4d89-b1b0-ce746eedeec9\") " pod="openshift-multus/network-metrics-daemon-5rs66" Jul 09 13:49:40.244995 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:40.244617 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:49:40.244995 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:40.244677 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37ebd359-357d-4d89-b1b0-ce746eedeec9-metrics-certs podName:37ebd359-357d-4d89-b1b0-ce746eedeec9 nodeName:}" failed. No retries permitted until 2026-07-09 13:49:44.244659013 +0000 UTC m=+9.151233190 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/37ebd359-357d-4d89-b1b0-ce746eedeec9-metrics-certs") pod "network-metrics-daemon-5rs66" (UID: "37ebd359-357d-4d89-b1b0-ce746eedeec9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:49:40.245180 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:40.245131 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 13:49:40.245231 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:40.245186 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36917a3c-dc1c-4371-8a99-f3fd743cfd9a-original-pull-secret podName:36917a3c-dc1c-4371-8a99-f3fd743cfd9a nodeName:}" failed. No retries permitted until 2026-07-09 13:49:44.245170539 +0000 UTC m=+9.151744726 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/36917a3c-dc1c-4371-8a99-f3fd743cfd9a-original-pull-secret") pod "global-pull-secret-syncer-lth82" (UID: "36917a3c-dc1c-4371-8a99-f3fd743cfd9a") : object "kube-system"/"original-pull-secret" not registered Jul 09 13:49:40.345755 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:40.345711 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxv9q\" (UniqueName: \"kubernetes.io/projected/60191bf6-e7d9-4411-85a0-f1cc73dcc646-kube-api-access-cxv9q\") pod \"network-check-target-7btnh\" (UID: \"60191bf6-e7d9-4411-85a0-f1cc73dcc646\") " pod="openshift-network-diagnostics/network-check-target-7btnh" Jul 09 13:49:40.346056 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:40.346031 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 13:49:40.346153 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:40.346064 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 13:49:40.346153 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:40.346078 2573 projected.go:196] Error preparing data for projected volume kube-api-access-cxv9q for pod openshift-network-diagnostics/network-check-target-7btnh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:49:40.346252 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:40.346211 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60191bf6-e7d9-4411-85a0-f1cc73dcc646-kube-api-access-cxv9q podName:60191bf6-e7d9-4411-85a0-f1cc73dcc646 nodeName:}" failed. No retries permitted until 2026-07-09 13:49:44.346189013 +0000 UTC m=+9.252763204 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cxv9q" (UniqueName: "kubernetes.io/projected/60191bf6-e7d9-4411-85a0-f1cc73dcc646-kube-api-access-cxv9q") pod "network-check-target-7btnh" (UID: "60191bf6-e7d9-4411-85a0-f1cc73dcc646") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:49:40.607935 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:40.607065 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rs66" Jul 09 13:49:40.607935 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:40.607205 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rs66" podUID="37ebd359-357d-4d89-b1b0-ce746eedeec9" Jul 09 13:49:40.607935 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:40.607599 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7btnh" Jul 09 13:49:40.607935 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:40.607692 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7btnh" podUID="60191bf6-e7d9-4411-85a0-f1cc73dcc646" Jul 09 13:49:40.607935 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:40.607757 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lth82" Jul 09 13:49:40.607935 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:40.607846 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lth82" podUID="36917a3c-dc1c-4371-8a99-f3fd743cfd9a" Jul 09 13:49:42.607746 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:42.607014 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rs66" Jul 09 13:49:42.607746 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:42.607211 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rs66" podUID="37ebd359-357d-4d89-b1b0-ce746eedeec9" Jul 09 13:49:42.607746 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:42.607042 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lth82" Jul 09 13:49:42.607746 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:42.607305 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lth82" podUID="36917a3c-dc1c-4371-8a99-f3fd743cfd9a" Jul 09 13:49:42.607746 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:42.607014 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7btnh" Jul 09 13:49:42.607746 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:42.607380 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7btnh" podUID="60191bf6-e7d9-4411-85a0-f1cc73dcc646" Jul 09 13:49:44.280138 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:44.280094 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37ebd359-357d-4d89-b1b0-ce746eedeec9-metrics-certs\") pod \"network-metrics-daemon-5rs66\" (UID: \"37ebd359-357d-4d89-b1b0-ce746eedeec9\") " pod="openshift-multus/network-metrics-daemon-5rs66" Jul 09 13:49:44.280499 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:44.280210 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/36917a3c-dc1c-4371-8a99-f3fd743cfd9a-original-pull-secret\") pod \"global-pull-secret-syncer-lth82\" (UID: \"36917a3c-dc1c-4371-8a99-f3fd743cfd9a\") " pod="kube-system/global-pull-secret-syncer-lth82" Jul 09 13:49:44.280499 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:44.280374 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 13:49:44.280499 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:44.280440 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36917a3c-dc1c-4371-8a99-f3fd743cfd9a-original-pull-secret podName:36917a3c-dc1c-4371-8a99-f3fd743cfd9a nodeName:}" failed. No retries permitted until 2026-07-09 13:49:52.280421411 +0000 UTC m=+17.186995602 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/36917a3c-dc1c-4371-8a99-f3fd743cfd9a-original-pull-secret") pod "global-pull-secret-syncer-lth82" (UID: "36917a3c-dc1c-4371-8a99-f3fd743cfd9a") : object "kube-system"/"original-pull-secret" not registered Jul 09 13:49:44.281072 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:44.281047 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:49:44.281202 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:44.281105 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37ebd359-357d-4d89-b1b0-ce746eedeec9-metrics-certs podName:37ebd359-357d-4d89-b1b0-ce746eedeec9 nodeName:}" failed. No retries permitted until 2026-07-09 13:49:52.281088791 +0000 UTC m=+17.187662964 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/37ebd359-357d-4d89-b1b0-ce746eedeec9-metrics-certs") pod "network-metrics-daemon-5rs66" (UID: "37ebd359-357d-4d89-b1b0-ce746eedeec9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:49:44.381350 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:44.381311 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxv9q\" (UniqueName: \"kubernetes.io/projected/60191bf6-e7d9-4411-85a0-f1cc73dcc646-kube-api-access-cxv9q\") pod \"network-check-target-7btnh\" (UID: \"60191bf6-e7d9-4411-85a0-f1cc73dcc646\") " pod="openshift-network-diagnostics/network-check-target-7btnh" Jul 09 13:49:44.381557 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:44.381539 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 13:49:44.381643 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:44.381564 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 13:49:44.381643 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:44.381577 2573 projected.go:196] Error preparing data for projected volume kube-api-access-cxv9q for pod openshift-network-diagnostics/network-check-target-7btnh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:49:44.381768 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:44.381643 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60191bf6-e7d9-4411-85a0-f1cc73dcc646-kube-api-access-cxv9q podName:60191bf6-e7d9-4411-85a0-f1cc73dcc646 nodeName:}" failed. No retries permitted until 2026-07-09 13:49:52.381624514 +0000 UTC m=+17.288198698 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cxv9q" (UniqueName: "kubernetes.io/projected/60191bf6-e7d9-4411-85a0-f1cc73dcc646-kube-api-access-cxv9q") pod "network-check-target-7btnh" (UID: "60191bf6-e7d9-4411-85a0-f1cc73dcc646") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:49:44.607276 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:44.607193 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lth82" Jul 09 13:49:44.607415 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:44.607323 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lth82" podUID="36917a3c-dc1c-4371-8a99-f3fd743cfd9a" Jul 09 13:49:44.607712 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:44.607694 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rs66" Jul 09 13:49:44.607841 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:44.607821 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rs66" podUID="37ebd359-357d-4d89-b1b0-ce746eedeec9" Jul 09 13:49:44.607928 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:44.607906 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7btnh" Jul 09 13:49:44.608038 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:44.608016 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7btnh" podUID="60191bf6-e7d9-4411-85a0-f1cc73dcc646" Jul 09 13:49:46.607023 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:46.606993 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rs66" Jul 09 13:49:46.607497 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:46.607108 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rs66" podUID="37ebd359-357d-4d89-b1b0-ce746eedeec9" Jul 09 13:49:46.607497 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:46.607407 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7btnh" Jul 09 13:49:46.607497 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:46.607472 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7btnh" podUID="60191bf6-e7d9-4411-85a0-f1cc73dcc646" Jul 09 13:49:46.607669 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:46.607520 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lth82" Jul 09 13:49:46.607669 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:46.607592 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lth82" podUID="36917a3c-dc1c-4371-8a99-f3fd743cfd9a" Jul 09 13:49:48.607579 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:48.607539 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7btnh" Jul 09 13:49:48.607579 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:48.607581 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rs66" Jul 09 13:49:48.608048 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:48.607585 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lth82" Jul 09 13:49:48.608048 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:48.607667 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7btnh" podUID="60191bf6-e7d9-4411-85a0-f1cc73dcc646" Jul 09 13:49:48.608048 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:48.607795 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rs66" podUID="37ebd359-357d-4d89-b1b0-ce746eedeec9" Jul 09 13:49:48.608048 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:48.607916 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lth82" podUID="36917a3c-dc1c-4371-8a99-f3fd743cfd9a" Jul 09 13:49:50.607596 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:50.607561 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lth82" Jul 09 13:49:50.608075 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:50.607561 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rs66" Jul 09 13:49:50.608075 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:50.607700 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lth82" podUID="36917a3c-dc1c-4371-8a99-f3fd743cfd9a" Jul 09 13:49:50.608075 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:50.607561 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7btnh" Jul 09 13:49:50.608075 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:50.607794 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rs66" podUID="37ebd359-357d-4d89-b1b0-ce746eedeec9" Jul 09 13:49:50.608075 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:50.607886 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7btnh" podUID="60191bf6-e7d9-4411-85a0-f1cc73dcc646" Jul 09 13:49:52.342342 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:52.342282 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/36917a3c-dc1c-4371-8a99-f3fd743cfd9a-original-pull-secret\") pod \"global-pull-secret-syncer-lth82\" (UID: \"36917a3c-dc1c-4371-8a99-f3fd743cfd9a\") " pod="kube-system/global-pull-secret-syncer-lth82" Jul 09 13:49:52.342342 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:52.342347 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37ebd359-357d-4d89-b1b0-ce746eedeec9-metrics-certs\") pod \"network-metrics-daemon-5rs66\" (UID: \"37ebd359-357d-4d89-b1b0-ce746eedeec9\") " pod="openshift-multus/network-metrics-daemon-5rs66" Jul 09 13:49:52.342830 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:52.342440 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:49:52.342830 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:52.342486 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37ebd359-357d-4d89-b1b0-ce746eedeec9-metrics-certs podName:37ebd359-357d-4d89-b1b0-ce746eedeec9 nodeName:}" failed. No retries permitted until 2026-07-09 13:50:08.342473178 +0000 UTC m=+33.249047350 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/37ebd359-357d-4d89-b1b0-ce746eedeec9-metrics-certs") pod "network-metrics-daemon-5rs66" (UID: "37ebd359-357d-4d89-b1b0-ce746eedeec9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:49:52.342830 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:52.342547 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 13:49:52.342830 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:52.342581 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36917a3c-dc1c-4371-8a99-f3fd743cfd9a-original-pull-secret podName:36917a3c-dc1c-4371-8a99-f3fd743cfd9a nodeName:}" failed. No retries permitted until 2026-07-09 13:50:08.342569279 +0000 UTC m=+33.249143469 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/36917a3c-dc1c-4371-8a99-f3fd743cfd9a-original-pull-secret") pod "global-pull-secret-syncer-lth82" (UID: "36917a3c-dc1c-4371-8a99-f3fd743cfd9a") : object "kube-system"/"original-pull-secret" not registered Jul 09 13:49:52.442982 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:52.442941 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxv9q\" (UniqueName: \"kubernetes.io/projected/60191bf6-e7d9-4411-85a0-f1cc73dcc646-kube-api-access-cxv9q\") pod \"network-check-target-7btnh\" (UID: \"60191bf6-e7d9-4411-85a0-f1cc73dcc646\") " pod="openshift-network-diagnostics/network-check-target-7btnh" Jul 09 13:49:52.443199 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:52.443070 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 13:49:52.443199 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:52.443086 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 13:49:52.443199 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:52.443094 2573 projected.go:196] Error preparing data for projected volume kube-api-access-cxv9q for pod openshift-network-diagnostics/network-check-target-7btnh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:49:52.443199 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:52.443153 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60191bf6-e7d9-4411-85a0-f1cc73dcc646-kube-api-access-cxv9q podName:60191bf6-e7d9-4411-85a0-f1cc73dcc646 nodeName:}" failed. No retries permitted until 2026-07-09 13:50:08.443134519 +0000 UTC m=+33.349708707 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cxv9q" (UniqueName: "kubernetes.io/projected/60191bf6-e7d9-4411-85a0-f1cc73dcc646-kube-api-access-cxv9q") pod "network-check-target-7btnh" (UID: "60191bf6-e7d9-4411-85a0-f1cc73dcc646") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:49:52.606961 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:52.606875 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7btnh" Jul 09 13:49:52.607216 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:52.606875 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rs66" Jul 09 13:49:52.607216 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:52.607017 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7btnh" podUID="60191bf6-e7d9-4411-85a0-f1cc73dcc646" Jul 09 13:49:52.607216 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:52.606879 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lth82" Jul 09 13:49:52.607216 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:52.607123 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rs66" podUID="37ebd359-357d-4d89-b1b0-ce746eedeec9" Jul 09 13:49:52.607415 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:52.607215 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lth82" podUID="36917a3c-dc1c-4371-8a99-f3fd743cfd9a" Jul 09 13:49:54.607464 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:54.607429 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lth82" Jul 09 13:49:54.607982 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:54.607428 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7btnh" Jul 09 13:49:54.607982 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:54.607540 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lth82" podUID="36917a3c-dc1c-4371-8a99-f3fd743cfd9a" Jul 09 13:49:54.607982 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:54.607428 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rs66" Jul 09 13:49:54.607982 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:54.607607 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7btnh" podUID="60191bf6-e7d9-4411-85a0-f1cc73dcc646" Jul 09 13:49:54.607982 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:54.607721 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rs66" podUID="37ebd359-357d-4d89-b1b0-ce746eedeec9" Jul 09 13:49:56.606742 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:56.606705 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7btnh" Jul 09 13:49:56.607223 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:56.606700 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lth82" Jul 09 13:49:56.607223 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:56.606857 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7btnh" podUID="60191bf6-e7d9-4411-85a0-f1cc73dcc646" Jul 09 13:49:56.607223 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:56.606707 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rs66" Jul 09 13:49:56.607223 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:56.606939 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lth82" podUID="36917a3c-dc1c-4371-8a99-f3fd743cfd9a" Jul 09 13:49:56.607223 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:56.607001 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rs66" podUID="37ebd359-357d-4d89-b1b0-ce746eedeec9" Jul 09 13:49:57.845866 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:57.845835 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xl2jp" event={"ID":"ad02c56f-c72c-49ff-9bfb-fc188743cfcb","Type":"ContainerStarted","Data":"a23379b885818ef3b237426290439eee99f8bed8ee2e1962e8faf9fc7f5b0d51"} Jul 09 13:49:57.848019 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:57.847914 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" event={"ID":"fe725cde-9e4a-4b8f-b96e-90fb61415652","Type":"ContainerStarted","Data":"226e47d79550899979d423caedf4f3aa80967f2f3cd97043bc93019643cc0a9b"} Jul 09 13:49:57.849661 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:57.849631 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" event={"ID":"3a07c917-a189-45a1-be43-1f672c0e7a36","Type":"ContainerStarted","Data":"0bd486d215fc88db9b47670e781ae1413c4039b435838943ecefc461f1ae69d1"} Jul 09 13:49:57.851834 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:57.851368 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-92.ec2.internal" event={"ID":"34bea405b2b687d739a81e962ab7a92d","Type":"ContainerStarted","Data":"901ba462bc1d54f72455eed83eb9b1a7758fcb01d1501a9be81122f037c5e088"} Jul 09 13:49:57.874218 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:57.874051 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xl2jp" podStartSLOduration=2.119179392 podStartE2EDuration="22.874037687s" totalImagesPullingTime="20.754858295s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:49:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:49:57.873761643 +0000 UTC m=+22.780335836" watchObservedRunningTime="2026-07-09 13:49:57.874037687 +0000 UTC m=+22.780611880" Jul 09 13:49:57.907365 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:57.907073 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8pjpx" podStartSLOduration=2.329533449 podStartE2EDuration="22.907055182s" totalImagesPullingTime="20.577521733s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:49:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:49:57.901405107 +0000 UTC m=+22.807979404" watchObservedRunningTime="2026-07-09 13:49:57.907055182 +0000 UTC m=+22.813629374" Jul 09 13:49:57.924617 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:57.924561 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-92.ec2.internal" podStartSLOduration=21.924540601 podStartE2EDuration="21.924540601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:49:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:49:57.924060241 +0000 UTC m=+22.830634439" watchObservedRunningTime="2026-07-09 13:49:57.924540601 +0000 UTC m=+22.831114818" Jul 09 13:49:58.607592 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:58.607521 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lth82" Jul 09 13:49:58.607790 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:58.607528 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7btnh" Jul 09 13:49:58.607790 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:58.607634 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lth82" podUID="36917a3c-dc1c-4371-8a99-f3fd743cfd9a" Jul 09 13:49:58.607790 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:58.607653 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rs66" Jul 09 13:49:58.607790 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:58.607716 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7btnh" podUID="60191bf6-e7d9-4411-85a0-f1cc73dcc646" Jul 09 13:49:58.607948 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:49:58.607783 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rs66" podUID="37ebd359-357d-4d89-b1b0-ce746eedeec9" Jul 09 13:49:58.857658 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:58.857449 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wlg95_fe725cde-9e4a-4b8f-b96e-90fb61415652/ovn-acl-logging/0.log" Jul 09 13:49:58.858623 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:58.857997 2573 generic.go:356] "Generic (PLEG): container finished" podID="fe725cde-9e4a-4b8f-b96e-90fb61415652" containerID="7a123275bdb734d4df8028e083833c0e34f12d080228bb557673801beab44109" exitCode=1 Jul 09 13:49:58.858623 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:58.858081 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" event={"ID":"fe725cde-9e4a-4b8f-b96e-90fb61415652","Type":"ContainerStarted","Data":"10473fede67b1bf33b1d5fe7b81215fb08ac0af10dcce3d2c23e9439fba1fde3"} Jul 09 13:49:58.858623 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:58.858166 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" event={"ID":"fe725cde-9e4a-4b8f-b96e-90fb61415652","Type":"ContainerStarted","Data":"4eceff5fd66cde770f22641846645adbab68ee4a678bcf69a63e55f6fdf19631"} Jul 09 13:49:58.858623 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:58.858209 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" event={"ID":"fe725cde-9e4a-4b8f-b96e-90fb61415652","Type":"ContainerStarted","Data":"e9b2353050fd3ca652110ddb096a3dc491bc39b39af2a18ad16a5f69bc052b2b"} Jul 09 13:49:58.858623 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:58.858250 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" event={"ID":"fe725cde-9e4a-4b8f-b96e-90fb61415652","Type":"ContainerStarted","Data":"dca68868c8d31fcfe62bb887472287401f3e522cb5e01542d3b395c86c364e1e"} Jul 09 13:49:58.858623 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:58.858294 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" event={"ID":"fe725cde-9e4a-4b8f-b96e-90fb61415652","Type":"ContainerDied","Data":"7a123275bdb734d4df8028e083833c0e34f12d080228bb557673801beab44109"} Jul 09 13:49:58.864680 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:58.864209 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-txs25" event={"ID":"8fae885f-7d7e-4ffa-ac4b-8521097c9cb4","Type":"ContainerStarted","Data":"b9268c75637f920ffeb824587e5998cfb2bf57d45ddbd78dbabfb952e2daf676"} Jul 09 13:49:59.866638 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:59.866598 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gcld7" event={"ID":"3d676a82-9c69-4065-b7e0-87787f3cc7bd","Type":"ContainerStarted","Data":"8e464b5598762ba9347263d2df9d4964acd1911f05c59eaa555cba82f082d405"} Jul 09 13:49:59.867985 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:59.867960 2573 generic.go:356] "Generic (PLEG): container finished" podID="963a639aab59673e2b60d423e0aa7762" containerID="f0c11d8ea5c24375790859bca20f95ddff5d5cb2e79a166aa8786dc2023d5342" exitCode=0 Jul 09 13:49:59.868095 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:59.868023 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-92.ec2.internal" event={"ID":"963a639aab59673e2b60d423e0aa7762","Type":"ContainerDied","Data":"f0c11d8ea5c24375790859bca20f95ddff5d5cb2e79a166aa8786dc2023d5342"} Jul 09 13:49:59.869634 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:59.869601 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fll8g" event={"ID":"9046684a-1e0f-4aae-b27d-04ab8a44aedb","Type":"ContainerStarted","Data":"6e0209f9f48beb036d6c2abb23d2d5c0c3947cd021a6834aec13f459db1fc435"} Jul 09 13:49:59.871076 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:59.871055 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9m82w" event={"ID":"ad8f280e-d164-45c9-88eb-40428803312c","Type":"ContainerStarted","Data":"80373f97bafc23f199068b7584c1ff550bc3ae531a60d15b36c1a5a7396c5048"} Jul 09 13:49:59.872434 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:59.872412 2573 generic.go:356] "Generic (PLEG): container finished" podID="d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0" containerID="06fc6f9ac8a8b047309fe3e0772e1779da9b10ef456ffae1a0ad03784f0d6310" exitCode=0 Jul 09 13:49:59.872522 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:59.872495 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dgjhm" event={"ID":"d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0","Type":"ContainerDied","Data":"06fc6f9ac8a8b047309fe3e0772e1779da9b10ef456ffae1a0ad03784f0d6310"} Jul 09 13:49:59.873839 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:59.873730 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l6z74" event={"ID":"0bec2f7c-c273-4005-993e-0aa98a8d95dd","Type":"ContainerStarted","Data":"8e83241e2d35f90c38f71cb390bf4a78141cb99ece09d8aaef9813d859f96805"} Jul 09 13:49:59.882285 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:59.882226 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gcld7" podStartSLOduration=4.154453243 podStartE2EDuration="24.882207532s" totalImagesPullingTime="20.727754289s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:49:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:49:59.881472619 +0000 UTC m=+24.788046812" watchObservedRunningTime="2026-07-09 13:49:59.882207532 +0000 UTC m=+24.788781726" Jul 09 13:49:59.911133 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:59.911094 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-l6z74" podStartSLOduration=4.347795995 podStartE2EDuration="24.911080365s" totalImagesPullingTime="20.56328437s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:49:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:49:59.910864829 +0000 UTC m=+24.817439027" watchObservedRunningTime="2026-07-09 13:49:59.911080365 +0000 UTC m=+24.817654557" Jul 09 13:49:59.978987 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:59.978931 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-txs25" podStartSLOduration=3.515985208 podStartE2EDuration="23.978910272s" totalImagesPullingTime="20.462925064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:49:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:49:59.978654397 +0000 UTC m=+24.885228592" watchObservedRunningTime="2026-07-09 13:49:59.978910272 +0000 UTC m=+24.885484467" Jul 09 13:49:59.999445 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:49:59.999392 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fll8g" podStartSLOduration=4.474813301 podStartE2EDuration="24.99937237s" totalImagesPullingTime="20.524559069s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:49:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:49:59.999102791 +0000 UTC m=+24.905676996" watchObservedRunningTime="2026-07-09 13:49:59.99937237 +0000 UTC m=+24.905946564" Jul 09 13:50:00.098381 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:00.098357 2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 13:50:00.577789 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:00.577692 2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T13:50:00.098374789Z","UUID":"31828f65-6b0e-4f6f-bc9c-f3efa858f654","Handler":null,"Name":"","Endpoint":""} Jul 09 13:50:00.579440 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:00.579416 2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 13:50:00.579621 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:00.579462 2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 13:50:00.607376 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:00.607312 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rs66" Jul 09 13:50:00.607502 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:00.607435 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7btnh" Jul 09 13:50:00.607502 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:00.607442 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rs66" podUID="37ebd359-357d-4d89-b1b0-ce746eedeec9" Jul 09 13:50:00.607613 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:00.607537 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7btnh" podUID="60191bf6-e7d9-4411-85a0-f1cc73dcc646" Jul 09 13:50:00.607613 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:00.607443 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lth82" Jul 09 13:50:00.607709 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:00.607638 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lth82" podUID="36917a3c-dc1c-4371-8a99-f3fd743cfd9a" Jul 09 13:50:00.879439 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:00.879377 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wlg95_fe725cde-9e4a-4b8f-b96e-90fb61415652/ovn-acl-logging/0.log" Jul 09 13:50:00.879906 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:00.879867 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" event={"ID":"fe725cde-9e4a-4b8f-b96e-90fb61415652","Type":"ContainerStarted","Data":"8f44b05fa6f81b9888b0f153d85b425c4ba4652dbd5993e121ff91bf758e7e07"} Jul 09 13:50:00.881711 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:00.881677 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-92.ec2.internal" event={"ID":"963a639aab59673e2b60d423e0aa7762","Type":"ContainerStarted","Data":"78684216fb5277e5917e9f9146a43bdfbdf29b5fee918071a05aa35fc927689f"} Jul 09 13:50:00.883643 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:00.883617 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9m82w" event={"ID":"ad8f280e-d164-45c9-88eb-40428803312c","Type":"ContainerStarted","Data":"3e35b8e07b09abf0bb14cb8995c886f0edbfaeb6bebb56c82b309d505acad261"} Jul 09 13:50:01.769843 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:01.769789 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-txs25" Jul 09 13:50:01.770357 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:01.770339 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-txs25" Jul 09 13:50:01.786944 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:01.786901 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-92.ec2.internal" podStartSLOduration=25.786888398 podStartE2EDuration="25.786888398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:49:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:50:00.897795732 +0000 UTC m=+25.804369927" watchObservedRunningTime="2026-07-09 13:50:01.786888398 +0000 UTC m=+26.693462594" Jul 09 13:50:01.888273 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:01.888233 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9m82w" event={"ID":"ad8f280e-d164-45c9-88eb-40428803312c","Type":"ContainerStarted","Data":"ab9e21796771269999ce20ecf47ebe233dee670328d28fb141eb948882771427"} Jul 09 13:50:01.888669 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:01.888633 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-txs25" Jul 09 13:50:01.889119 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:01.889104 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-txs25" Jul 09 13:50:01.906411 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:01.906352 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9m82w" podStartSLOduration=4.106668344 podStartE2EDuration="26.906335134s" totalImagesPullingTime="22.79966679s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:49:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:50:01.906167932 +0000 UTC m=+26.812742126" watchObservedRunningTime="2026-07-09 13:50:01.906335134 +0000 UTC m=+26.812909326" Jul 09 13:50:02.607838 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:02.607533 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lth82" Jul 09 13:50:02.607838 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:02.607597 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rs66" Jul 09 13:50:02.608079 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:02.607857 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lth82" podUID="36917a3c-dc1c-4371-8a99-f3fd743cfd9a" Jul 09 13:50:02.608079 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:02.607616 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7btnh" Jul 09 13:50:02.608079 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:02.607939 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rs66" podUID="37ebd359-357d-4d89-b1b0-ce746eedeec9" Jul 09 13:50:02.608079 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:02.608021 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7btnh" podUID="60191bf6-e7d9-4411-85a0-f1cc73dcc646" Jul 09 13:50:02.894645 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:02.894571 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wlg95_fe725cde-9e4a-4b8f-b96e-90fb61415652/ovn-acl-logging/0.log" Jul 09 13:50:02.895339 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:02.895044 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" event={"ID":"fe725cde-9e4a-4b8f-b96e-90fb61415652","Type":"ContainerStarted","Data":"36ef9c92787a8998af8d0659baf7cbdd59295beecf6f82164ef26447536f1a98"} Jul 09 13:50:02.895851 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:02.895794 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:50:02.895966 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:02.895895 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:50:02.895966 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:02.895928 2573 scope.go:117] "RemoveContainer" containerID="7a123275bdb734d4df8028e083833c0e34f12d080228bb557673801beab44109" Jul 09 13:50:02.913861 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:02.913840 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:50:03.903528 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:03.903483 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wlg95_fe725cde-9e4a-4b8f-b96e-90fb61415652/ovn-acl-logging/0.log" Jul 09 13:50:03.904559 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:03.904524 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" event={"ID":"fe725cde-9e4a-4b8f-b96e-90fb61415652","Type":"ContainerStarted","Data":"d6ce7741148e9ce2acab830a2e019560adccb910d984f51b8de8175f8a3b60cc"} Jul 09 13:50:03.904769 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:03.904750 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:50:03.929477 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:03.929448 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:50:03.932054 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:03.932004 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" podStartSLOduration=8.177227951 podStartE2EDuration="28.93198509s" totalImagesPullingTime="20.754757139s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:49:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:50:03.931235703 +0000 UTC m=+28.837809896" watchObservedRunningTime="2026-07-09 13:50:03.93198509 +0000 UTC m=+28.838559287" Jul 09 13:50:04.607167 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:04.606950 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7btnh" Jul 09 13:50:04.607327 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:04.607183 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lth82" Jul 09 13:50:04.607327 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:04.607264 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7btnh" podUID="60191bf6-e7d9-4411-85a0-f1cc73dcc646" Jul 09 13:50:04.607760 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:04.607728 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lth82" podUID="36917a3c-dc1c-4371-8a99-f3fd743cfd9a" Jul 09 13:50:04.607916 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:04.607830 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rs66" Jul 09 13:50:04.607916 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:04.607895 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rs66" podUID="37ebd359-357d-4d89-b1b0-ce746eedeec9" Jul 09 13:50:04.854560 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:04.854517 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lth82"] Jul 09 13:50:04.858476 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:04.858400 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7btnh"] Jul 09 13:50:04.859047 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:04.859030 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5rs66"] Jul 09 13:50:04.906194 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:04.906166 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rs66" Jul 09 13:50:04.906582 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:04.906170 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7btnh" Jul 09 13:50:04.906582 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:04.906172 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lth82" Jul 09 13:50:04.906582 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:04.906304 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rs66" podUID="37ebd359-357d-4d89-b1b0-ce746eedeec9" Jul 09 13:50:04.906582 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:04.906386 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7btnh" podUID="60191bf6-e7d9-4411-85a0-f1cc73dcc646" Jul 09 13:50:04.906880 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:04.906860 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lth82" podUID="36917a3c-dc1c-4371-8a99-f3fd743cfd9a" Jul 09 13:50:05.910400 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:05.910271 2573 generic.go:356] "Generic (PLEG): container finished" podID="d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0" containerID="fb311a21d5cbed42f510ef1f980be2e4178e462ddf63b038a598b6c053bcd214" exitCode=0 Jul 09 13:50:05.910400 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:05.910352 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dgjhm" event={"ID":"d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0","Type":"ContainerDied","Data":"fb311a21d5cbed42f510ef1f980be2e4178e462ddf63b038a598b6c053bcd214"} Jul 09 13:50:06.607217 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:06.607188 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rs66" Jul 09 13:50:06.607363 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:06.607232 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7btnh" Jul 09 13:50:06.607363 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:06.607324 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rs66" podUID="37ebd359-357d-4d89-b1b0-ce746eedeec9" Jul 09 13:50:06.607461 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:06.607373 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lth82" Jul 09 13:50:06.607506 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:06.607472 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7btnh" podUID="60191bf6-e7d9-4411-85a0-f1cc73dcc646" Jul 09 13:50:06.607571 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:06.607551 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lth82" podUID="36917a3c-dc1c-4371-8a99-f3fd743cfd9a" Jul 09 13:50:07.916557 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:07.916528 2573 generic.go:356] "Generic (PLEG): container finished" podID="d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0" containerID="df51baf8a804adcb2167906c4b946d41c92234392c8ce5860437bbb86c2f56b4" exitCode=0 Jul 09 13:50:07.916921 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:07.916587 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dgjhm" event={"ID":"d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0","Type":"ContainerDied","Data":"df51baf8a804adcb2167906c4b946d41c92234392c8ce5860437bbb86c2f56b4"} Jul 09 13:50:08.358756 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:08.358719 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/36917a3c-dc1c-4371-8a99-f3fd743cfd9a-original-pull-secret\") pod \"global-pull-secret-syncer-lth82\" (UID: \"36917a3c-dc1c-4371-8a99-f3fd743cfd9a\") " pod="kube-system/global-pull-secret-syncer-lth82" Jul 09 13:50:08.358756 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:08.358760 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37ebd359-357d-4d89-b1b0-ce746eedeec9-metrics-certs\") pod \"network-metrics-daemon-5rs66\" (UID: \"37ebd359-357d-4d89-b1b0-ce746eedeec9\") " pod="openshift-multus/network-metrics-daemon-5rs66" Jul 09 13:50:08.358956 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:08.358904 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:50:08.358956 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:08.358904 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 13:50:08.359049 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:08.358963 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37ebd359-357d-4d89-b1b0-ce746eedeec9-metrics-certs podName:37ebd359-357d-4d89-b1b0-ce746eedeec9 nodeName:}" failed. No retries permitted until 2026-07-09 13:50:40.358946435 +0000 UTC m=+65.265520620 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/37ebd359-357d-4d89-b1b0-ce746eedeec9-metrics-certs") pod "network-metrics-daemon-5rs66" (UID: "37ebd359-357d-4d89-b1b0-ce746eedeec9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:50:08.359049 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:08.358977 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36917a3c-dc1c-4371-8a99-f3fd743cfd9a-original-pull-secret podName:36917a3c-dc1c-4371-8a99-f3fd743cfd9a nodeName:}" failed. No retries permitted until 2026-07-09 13:50:40.358971202 +0000 UTC m=+65.265545372 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/36917a3c-dc1c-4371-8a99-f3fd743cfd9a-original-pull-secret") pod "global-pull-secret-syncer-lth82" (UID: "36917a3c-dc1c-4371-8a99-f3fd743cfd9a") : object "kube-system"/"original-pull-secret" not registered Jul 09 13:50:08.459241 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:08.459209 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxv9q\" (UniqueName: \"kubernetes.io/projected/60191bf6-e7d9-4411-85a0-f1cc73dcc646-kube-api-access-cxv9q\") pod \"network-check-target-7btnh\" (UID: \"60191bf6-e7d9-4411-85a0-f1cc73dcc646\") " pod="openshift-network-diagnostics/network-check-target-7btnh" Jul 09 13:50:08.459376 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:08.459357 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 13:50:08.459376 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:08.459373 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 13:50:08.459462 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:08.459382 2573 projected.go:196] Error preparing data for projected volume kube-api-access-cxv9q for pod openshift-network-diagnostics/network-check-target-7btnh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:50:08.459462 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:08.459430 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60191bf6-e7d9-4411-85a0-f1cc73dcc646-kube-api-access-cxv9q podName:60191bf6-e7d9-4411-85a0-f1cc73dcc646 nodeName:}" failed. No retries permitted until 2026-07-09 13:50:40.459416188 +0000 UTC m=+65.365990359 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cxv9q" (UniqueName: "kubernetes.io/projected/60191bf6-e7d9-4411-85a0-f1cc73dcc646-kube-api-access-cxv9q") pod "network-check-target-7btnh" (UID: "60191bf6-e7d9-4411-85a0-f1cc73dcc646") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:50:08.607268 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:08.607188 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rs66" Jul 09 13:50:08.607268 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:08.607233 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7btnh" Jul 09 13:50:08.607268 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:08.607233 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lth82" Jul 09 13:50:08.607512 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:08.607327 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rs66" podUID="37ebd359-357d-4d89-b1b0-ce746eedeec9" Jul 09 13:50:08.607512 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:08.607400 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7btnh" podUID="60191bf6-e7d9-4411-85a0-f1cc73dcc646" Jul 09 13:50:08.607605 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:08.607512 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lth82" podUID="36917a3c-dc1c-4371-8a99-f3fd743cfd9a" Jul 09 13:50:08.921518 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:08.921286 2573 generic.go:356] "Generic (PLEG): container finished" podID="d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0" containerID="3e4f9fd9a4fd895233c7d092f52fbd26ee9eacff383b47dd6403baee5a3c2d84" exitCode=0 Jul 09 13:50:08.921518 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:08.921377 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dgjhm" event={"ID":"d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0","Type":"ContainerDied","Data":"3e4f9fd9a4fd895233c7d092f52fbd26ee9eacff383b47dd6403baee5a3c2d84"} Jul 09 13:50:10.382423 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.382393 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-92.ec2.internal" event="NodeReady" Jul 09 13:50:10.382892 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.382542 2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 13:50:10.416519 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.416481 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-cdbb9d64f-8bhxh"] Jul 09 13:50:10.418681 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.418652 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" Jul 09 13:50:10.421486 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.421463 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 09 13:50:10.421604 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.421500 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 09 13:50:10.421724 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.421709 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 09 13:50:10.424362 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.423829 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mvjq8\"" Jul 09 13:50:10.428321 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.428301 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 09 13:50:10.431161 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.431140 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bj8dh"] Jul 09 13:50:10.432988 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.432971 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bj8dh" Jul 09 13:50:10.434454 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.434432 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-z4hbz"] Jul 09 13:50:10.435213 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.435197 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-44bgf\"" Jul 09 13:50:10.435421 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.435409 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 13:50:10.435793 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.435404 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 13:50:10.436701 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.436677 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-z4hbz" Jul 09 13:50:10.440378 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.440353 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6g4hg\"" Jul 09 13:50:10.440490 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.440424 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 13:50:10.441086 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.441065 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-cdbb9d64f-8bhxh"] Jul 09 13:50:10.442841 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.441898 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 13:50:10.442841 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.441916 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 13:50:10.446550 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.446532 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bj8dh"] Jul 09 13:50:10.450544 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.450453 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-z4hbz"] Jul 09 13:50:10.575220 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.575187 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-bound-sa-token\") pod \"image-registry-cdbb9d64f-8bhxh\" (UID: \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\") " pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" Jul 09 13:50:10.575220 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.575229 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9ee58331-355b-4a78-a3f5-b3e312ba9c70-config-volume\") pod \"dns-default-bj8dh\" (UID: \"9ee58331-355b-4a78-a3f5-b3e312ba9c70\") " pod="openshift-dns/dns-default-bj8dh" Jul 09 13:50:10.575424 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.575257 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlp2c\" (UniqueName: \"kubernetes.io/projected/9ee58331-355b-4a78-a3f5-b3e312ba9c70-kube-api-access-mlp2c\") pod \"dns-default-bj8dh\" (UID: \"9ee58331-355b-4a78-a3f5-b3e312ba9c70\") " pod="openshift-dns/dns-default-bj8dh" Jul 09 13:50:10.575424 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.575284 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zvh2\" (UniqueName: \"kubernetes.io/projected/49134287-0ad9-48b8-932e-c94dba92401c-kube-api-access-4zvh2\") pod \"ingress-canary-z4hbz\" (UID: \"49134287-0ad9-48b8-932e-c94dba92401c\") " pod="openshift-ingress-canary/ingress-canary-z4hbz" Jul 09 13:50:10.575424 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.575319 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-image-registry-private-configuration\") pod \"image-registry-cdbb9d64f-8bhxh\" (UID: \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\") " pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" Jul 09 13:50:10.575424 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.575347 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-registry-certificates\") pod \"image-registry-cdbb9d64f-8bhxh\" (UID: \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\") " pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" Jul 09 13:50:10.575424 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.575371 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-installation-pull-secrets\") pod \"image-registry-cdbb9d64f-8bhxh\" (UID: \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\") " pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" Jul 09 13:50:10.575424 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.575394 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ee58331-355b-4a78-a3f5-b3e312ba9c70-tmp-dir\") pod \"dns-default-bj8dh\" (UID: \"9ee58331-355b-4a78-a3f5-b3e312ba9c70\") " pod="openshift-dns/dns-default-bj8dh" Jul 09 13:50:10.575424 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.575421 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ee58331-355b-4a78-a3f5-b3e312ba9c70-metrics-tls\") pod \"dns-default-bj8dh\" (UID: \"9ee58331-355b-4a78-a3f5-b3e312ba9c70\") " pod="openshift-dns/dns-default-bj8dh" Jul 09 13:50:10.575751 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.575472 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-trusted-ca\") pod \"image-registry-cdbb9d64f-8bhxh\" (UID: \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\") " pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" Jul 09 13:50:10.575751 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.575545 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-ca-trust-extracted\") pod \"image-registry-cdbb9d64f-8bhxh\" (UID: \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\") " pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" Jul 09 13:50:10.575751 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.575571 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72fl8\" (UniqueName: \"kubernetes.io/projected/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-kube-api-access-72fl8\") pod \"image-registry-cdbb9d64f-8bhxh\" (UID: \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\") " pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" Jul 09 13:50:10.575751 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.575615 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-registry-tls\") pod \"image-registry-cdbb9d64f-8bhxh\" (UID: \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\") " pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" Jul 09 13:50:10.575751 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.575642 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49134287-0ad9-48b8-932e-c94dba92401c-cert\") pod \"ingress-canary-z4hbz\" (UID: \"49134287-0ad9-48b8-932e-c94dba92401c\") " pod="openshift-ingress-canary/ingress-canary-z4hbz" Jul 09 13:50:10.595337 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.595289 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-txs25_8fae885f-7d7e-4ffa-ac4b-8521097c9cb4/konnectivity-agent/0.log" limit=1024 Jul 09 13:50:10.607251 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.607223 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rs66" Jul 09 13:50:10.607251 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.607243 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lth82" Jul 09 13:50:10.607388 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.607223 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7btnh" Jul 09 13:50:10.609929 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.609796 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 13:50:10.609929 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.609818 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 13:50:10.609929 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.609871 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 13:50:10.609929 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.609889 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 13:50:10.609929 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.609900 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jnfkt\"" Jul 09 13:50:10.609929 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.609907 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4kxnf\"" Jul 09 13:50:10.676784 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.676744 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-bound-sa-token\") pod \"image-registry-cdbb9d64f-8bhxh\" (UID: \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\") " pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" Jul 09 13:50:10.676784 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.676780 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9ee58331-355b-4a78-a3f5-b3e312ba9c70-config-volume\") pod \"dns-default-bj8dh\" (UID: \"9ee58331-355b-4a78-a3f5-b3e312ba9c70\") " pod="openshift-dns/dns-default-bj8dh" Jul 09 13:50:10.677056 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.676797 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlp2c\" (UniqueName: \"kubernetes.io/projected/9ee58331-355b-4a78-a3f5-b3e312ba9c70-kube-api-access-mlp2c\") pod \"dns-default-bj8dh\" (UID: \"9ee58331-355b-4a78-a3f5-b3e312ba9c70\") " pod="openshift-dns/dns-default-bj8dh" Jul 09 13:50:10.677056 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.676943 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zvh2\" (UniqueName: \"kubernetes.io/projected/49134287-0ad9-48b8-932e-c94dba92401c-kube-api-access-4zvh2\") pod \"ingress-canary-z4hbz\" (UID: \"49134287-0ad9-48b8-932e-c94dba92401c\") " pod="openshift-ingress-canary/ingress-canary-z4hbz" Jul 09 13:50:10.677056 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.676986 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-image-registry-private-configuration\") pod \"image-registry-cdbb9d64f-8bhxh\" (UID: \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\") " pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" Jul 09 13:50:10.677056 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.677011 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-registry-certificates\") pod \"image-registry-cdbb9d64f-8bhxh\" (UID: \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\") " pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" Jul 09 13:50:10.677247 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.677126 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-installation-pull-secrets\") pod \"image-registry-cdbb9d64f-8bhxh\" (UID: \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\") " pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" Jul 09 13:50:10.677247 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.677160 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ee58331-355b-4a78-a3f5-b3e312ba9c70-tmp-dir\") pod \"dns-default-bj8dh\" (UID: \"9ee58331-355b-4a78-a3f5-b3e312ba9c70\") " pod="openshift-dns/dns-default-bj8dh" Jul 09 13:50:10.677247 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.677193 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ee58331-355b-4a78-a3f5-b3e312ba9c70-metrics-tls\") pod \"dns-default-bj8dh\" (UID: \"9ee58331-355b-4a78-a3f5-b3e312ba9c70\") " pod="openshift-dns/dns-default-bj8dh" Jul 09 13:50:10.677395 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:10.677267 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 13:50:10.677395 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.677312 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-trusted-ca\") pod \"image-registry-cdbb9d64f-8bhxh\" (UID: \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\") " pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" Jul 09 13:50:10.677395 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:10.677324 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ee58331-355b-4a78-a3f5-b3e312ba9c70-metrics-tls podName:9ee58331-355b-4a78-a3f5-b3e312ba9c70 nodeName:}" failed. No retries permitted until 2026-07-09 13:50:11.177304132 +0000 UTC m=+36.083878319 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9ee58331-355b-4a78-a3f5-b3e312ba9c70-metrics-tls") pod "dns-default-bj8dh" (UID: "9ee58331-355b-4a78-a3f5-b3e312ba9c70") : secret "dns-default-metrics-tls" not found Jul 09 13:50:10.677395 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.677385 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-ca-trust-extracted\") pod \"image-registry-cdbb9d64f-8bhxh\" (UID: \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\") " pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" Jul 09 13:50:10.677609 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.677420 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72fl8\" (UniqueName: \"kubernetes.io/projected/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-kube-api-access-72fl8\") pod \"image-registry-cdbb9d64f-8bhxh\" (UID: \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\") " pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" Jul 09 13:50:10.677609 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.677451 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-registry-tls\") pod \"image-registry-cdbb9d64f-8bhxh\" (UID: \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\") " pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" Jul 09 13:50:10.677609 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.677458 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9ee58331-355b-4a78-a3f5-b3e312ba9c70-config-volume\") pod \"dns-default-bj8dh\" (UID: \"9ee58331-355b-4a78-a3f5-b3e312ba9c70\") " pod="openshift-dns/dns-default-bj8dh" Jul 09 13:50:10.677609 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.677474 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49134287-0ad9-48b8-932e-c94dba92401c-cert\") pod \"ingress-canary-z4hbz\" (UID: \"49134287-0ad9-48b8-932e-c94dba92401c\") " pod="openshift-ingress-canary/ingress-canary-z4hbz" Jul 09 13:50:10.677609 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.677486 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ee58331-355b-4a78-a3f5-b3e312ba9c70-tmp-dir\") pod \"dns-default-bj8dh\" (UID: \"9ee58331-355b-4a78-a3f5-b3e312ba9c70\") " pod="openshift-dns/dns-default-bj8dh" Jul 09 13:50:10.677856 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.677662 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-registry-certificates\") pod \"image-registry-cdbb9d64f-8bhxh\" (UID: \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\") " pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" Jul 09 13:50:10.677856 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.677799 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-ca-trust-extracted\") pod \"image-registry-cdbb9d64f-8bhxh\" (UID: \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\") " pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" Jul 09 13:50:10.677856 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:10.677847 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 13:50:10.677986 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:10.677861 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cdbb9d64f-8bhxh: secret "image-registry-tls" not found Jul 09 13:50:10.677986 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:10.677921 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-registry-tls podName:4d0c7810-9ef5-44fa-ab79-8ceaf4fce137 nodeName:}" failed. No retries permitted until 2026-07-09 13:50:11.177905397 +0000 UTC m=+36.084479582 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-registry-tls") pod "image-registry-cdbb9d64f-8bhxh" (UID: "4d0c7810-9ef5-44fa-ab79-8ceaf4fce137") : secret "image-registry-tls" not found Jul 09 13:50:10.678320 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.678296 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-trusted-ca\") pod \"image-registry-cdbb9d64f-8bhxh\" (UID: \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\") " pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" Jul 09 13:50:10.681286 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.681256 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-installation-pull-secrets\") pod \"image-registry-cdbb9d64f-8bhxh\" (UID: \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\") " pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" Jul 09 13:50:10.681286 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.681281 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49134287-0ad9-48b8-932e-c94dba92401c-cert\") pod \"ingress-canary-z4hbz\" (UID: \"49134287-0ad9-48b8-932e-c94dba92401c\") " pod="openshift-ingress-canary/ingress-canary-z4hbz" Jul 09 13:50:10.681416 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.681314 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-image-registry-private-configuration\") pod \"image-registry-cdbb9d64f-8bhxh\" (UID: \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\") " pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" Jul 09 13:50:10.686344 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.686315 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-bound-sa-token\") pod \"image-registry-cdbb9d64f-8bhxh\" (UID: \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\") " pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" Jul 09 13:50:10.686453 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.686405 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlp2c\" (UniqueName: \"kubernetes.io/projected/9ee58331-355b-4a78-a3f5-b3e312ba9c70-kube-api-access-mlp2c\") pod \"dns-default-bj8dh\" (UID: \"9ee58331-355b-4a78-a3f5-b3e312ba9c70\") " pod="openshift-dns/dns-default-bj8dh" Jul 09 13:50:10.686785 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.686760 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zvh2\" (UniqueName: \"kubernetes.io/projected/49134287-0ad9-48b8-932e-c94dba92401c-kube-api-access-4zvh2\") pod \"ingress-canary-z4hbz\" (UID: \"49134287-0ad9-48b8-932e-c94dba92401c\") " pod="openshift-ingress-canary/ingress-canary-z4hbz" Jul 09 13:50:10.686984 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.686957 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72fl8\" (UniqueName: \"kubernetes.io/projected/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-kube-api-access-72fl8\") pod \"image-registry-cdbb9d64f-8bhxh\" (UID: \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\") " pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" Jul 09 13:50:10.690167 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.690140 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-txs25_8fae885f-7d7e-4ffa-ac4b-8521097c9cb4/konnectivity-agent/0.log" limit=1024 Jul 09 13:50:10.756459 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.756383 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-z4hbz" Jul 09 13:50:10.919922 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:10.919889 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-z4hbz"] Jul 09 13:50:10.924563 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:50:10.924530 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49134287_0ad9_48b8_932e_c94dba92401c.slice/crio-379f5d4f7b815a3391af8f7dd597fdd8af8fa71f19de1657552f564941246d41 WatchSource:0}: Error finding container 379f5d4f7b815a3391af8f7dd597fdd8af8fa71f19de1657552f564941246d41: Status 404 returned error can't find the container with id 379f5d4f7b815a3391af8f7dd597fdd8af8fa71f19de1657552f564941246d41 Jul 09 13:50:11.182051 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:11.181961 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-registry-tls\") pod \"image-registry-cdbb9d64f-8bhxh\" (UID: \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\") " pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" Jul 09 13:50:11.182257 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:11.182057 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ee58331-355b-4a78-a3f5-b3e312ba9c70-metrics-tls\") pod \"dns-default-bj8dh\" (UID: \"9ee58331-355b-4a78-a3f5-b3e312ba9c70\") " pod="openshift-dns/dns-default-bj8dh" Jul 09 13:50:11.182257 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:11.182136 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 13:50:11.182257 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:11.182158 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cdbb9d64f-8bhxh: secret "image-registry-tls" not found Jul 09 13:50:11.182257 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:11.182191 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 13:50:11.182257 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:11.182230 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-registry-tls podName:4d0c7810-9ef5-44fa-ab79-8ceaf4fce137 nodeName:}" failed. No retries permitted until 2026-07-09 13:50:12.182208385 +0000 UTC m=+37.088782558 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-registry-tls") pod "image-registry-cdbb9d64f-8bhxh" (UID: "4d0c7810-9ef5-44fa-ab79-8ceaf4fce137") : secret "image-registry-tls" not found Jul 09 13:50:11.182502 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:11.182262 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ee58331-355b-4a78-a3f5-b3e312ba9c70-metrics-tls podName:9ee58331-355b-4a78-a3f5-b3e312ba9c70 nodeName:}" failed. No retries permitted until 2026-07-09 13:50:12.182244477 +0000 UTC m=+37.088818671 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9ee58331-355b-4a78-a3f5-b3e312ba9c70-metrics-tls") pod "dns-default-bj8dh" (UID: "9ee58331-355b-4a78-a3f5-b3e312ba9c70") : secret "dns-default-metrics-tls" not found Jul 09 13:50:11.931073 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:11.930998 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-z4hbz" event={"ID":"49134287-0ad9-48b8-932e-c94dba92401c","Type":"ContainerStarted","Data":"379f5d4f7b815a3391af8f7dd597fdd8af8fa71f19de1657552f564941246d41"} Jul 09 13:50:12.190318 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:12.190227 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ee58331-355b-4a78-a3f5-b3e312ba9c70-metrics-tls\") pod \"dns-default-bj8dh\" (UID: \"9ee58331-355b-4a78-a3f5-b3e312ba9c70\") " pod="openshift-dns/dns-default-bj8dh" Jul 09 13:50:12.190318 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:12.190302 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-registry-tls\") pod \"image-registry-cdbb9d64f-8bhxh\" (UID: \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\") " pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" Jul 09 13:50:12.190546 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:12.190452 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 13:50:12.190546 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:12.190467 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cdbb9d64f-8bhxh: secret "image-registry-tls" not found Jul 09 13:50:12.190546 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:12.190533 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-registry-tls podName:4d0c7810-9ef5-44fa-ab79-8ceaf4fce137 nodeName:}" failed. No retries permitted until 2026-07-09 13:50:14.190515663 +0000 UTC m=+39.097089835 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-registry-tls") pod "image-registry-cdbb9d64f-8bhxh" (UID: "4d0c7810-9ef5-44fa-ab79-8ceaf4fce137") : secret "image-registry-tls" not found Jul 09 13:50:12.190950 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:12.190843 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 13:50:12.190950 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:12.190919 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ee58331-355b-4a78-a3f5-b3e312ba9c70-metrics-tls podName:9ee58331-355b-4a78-a3f5-b3e312ba9c70 nodeName:}" failed. No retries permitted until 2026-07-09 13:50:14.190899773 +0000 UTC m=+39.097473995 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9ee58331-355b-4a78-a3f5-b3e312ba9c70-metrics-tls") pod "dns-default-bj8dh" (UID: "9ee58331-355b-4a78-a3f5-b3e312ba9c70") : secret "dns-default-metrics-tls" not found Jul 09 13:50:12.436323 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:12.436284 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-txs25_8fae885f-7d7e-4ffa-ac4b-8521097c9cb4/konnectivity-agent/0.log" limit=1024 Jul 09 13:50:12.536462 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:12.536365 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-txs25_8fae885f-7d7e-4ffa-ac4b-8521097c9cb4/konnectivity-agent/0.log" limit=1024 Jul 09 13:50:12.607202 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:12.607151 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-txs25_8fae885f-7d7e-4ffa-ac4b-8521097c9cb4/konnectivity-agent/0.log" limit=1024 Jul 09 13:50:12.706119 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:12.706091 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-txs25_8fae885f-7d7e-4ffa-ac4b-8521097c9cb4/konnectivity-agent/0.log" limit=1024 Jul 09 13:50:12.808859 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:12.808752 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-txs25_8fae885f-7d7e-4ffa-ac4b-8521097c9cb4/konnectivity-agent/0.log" limit=1024 Jul 09 13:50:13.561357 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:13.561170 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-txs25_8fae885f-7d7e-4ffa-ac4b-8521097c9cb4/konnectivity-agent/0.log" limit=1024 Jul 09 13:50:13.662346 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:13.662310 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-txs25_8fae885f-7d7e-4ffa-ac4b-8521097c9cb4/konnectivity-agent/0.log" limit=1024 Jul 09 13:50:13.799241 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:13.799202 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-txs25_8fae885f-7d7e-4ffa-ac4b-8521097c9cb4/konnectivity-agent/0.log" limit=1024 Jul 09 13:50:13.856797 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:13.856684 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-txs25_8fae885f-7d7e-4ffa-ac4b-8521097c9cb4/konnectivity-agent/0.log" limit=1024 Jul 09 13:50:14.211935 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:14.211852 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ee58331-355b-4a78-a3f5-b3e312ba9c70-metrics-tls\") pod \"dns-default-bj8dh\" (UID: \"9ee58331-355b-4a78-a3f5-b3e312ba9c70\") " pod="openshift-dns/dns-default-bj8dh" Jul 09 13:50:14.212095 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:14.211935 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-registry-tls\") pod \"image-registry-cdbb9d64f-8bhxh\" (UID: \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\") " pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" Jul 09 13:50:14.212095 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:14.212009 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 13:50:14.212095 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:14.212053 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 13:50:14.212095 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:14.212075 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cdbb9d64f-8bhxh: secret "image-registry-tls" not found Jul 09 13:50:14.212095 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:14.212089 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ee58331-355b-4a78-a3f5-b3e312ba9c70-metrics-tls podName:9ee58331-355b-4a78-a3f5-b3e312ba9c70 nodeName:}" failed. No retries permitted until 2026-07-09 13:50:18.212067898 +0000 UTC m=+43.118642086 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9ee58331-355b-4a78-a3f5-b3e312ba9c70-metrics-tls") pod "dns-default-bj8dh" (UID: "9ee58331-355b-4a78-a3f5-b3e312ba9c70") : secret "dns-default-metrics-tls" not found Jul 09 13:50:14.212301 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:14.212126 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-registry-tls podName:4d0c7810-9ef5-44fa-ab79-8ceaf4fce137 nodeName:}" failed. No retries permitted until 2026-07-09 13:50:18.212111528 +0000 UTC m=+43.118685722 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-registry-tls") pod "image-registry-cdbb9d64f-8bhxh" (UID: "4d0c7810-9ef5-44fa-ab79-8ceaf4fce137") : secret "image-registry-tls" not found Jul 09 13:50:15.942748 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:15.942705 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-z4hbz" event={"ID":"49134287-0ad9-48b8-932e-c94dba92401c","Type":"ContainerStarted","Data":"a2434777b89d9209a7947d7d5268e42d671d0a442b02248c158a14dca985bb73"} Jul 09 13:50:15.945563 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:15.945538 2573 generic.go:356] "Generic (PLEG): container finished" podID="d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0" containerID="61030738d831c4565e3d36072e75e80bf01e4f236cfeaa881b7e192a69be6e4a" exitCode=0 Jul 09 13:50:15.945710 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:15.945593 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dgjhm" event={"ID":"d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0","Type":"ContainerDied","Data":"61030738d831c4565e3d36072e75e80bf01e4f236cfeaa881b7e192a69be6e4a"} Jul 09 13:50:15.952571 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:15.952548 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-txs25_8fae885f-7d7e-4ffa-ac4b-8521097c9cb4/konnectivity-agent/0.log" limit=1024 Jul 09 13:50:15.960511 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:15.960471 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-z4hbz" podStartSLOduration=1.3026644250000001 podStartE2EDuration="5.960457732s" totalImagesPullingTime="4.657793307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:50:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:50:15.959929317 +0000 UTC m=+40.866503525" watchObservedRunningTime="2026-07-09 13:50:15.960457732 +0000 UTC m=+40.867031924" Jul 09 13:50:16.951305 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:16.951258 2573 generic.go:356] "Generic (PLEG): container finished" podID="d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0" containerID="c5c24ecc2912df7d5c203b8d9a1fba7b4edb7d4ed8e535f4aec53ed98cbc41b3" exitCode=0 Jul 09 13:50:16.951666 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:16.951329 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dgjhm" event={"ID":"d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0","Type":"ContainerDied","Data":"c5c24ecc2912df7d5c203b8d9a1fba7b4edb7d4ed8e535f4aec53ed98cbc41b3"} Jul 09 13:50:17.956588 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:17.956545 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dgjhm" event={"ID":"d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0","Type":"ContainerStarted","Data":"d4a586e0df18c0c65f411a324a5ef6d514f82dbd4539d1bb604aad946c434e64"} Jul 09 13:50:17.985823 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:17.985733 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dgjhm" podStartSLOduration=8.229557786 podStartE2EDuration="42.985712356s" totalImagesPullingTime="34.75615457s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:49:35 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:50:17.984560554 +0000 UTC m=+42.891134749" watchObservedRunningTime="2026-07-09 13:50:17.985712356 +0000 UTC m=+42.892286551" Jul 09 13:50:18.111516 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:18.111475 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-txs25_8fae885f-7d7e-4ffa-ac4b-8521097c9cb4/konnectivity-agent/0.log" limit=1024 Jul 09 13:50:18.166263 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:18.166230 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-txs25_8fae885f-7d7e-4ffa-ac4b-8521097c9cb4/konnectivity-agent/0.log" limit=1024 Jul 09 13:50:18.243404 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:18.243334 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ee58331-355b-4a78-a3f5-b3e312ba9c70-metrics-tls\") pod \"dns-default-bj8dh\" (UID: \"9ee58331-355b-4a78-a3f5-b3e312ba9c70\") " pod="openshift-dns/dns-default-bj8dh" Jul 09 13:50:18.243404 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:18.243391 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-registry-tls\") pod \"image-registry-cdbb9d64f-8bhxh\" (UID: \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\") " pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" Jul 09 13:50:18.243541 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:18.243488 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 13:50:18.243541 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:18.243506 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 13:50:18.243541 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:18.243523 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cdbb9d64f-8bhxh: secret "image-registry-tls" not found Jul 09 13:50:18.243632 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:18.243547 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ee58331-355b-4a78-a3f5-b3e312ba9c70-metrics-tls podName:9ee58331-355b-4a78-a3f5-b3e312ba9c70 nodeName:}" failed. No retries permitted until 2026-07-09 13:50:26.243531317 +0000 UTC m=+51.150105489 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9ee58331-355b-4a78-a3f5-b3e312ba9c70-metrics-tls") pod "dns-default-bj8dh" (UID: "9ee58331-355b-4a78-a3f5-b3e312ba9c70") : secret "dns-default-metrics-tls" not found Jul 09 13:50:18.243632 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:18.243567 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-registry-tls podName:4d0c7810-9ef5-44fa-ab79-8ceaf4fce137 nodeName:}" failed. No retries permitted until 2026-07-09 13:50:26.243554774 +0000 UTC m=+51.150128947 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-registry-tls") pod "image-registry-cdbb9d64f-8bhxh" (UID: "4d0c7810-9ef5-44fa-ab79-8ceaf4fce137") : secret "image-registry-tls" not found Jul 09 13:50:20.168618 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:20.168581 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-txs25_8fae885f-7d7e-4ffa-ac4b-8521097c9cb4/konnectivity-agent/0.log" limit=1024 Jul 09 13:50:20.227632 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:20.227593 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-txs25_8fae885f-7d7e-4ffa-ac4b-8521097c9cb4/konnectivity-agent/0.log" limit=1024 Jul 09 13:50:20.294178 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:20.294148 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-txs25_8fae885f-7d7e-4ffa-ac4b-8521097c9cb4/konnectivity-agent/0.log" limit=1024 Jul 09 13:50:26.307580 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:26.307544 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ee58331-355b-4a78-a3f5-b3e312ba9c70-metrics-tls\") pod \"dns-default-bj8dh\" (UID: \"9ee58331-355b-4a78-a3f5-b3e312ba9c70\") " pod="openshift-dns/dns-default-bj8dh" Jul 09 13:50:26.308007 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:26.307605 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-registry-tls\") pod \"image-registry-cdbb9d64f-8bhxh\" (UID: \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\") " pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" Jul 09 13:50:26.308007 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:26.307720 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 13:50:26.308007 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:26.307788 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ee58331-355b-4a78-a3f5-b3e312ba9c70-metrics-tls podName:9ee58331-355b-4a78-a3f5-b3e312ba9c70 nodeName:}" failed. No retries permitted until 2026-07-09 13:50:42.307773455 +0000 UTC m=+67.214347626 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9ee58331-355b-4a78-a3f5-b3e312ba9c70-metrics-tls") pod "dns-default-bj8dh" (UID: "9ee58331-355b-4a78-a3f5-b3e312ba9c70") : secret "dns-default-metrics-tls" not found Jul 09 13:50:26.308007 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:26.307723 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 13:50:26.308007 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:26.307827 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cdbb9d64f-8bhxh: secret "image-registry-tls" not found Jul 09 13:50:26.308007 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:26.307869 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-registry-tls podName:4d0c7810-9ef5-44fa-ab79-8ceaf4fce137 nodeName:}" failed. No retries permitted until 2026-07-09 13:50:42.307858393 +0000 UTC m=+67.214432585 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-registry-tls") pod "image-registry-cdbb9d64f-8bhxh" (UID: "4d0c7810-9ef5-44fa-ab79-8ceaf4fce137") : secret "image-registry-tls" not found Jul 09 13:50:27.220875 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.220843 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p6mh2"] Jul 09 13:50:27.242106 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.242073 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-q2tlh"] Jul 09 13:50:27.242273 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.242203 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p6mh2" Jul 09 13:50:27.244684 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.244662 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-kvzfg\"" Jul 09 13:50:27.244684 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.244676 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 09 13:50:27.244909 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.244683 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 09 13:50:27.244909 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.244662 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 09 13:50:27.245251 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.245232 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 09 13:50:27.262303 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.262281 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-q2tlh" Jul 09 13:50:27.262303 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.262291 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p6mh2"] Jul 09 13:50:27.262428 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.262336 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-q2tlh"] Jul 09 13:50:27.264606 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.264590 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 09 13:50:27.264720 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.264701 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 13:50:27.265006 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.264990 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 13:50:27.265087 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.265019 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-jjwxn\"" Jul 09 13:50:27.265087 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.264998 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 09 13:50:27.270763 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.270747 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 09 13:50:27.317266 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.317229 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15e19452-d64a-46b3-9ca1-f39d4a955d45-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-q2tlh\" (UID: \"15e19452-d64a-46b3-9ca1-f39d4a955d45\") " pod="openshift-insights/insights-operator-5c847dcfc4-q2tlh" Jul 09 13:50:27.317681 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.317339 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3d907576-86ea-4a33-928a-85df98300620-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-p6mh2\" (UID: \"3d907576-86ea-4a33-928a-85df98300620\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p6mh2" Jul 09 13:50:27.317681 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.317364 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8fkd\" (UniqueName: \"kubernetes.io/projected/3d907576-86ea-4a33-928a-85df98300620-kube-api-access-w8fkd\") pod \"kube-storage-version-migrator-operator-846bf668f7-p6mh2\" (UID: \"3d907576-86ea-4a33-928a-85df98300620\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p6mh2" Jul 09 13:50:27.317681 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.317394 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15e19452-d64a-46b3-9ca1-f39d4a955d45-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-q2tlh\" (UID: \"15e19452-d64a-46b3-9ca1-f39d4a955d45\") " pod="openshift-insights/insights-operator-5c847dcfc4-q2tlh" Jul 09 13:50:27.317681 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.317420 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3d907576-86ea-4a33-928a-85df98300620-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-p6mh2\" (UID: \"3d907576-86ea-4a33-928a-85df98300620\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p6mh2" Jul 09 13:50:27.317681 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.317434 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/15e19452-d64a-46b3-9ca1-f39d4a955d45-serving-cert\") pod \"insights-operator-5c847dcfc4-q2tlh\" (UID: \"15e19452-d64a-46b3-9ca1-f39d4a955d45\") " pod="openshift-insights/insights-operator-5c847dcfc4-q2tlh" Jul 09 13:50:27.317681 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.317455 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/15e19452-d64a-46b3-9ca1-f39d4a955d45-snapshots\") pod \"insights-operator-5c847dcfc4-q2tlh\" (UID: \"15e19452-d64a-46b3-9ca1-f39d4a955d45\") " pod="openshift-insights/insights-operator-5c847dcfc4-q2tlh" Jul 09 13:50:27.317681 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.317488 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klfcg\" (UniqueName: \"kubernetes.io/projected/15e19452-d64a-46b3-9ca1-f39d4a955d45-kube-api-access-klfcg\") pod \"insights-operator-5c847dcfc4-q2tlh\" (UID: \"15e19452-d64a-46b3-9ca1-f39d4a955d45\") " pod="openshift-insights/insights-operator-5c847dcfc4-q2tlh" Jul 09 13:50:27.317681 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.317539 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/15e19452-d64a-46b3-9ca1-f39d4a955d45-tmp\") pod \"insights-operator-5c847dcfc4-q2tlh\" (UID: \"15e19452-d64a-46b3-9ca1-f39d4a955d45\") " pod="openshift-insights/insights-operator-5c847dcfc4-q2tlh" Jul 09 13:50:27.321693 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.321666 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-shl9d"] Jul 09 13:50:27.338554 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.338527 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-gfgjz"] Jul 09 13:50:27.338726 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.338603 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-shl9d" Jul 09 13:50:27.341576 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.341553 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-z42px\"" Jul 09 13:50:27.354342 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.354315 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bhvll"] Jul 09 13:50:27.354484 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.354449 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-gfgjz" Jul 09 13:50:27.357070 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.357044 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-v9lkl\"" Jul 09 13:50:27.357070 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.357064 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 09 13:50:27.357238 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.357070 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 09 13:50:27.378351 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.378318 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-shl9d"] Jul 09 13:50:27.378493 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.378360 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-gfgjz"] Jul 09 13:50:27.378493 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.378385 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bhvll"] Jul 09 13:50:27.378493 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.378413 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bhvll" Jul 09 13:50:27.387180 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.387158 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 09 13:50:27.387311 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.387178 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 09 13:50:27.387311 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.387159 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 09 13:50:27.387421 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.387409 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-m4v7r\"" Jul 09 13:50:27.418213 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.418187 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/15e19452-d64a-46b3-9ca1-f39d4a955d45-serving-cert\") pod \"insights-operator-5c847dcfc4-q2tlh\" (UID: \"15e19452-d64a-46b3-9ca1-f39d4a955d45\") " pod="openshift-insights/insights-operator-5c847dcfc4-q2tlh" Jul 09 13:50:27.418334 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.418218 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpk65\" (UniqueName: \"kubernetes.io/projected/50f246ea-4255-4638-94d4-426607eaed9d-kube-api-access-dpk65\") pod \"cluster-samples-operator-56fcf86bf-bhvll\" (UID: \"50f246ea-4255-4638-94d4-426607eaed9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bhvll" Jul 09 13:50:27.418334 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.418240 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/15e19452-d64a-46b3-9ca1-f39d4a955d45-snapshots\") pod \"insights-operator-5c847dcfc4-q2tlh\" (UID: \"15e19452-d64a-46b3-9ca1-f39d4a955d45\") " pod="openshift-insights/insights-operator-5c847dcfc4-q2tlh" Jul 09 13:50:27.418334 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.418258 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl79w\" (UniqueName: \"kubernetes.io/projected/468dec5e-20f4-4a48-bbf9-f07fc203db0d-kube-api-access-nl79w\") pod \"network-check-source-989f8b8dc-shl9d\" (UID: \"468dec5e-20f4-4a48-bbf9-f07fc203db0d\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-shl9d" Jul 09 13:50:27.418334 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.418291 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8fkd\" (UniqueName: \"kubernetes.io/projected/3d907576-86ea-4a33-928a-85df98300620-kube-api-access-w8fkd\") pod \"kube-storage-version-migrator-operator-846bf668f7-p6mh2\" (UID: \"3d907576-86ea-4a33-928a-85df98300620\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p6mh2" Jul 09 13:50:27.418532 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.418380 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3d907576-86ea-4a33-928a-85df98300620-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-p6mh2\" (UID: \"3d907576-86ea-4a33-928a-85df98300620\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p6mh2" Jul 09 13:50:27.418532 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.418417 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15e19452-d64a-46b3-9ca1-f39d4a955d45-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-q2tlh\" (UID: \"15e19452-d64a-46b3-9ca1-f39d4a955d45\") " pod="openshift-insights/insights-operator-5c847dcfc4-q2tlh" Jul 09 13:50:27.418532 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.418455 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3d907576-86ea-4a33-928a-85df98300620-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-p6mh2\" (UID: \"3d907576-86ea-4a33-928a-85df98300620\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p6mh2" Jul 09 13:50:27.418532 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.418490 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klfcg\" (UniqueName: \"kubernetes.io/projected/15e19452-d64a-46b3-9ca1-f39d4a955d45-kube-api-access-klfcg\") pod \"insights-operator-5c847dcfc4-q2tlh\" (UID: \"15e19452-d64a-46b3-9ca1-f39d4a955d45\") " pod="openshift-insights/insights-operator-5c847dcfc4-q2tlh" Jul 09 13:50:27.418532 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.418517 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v9pq\" (UniqueName: \"kubernetes.io/projected/180dbcfb-3d0e-4ea9-8cf0-1731de5e6fe7-kube-api-access-9v9pq\") pod \"volume-data-source-validator-5d456fdbcd-gfgjz\" (UID: \"180dbcfb-3d0e-4ea9-8cf0-1731de5e6fe7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-gfgjz" Jul 09 13:50:27.418771 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.418566 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/15e19452-d64a-46b3-9ca1-f39d4a955d45-tmp\") pod \"insights-operator-5c847dcfc4-q2tlh\" (UID: \"15e19452-d64a-46b3-9ca1-f39d4a955d45\") " pod="openshift-insights/insights-operator-5c847dcfc4-q2tlh" Jul 09 13:50:27.418771 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.418595 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/50f246ea-4255-4638-94d4-426607eaed9d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bhvll\" (UID: \"50f246ea-4255-4638-94d4-426607eaed9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bhvll" Jul 09 13:50:27.418771 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.418633 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15e19452-d64a-46b3-9ca1-f39d4a955d45-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-q2tlh\" (UID: \"15e19452-d64a-46b3-9ca1-f39d4a955d45\") " pod="openshift-insights/insights-operator-5c847dcfc4-q2tlh" Jul 09 13:50:27.418963 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.418908 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/15e19452-d64a-46b3-9ca1-f39d4a955d45-snapshots\") pod \"insights-operator-5c847dcfc4-q2tlh\" (UID: \"15e19452-d64a-46b3-9ca1-f39d4a955d45\") " pod="openshift-insights/insights-operator-5c847dcfc4-q2tlh" Jul 09 13:50:27.419116 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.419091 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3d907576-86ea-4a33-928a-85df98300620-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-p6mh2\" (UID: \"3d907576-86ea-4a33-928a-85df98300620\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p6mh2" Jul 09 13:50:27.419166 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.419140 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15e19452-d64a-46b3-9ca1-f39d4a955d45-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-q2tlh\" (UID: \"15e19452-d64a-46b3-9ca1-f39d4a955d45\") " pod="openshift-insights/insights-operator-5c847dcfc4-q2tlh" Jul 09 13:50:27.419166 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.419155 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/15e19452-d64a-46b3-9ca1-f39d4a955d45-tmp\") pod \"insights-operator-5c847dcfc4-q2tlh\" (UID: \"15e19452-d64a-46b3-9ca1-f39d4a955d45\") " pod="openshift-insights/insights-operator-5c847dcfc4-q2tlh" Jul 09 13:50:27.419375 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.419355 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15e19452-d64a-46b3-9ca1-f39d4a955d45-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-q2tlh\" (UID: \"15e19452-d64a-46b3-9ca1-f39d4a955d45\") " pod="openshift-insights/insights-operator-5c847dcfc4-q2tlh" Jul 09 13:50:27.421905 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.421880 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3d907576-86ea-4a33-928a-85df98300620-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-p6mh2\" (UID: \"3d907576-86ea-4a33-928a-85df98300620\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p6mh2" Jul 09 13:50:27.422003 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.421936 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/15e19452-d64a-46b3-9ca1-f39d4a955d45-serving-cert\") pod \"insights-operator-5c847dcfc4-q2tlh\" (UID: \"15e19452-d64a-46b3-9ca1-f39d4a955d45\") " pod="openshift-insights/insights-operator-5c847dcfc4-q2tlh" Jul 09 13:50:27.429362 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.429343 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-j2j9h"] Jul 09 13:50:27.436129 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.436105 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8fkd\" (UniqueName: \"kubernetes.io/projected/3d907576-86ea-4a33-928a-85df98300620-kube-api-access-w8fkd\") pod \"kube-storage-version-migrator-operator-846bf668f7-p6mh2\" (UID: \"3d907576-86ea-4a33-928a-85df98300620\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p6mh2" Jul 09 13:50:27.437090 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.437071 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klfcg\" (UniqueName: \"kubernetes.io/projected/15e19452-d64a-46b3-9ca1-f39d4a955d45-kube-api-access-klfcg\") pod \"insights-operator-5c847dcfc4-q2tlh\" (UID: \"15e19452-d64a-46b3-9ca1-f39d4a955d45\") " pod="openshift-insights/insights-operator-5c847dcfc4-q2tlh" Jul 09 13:50:27.464786 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.464749 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-tvsqr"] Jul 09 13:50:27.464956 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.464900 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-j2j9h" Jul 09 13:50:27.467513 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.467488 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 09 13:50:27.467725 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.467689 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 09 13:50:27.467873 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.467526 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 09 13:50:27.467873 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.467621 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 09 13:50:27.467873 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.467858 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-x2gg4\"" Jul 09 13:50:27.488993 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.488969 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qs4qg"] Jul 09 13:50:27.489109 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.489096 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-tvsqr" Jul 09 13:50:27.491350 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.491334 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 09 13:50:27.491564 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.491548 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 09 13:50:27.491780 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.491766 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-gxfwj\"" Jul 09 13:50:27.491854 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.491796 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 09 13:50:27.491987 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.491962 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 09 13:50:27.496684 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.496663 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 09 13:50:27.508825 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.508787 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-9fcb6c59f-blmj7"] Jul 09 13:50:27.508941 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.508926 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qs4qg" Jul 09 13:50:27.511019 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.511003 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 09 13:50:27.511118 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.511093 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 13:50:27.511333 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.511317 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rp6sj\"" Jul 09 13:50:27.511480 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.511465 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 09 13:50:27.511561 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.511465 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 13:50:27.519444 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.519426 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl79w\" (UniqueName: \"kubernetes.io/projected/468dec5e-20f4-4a48-bbf9-f07fc203db0d-kube-api-access-nl79w\") pod \"network-check-source-989f8b8dc-shl9d\" (UID: \"468dec5e-20f4-4a48-bbf9-f07fc203db0d\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-shl9d" Jul 09 13:50:27.519532 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.519458 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e870a285-4a50-429d-b74d-bc5b4ace1275-config\") pod \"service-ca-operator-5d46d9ffd4-j2j9h\" (UID: \"e870a285-4a50-429d-b74d-bc5b4ace1275\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-j2j9h" Jul 09 13:50:27.519532 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.519479 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5a15c1c-ff3c-4162-9f34-3beac8095bba-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qs4qg\" (UID: \"e5a15c1c-ff3c-4162-9f34-3beac8095bba\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qs4qg" Jul 09 13:50:27.519532 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.519498 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7bpx\" (UniqueName: \"kubernetes.io/projected/e5a15c1c-ff3c-4162-9f34-3beac8095bba-kube-api-access-m7bpx\") pod \"cluster-monitoring-operator-64786d9cbb-qs4qg\" (UID: \"e5a15c1c-ff3c-4162-9f34-3beac8095bba\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qs4qg" Jul 09 13:50:27.519532 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.519518 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c6be1427-c9fa-45b4-a6ca-3aaf2be3513b-trusted-ca\") pod \"console-operator-68b757fb67-tvsqr\" (UID: \"c6be1427-c9fa-45b4-a6ca-3aaf2be3513b\") " pod="openshift-console-operator/console-operator-68b757fb67-tvsqr" Jul 09 13:50:27.519684 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.519553 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c6be1427-c9fa-45b4-a6ca-3aaf2be3513b-config\") pod \"console-operator-68b757fb67-tvsqr\" (UID: \"c6be1427-c9fa-45b4-a6ca-3aaf2be3513b\") " pod="openshift-console-operator/console-operator-68b757fb67-tvsqr" Jul 09 13:50:27.519684 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.519593 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c6be1427-c9fa-45b4-a6ca-3aaf2be3513b-serving-cert\") pod \"console-operator-68b757fb67-tvsqr\" (UID: \"c6be1427-c9fa-45b4-a6ca-3aaf2be3513b\") " pod="openshift-console-operator/console-operator-68b757fb67-tvsqr" Jul 09 13:50:27.519684 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.519629 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hdlf\" (UniqueName: \"kubernetes.io/projected/e870a285-4a50-429d-b74d-bc5b4ace1275-kube-api-access-8hdlf\") pod \"service-ca-operator-5d46d9ffd4-j2j9h\" (UID: \"e870a285-4a50-429d-b74d-bc5b4ace1275\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-j2j9h" Jul 09 13:50:27.519684 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.519649 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9v9pq\" (UniqueName: \"kubernetes.io/projected/180dbcfb-3d0e-4ea9-8cf0-1731de5e6fe7-kube-api-access-9v9pq\") pod \"volume-data-source-validator-5d456fdbcd-gfgjz\" (UID: \"180dbcfb-3d0e-4ea9-8cf0-1731de5e6fe7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-gfgjz" Jul 09 13:50:27.519878 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.519692 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e870a285-4a50-429d-b74d-bc5b4ace1275-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-j2j9h\" (UID: \"e870a285-4a50-429d-b74d-bc5b4ace1275\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-j2j9h" Jul 09 13:50:27.519878 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.519723 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e5a15c1c-ff3c-4162-9f34-3beac8095bba-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-qs4qg\" (UID: \"e5a15c1c-ff3c-4162-9f34-3beac8095bba\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qs4qg" Jul 09 13:50:27.519878 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.519767 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/50f246ea-4255-4638-94d4-426607eaed9d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bhvll\" (UID: \"50f246ea-4255-4638-94d4-426607eaed9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bhvll" Jul 09 13:50:27.519878 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.519830 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwg74\" (UniqueName: \"kubernetes.io/projected/c6be1427-c9fa-45b4-a6ca-3aaf2be3513b-kube-api-access-hwg74\") pod \"console-operator-68b757fb67-tvsqr\" (UID: \"c6be1427-c9fa-45b4-a6ca-3aaf2be3513b\") " pod="openshift-console-operator/console-operator-68b757fb67-tvsqr" Jul 09 13:50:27.519878 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.519858 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpk65\" (UniqueName: \"kubernetes.io/projected/50f246ea-4255-4638-94d4-426607eaed9d-kube-api-access-dpk65\") pod \"cluster-samples-operator-56fcf86bf-bhvll\" (UID: \"50f246ea-4255-4638-94d4-426607eaed9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bhvll" Jul 09 13:50:27.519878 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:27.519875 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 13:50:27.520149 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:27.519931 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50f246ea-4255-4638-94d4-426607eaed9d-samples-operator-tls podName:50f246ea-4255-4638-94d4-426607eaed9d nodeName:}" failed. No retries permitted until 2026-07-09 13:50:28.019912023 +0000 UTC m=+52.926486196 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/50f246ea-4255-4638-94d4-426607eaed9d-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-bhvll" (UID: "50f246ea-4255-4638-94d4-426607eaed9d") : secret "samples-operator-tls" not found Jul 09 13:50:27.530970 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.530946 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl79w\" (UniqueName: \"kubernetes.io/projected/468dec5e-20f4-4a48-bbf9-f07fc203db0d-kube-api-access-nl79w\") pod \"network-check-source-989f8b8dc-shl9d\" (UID: \"468dec5e-20f4-4a48-bbf9-f07fc203db0d\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-shl9d" Jul 09 13:50:27.531083 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.531062 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v9pq\" (UniqueName: \"kubernetes.io/projected/180dbcfb-3d0e-4ea9-8cf0-1731de5e6fe7-kube-api-access-9v9pq\") pod \"volume-data-source-validator-5d456fdbcd-gfgjz\" (UID: \"180dbcfb-3d0e-4ea9-8cf0-1731de5e6fe7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-gfgjz" Jul 09 13:50:27.531130 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.531107 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpk65\" (UniqueName: \"kubernetes.io/projected/50f246ea-4255-4638-94d4-426607eaed9d-kube-api-access-dpk65\") pod \"cluster-samples-operator-56fcf86bf-bhvll\" (UID: \"50f246ea-4255-4638-94d4-426607eaed9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bhvll" Jul 09 13:50:27.536965 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.536947 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-j2j9h"] Jul 09 13:50:27.537030 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.536978 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-tvsqr"] Jul 09 13:50:27.537030 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.536994 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qs4qg"] Jul 09 13:50:27.537030 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.537016 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-9fcb6c59f-blmj7"] Jul 09 13:50:27.537129 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.537072 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-9fcb6c59f-blmj7" Jul 09 13:50:27.539432 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.539417 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-qd24n\"" Jul 09 13:50:27.539551 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.539539 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 09 13:50:27.539611 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.539602 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 09 13:50:27.539697 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.539681 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 09 13:50:27.540014 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.540002 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 09 13:50:27.540067 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.540007 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 09 13:50:27.540102 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.540007 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 09 13:50:27.551281 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.551264 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p6mh2" Jul 09 13:50:27.570494 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.570471 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-q2tlh" Jul 09 13:50:27.620968 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.620771 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e870a285-4a50-429d-b74d-bc5b4ace1275-config\") pod \"service-ca-operator-5d46d9ffd4-j2j9h\" (UID: \"e870a285-4a50-429d-b74d-bc5b4ace1275\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-j2j9h" Jul 09 13:50:27.620968 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.620839 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5a15c1c-ff3c-4162-9f34-3beac8095bba-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qs4qg\" (UID: \"e5a15c1c-ff3c-4162-9f34-3beac8095bba\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qs4qg" Jul 09 13:50:27.620968 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.620871 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7bpx\" (UniqueName: \"kubernetes.io/projected/e5a15c1c-ff3c-4162-9f34-3beac8095bba-kube-api-access-m7bpx\") pod \"cluster-monitoring-operator-64786d9cbb-qs4qg\" (UID: \"e5a15c1c-ff3c-4162-9f34-3beac8095bba\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qs4qg" Jul 09 13:50:27.620968 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.620902 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f964a6d-bb71-4efc-aa44-3fa94a53608b-service-ca-bundle\") pod \"router-default-9fcb6c59f-blmj7\" (UID: \"9f964a6d-bb71-4efc-aa44-3fa94a53608b\") " pod="openshift-ingress/router-default-9fcb6c59f-blmj7" Jul 09 13:50:27.620968 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.620936 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c6be1427-c9fa-45b4-a6ca-3aaf2be3513b-trusted-ca\") pod \"console-operator-68b757fb67-tvsqr\" (UID: \"c6be1427-c9fa-45b4-a6ca-3aaf2be3513b\") " pod="openshift-console-operator/console-operator-68b757fb67-tvsqr" Jul 09 13:50:27.620968 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.620962 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c6be1427-c9fa-45b4-a6ca-3aaf2be3513b-config\") pod \"console-operator-68b757fb67-tvsqr\" (UID: \"c6be1427-c9fa-45b4-a6ca-3aaf2be3513b\") " pod="openshift-console-operator/console-operator-68b757fb67-tvsqr" Jul 09 13:50:27.621267 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.621014 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c6be1427-c9fa-45b4-a6ca-3aaf2be3513b-serving-cert\") pod \"console-operator-68b757fb67-tvsqr\" (UID: \"c6be1427-c9fa-45b4-a6ca-3aaf2be3513b\") " pod="openshift-console-operator/console-operator-68b757fb67-tvsqr" Jul 09 13:50:27.621267 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.621041 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p27mv\" (UniqueName: \"kubernetes.io/projected/9f964a6d-bb71-4efc-aa44-3fa94a53608b-kube-api-access-p27mv\") pod \"router-default-9fcb6c59f-blmj7\" (UID: \"9f964a6d-bb71-4efc-aa44-3fa94a53608b\") " pod="openshift-ingress/router-default-9fcb6c59f-blmj7" Jul 09 13:50:27.621267 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.621083 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9f964a6d-bb71-4efc-aa44-3fa94a53608b-stats-auth\") pod \"router-default-9fcb6c59f-blmj7\" (UID: \"9f964a6d-bb71-4efc-aa44-3fa94a53608b\") " pod="openshift-ingress/router-default-9fcb6c59f-blmj7" Jul 09 13:50:27.621267 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.621118 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hdlf\" (UniqueName: \"kubernetes.io/projected/e870a285-4a50-429d-b74d-bc5b4ace1275-kube-api-access-8hdlf\") pod \"service-ca-operator-5d46d9ffd4-j2j9h\" (UID: \"e870a285-4a50-429d-b74d-bc5b4ace1275\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-j2j9h" Jul 09 13:50:27.621267 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.621156 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e870a285-4a50-429d-b74d-bc5b4ace1275-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-j2j9h\" (UID: \"e870a285-4a50-429d-b74d-bc5b4ace1275\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-j2j9h" Jul 09 13:50:27.621267 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.621197 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e5a15c1c-ff3c-4162-9f34-3beac8095bba-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-qs4qg\" (UID: \"e5a15c1c-ff3c-4162-9f34-3beac8095bba\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qs4qg" Jul 09 13:50:27.621267 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.621219 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9f964a6d-bb71-4efc-aa44-3fa94a53608b-default-certificate\") pod \"router-default-9fcb6c59f-blmj7\" (UID: \"9f964a6d-bb71-4efc-aa44-3fa94a53608b\") " pod="openshift-ingress/router-default-9fcb6c59f-blmj7" Jul 09 13:50:27.622249 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.621268 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwg74\" (UniqueName: \"kubernetes.io/projected/c6be1427-c9fa-45b4-a6ca-3aaf2be3513b-kube-api-access-hwg74\") pod \"console-operator-68b757fb67-tvsqr\" (UID: \"c6be1427-c9fa-45b4-a6ca-3aaf2be3513b\") " pod="openshift-console-operator/console-operator-68b757fb67-tvsqr" Jul 09 13:50:27.622249 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.621296 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f964a6d-bb71-4efc-aa44-3fa94a53608b-metrics-certs\") pod \"router-default-9fcb6c59f-blmj7\" (UID: \"9f964a6d-bb71-4efc-aa44-3fa94a53608b\") " pod="openshift-ingress/router-default-9fcb6c59f-blmj7" Jul 09 13:50:27.622249 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.621949 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e870a285-4a50-429d-b74d-bc5b4ace1275-config\") pod \"service-ca-operator-5d46d9ffd4-j2j9h\" (UID: \"e870a285-4a50-429d-b74d-bc5b4ace1275\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-j2j9h" Jul 09 13:50:27.623019 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.622993 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c6be1427-c9fa-45b4-a6ca-3aaf2be3513b-config\") pod \"console-operator-68b757fb67-tvsqr\" (UID: \"c6be1427-c9fa-45b4-a6ca-3aaf2be3513b\") " pod="openshift-console-operator/console-operator-68b757fb67-tvsqr" Jul 09 13:50:27.623137 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:27.623118 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 13:50:27.623200 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:27.623188 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5a15c1c-ff3c-4162-9f34-3beac8095bba-cluster-monitoring-operator-tls podName:e5a15c1c-ff3c-4162-9f34-3beac8095bba nodeName:}" failed. No retries permitted until 2026-07-09 13:50:28.123167279 +0000 UTC m=+53.029741453 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e5a15c1c-ff3c-4162-9f34-3beac8095bba-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-qs4qg" (UID: "e5a15c1c-ff3c-4162-9f34-3beac8095bba") : secret "cluster-monitoring-operator-tls" not found Jul 09 13:50:27.623722 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.623656 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e5a15c1c-ff3c-4162-9f34-3beac8095bba-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-qs4qg\" (UID: \"e5a15c1c-ff3c-4162-9f34-3beac8095bba\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qs4qg" Jul 09 13:50:27.624480 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.624452 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c6be1427-c9fa-45b4-a6ca-3aaf2be3513b-trusted-ca\") pod \"console-operator-68b757fb67-tvsqr\" (UID: \"c6be1427-c9fa-45b4-a6ca-3aaf2be3513b\") " pod="openshift-console-operator/console-operator-68b757fb67-tvsqr" Jul 09 13:50:27.624918 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.624786 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e870a285-4a50-429d-b74d-bc5b4ace1275-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-j2j9h\" (UID: \"e870a285-4a50-429d-b74d-bc5b4ace1275\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-j2j9h" Jul 09 13:50:27.626785 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.626753 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c6be1427-c9fa-45b4-a6ca-3aaf2be3513b-serving-cert\") pod \"console-operator-68b757fb67-tvsqr\" (UID: \"c6be1427-c9fa-45b4-a6ca-3aaf2be3513b\") " pod="openshift-console-operator/console-operator-68b757fb67-tvsqr" Jul 09 13:50:27.634099 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.634051 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hdlf\" (UniqueName: \"kubernetes.io/projected/e870a285-4a50-429d-b74d-bc5b4ace1275-kube-api-access-8hdlf\") pod \"service-ca-operator-5d46d9ffd4-j2j9h\" (UID: \"e870a285-4a50-429d-b74d-bc5b4ace1275\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-j2j9h" Jul 09 13:50:27.634743 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.634718 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwg74\" (UniqueName: \"kubernetes.io/projected/c6be1427-c9fa-45b4-a6ca-3aaf2be3513b-kube-api-access-hwg74\") pod \"console-operator-68b757fb67-tvsqr\" (UID: \"c6be1427-c9fa-45b4-a6ca-3aaf2be3513b\") " pod="openshift-console-operator/console-operator-68b757fb67-tvsqr" Jul 09 13:50:27.635634 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.635611 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7bpx\" (UniqueName: \"kubernetes.io/projected/e5a15c1c-ff3c-4162-9f34-3beac8095bba-kube-api-access-m7bpx\") pod \"cluster-monitoring-operator-64786d9cbb-qs4qg\" (UID: \"e5a15c1c-ff3c-4162-9f34-3beac8095bba\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qs4qg" Jul 09 13:50:27.649394 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.649274 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-shl9d" Jul 09 13:50:27.663258 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.663228 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-gfgjz" Jul 09 13:50:27.678877 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.678849 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-br6cl"] Jul 09 13:50:27.710236 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.709755 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-br6cl"] Jul 09 13:50:27.710236 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.709870 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-br6cl" Jul 09 13:50:27.712609 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.712581 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-lr4t6\"" Jul 09 13:50:27.712972 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.712951 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 09 13:50:27.713084 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.713035 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 09 13:50:27.721881 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.721617 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p6mh2"] Jul 09 13:50:27.723982 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.722931 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f964a6d-bb71-4efc-aa44-3fa94a53608b-service-ca-bundle\") pod \"router-default-9fcb6c59f-blmj7\" (UID: \"9f964a6d-bb71-4efc-aa44-3fa94a53608b\") " pod="openshift-ingress/router-default-9fcb6c59f-blmj7" Jul 09 13:50:27.723982 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.723015 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/355b7781-b0d3-467a-9f6c-370962faa278-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-br6cl\" (UID: \"355b7781-b0d3-467a-9f6c-370962faa278\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-br6cl" Jul 09 13:50:27.723982 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.723061 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p27mv\" (UniqueName: \"kubernetes.io/projected/9f964a6d-bb71-4efc-aa44-3fa94a53608b-kube-api-access-p27mv\") pod \"router-default-9fcb6c59f-blmj7\" (UID: \"9f964a6d-bb71-4efc-aa44-3fa94a53608b\") " pod="openshift-ingress/router-default-9fcb6c59f-blmj7" Jul 09 13:50:27.723982 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.723094 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/355b7781-b0d3-467a-9f6c-370962faa278-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-br6cl\" (UID: \"355b7781-b0d3-467a-9f6c-370962faa278\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-br6cl" Jul 09 13:50:27.723982 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.723152 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9f964a6d-bb71-4efc-aa44-3fa94a53608b-stats-auth\") pod \"router-default-9fcb6c59f-blmj7\" (UID: \"9f964a6d-bb71-4efc-aa44-3fa94a53608b\") " pod="openshift-ingress/router-default-9fcb6c59f-blmj7" Jul 09 13:50:27.723982 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.723227 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9f964a6d-bb71-4efc-aa44-3fa94a53608b-default-certificate\") pod \"router-default-9fcb6c59f-blmj7\" (UID: \"9f964a6d-bb71-4efc-aa44-3fa94a53608b\") " pod="openshift-ingress/router-default-9fcb6c59f-blmj7" Jul 09 13:50:27.723982 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.723288 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f964a6d-bb71-4efc-aa44-3fa94a53608b-metrics-certs\") pod \"router-default-9fcb6c59f-blmj7\" (UID: \"9f964a6d-bb71-4efc-aa44-3fa94a53608b\") " pod="openshift-ingress/router-default-9fcb6c59f-blmj7" Jul 09 13:50:27.723982 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:27.723909 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 13:50:27.723982 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:27.723955 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9f964a6d-bb71-4efc-aa44-3fa94a53608b-service-ca-bundle podName:9f964a6d-bb71-4efc-aa44-3fa94a53608b nodeName:}" failed. No retries permitted until 2026-07-09 13:50:28.223931491 +0000 UTC m=+53.130505685 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9f964a6d-bb71-4efc-aa44-3fa94a53608b-service-ca-bundle") pod "router-default-9fcb6c59f-blmj7" (UID: "9f964a6d-bb71-4efc-aa44-3fa94a53608b") : configmap references non-existent config key: service-ca.crt Jul 09 13:50:27.723982 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:27.723982 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f964a6d-bb71-4efc-aa44-3fa94a53608b-metrics-certs podName:9f964a6d-bb71-4efc-aa44-3fa94a53608b nodeName:}" failed. No retries permitted until 2026-07-09 13:50:28.223970975 +0000 UTC m=+53.130545146 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f964a6d-bb71-4efc-aa44-3fa94a53608b-metrics-certs") pod "router-default-9fcb6c59f-blmj7" (UID: "9f964a6d-bb71-4efc-aa44-3fa94a53608b") : secret "router-metrics-certs-default" not found Jul 09 13:50:27.724536 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:50:27.724457 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d907576_86ea_4a33_928a_85df98300620.slice/crio-ed36ad28a7404c3b18261b35fe7e18b20b81febed4930f639c24f1f99081e553 WatchSource:0}: Error finding container ed36ad28a7404c3b18261b35fe7e18b20b81febed4930f639c24f1f99081e553: Status 404 returned error can't find the container with id ed36ad28a7404c3b18261b35fe7e18b20b81febed4930f639c24f1f99081e553 Jul 09 13:50:27.728926 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.728903 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9f964a6d-bb71-4efc-aa44-3fa94a53608b-stats-auth\") pod \"router-default-9fcb6c59f-blmj7\" (UID: \"9f964a6d-bb71-4efc-aa44-3fa94a53608b\") " pod="openshift-ingress/router-default-9fcb6c59f-blmj7" Jul 09 13:50:27.729384 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.729348 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9f964a6d-bb71-4efc-aa44-3fa94a53608b-default-certificate\") pod \"router-default-9fcb6c59f-blmj7\" (UID: \"9f964a6d-bb71-4efc-aa44-3fa94a53608b\") " pod="openshift-ingress/router-default-9fcb6c59f-blmj7" Jul 09 13:50:27.740568 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.738391 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p27mv\" (UniqueName: \"kubernetes.io/projected/9f964a6d-bb71-4efc-aa44-3fa94a53608b-kube-api-access-p27mv\") pod \"router-default-9fcb6c59f-blmj7\" (UID: \"9f964a6d-bb71-4efc-aa44-3fa94a53608b\") " pod="openshift-ingress/router-default-9fcb6c59f-blmj7" Jul 09 13:50:27.740568 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.740337 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-q2tlh"] Jul 09 13:50:27.744404 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:50:27.744380 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15e19452_d64a_46b3_9ca1_f39d4a955d45.slice/crio-98fe698fb9d55c1f97f4467a757a309cb18d25f523741b1d7c656916ea1741a6 WatchSource:0}: Error finding container 98fe698fb9d55c1f97f4467a757a309cb18d25f523741b1d7c656916ea1741a6: Status 404 returned error can't find the container with id 98fe698fb9d55c1f97f4467a757a309cb18d25f523741b1d7c656916ea1741a6 Jul 09 13:50:27.774933 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.774868 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-j2j9h" Jul 09 13:50:27.799227 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.799197 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-tvsqr" Jul 09 13:50:27.821286 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.821267 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-shl9d"] Jul 09 13:50:27.823955 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:50:27.823931 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod468dec5e_20f4_4a48_bbf9_f07fc203db0d.slice/crio-537a02199ebba4ac08d18c52c5f5d590fec98eba794a1a188c6c185637aa3256 WatchSource:0}: Error finding container 537a02199ebba4ac08d18c52c5f5d590fec98eba794a1a188c6c185637aa3256: Status 404 returned error can't find the container with id 537a02199ebba4ac08d18c52c5f5d590fec98eba794a1a188c6c185637aa3256 Jul 09 13:50:27.824222 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.824204 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/355b7781-b0d3-467a-9f6c-370962faa278-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-br6cl\" (UID: \"355b7781-b0d3-467a-9f6c-370962faa278\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-br6cl" Jul 09 13:50:27.824269 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.824235 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/355b7781-b0d3-467a-9f6c-370962faa278-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-br6cl\" (UID: \"355b7781-b0d3-467a-9f6c-370962faa278\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-br6cl" Jul 09 13:50:27.824347 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:27.824332 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 13:50:27.824416 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:27.824398 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/355b7781-b0d3-467a-9f6c-370962faa278-networking-console-plugin-cert podName:355b7781-b0d3-467a-9f6c-370962faa278 nodeName:}" failed. No retries permitted until 2026-07-09 13:50:28.324379219 +0000 UTC m=+53.230953391 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/355b7781-b0d3-467a-9f6c-370962faa278-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-br6cl" (UID: "355b7781-b0d3-467a-9f6c-370962faa278") : secret "networking-console-plugin-cert" not found Jul 09 13:50:27.824898 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.824876 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/355b7781-b0d3-467a-9f6c-370962faa278-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-br6cl\" (UID: \"355b7781-b0d3-467a-9f6c-370962faa278\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-br6cl" Jul 09 13:50:27.842077 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.842053 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-gfgjz"] Jul 09 13:50:27.844845 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:50:27.844800 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod180dbcfb_3d0e_4ea9_8cf0_1731de5e6fe7.slice/crio-6d8d719da32fb4eefefcb0bab771ab950925487b654170771e8a21d78435b525 WatchSource:0}: Error finding container 6d8d719da32fb4eefefcb0bab771ab950925487b654170771e8a21d78435b525: Status 404 returned error can't find the container with id 6d8d719da32fb4eefefcb0bab771ab950925487b654170771e8a21d78435b525 Jul 09 13:50:27.949352 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.949322 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-j2j9h"] Jul 09 13:50:27.953013 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:50:27.952983 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode870a285_4a50_429d_b74d_bc5b4ace1275.slice/crio-dec9b8977399788485efdb671e62de88b9722317ce3e2829e78f5a9ce74a3510 WatchSource:0}: Error finding container dec9b8977399788485efdb671e62de88b9722317ce3e2829e78f5a9ce74a3510: Status 404 returned error can't find the container with id dec9b8977399788485efdb671e62de88b9722317ce3e2829e78f5a9ce74a3510 Jul 09 13:50:27.964861 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.964838 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-tvsqr"] Jul 09 13:50:27.967823 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:50:27.967775 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6be1427_c9fa_45b4_a6ca_3aaf2be3513b.slice/crio-ba055fb287b1f059395bdca0b4fc6ea77aabc8eb56181c69dcd588fd82b9a208 WatchSource:0}: Error finding container ba055fb287b1f059395bdca0b4fc6ea77aabc8eb56181c69dcd588fd82b9a208: Status 404 returned error can't find the container with id ba055fb287b1f059395bdca0b4fc6ea77aabc8eb56181c69dcd588fd82b9a208 Jul 09 13:50:27.985428 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.985355 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-j2j9h" event={"ID":"e870a285-4a50-429d-b74d-bc5b4ace1275","Type":"ContainerStarted","Data":"dec9b8977399788485efdb671e62de88b9722317ce3e2829e78f5a9ce74a3510"} Jul 09 13:50:27.986472 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.986447 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p6mh2" event={"ID":"3d907576-86ea-4a33-928a-85df98300620","Type":"ContainerStarted","Data":"ed36ad28a7404c3b18261b35fe7e18b20b81febed4930f639c24f1f99081e553"} Jul 09 13:50:27.987640 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.987608 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-gfgjz" event={"ID":"180dbcfb-3d0e-4ea9-8cf0-1731de5e6fe7","Type":"ContainerStarted","Data":"6d8d719da32fb4eefefcb0bab771ab950925487b654170771e8a21d78435b525"} Jul 09 13:50:27.988708 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.988681 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-shl9d" event={"ID":"468dec5e-20f4-4a48-bbf9-f07fc203db0d","Type":"ContainerStarted","Data":"537a02199ebba4ac08d18c52c5f5d590fec98eba794a1a188c6c185637aa3256"} Jul 09 13:50:27.989700 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.989677 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-q2tlh" event={"ID":"15e19452-d64a-46b3-9ca1-f39d4a955d45","Type":"ContainerStarted","Data":"98fe698fb9d55c1f97f4467a757a309cb18d25f523741b1d7c656916ea1741a6"} Jul 09 13:50:27.990712 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:27.990693 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-tvsqr" event={"ID":"c6be1427-c9fa-45b4-a6ca-3aaf2be3513b","Type":"ContainerStarted","Data":"ba055fb287b1f059395bdca0b4fc6ea77aabc8eb56181c69dcd588fd82b9a208"} Jul 09 13:50:28.026478 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:28.026439 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/50f246ea-4255-4638-94d4-426607eaed9d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bhvll\" (UID: \"50f246ea-4255-4638-94d4-426607eaed9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bhvll" Jul 09 13:50:28.026623 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:28.026601 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 13:50:28.026687 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:28.026676 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50f246ea-4255-4638-94d4-426607eaed9d-samples-operator-tls podName:50f246ea-4255-4638-94d4-426607eaed9d nodeName:}" failed. No retries permitted until 2026-07-09 13:50:29.026659005 +0000 UTC m=+53.933233180 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/50f246ea-4255-4638-94d4-426607eaed9d-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-bhvll" (UID: "50f246ea-4255-4638-94d4-426607eaed9d") : secret "samples-operator-tls" not found Jul 09 13:50:28.126872 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:28.126823 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5a15c1c-ff3c-4162-9f34-3beac8095bba-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qs4qg\" (UID: \"e5a15c1c-ff3c-4162-9f34-3beac8095bba\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qs4qg" Jul 09 13:50:28.127019 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:28.126921 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 13:50:28.127019 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:28.126996 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5a15c1c-ff3c-4162-9f34-3beac8095bba-cluster-monitoring-operator-tls podName:e5a15c1c-ff3c-4162-9f34-3beac8095bba nodeName:}" failed. No retries permitted until 2026-07-09 13:50:29.126975789 +0000 UTC m=+54.033549962 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e5a15c1c-ff3c-4162-9f34-3beac8095bba-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-qs4qg" (UID: "e5a15c1c-ff3c-4162-9f34-3beac8095bba") : secret "cluster-monitoring-operator-tls" not found Jul 09 13:50:28.228045 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:28.228011 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f964a6d-bb71-4efc-aa44-3fa94a53608b-metrics-certs\") pod \"router-default-9fcb6c59f-blmj7\" (UID: \"9f964a6d-bb71-4efc-aa44-3fa94a53608b\") " pod="openshift-ingress/router-default-9fcb6c59f-blmj7" Jul 09 13:50:28.228206 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:28.228072 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f964a6d-bb71-4efc-aa44-3fa94a53608b-service-ca-bundle\") pod \"router-default-9fcb6c59f-blmj7\" (UID: \"9f964a6d-bb71-4efc-aa44-3fa94a53608b\") " pod="openshift-ingress/router-default-9fcb6c59f-blmj7" Jul 09 13:50:28.228206 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:28.228165 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 13:50:28.228206 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:28.228183 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9f964a6d-bb71-4efc-aa44-3fa94a53608b-service-ca-bundle podName:9f964a6d-bb71-4efc-aa44-3fa94a53608b nodeName:}" failed. No retries permitted until 2026-07-09 13:50:29.228170315 +0000 UTC m=+54.134744499 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9f964a6d-bb71-4efc-aa44-3fa94a53608b-service-ca-bundle") pod "router-default-9fcb6c59f-blmj7" (UID: "9f964a6d-bb71-4efc-aa44-3fa94a53608b") : configmap references non-existent config key: service-ca.crt Jul 09 13:50:28.228315 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:28.228222 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f964a6d-bb71-4efc-aa44-3fa94a53608b-metrics-certs podName:9f964a6d-bb71-4efc-aa44-3fa94a53608b nodeName:}" failed. No retries permitted until 2026-07-09 13:50:29.228208239 +0000 UTC m=+54.134782411 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f964a6d-bb71-4efc-aa44-3fa94a53608b-metrics-certs") pod "router-default-9fcb6c59f-blmj7" (UID: "9f964a6d-bb71-4efc-aa44-3fa94a53608b") : secret "router-metrics-certs-default" not found Jul 09 13:50:28.328819 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:28.328785 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/355b7781-b0d3-467a-9f6c-370962faa278-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-br6cl\" (UID: \"355b7781-b0d3-467a-9f6c-370962faa278\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-br6cl" Jul 09 13:50:28.329157 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:28.328917 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 13:50:28.329157 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:28.328978 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/355b7781-b0d3-467a-9f6c-370962faa278-networking-console-plugin-cert podName:355b7781-b0d3-467a-9f6c-370962faa278 nodeName:}" failed. No retries permitted until 2026-07-09 13:50:29.32896337 +0000 UTC m=+54.235537540 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/355b7781-b0d3-467a-9f6c-370962faa278-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-br6cl" (UID: "355b7781-b0d3-467a-9f6c-370962faa278") : secret "networking-console-plugin-cert" not found Jul 09 13:50:29.035896 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:29.035856 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/50f246ea-4255-4638-94d4-426607eaed9d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bhvll\" (UID: \"50f246ea-4255-4638-94d4-426607eaed9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bhvll" Jul 09 13:50:29.036092 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:29.036066 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 13:50:29.036158 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:29.036133 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50f246ea-4255-4638-94d4-426607eaed9d-samples-operator-tls podName:50f246ea-4255-4638-94d4-426607eaed9d nodeName:}" failed. No retries permitted until 2026-07-09 13:50:31.036113622 +0000 UTC m=+55.942687796 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/50f246ea-4255-4638-94d4-426607eaed9d-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-bhvll" (UID: "50f246ea-4255-4638-94d4-426607eaed9d") : secret "samples-operator-tls" not found Jul 09 13:50:29.137543 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:29.137499 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5a15c1c-ff3c-4162-9f34-3beac8095bba-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qs4qg\" (UID: \"e5a15c1c-ff3c-4162-9f34-3beac8095bba\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qs4qg" Jul 09 13:50:29.138261 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:29.137748 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 13:50:29.138261 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:29.137856 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5a15c1c-ff3c-4162-9f34-3beac8095bba-cluster-monitoring-operator-tls podName:e5a15c1c-ff3c-4162-9f34-3beac8095bba nodeName:}" failed. No retries permitted until 2026-07-09 13:50:31.137832387 +0000 UTC m=+56.044406566 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e5a15c1c-ff3c-4162-9f34-3beac8095bba-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-qs4qg" (UID: "e5a15c1c-ff3c-4162-9f34-3beac8095bba") : secret "cluster-monitoring-operator-tls" not found Jul 09 13:50:29.239582 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:29.238962 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f964a6d-bb71-4efc-aa44-3fa94a53608b-metrics-certs\") pod \"router-default-9fcb6c59f-blmj7\" (UID: \"9f964a6d-bb71-4efc-aa44-3fa94a53608b\") " pod="openshift-ingress/router-default-9fcb6c59f-blmj7" Jul 09 13:50:29.239582 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:29.239054 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f964a6d-bb71-4efc-aa44-3fa94a53608b-service-ca-bundle\") pod \"router-default-9fcb6c59f-blmj7\" (UID: \"9f964a6d-bb71-4efc-aa44-3fa94a53608b\") " pod="openshift-ingress/router-default-9fcb6c59f-blmj7" Jul 09 13:50:29.239582 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:29.239235 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9f964a6d-bb71-4efc-aa44-3fa94a53608b-service-ca-bundle podName:9f964a6d-bb71-4efc-aa44-3fa94a53608b nodeName:}" failed. No retries permitted until 2026-07-09 13:50:31.239215418 +0000 UTC m=+56.145789594 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9f964a6d-bb71-4efc-aa44-3fa94a53608b-service-ca-bundle") pod "router-default-9fcb6c59f-blmj7" (UID: "9f964a6d-bb71-4efc-aa44-3fa94a53608b") : configmap references non-existent config key: service-ca.crt Jul 09 13:50:29.239582 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:29.239429 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 13:50:29.239582 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:29.239478 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f964a6d-bb71-4efc-aa44-3fa94a53608b-metrics-certs podName:9f964a6d-bb71-4efc-aa44-3fa94a53608b nodeName:}" failed. No retries permitted until 2026-07-09 13:50:31.239464417 +0000 UTC m=+56.146038605 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f964a6d-bb71-4efc-aa44-3fa94a53608b-metrics-certs") pod "router-default-9fcb6c59f-blmj7" (UID: "9f964a6d-bb71-4efc-aa44-3fa94a53608b") : secret "router-metrics-certs-default" not found Jul 09 13:50:29.340863 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:29.340128 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/355b7781-b0d3-467a-9f6c-370962faa278-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-br6cl\" (UID: \"355b7781-b0d3-467a-9f6c-370962faa278\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-br6cl" Jul 09 13:50:29.340863 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:29.340271 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 13:50:29.340863 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:29.340338 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/355b7781-b0d3-467a-9f6c-370962faa278-networking-console-plugin-cert podName:355b7781-b0d3-467a-9f6c-370962faa278 nodeName:}" failed. No retries permitted until 2026-07-09 13:50:31.340319947 +0000 UTC m=+56.246894121 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/355b7781-b0d3-467a-9f6c-370962faa278-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-br6cl" (UID: "355b7781-b0d3-467a-9f6c-370962faa278") : secret "networking-console-plugin-cert" not found Jul 09 13:50:31.060087 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:31.060048 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/50f246ea-4255-4638-94d4-426607eaed9d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bhvll\" (UID: \"50f246ea-4255-4638-94d4-426607eaed9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bhvll" Jul 09 13:50:31.060402 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:31.060213 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 13:50:31.060402 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:31.060285 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50f246ea-4255-4638-94d4-426607eaed9d-samples-operator-tls podName:50f246ea-4255-4638-94d4-426607eaed9d nodeName:}" failed. No retries permitted until 2026-07-09 13:50:35.060266093 +0000 UTC m=+59.966840264 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/50f246ea-4255-4638-94d4-426607eaed9d-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-bhvll" (UID: "50f246ea-4255-4638-94d4-426607eaed9d") : secret "samples-operator-tls" not found Jul 09 13:50:31.161336 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:31.161303 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5a15c1c-ff3c-4162-9f34-3beac8095bba-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qs4qg\" (UID: \"e5a15c1c-ff3c-4162-9f34-3beac8095bba\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qs4qg" Jul 09 13:50:31.161485 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:31.161450 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 13:50:31.161525 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:31.161517 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5a15c1c-ff3c-4162-9f34-3beac8095bba-cluster-monitoring-operator-tls podName:e5a15c1c-ff3c-4162-9f34-3beac8095bba nodeName:}" failed. No retries permitted until 2026-07-09 13:50:35.161499624 +0000 UTC m=+60.068073795 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e5a15c1c-ff3c-4162-9f34-3beac8095bba-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-qs4qg" (UID: "e5a15c1c-ff3c-4162-9f34-3beac8095bba") : secret "cluster-monitoring-operator-tls" not found Jul 09 13:50:31.262013 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:31.261978 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f964a6d-bb71-4efc-aa44-3fa94a53608b-metrics-certs\") pod \"router-default-9fcb6c59f-blmj7\" (UID: \"9f964a6d-bb71-4efc-aa44-3fa94a53608b\") " pod="openshift-ingress/router-default-9fcb6c59f-blmj7" Jul 09 13:50:31.262199 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:31.262049 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f964a6d-bb71-4efc-aa44-3fa94a53608b-service-ca-bundle\") pod \"router-default-9fcb6c59f-blmj7\" (UID: \"9f964a6d-bb71-4efc-aa44-3fa94a53608b\") " pod="openshift-ingress/router-default-9fcb6c59f-blmj7" Jul 09 13:50:31.262199 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:31.262126 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 13:50:31.262199 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:31.262192 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f964a6d-bb71-4efc-aa44-3fa94a53608b-metrics-certs podName:9f964a6d-bb71-4efc-aa44-3fa94a53608b nodeName:}" failed. No retries permitted until 2026-07-09 13:50:35.262175144 +0000 UTC m=+60.168749347 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f964a6d-bb71-4efc-aa44-3fa94a53608b-metrics-certs") pod "router-default-9fcb6c59f-blmj7" (UID: "9f964a6d-bb71-4efc-aa44-3fa94a53608b") : secret "router-metrics-certs-default" not found Jul 09 13:50:31.262326 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:31.262206 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9f964a6d-bb71-4efc-aa44-3fa94a53608b-service-ca-bundle podName:9f964a6d-bb71-4efc-aa44-3fa94a53608b nodeName:}" failed. No retries permitted until 2026-07-09 13:50:35.262199854 +0000 UTC m=+60.168774025 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9f964a6d-bb71-4efc-aa44-3fa94a53608b-service-ca-bundle") pod "router-default-9fcb6c59f-blmj7" (UID: "9f964a6d-bb71-4efc-aa44-3fa94a53608b") : configmap references non-existent config key: service-ca.crt Jul 09 13:50:31.363504 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:31.363420 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/355b7781-b0d3-467a-9f6c-370962faa278-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-br6cl\" (UID: \"355b7781-b0d3-467a-9f6c-370962faa278\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-br6cl" Jul 09 13:50:31.363673 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:31.363588 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 13:50:31.363729 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:31.363674 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/355b7781-b0d3-467a-9f6c-370962faa278-networking-console-plugin-cert podName:355b7781-b0d3-467a-9f6c-370962faa278 nodeName:}" failed. No retries permitted until 2026-07-09 13:50:35.363651136 +0000 UTC m=+60.270225310 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/355b7781-b0d3-467a-9f6c-370962faa278-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-br6cl" (UID: "355b7781-b0d3-467a-9f6c-370962faa278") : secret "networking-console-plugin-cert" not found Jul 09 13:50:34.012131 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:34.012097 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tvsqr_c6be1427-c9fa-45b4-a6ca-3aaf2be3513b/console-operator/0.log" Jul 09 13:50:34.012629 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:34.012145 2573 generic.go:356] "Generic (PLEG): container finished" podID="c6be1427-c9fa-45b4-a6ca-3aaf2be3513b" containerID="922a452a4139a6f3c5209e8124ccecd5c6312024f009fef7ebd767b7827f6198" exitCode=255 Jul 09 13:50:34.012629 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:34.012423 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-tvsqr" event={"ID":"c6be1427-c9fa-45b4-a6ca-3aaf2be3513b","Type":"ContainerDied","Data":"922a452a4139a6f3c5209e8124ccecd5c6312024f009fef7ebd767b7827f6198"} Jul 09 13:50:34.012629 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:34.012547 2573 scope.go:117] "RemoveContainer" containerID="922a452a4139a6f3c5209e8124ccecd5c6312024f009fef7ebd767b7827f6198" Jul 09 13:50:34.014507 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:34.014480 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-j2j9h" event={"ID":"e870a285-4a50-429d-b74d-bc5b4ace1275","Type":"ContainerStarted","Data":"6e5659ccd636c8803ca32dee9e12ab1a3bb188cd85e0f8af18aa6ab31009a782"} Jul 09 13:50:34.017601 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:34.017545 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p6mh2" event={"ID":"3d907576-86ea-4a33-928a-85df98300620","Type":"ContainerStarted","Data":"7bce108714a78ba217bc3a1b5fc5b1a1f30d30aec1aede90a0f4d19b7b2cf7ba"} Jul 09 13:50:34.019245 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:34.019199 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-gfgjz" event={"ID":"180dbcfb-3d0e-4ea9-8cf0-1731de5e6fe7","Type":"ContainerStarted","Data":"f2503521631a973d15ea64c349af770bfe9b476d5bf29e6ca34bfe0fc010707a"} Jul 09 13:50:34.021224 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:34.020891 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-shl9d" event={"ID":"468dec5e-20f4-4a48-bbf9-f07fc203db0d","Type":"ContainerStarted","Data":"5a8d1436c0b857c556d9c75afc859647574810cad5c8d845fc6cb4be24f2f5ea"} Jul 09 13:50:34.022679 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:34.022653 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-q2tlh" event={"ID":"15e19452-d64a-46b3-9ca1-f39d4a955d45","Type":"ContainerStarted","Data":"ecfaea5400e11bc741d4997461e3c755ae88c16761779488bf4cb04b59300003"} Jul 09 13:50:34.042315 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:34.042259 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-shl9d" podStartSLOduration=1.583516063 podStartE2EDuration="7.042239489s" totalImagesPullingTime="5.458723426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:50:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:50:34.041938455 +0000 UTC m=+58.948512649" watchObservedRunningTime="2026-07-09 13:50:34.042239489 +0000 UTC m=+58.948813683" Jul 09 13:50:34.063452 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:34.063401 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-gfgjz" podStartSLOduration=1.665220066 podStartE2EDuration="7.063380113s" totalImagesPullingTime="5.398160047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:50:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:50:34.063330526 +0000 UTC m=+58.969904721" watchObservedRunningTime="2026-07-09 13:50:34.063380113 +0000 UTC m=+58.969954307" Jul 09 13:50:34.077727 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:34.077674 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-j2j9h" podStartSLOduration=1.768351303 podStartE2EDuration="7.077655631s" totalImagesPullingTime="5.309304328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:50:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:50:34.076699994 +0000 UTC m=+58.983274188" watchObservedRunningTime="2026-07-09 13:50:34.077655631 +0000 UTC m=+58.984229825" Jul 09 13:50:34.099700 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:34.098042 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p6mh2" podStartSLOduration=1.560416797 podStartE2EDuration="7.098022372s" totalImagesPullingTime="5.537605575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:50:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:50:34.097320658 +0000 UTC m=+59.003894852" watchObservedRunningTime="2026-07-09 13:50:34.098022372 +0000 UTC m=+59.004596566" Jul 09 13:50:34.115493 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:34.115211 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-q2tlh" podStartSLOduration=1.6147582809999999 podStartE2EDuration="7.115190039s" totalImagesPullingTime="5.500431758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:50:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:50:34.113993482 +0000 UTC m=+59.020567676" watchObservedRunningTime="2026-07-09 13:50:34.115190039 +0000 UTC m=+59.021764232" Jul 09 13:50:34.475907 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:34.475263 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vr64v"] Jul 09 13:50:34.478237 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:34.478213 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vr64v" Jul 09 13:50:34.480643 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:34.480622 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-s4s8j\"" Jul 09 13:50:34.482786 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:34.482708 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 13:50:34.483186 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:34.483167 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 13:50:34.506274 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:34.500694 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vr64v"] Jul 09 13:50:34.596555 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:34.596515 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/97ae6181-9332-4b9e-a573-4ae3d779466c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vr64v\" (UID: \"97ae6181-9332-4b9e-a573-4ae3d779466c\") " pod="openshift-insights/insights-runtime-extractor-vr64v" Jul 09 13:50:34.596734 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:34.596682 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/97ae6181-9332-4b9e-a573-4ae3d779466c-crio-socket\") pod \"insights-runtime-extractor-vr64v\" (UID: \"97ae6181-9332-4b9e-a573-4ae3d779466c\") " pod="openshift-insights/insights-runtime-extractor-vr64v" Jul 09 13:50:34.596835 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:34.596729 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw4rd\" (UniqueName: \"kubernetes.io/projected/97ae6181-9332-4b9e-a573-4ae3d779466c-kube-api-access-cw4rd\") pod \"insights-runtime-extractor-vr64v\" (UID: \"97ae6181-9332-4b9e-a573-4ae3d779466c\") " pod="openshift-insights/insights-runtime-extractor-vr64v" Jul 09 13:50:34.596897 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:34.596862 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97ae6181-9332-4b9e-a573-4ae3d779466c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vr64v\" (UID: \"97ae6181-9332-4b9e-a573-4ae3d779466c\") " pod="openshift-insights/insights-runtime-extractor-vr64v" Jul 09 13:50:34.596948 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:34.596906 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/97ae6181-9332-4b9e-a573-4ae3d779466c-data-volume\") pod \"insights-runtime-extractor-vr64v\" (UID: \"97ae6181-9332-4b9e-a573-4ae3d779466c\") " pod="openshift-insights/insights-runtime-extractor-vr64v" Jul 09 13:50:34.697652 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:34.697609 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/97ae6181-9332-4b9e-a573-4ae3d779466c-crio-socket\") pod \"insights-runtime-extractor-vr64v\" (UID: \"97ae6181-9332-4b9e-a573-4ae3d779466c\") " pod="openshift-insights/insights-runtime-extractor-vr64v" Jul 09 13:50:34.697866 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:34.697660 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cw4rd\" (UniqueName: \"kubernetes.io/projected/97ae6181-9332-4b9e-a573-4ae3d779466c-kube-api-access-cw4rd\") pod \"insights-runtime-extractor-vr64v\" (UID: \"97ae6181-9332-4b9e-a573-4ae3d779466c\") " pod="openshift-insights/insights-runtime-extractor-vr64v" Jul 09 13:50:34.697866 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:34.697757 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/97ae6181-9332-4b9e-a573-4ae3d779466c-crio-socket\") pod \"insights-runtime-extractor-vr64v\" (UID: \"97ae6181-9332-4b9e-a573-4ae3d779466c\") " pod="openshift-insights/insights-runtime-extractor-vr64v" Jul 09 13:50:34.697866 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:34.697845 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97ae6181-9332-4b9e-a573-4ae3d779466c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vr64v\" (UID: \"97ae6181-9332-4b9e-a573-4ae3d779466c\") " pod="openshift-insights/insights-runtime-extractor-vr64v" Jul 09 13:50:34.698042 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:34.697874 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/97ae6181-9332-4b9e-a573-4ae3d779466c-data-volume\") pod \"insights-runtime-extractor-vr64v\" (UID: \"97ae6181-9332-4b9e-a573-4ae3d779466c\") " pod="openshift-insights/insights-runtime-extractor-vr64v" Jul 09 13:50:34.698042 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:34.697976 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/97ae6181-9332-4b9e-a573-4ae3d779466c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vr64v\" (UID: \"97ae6181-9332-4b9e-a573-4ae3d779466c\") " pod="openshift-insights/insights-runtime-extractor-vr64v" Jul 09 13:50:34.698042 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:34.698004 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 13:50:34.698168 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:34.698054 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 13:50:34.698168 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:34.698067 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97ae6181-9332-4b9e-a573-4ae3d779466c-insights-runtime-extractor-tls podName:97ae6181-9332-4b9e-a573-4ae3d779466c nodeName:}" failed. No retries permitted until 2026-07-09 13:50:35.198048537 +0000 UTC m=+60.104622723 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/97ae6181-9332-4b9e-a573-4ae3d779466c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vr64v" (UID: "97ae6181-9332-4b9e-a573-4ae3d779466c") : secret "insights-runtime-extractor-tls" not found Jul 09 13:50:34.698168 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:34.698088 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/97ae6181-9332-4b9e-a573-4ae3d779466c-kube-rbac-proxy-cm podName:97ae6181-9332-4b9e-a573-4ae3d779466c nodeName:}" failed. No retries permitted until 2026-07-09 13:50:35.198078266 +0000 UTC m=+60.104652437 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/97ae6181-9332-4b9e-a573-4ae3d779466c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vr64v" (UID: "97ae6181-9332-4b9e-a573-4ae3d779466c") : configmap "kube-rbac-proxy" not found Jul 09 13:50:34.698397 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:34.698374 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/97ae6181-9332-4b9e-a573-4ae3d779466c-data-volume\") pod \"insights-runtime-extractor-vr64v\" (UID: \"97ae6181-9332-4b9e-a573-4ae3d779466c\") " pod="openshift-insights/insights-runtime-extractor-vr64v" Jul 09 13:50:34.707922 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:34.707893 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw4rd\" (UniqueName: \"kubernetes.io/projected/97ae6181-9332-4b9e-a573-4ae3d779466c-kube-api-access-cw4rd\") pod \"insights-runtime-extractor-vr64v\" (UID: \"97ae6181-9332-4b9e-a573-4ae3d779466c\") " pod="openshift-insights/insights-runtime-extractor-vr64v" Jul 09 13:50:35.029463 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:35.029433 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tvsqr_c6be1427-c9fa-45b4-a6ca-3aaf2be3513b/console-operator/1.log" Jul 09 13:50:35.029923 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:35.029905 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tvsqr_c6be1427-c9fa-45b4-a6ca-3aaf2be3513b/console-operator/0.log" Jul 09 13:50:35.029971 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:35.029949 2573 generic.go:356] "Generic (PLEG): container finished" podID="c6be1427-c9fa-45b4-a6ca-3aaf2be3513b" containerID="0e749eef6cd871c8abc1f34496258ccc9c27bba5b7f74067e82964d84e46d74a" exitCode=255 Jul 09 13:50:35.030079 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:35.030054 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-tvsqr" event={"ID":"c6be1427-c9fa-45b4-a6ca-3aaf2be3513b","Type":"ContainerDied","Data":"0e749eef6cd871c8abc1f34496258ccc9c27bba5b7f74067e82964d84e46d74a"} Jul 09 13:50:35.030175 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:35.030160 2573 scope.go:117] "RemoveContainer" containerID="922a452a4139a6f3c5209e8124ccecd5c6312024f009fef7ebd767b7827f6198" Jul 09 13:50:35.030310 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:35.030286 2573 scope.go:117] "RemoveContainer" containerID="0e749eef6cd871c8abc1f34496258ccc9c27bba5b7f74067e82964d84e46d74a" Jul 09 13:50:35.030519 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:35.030494 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-tvsqr_openshift-console-operator(c6be1427-c9fa-45b4-a6ca-3aaf2be3513b)\"" pod="openshift-console-operator/console-operator-68b757fb67-tvsqr" podUID="c6be1427-c9fa-45b4-a6ca-3aaf2be3513b" Jul 09 13:50:35.102727 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:35.102671 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/50f246ea-4255-4638-94d4-426607eaed9d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bhvll\" (UID: \"50f246ea-4255-4638-94d4-426607eaed9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bhvll" Jul 09 13:50:35.103132 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:35.103079 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 13:50:35.103267 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:35.103142 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50f246ea-4255-4638-94d4-426607eaed9d-samples-operator-tls podName:50f246ea-4255-4638-94d4-426607eaed9d nodeName:}" failed. No retries permitted until 2026-07-09 13:50:43.10312335 +0000 UTC m=+68.009697524 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/50f246ea-4255-4638-94d4-426607eaed9d-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-bhvll" (UID: "50f246ea-4255-4638-94d4-426607eaed9d") : secret "samples-operator-tls" not found Jul 09 13:50:35.204051 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:35.204007 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97ae6181-9332-4b9e-a573-4ae3d779466c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vr64v\" (UID: \"97ae6181-9332-4b9e-a573-4ae3d779466c\") " pod="openshift-insights/insights-runtime-extractor-vr64v" Jul 09 13:50:35.204237 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:35.204098 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5a15c1c-ff3c-4162-9f34-3beac8095bba-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qs4qg\" (UID: \"e5a15c1c-ff3c-4162-9f34-3beac8095bba\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qs4qg" Jul 09 13:50:35.204237 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:35.204131 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/97ae6181-9332-4b9e-a573-4ae3d779466c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vr64v\" (UID: \"97ae6181-9332-4b9e-a573-4ae3d779466c\") " pod="openshift-insights/insights-runtime-extractor-vr64v" Jul 09 13:50:35.204237 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:35.204177 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 13:50:35.204394 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:35.204242 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 13:50:35.204394 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:35.204242 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 13:50:35.204394 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:35.204250 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97ae6181-9332-4b9e-a573-4ae3d779466c-insights-runtime-extractor-tls podName:97ae6181-9332-4b9e-a573-4ae3d779466c nodeName:}" failed. No retries permitted until 2026-07-09 13:50:36.204230854 +0000 UTC m=+61.110805028 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/97ae6181-9332-4b9e-a573-4ae3d779466c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vr64v" (UID: "97ae6181-9332-4b9e-a573-4ae3d779466c") : secret "insights-runtime-extractor-tls" not found Jul 09 13:50:35.204394 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:35.204327 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/97ae6181-9332-4b9e-a573-4ae3d779466c-kube-rbac-proxy-cm podName:97ae6181-9332-4b9e-a573-4ae3d779466c nodeName:}" failed. No retries permitted until 2026-07-09 13:50:36.204310379 +0000 UTC m=+61.110884556 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/97ae6181-9332-4b9e-a573-4ae3d779466c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vr64v" (UID: "97ae6181-9332-4b9e-a573-4ae3d779466c") : configmap "kube-rbac-proxy" not found Jul 09 13:50:35.204394 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:35.204344 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5a15c1c-ff3c-4162-9f34-3beac8095bba-cluster-monitoring-operator-tls podName:e5a15c1c-ff3c-4162-9f34-3beac8095bba nodeName:}" failed. No retries permitted until 2026-07-09 13:50:43.204334135 +0000 UTC m=+68.110908306 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e5a15c1c-ff3c-4162-9f34-3beac8095bba-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-qs4qg" (UID: "e5a15c1c-ff3c-4162-9f34-3beac8095bba") : secret "cluster-monitoring-operator-tls" not found Jul 09 13:50:35.304844 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:35.304739 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f964a6d-bb71-4efc-aa44-3fa94a53608b-service-ca-bundle\") pod \"router-default-9fcb6c59f-blmj7\" (UID: \"9f964a6d-bb71-4efc-aa44-3fa94a53608b\") " pod="openshift-ingress/router-default-9fcb6c59f-blmj7" Jul 09 13:50:35.304999 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:35.304900 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f964a6d-bb71-4efc-aa44-3fa94a53608b-metrics-certs\") pod \"router-default-9fcb6c59f-blmj7\" (UID: \"9f964a6d-bb71-4efc-aa44-3fa94a53608b\") " pod="openshift-ingress/router-default-9fcb6c59f-blmj7" Jul 09 13:50:35.304999 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:35.304939 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9f964a6d-bb71-4efc-aa44-3fa94a53608b-service-ca-bundle podName:9f964a6d-bb71-4efc-aa44-3fa94a53608b nodeName:}" failed. No retries permitted until 2026-07-09 13:50:43.304918306 +0000 UTC m=+68.211492496 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9f964a6d-bb71-4efc-aa44-3fa94a53608b-service-ca-bundle") pod "router-default-9fcb6c59f-blmj7" (UID: "9f964a6d-bb71-4efc-aa44-3fa94a53608b") : configmap references non-existent config key: service-ca.crt Jul 09 13:50:35.304999 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:35.304990 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 13:50:35.305145 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:35.305039 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f964a6d-bb71-4efc-aa44-3fa94a53608b-metrics-certs podName:9f964a6d-bb71-4efc-aa44-3fa94a53608b nodeName:}" failed. No retries permitted until 2026-07-09 13:50:43.305024475 +0000 UTC m=+68.211598648 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f964a6d-bb71-4efc-aa44-3fa94a53608b-metrics-certs") pod "router-default-9fcb6c59f-blmj7" (UID: "9f964a6d-bb71-4efc-aa44-3fa94a53608b") : secret "router-metrics-certs-default" not found Jul 09 13:50:35.406310 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:35.406277 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/355b7781-b0d3-467a-9f6c-370962faa278-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-br6cl\" (UID: \"355b7781-b0d3-467a-9f6c-370962faa278\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-br6cl" Jul 09 13:50:35.406456 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:35.406407 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 13:50:35.406493 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:35.406465 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/355b7781-b0d3-467a-9f6c-370962faa278-networking-console-plugin-cert podName:355b7781-b0d3-467a-9f6c-370962faa278 nodeName:}" failed. No retries permitted until 2026-07-09 13:50:43.406448812 +0000 UTC m=+68.313022984 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/355b7781-b0d3-467a-9f6c-370962faa278-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-br6cl" (UID: "355b7781-b0d3-467a-9f6c-370962faa278") : secret "networking-console-plugin-cert" not found Jul 09 13:50:35.921510 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:35.921481 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wlg95" Jul 09 13:50:36.034604 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:36.034576 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tvsqr_c6be1427-c9fa-45b4-a6ca-3aaf2be3513b/console-operator/1.log" Jul 09 13:50:36.035035 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:36.034946 2573 scope.go:117] "RemoveContainer" containerID="0e749eef6cd871c8abc1f34496258ccc9c27bba5b7f74067e82964d84e46d74a" Jul 09 13:50:36.035103 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:36.035083 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-tvsqr_openshift-console-operator(c6be1427-c9fa-45b4-a6ca-3aaf2be3513b)\"" pod="openshift-console-operator/console-operator-68b757fb67-tvsqr" podUID="c6be1427-c9fa-45b4-a6ca-3aaf2be3513b" Jul 09 13:50:36.064737 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:36.064711 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gcld7_3d676a82-9c69-4065-b7e0-87787f3cc7bd/dns-node-resolver/0.log" Jul 09 13:50:36.212281 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:36.212196 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97ae6181-9332-4b9e-a573-4ae3d779466c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vr64v\" (UID: \"97ae6181-9332-4b9e-a573-4ae3d779466c\") " pod="openshift-insights/insights-runtime-extractor-vr64v" Jul 09 13:50:36.212432 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:36.212299 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/97ae6181-9332-4b9e-a573-4ae3d779466c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vr64v\" (UID: \"97ae6181-9332-4b9e-a573-4ae3d779466c\") " pod="openshift-insights/insights-runtime-extractor-vr64v" Jul 09 13:50:36.212432 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:36.212345 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 13:50:36.212432 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:36.212409 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97ae6181-9332-4b9e-a573-4ae3d779466c-insights-runtime-extractor-tls podName:97ae6181-9332-4b9e-a573-4ae3d779466c nodeName:}" failed. No retries permitted until 2026-07-09 13:50:38.212393235 +0000 UTC m=+63.118967430 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/97ae6181-9332-4b9e-a573-4ae3d779466c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vr64v" (UID: "97ae6181-9332-4b9e-a573-4ae3d779466c") : secret "insights-runtime-extractor-tls" not found Jul 09 13:50:36.212432 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:36.212418 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 13:50:36.212567 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:36.212463 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/97ae6181-9332-4b9e-a573-4ae3d779466c-kube-rbac-proxy-cm podName:97ae6181-9332-4b9e-a573-4ae3d779466c nodeName:}" failed. No retries permitted until 2026-07-09 13:50:38.212451123 +0000 UTC m=+63.119025294 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/97ae6181-9332-4b9e-a573-4ae3d779466c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vr64v" (UID: "97ae6181-9332-4b9e-a573-4ae3d779466c") : configmap "kube-rbac-proxy" not found Jul 09 13:50:37.064121 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:37.064087 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l6z74_0bec2f7c-c273-4005-993e-0aa98a8d95dd/node-ca/0.log" Jul 09 13:50:37.126553 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:37.126520 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-qh9n9"] Jul 09 13:50:37.156610 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:37.156577 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-qh9n9"] Jul 09 13:50:37.156788 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:37.156675 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-qh9n9" Jul 09 13:50:37.159545 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:37.159517 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-phxj8\"" Jul 09 13:50:37.159683 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:37.159556 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 09 13:50:37.159683 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:37.159517 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 09 13:50:37.159683 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:37.159568 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 09 13:50:37.159951 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:37.159933 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 09 13:50:37.222402 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:37.222373 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr2gs\" (UniqueName: \"kubernetes.io/projected/6417e918-ad6b-4acf-ade2-59c22c0173ce-kube-api-access-mr2gs\") pod \"service-ca-758f599c5-qh9n9\" (UID: \"6417e918-ad6b-4acf-ade2-59c22c0173ce\") " pod="openshift-service-ca/service-ca-758f599c5-qh9n9" Jul 09 13:50:37.222557 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:37.222527 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6417e918-ad6b-4acf-ade2-59c22c0173ce-signing-key\") pod \"service-ca-758f599c5-qh9n9\" (UID: \"6417e918-ad6b-4acf-ade2-59c22c0173ce\") " pod="openshift-service-ca/service-ca-758f599c5-qh9n9" Jul 09 13:50:37.222609 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:37.222579 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6417e918-ad6b-4acf-ade2-59c22c0173ce-signing-cabundle\") pod \"service-ca-758f599c5-qh9n9\" (UID: \"6417e918-ad6b-4acf-ade2-59c22c0173ce\") " pod="openshift-service-ca/service-ca-758f599c5-qh9n9" Jul 09 13:50:37.323669 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:37.323584 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6417e918-ad6b-4acf-ade2-59c22c0173ce-signing-key\") pod \"service-ca-758f599c5-qh9n9\" (UID: \"6417e918-ad6b-4acf-ade2-59c22c0173ce\") " pod="openshift-service-ca/service-ca-758f599c5-qh9n9" Jul 09 13:50:37.323669 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:37.323644 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6417e918-ad6b-4acf-ade2-59c22c0173ce-signing-cabundle\") pod \"service-ca-758f599c5-qh9n9\" (UID: \"6417e918-ad6b-4acf-ade2-59c22c0173ce\") " pod="openshift-service-ca/service-ca-758f599c5-qh9n9" Jul 09 13:50:37.323887 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:37.323863 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr2gs\" (UniqueName: \"kubernetes.io/projected/6417e918-ad6b-4acf-ade2-59c22c0173ce-kube-api-access-mr2gs\") pod \"service-ca-758f599c5-qh9n9\" (UID: \"6417e918-ad6b-4acf-ade2-59c22c0173ce\") " pod="openshift-service-ca/service-ca-758f599c5-qh9n9" Jul 09 13:50:37.324244 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:37.324223 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6417e918-ad6b-4acf-ade2-59c22c0173ce-signing-cabundle\") pod \"service-ca-758f599c5-qh9n9\" (UID: \"6417e918-ad6b-4acf-ade2-59c22c0173ce\") " pod="openshift-service-ca/service-ca-758f599c5-qh9n9" Jul 09 13:50:37.326155 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:37.326136 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6417e918-ad6b-4acf-ade2-59c22c0173ce-signing-key\") pod \"service-ca-758f599c5-qh9n9\" (UID: \"6417e918-ad6b-4acf-ade2-59c22c0173ce\") " pod="openshift-service-ca/service-ca-758f599c5-qh9n9" Jul 09 13:50:37.331930 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:37.331909 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr2gs\" (UniqueName: \"kubernetes.io/projected/6417e918-ad6b-4acf-ade2-59c22c0173ce-kube-api-access-mr2gs\") pod \"service-ca-758f599c5-qh9n9\" (UID: \"6417e918-ad6b-4acf-ade2-59c22c0173ce\") " pod="openshift-service-ca/service-ca-758f599c5-qh9n9" Jul 09 13:50:37.466225 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:37.466189 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-qh9n9" Jul 09 13:50:37.603783 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:37.603618 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-qh9n9"] Jul 09 13:50:37.606231 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:50:37.606204 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6417e918_ad6b_4acf_ade2_59c22c0173ce.slice/crio-defd51975d1bfd14f17906617e9a791e2d85b403436800b16dfb2a7609b001b9 WatchSource:0}: Error finding container defd51975d1bfd14f17906617e9a791e2d85b403436800b16dfb2a7609b001b9: Status 404 returned error can't find the container with id defd51975d1bfd14f17906617e9a791e2d85b403436800b16dfb2a7609b001b9 Jul 09 13:50:37.800336 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:37.800299 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-tvsqr" Jul 09 13:50:37.800476 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:37.800359 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-tvsqr" Jul 09 13:50:37.800694 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:37.800681 2573 scope.go:117] "RemoveContainer" containerID="0e749eef6cd871c8abc1f34496258ccc9c27bba5b7f74067e82964d84e46d74a" Jul 09 13:50:37.800872 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:37.800853 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-tvsqr_openshift-console-operator(c6be1427-c9fa-45b4-a6ca-3aaf2be3513b)\"" pod="openshift-console-operator/console-operator-68b757fb67-tvsqr" podUID="c6be1427-c9fa-45b4-a6ca-3aaf2be3513b" Jul 09 13:50:37.865266 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:37.865185 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z4hbz_49134287-0ad9-48b8-932e-c94dba92401c/serve-healthcheck-canary/0.log" Jul 09 13:50:38.043470 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:38.043429 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-qh9n9" event={"ID":"6417e918-ad6b-4acf-ade2-59c22c0173ce","Type":"ContainerStarted","Data":"b3d4a6850a821fa7f2d5ff007bfdbff349c2416009440b0b2c762e243c1ef976"} Jul 09 13:50:38.043654 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:38.043521 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-qh9n9" event={"ID":"6417e918-ad6b-4acf-ade2-59c22c0173ce","Type":"ContainerStarted","Data":"defd51975d1bfd14f17906617e9a791e2d85b403436800b16dfb2a7609b001b9"} Jul 09 13:50:38.060417 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:38.060355 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-qh9n9" podStartSLOduration=1.060339007 podStartE2EDuration="1.060339007s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:50:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:50:38.059203911 +0000 UTC m=+62.965778105" watchObservedRunningTime="2026-07-09 13:50:38.060339007 +0000 UTC m=+62.966913199" Jul 09 13:50:38.232444 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:38.232345 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/97ae6181-9332-4b9e-a573-4ae3d779466c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vr64v\" (UID: \"97ae6181-9332-4b9e-a573-4ae3d779466c\") " pod="openshift-insights/insights-runtime-extractor-vr64v" Jul 09 13:50:38.232893 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:38.232482 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 13:50:38.232893 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:38.232501 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97ae6181-9332-4b9e-a573-4ae3d779466c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vr64v\" (UID: \"97ae6181-9332-4b9e-a573-4ae3d779466c\") " pod="openshift-insights/insights-runtime-extractor-vr64v" Jul 09 13:50:38.232893 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:38.232550 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/97ae6181-9332-4b9e-a573-4ae3d779466c-kube-rbac-proxy-cm podName:97ae6181-9332-4b9e-a573-4ae3d779466c nodeName:}" failed. No retries permitted until 2026-07-09 13:50:42.232533282 +0000 UTC m=+67.139107452 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/97ae6181-9332-4b9e-a573-4ae3d779466c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vr64v" (UID: "97ae6181-9332-4b9e-a573-4ae3d779466c") : configmap "kube-rbac-proxy" not found Jul 09 13:50:38.232893 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:38.232630 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 13:50:38.232893 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:38.232687 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97ae6181-9332-4b9e-a573-4ae3d779466c-insights-runtime-extractor-tls podName:97ae6181-9332-4b9e-a573-4ae3d779466c nodeName:}" failed. No retries permitted until 2026-07-09 13:50:42.232672124 +0000 UTC m=+67.139246307 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/97ae6181-9332-4b9e-a573-4ae3d779466c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vr64v" (UID: "97ae6181-9332-4b9e-a573-4ae3d779466c") : secret "insights-runtime-extractor-tls" not found Jul 09 13:50:40.454656 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:40.454614 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/36917a3c-dc1c-4371-8a99-f3fd743cfd9a-original-pull-secret\") pod \"global-pull-secret-syncer-lth82\" (UID: \"36917a3c-dc1c-4371-8a99-f3fd743cfd9a\") " pod="kube-system/global-pull-secret-syncer-lth82" Jul 09 13:50:40.455132 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:40.454741 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37ebd359-357d-4d89-b1b0-ce746eedeec9-metrics-certs\") pod \"network-metrics-daemon-5rs66\" (UID: \"37ebd359-357d-4d89-b1b0-ce746eedeec9\") " pod="openshift-multus/network-metrics-daemon-5rs66" Jul 09 13:50:40.457080 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:40.457061 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 13:50:40.457168 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:40.457151 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 13:50:40.464956 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:40.464939 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 09 13:50:40.465043 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:40.465010 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37ebd359-357d-4d89-b1b0-ce746eedeec9-metrics-certs podName:37ebd359-357d-4d89-b1b0-ce746eedeec9 nodeName:}" failed. No retries permitted until 2026-07-09 13:51:44.464988583 +0000 UTC m=+129.371562761 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/37ebd359-357d-4d89-b1b0-ce746eedeec9-metrics-certs") pod "network-metrics-daemon-5rs66" (UID: "37ebd359-357d-4d89-b1b0-ce746eedeec9") : secret "metrics-daemon-secret" not found Jul 09 13:50:40.467274 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:40.467257 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/36917a3c-dc1c-4371-8a99-f3fd743cfd9a-original-pull-secret\") pod \"global-pull-secret-syncer-lth82\" (UID: \"36917a3c-dc1c-4371-8a99-f3fd743cfd9a\") " pod="kube-system/global-pull-secret-syncer-lth82" Jul 09 13:50:40.555640 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:40.555605 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxv9q\" (UniqueName: \"kubernetes.io/projected/60191bf6-e7d9-4411-85a0-f1cc73dcc646-kube-api-access-cxv9q\") pod \"network-check-target-7btnh\" (UID: \"60191bf6-e7d9-4411-85a0-f1cc73dcc646\") " pod="openshift-network-diagnostics/network-check-target-7btnh" Jul 09 13:50:40.558524 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:40.558497 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxv9q\" (UniqueName: \"kubernetes.io/projected/60191bf6-e7d9-4411-85a0-f1cc73dcc646-kube-api-access-cxv9q\") pod \"network-check-target-7btnh\" (UID: \"60191bf6-e7d9-4411-85a0-f1cc73dcc646\") " pod="openshift-network-diagnostics/network-check-target-7btnh" Jul 09 13:50:40.625185 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:40.625148 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jnfkt\"" Jul 09 13:50:40.627234 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:40.627214 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lth82" Jul 09 13:50:40.633013 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:40.632992 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7btnh" Jul 09 13:50:40.780599 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:40.780567 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lth82"] Jul 09 13:50:40.784131 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:50:40.784106 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36917a3c_dc1c_4371_8a99_f3fd743cfd9a.slice/crio-01102b2a5b0477e0a71cfa101510633d4401e8f85344d5f2e2b0ec3e5b57bfa2 WatchSource:0}: Error finding container 01102b2a5b0477e0a71cfa101510633d4401e8f85344d5f2e2b0ec3e5b57bfa2: Status 404 returned error can't find the container with id 01102b2a5b0477e0a71cfa101510633d4401e8f85344d5f2e2b0ec3e5b57bfa2 Jul 09 13:50:40.793263 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:40.793246 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7btnh"] Jul 09 13:50:40.794974 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:50:40.794954 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60191bf6_e7d9_4411_85a0_f1cc73dcc646.slice/crio-3bb0d864a7a6285f7f68c81007ac8a542ee25289a98ff2c275a4e294a220c693 WatchSource:0}: Error finding container 3bb0d864a7a6285f7f68c81007ac8a542ee25289a98ff2c275a4e294a220c693: Status 404 returned error can't find the container with id 3bb0d864a7a6285f7f68c81007ac8a542ee25289a98ff2c275a4e294a220c693 Jul 09 13:50:41.054670 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:41.054633 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lth82" event={"ID":"36917a3c-dc1c-4371-8a99-f3fd743cfd9a","Type":"ContainerStarted","Data":"01102b2a5b0477e0a71cfa101510633d4401e8f85344d5f2e2b0ec3e5b57bfa2"} Jul 09 13:50:41.056038 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:41.056012 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7btnh" event={"ID":"60191bf6-e7d9-4411-85a0-f1cc73dcc646","Type":"ContainerStarted","Data":"00608e55e6a433cf054b86cc7c1c5c6557cc7e092443f69147da8752e2956695"} Jul 09 13:50:41.056147 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:41.056052 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7btnh" event={"ID":"60191bf6-e7d9-4411-85a0-f1cc73dcc646","Type":"ContainerStarted","Data":"3bb0d864a7a6285f7f68c81007ac8a542ee25289a98ff2c275a4e294a220c693"} Jul 09 13:50:41.056190 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:41.056141 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7btnh" Jul 09 13:50:41.078229 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:41.078186 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7btnh" podStartSLOduration=66.078170089 podStartE2EDuration="1m6.078170089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:49:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:50:41.077862422 +0000 UTC m=+65.984436612" watchObservedRunningTime="2026-07-09 13:50:41.078170089 +0000 UTC m=+65.984744282" Jul 09 13:50:42.271792 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:42.271759 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/97ae6181-9332-4b9e-a573-4ae3d779466c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vr64v\" (UID: \"97ae6181-9332-4b9e-a573-4ae3d779466c\") " pod="openshift-insights/insights-runtime-extractor-vr64v" Jul 09 13:50:42.272270 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:42.271909 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97ae6181-9332-4b9e-a573-4ae3d779466c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vr64v\" (UID: \"97ae6181-9332-4b9e-a573-4ae3d779466c\") " pod="openshift-insights/insights-runtime-extractor-vr64v" Jul 09 13:50:42.272270 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:42.272067 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 13:50:42.272270 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:42.272135 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97ae6181-9332-4b9e-a573-4ae3d779466c-insights-runtime-extractor-tls podName:97ae6181-9332-4b9e-a573-4ae3d779466c nodeName:}" failed. No retries permitted until 2026-07-09 13:50:50.272116916 +0000 UTC m=+75.178691088 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/97ae6181-9332-4b9e-a573-4ae3d779466c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vr64v" (UID: "97ae6181-9332-4b9e-a573-4ae3d779466c") : secret "insights-runtime-extractor-tls" not found Jul 09 13:50:42.272523 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:42.272496 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 13:50:42.272612 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:42.272558 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/97ae6181-9332-4b9e-a573-4ae3d779466c-kube-rbac-proxy-cm podName:97ae6181-9332-4b9e-a573-4ae3d779466c nodeName:}" failed. No retries permitted until 2026-07-09 13:50:50.272542019 +0000 UTC m=+75.179116211 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/97ae6181-9332-4b9e-a573-4ae3d779466c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vr64v" (UID: "97ae6181-9332-4b9e-a573-4ae3d779466c") : configmap "kube-rbac-proxy" not found Jul 09 13:50:42.372769 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:42.372730 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ee58331-355b-4a78-a3f5-b3e312ba9c70-metrics-tls\") pod \"dns-default-bj8dh\" (UID: \"9ee58331-355b-4a78-a3f5-b3e312ba9c70\") " pod="openshift-dns/dns-default-bj8dh" Jul 09 13:50:42.372969 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:42.372800 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-registry-tls\") pod \"image-registry-cdbb9d64f-8bhxh\" (UID: \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\") " pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" Jul 09 13:50:42.373082 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:42.373063 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 13:50:42.373082 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:42.373083 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cdbb9d64f-8bhxh: secret "image-registry-tls" not found Jul 09 13:50:42.373235 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:42.373142 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-registry-tls podName:4d0c7810-9ef5-44fa-ab79-8ceaf4fce137 nodeName:}" failed. No retries permitted until 2026-07-09 13:51:14.373124496 +0000 UTC m=+99.279698670 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-registry-tls") pod "image-registry-cdbb9d64f-8bhxh" (UID: "4d0c7810-9ef5-44fa-ab79-8ceaf4fce137") : secret "image-registry-tls" not found Jul 09 13:50:42.375798 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:42.375772 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ee58331-355b-4a78-a3f5-b3e312ba9c70-metrics-tls\") pod \"dns-default-bj8dh\" (UID: \"9ee58331-355b-4a78-a3f5-b3e312ba9c70\") " pod="openshift-dns/dns-default-bj8dh" Jul 09 13:50:42.551776 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:42.551538 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-44bgf\"" Jul 09 13:50:42.560180 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:42.560151 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bj8dh" Jul 09 13:50:42.723883 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:42.723782 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bj8dh"] Jul 09 13:50:42.726847 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:50:42.726818 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ee58331_355b_4a78_a3f5_b3e312ba9c70.slice/crio-87c558f2d7791c4dbbd571840840de95ca71fcbf551243370ab2624a1d675b55 WatchSource:0}: Error finding container 87c558f2d7791c4dbbd571840840de95ca71fcbf551243370ab2624a1d675b55: Status 404 returned error can't find the container with id 87c558f2d7791c4dbbd571840840de95ca71fcbf551243370ab2624a1d675b55 Jul 09 13:50:43.064537 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:43.064493 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bj8dh" event={"ID":"9ee58331-355b-4a78-a3f5-b3e312ba9c70","Type":"ContainerStarted","Data":"87c558f2d7791c4dbbd571840840de95ca71fcbf551243370ab2624a1d675b55"} Jul 09 13:50:43.179630 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:43.179578 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/50f246ea-4255-4638-94d4-426607eaed9d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bhvll\" (UID: \"50f246ea-4255-4638-94d4-426607eaed9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bhvll" Jul 09 13:50:43.182327 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:43.182292 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/50f246ea-4255-4638-94d4-426607eaed9d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bhvll\" (UID: \"50f246ea-4255-4638-94d4-426607eaed9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bhvll" Jul 09 13:50:43.280304 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:43.280258 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5a15c1c-ff3c-4162-9f34-3beac8095bba-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qs4qg\" (UID: \"e5a15c1c-ff3c-4162-9f34-3beac8095bba\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qs4qg" Jul 09 13:50:43.280753 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:43.280466 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 13:50:43.280753 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:43.280554 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5a15c1c-ff3c-4162-9f34-3beac8095bba-cluster-monitoring-operator-tls podName:e5a15c1c-ff3c-4162-9f34-3beac8095bba nodeName:}" failed. No retries permitted until 2026-07-09 13:50:59.280531825 +0000 UTC m=+84.187105998 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e5a15c1c-ff3c-4162-9f34-3beac8095bba-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-qs4qg" (UID: "e5a15c1c-ff3c-4162-9f34-3beac8095bba") : secret "cluster-monitoring-operator-tls" not found Jul 09 13:50:43.288322 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:43.288298 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-m4v7r\"" Jul 09 13:50:43.297070 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:43.297044 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bhvll" Jul 09 13:50:43.381520 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:43.381036 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f964a6d-bb71-4efc-aa44-3fa94a53608b-service-ca-bundle\") pod \"router-default-9fcb6c59f-blmj7\" (UID: \"9f964a6d-bb71-4efc-aa44-3fa94a53608b\") " pod="openshift-ingress/router-default-9fcb6c59f-blmj7" Jul 09 13:50:43.381520 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:43.381187 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f964a6d-bb71-4efc-aa44-3fa94a53608b-metrics-certs\") pod \"router-default-9fcb6c59f-blmj7\" (UID: \"9f964a6d-bb71-4efc-aa44-3fa94a53608b\") " pod="openshift-ingress/router-default-9fcb6c59f-blmj7" Jul 09 13:50:43.381520 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:43.381212 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9f964a6d-bb71-4efc-aa44-3fa94a53608b-service-ca-bundle podName:9f964a6d-bb71-4efc-aa44-3fa94a53608b nodeName:}" failed. No retries permitted until 2026-07-09 13:50:59.381191789 +0000 UTC m=+84.287765963 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9f964a6d-bb71-4efc-aa44-3fa94a53608b-service-ca-bundle") pod "router-default-9fcb6c59f-blmj7" (UID: "9f964a6d-bb71-4efc-aa44-3fa94a53608b") : configmap references non-existent config key: service-ca.crt Jul 09 13:50:43.384273 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:43.384232 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f964a6d-bb71-4efc-aa44-3fa94a53608b-metrics-certs\") pod \"router-default-9fcb6c59f-blmj7\" (UID: \"9f964a6d-bb71-4efc-aa44-3fa94a53608b\") " pod="openshift-ingress/router-default-9fcb6c59f-blmj7" Jul 09 13:50:43.447042 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:43.447005 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bhvll"] Jul 09 13:50:43.482023 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:43.481993 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/355b7781-b0d3-467a-9f6c-370962faa278-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-br6cl\" (UID: \"355b7781-b0d3-467a-9f6c-370962faa278\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-br6cl" Jul 09 13:50:43.482161 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:43.482149 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 13:50:43.482232 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:50:43.482216 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/355b7781-b0d3-467a-9f6c-370962faa278-networking-console-plugin-cert podName:355b7781-b0d3-467a-9f6c-370962faa278 nodeName:}" failed. No retries permitted until 2026-07-09 13:50:59.48219853 +0000 UTC m=+84.388772705 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/355b7781-b0d3-467a-9f6c-370962faa278-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-br6cl" (UID: "355b7781-b0d3-467a-9f6c-370962faa278") : secret "networking-console-plugin-cert" not found Jul 09 13:50:44.070295 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:44.070261 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bhvll" event={"ID":"50f246ea-4255-4638-94d4-426607eaed9d","Type":"ContainerStarted","Data":"5b99d7436a36fdaa8ad222c5465edd5483ffe9fab46442966f3a0fa9a25b39f2"} Jul 09 13:50:48.087558 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:48.087520 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bj8dh" event={"ID":"9ee58331-355b-4a78-a3f5-b3e312ba9c70","Type":"ContainerStarted","Data":"8d7894b3644d1b043104a5362e29d5763b3d744644112eb1b0d8b217b05b9ffe"} Jul 09 13:50:48.088059 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:48.087586 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bj8dh" event={"ID":"9ee58331-355b-4a78-a3f5-b3e312ba9c70","Type":"ContainerStarted","Data":"f33879be4b86914a5e7f07f7f60f1cf82c29b493a503a7e34df92b49881160ef"} Jul 09 13:50:48.088059 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:48.087619 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bj8dh" Jul 09 13:50:48.089050 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:48.089022 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lth82" event={"ID":"36917a3c-dc1c-4371-8a99-f3fd743cfd9a","Type":"ContainerStarted","Data":"e3a5d83811cb215a51b50af0f80f4755928b0e298fd38d1d104cb8a889075bda"} Jul 09 13:50:48.090629 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:48.090606 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bhvll" event={"ID":"50f246ea-4255-4638-94d4-426607eaed9d","Type":"ContainerStarted","Data":"585059a8ff0d60d5acc51b80d19455ff620e32ef9bcc5465ca79ca95fbc2e7f9"} Jul 09 13:50:48.090748 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:48.090646 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bhvll" event={"ID":"50f246ea-4255-4638-94d4-426607eaed9d","Type":"ContainerStarted","Data":"c8c6820becbe17c36914a4cedd06e694213bd692fc33cae9ef445ec2d77addd0"} Jul 09 13:50:48.104492 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:48.104454 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bj8dh" podStartSLOduration=33.782003557 podStartE2EDuration="38.104441225s" totalImagesPullingTime="4.322437668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:50:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:50:48.102974154 +0000 UTC m=+73.009548350" watchObservedRunningTime="2026-07-09 13:50:48.104441225 +0000 UTC m=+73.011015412" Jul 09 13:50:48.119474 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:48.119431 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bhvll" podStartSLOduration=17.562353005 podStartE2EDuration="21.119415919s" totalImagesPullingTime="3.557062914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:50:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:50:48.118266405 +0000 UTC m=+73.024840610" watchObservedRunningTime="2026-07-09 13:50:48.119415919 +0000 UTC m=+73.025990164" Jul 09 13:50:48.132465 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:48.132422 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lth82" podStartSLOduration=65.838375824 podStartE2EDuration="1m12.13240727s" totalImagesPullingTime="6.294031446s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:49:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:50:48.131460142 +0000 UTC m=+73.038034338" watchObservedRunningTime="2026-07-09 13:50:48.13240727 +0000 UTC m=+73.038981462" Jul 09 13:50:50.341014 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:50.340968 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97ae6181-9332-4b9e-a573-4ae3d779466c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vr64v\" (UID: \"97ae6181-9332-4b9e-a573-4ae3d779466c\") " pod="openshift-insights/insights-runtime-extractor-vr64v" Jul 09 13:50:50.341411 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:50.341067 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/97ae6181-9332-4b9e-a573-4ae3d779466c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vr64v\" (UID: \"97ae6181-9332-4b9e-a573-4ae3d779466c\") " pod="openshift-insights/insights-runtime-extractor-vr64v" Jul 09 13:50:50.341561 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:50.341543 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/97ae6181-9332-4b9e-a573-4ae3d779466c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vr64v\" (UID: \"97ae6181-9332-4b9e-a573-4ae3d779466c\") " pod="openshift-insights/insights-runtime-extractor-vr64v" Jul 09 13:50:50.343452 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:50.343416 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97ae6181-9332-4b9e-a573-4ae3d779466c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vr64v\" (UID: \"97ae6181-9332-4b9e-a573-4ae3d779466c\") " pod="openshift-insights/insights-runtime-extractor-vr64v" Jul 09 13:50:50.393052 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:50.393020 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-s4s8j\"" Jul 09 13:50:50.401082 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:50.401061 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vr64v" Jul 09 13:50:50.528273 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:50.528242 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vr64v"] Jul 09 13:50:50.530685 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:50:50.530645 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97ae6181_9332_4b9e_a573_4ae3d779466c.slice/crio-6694633839fb1a666d41aaabca2549aedcebc421c456b7e6ac5da9c456b00015 WatchSource:0}: Error finding container 6694633839fb1a666d41aaabca2549aedcebc421c456b7e6ac5da9c456b00015: Status 404 returned error can't find the container with id 6694633839fb1a666d41aaabca2549aedcebc421c456b7e6ac5da9c456b00015 Jul 09 13:50:51.103203 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:51.103163 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vr64v" event={"ID":"97ae6181-9332-4b9e-a573-4ae3d779466c","Type":"ContainerStarted","Data":"6694633839fb1a666d41aaabca2549aedcebc421c456b7e6ac5da9c456b00015"} Jul 09 13:50:52.607168 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:52.607134 2573 scope.go:117] "RemoveContainer" containerID="0e749eef6cd871c8abc1f34496258ccc9c27bba5b7f74067e82964d84e46d74a" Jul 09 13:50:55.120918 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:55.120837 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tvsqr_c6be1427-c9fa-45b4-a6ca-3aaf2be3513b/console-operator/1.log" Jul 09 13:50:55.121326 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:55.120960 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-tvsqr" event={"ID":"c6be1427-c9fa-45b4-a6ca-3aaf2be3513b","Type":"ContainerStarted","Data":"32b35187e04012027eb587f472ed0d68d2e0d3506814c47680f3f15a8c382f86"} Jul 09 13:50:55.121326 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:55.121279 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-tvsqr" Jul 09 13:50:55.123098 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:55.123077 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vr64v" event={"ID":"97ae6181-9332-4b9e-a573-4ae3d779466c","Type":"ContainerStarted","Data":"632e84ec51d7502411d1c8c8ece0e4d19968c16562582718897856da4ccf98c7"} Jul 09 13:50:55.123236 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:55.123118 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vr64v" event={"ID":"97ae6181-9332-4b9e-a573-4ae3d779466c","Type":"ContainerStarted","Data":"85c5afa45123eca3fdae6c5c2c7ead680a81d2ee0074cda45bad8b791a51cbbb"} Jul 09 13:50:55.137914 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:55.137873 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-tvsqr" podStartSLOduration=22.842075612 podStartE2EDuration="28.137859913s" totalImagesPullingTime="5.295784301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:50:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:50:55.136564592 +0000 UTC m=+80.043138785" watchObservedRunningTime="2026-07-09 13:50:55.137859913 +0000 UTC m=+80.044434142" Jul 09 13:50:55.391983 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:55.391913 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-tvsqr" Jul 09 13:50:57.340204 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:57.338980 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5884cf5d6-nswdk"] Jul 09 13:50:57.349688 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:57.349663 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5884cf5d6-nswdk" Jul 09 13:50:57.352374 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:57.352351 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 09 13:50:57.352612 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:57.352596 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 09 13:50:57.353325 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:57.353302 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 09 13:50:57.353325 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:57.353316 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 09 13:50:57.360415 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:57.360392 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5884cf5d6-nswdk"] Jul 09 13:50:57.430463 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:57.430428 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-l6rt9"] Jul 09 13:50:57.434148 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:57.434122 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-l6rt9" Jul 09 13:50:57.437114 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:57.436898 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-c7652\"" Jul 09 13:50:57.437114 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:57.436934 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 09 13:50:57.438138 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:57.438114 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 09 13:50:57.461460 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:57.461429 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-l6rt9"] Jul 09 13:50:57.508936 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:57.508902 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67vhk\" (UniqueName: \"kubernetes.io/projected/bd829d83-8101-402d-895a-80eb3ab24383-kube-api-access-67vhk\") pod \"klusterlet-addon-workmgr-5884cf5d6-nswdk\" (UID: \"bd829d83-8101-402d-895a-80eb3ab24383\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5884cf5d6-nswdk" Jul 09 13:50:57.509097 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:57.508958 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bd829d83-8101-402d-895a-80eb3ab24383-klusterlet-config\") pod \"klusterlet-addon-workmgr-5884cf5d6-nswdk\" (UID: \"bd829d83-8101-402d-895a-80eb3ab24383\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5884cf5d6-nswdk" Jul 09 13:50:57.509097 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:57.509062 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd829d83-8101-402d-895a-80eb3ab24383-tmp\") pod \"klusterlet-addon-workmgr-5884cf5d6-nswdk\" (UID: \"bd829d83-8101-402d-895a-80eb3ab24383\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5884cf5d6-nswdk" Jul 09 13:50:57.609499 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:57.609476 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp7l8\" (UniqueName: \"kubernetes.io/projected/40c503b2-14ca-49e1-a8cc-6b561ab8bcc7-kube-api-access-zp7l8\") pod \"downloads-685bfb5f64-l6rt9\" (UID: \"40c503b2-14ca-49e1-a8cc-6b561ab8bcc7\") " pod="openshift-console/downloads-685bfb5f64-l6rt9" Jul 09 13:50:57.609636 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:57.609570 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67vhk\" (UniqueName: \"kubernetes.io/projected/bd829d83-8101-402d-895a-80eb3ab24383-kube-api-access-67vhk\") pod \"klusterlet-addon-workmgr-5884cf5d6-nswdk\" (UID: \"bd829d83-8101-402d-895a-80eb3ab24383\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5884cf5d6-nswdk" Jul 09 13:50:57.609636 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:57.609614 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bd829d83-8101-402d-895a-80eb3ab24383-klusterlet-config\") pod \"klusterlet-addon-workmgr-5884cf5d6-nswdk\" (UID: \"bd829d83-8101-402d-895a-80eb3ab24383\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5884cf5d6-nswdk" Jul 09 13:50:57.609756 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:57.609642 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd829d83-8101-402d-895a-80eb3ab24383-tmp\") pod \"klusterlet-addon-workmgr-5884cf5d6-nswdk\" (UID: \"bd829d83-8101-402d-895a-80eb3ab24383\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5884cf5d6-nswdk" Jul 09 13:50:57.610047 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:57.610020 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd829d83-8101-402d-895a-80eb3ab24383-tmp\") pod \"klusterlet-addon-workmgr-5884cf5d6-nswdk\" (UID: \"bd829d83-8101-402d-895a-80eb3ab24383\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5884cf5d6-nswdk" Jul 09 13:50:57.612519 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:57.612497 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bd829d83-8101-402d-895a-80eb3ab24383-klusterlet-config\") pod \"klusterlet-addon-workmgr-5884cf5d6-nswdk\" (UID: \"bd829d83-8101-402d-895a-80eb3ab24383\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5884cf5d6-nswdk" Jul 09 13:50:57.627047 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:57.627016 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67vhk\" (UniqueName: \"kubernetes.io/projected/bd829d83-8101-402d-895a-80eb3ab24383-kube-api-access-67vhk\") pod \"klusterlet-addon-workmgr-5884cf5d6-nswdk\" (UID: \"bd829d83-8101-402d-895a-80eb3ab24383\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5884cf5d6-nswdk" Jul 09 13:50:57.665225 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:57.665189 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5884cf5d6-nswdk" Jul 09 13:50:57.710878 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:57.710839 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp7l8\" (UniqueName: \"kubernetes.io/projected/40c503b2-14ca-49e1-a8cc-6b561ab8bcc7-kube-api-access-zp7l8\") pod \"downloads-685bfb5f64-l6rt9\" (UID: \"40c503b2-14ca-49e1-a8cc-6b561ab8bcc7\") " pod="openshift-console/downloads-685bfb5f64-l6rt9" Jul 09 13:50:57.722289 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:57.722262 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp7l8\" (UniqueName: \"kubernetes.io/projected/40c503b2-14ca-49e1-a8cc-6b561ab8bcc7-kube-api-access-zp7l8\") pod \"downloads-685bfb5f64-l6rt9\" (UID: \"40c503b2-14ca-49e1-a8cc-6b561ab8bcc7\") " pod="openshift-console/downloads-685bfb5f64-l6rt9" Jul 09 13:50:57.748140 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:57.748090 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-l6rt9" Jul 09 13:50:57.803996 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:57.803964 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5884cf5d6-nswdk"] Jul 09 13:50:57.807625 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:50:57.807599 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd829d83_8101_402d_895a_80eb3ab24383.slice/crio-35356fb6183959954f211f48c9f61b5e454d64c5d42263f9bc40ec63f7dded93 WatchSource:0}: Error finding container 35356fb6183959954f211f48c9f61b5e454d64c5d42263f9bc40ec63f7dded93: Status 404 returned error can't find the container with id 35356fb6183959954f211f48c9f61b5e454d64c5d42263f9bc40ec63f7dded93 Jul 09 13:50:57.882584 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:57.882509 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-l6rt9"] Jul 09 13:50:57.885192 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:50:57.885171 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40c503b2_14ca_49e1_a8cc_6b561ab8bcc7.slice/crio-4fde61d6c83c64d1a7e9474fc8fec0cadc68c09dc1ddaa8755eaeff0877145be WatchSource:0}: Error finding container 4fde61d6c83c64d1a7e9474fc8fec0cadc68c09dc1ddaa8755eaeff0877145be: Status 404 returned error can't find the container with id 4fde61d6c83c64d1a7e9474fc8fec0cadc68c09dc1ddaa8755eaeff0877145be Jul 09 13:50:58.096246 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:58.096219 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bj8dh" Jul 09 13:50:58.142622 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:58.142532 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vr64v" event={"ID":"97ae6181-9332-4b9e-a573-4ae3d779466c","Type":"ContainerStarted","Data":"038980d6ba4efc2ac68879ab70e4bcc4a9c18f4ffcd6b3973a883277c2f53100"} Jul 09 13:50:58.143836 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:58.143792 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-l6rt9" event={"ID":"40c503b2-14ca-49e1-a8cc-6b561ab8bcc7","Type":"ContainerStarted","Data":"4fde61d6c83c64d1a7e9474fc8fec0cadc68c09dc1ddaa8755eaeff0877145be"} Jul 09 13:50:58.144969 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:58.144939 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5884cf5d6-nswdk" event={"ID":"bd829d83-8101-402d-895a-80eb3ab24383","Type":"ContainerStarted","Data":"35356fb6183959954f211f48c9f61b5e454d64c5d42263f9bc40ec63f7dded93"} Jul 09 13:50:58.164128 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:58.163972 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vr64v" podStartSLOduration=17.272175752 podStartE2EDuration="24.163953961s" totalImagesPullingTime="6.891778209s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:50:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:50:58.163230811 +0000 UTC m=+83.069805004" watchObservedRunningTime="2026-07-09 13:50:58.163953961 +0000 UTC m=+83.070528153" Jul 09 13:50:59.326066 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:59.326021 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5a15c1c-ff3c-4162-9f34-3beac8095bba-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qs4qg\" (UID: \"e5a15c1c-ff3c-4162-9f34-3beac8095bba\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qs4qg" Jul 09 13:50:59.329531 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:59.329501 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5a15c1c-ff3c-4162-9f34-3beac8095bba-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qs4qg\" (UID: \"e5a15c1c-ff3c-4162-9f34-3beac8095bba\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qs4qg" Jul 09 13:50:59.428228 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:59.428187 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f964a6d-bb71-4efc-aa44-3fa94a53608b-service-ca-bundle\") pod \"router-default-9fcb6c59f-blmj7\" (UID: \"9f964a6d-bb71-4efc-aa44-3fa94a53608b\") " pod="openshift-ingress/router-default-9fcb6c59f-blmj7" Jul 09 13:50:59.428918 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:59.428887 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f964a6d-bb71-4efc-aa44-3fa94a53608b-service-ca-bundle\") pod \"router-default-9fcb6c59f-blmj7\" (UID: \"9f964a6d-bb71-4efc-aa44-3fa94a53608b\") " pod="openshift-ingress/router-default-9fcb6c59f-blmj7" Jul 09 13:50:59.529083 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:59.529042 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/355b7781-b0d3-467a-9f6c-370962faa278-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-br6cl\" (UID: \"355b7781-b0d3-467a-9f6c-370962faa278\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-br6cl" Jul 09 13:50:59.536183 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:59.536157 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/355b7781-b0d3-467a-9f6c-370962faa278-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-br6cl\" (UID: \"355b7781-b0d3-467a-9f6c-370962faa278\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-br6cl" Jul 09 13:50:59.620502 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:59.620220 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rp6sj\"" Jul 09 13:50:59.629562 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:59.629191 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qs4qg" Jul 09 13:50:59.648002 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:59.647967 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-qd24n\"" Jul 09 13:50:59.656132 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:59.656088 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-9fcb6c59f-blmj7" Jul 09 13:50:59.830552 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:59.830520 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-lr4t6\"" Jul 09 13:50:59.838835 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:50:59.838781 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-br6cl" Jul 09 13:51:00.497659 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:00.497543 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-br6cl"] Jul 09 13:51:00.503741 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:51:00.503704 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod355b7781_b0d3_467a_9f6c_370962faa278.slice/crio-264cc800dc7d1f7f2d1509bb28f7e6591567aec6896e01669f42c546e45eb993 WatchSource:0}: Error finding container 264cc800dc7d1f7f2d1509bb28f7e6591567aec6896e01669f42c546e45eb993: Status 404 returned error can't find the container with id 264cc800dc7d1f7f2d1509bb28f7e6591567aec6896e01669f42c546e45eb993 Jul 09 13:51:00.520721 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:00.520690 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qs4qg"] Jul 09 13:51:00.523501 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:51:00.523451 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5a15c1c_ff3c_4162_9f34_3beac8095bba.slice/crio-29deef9b69682c20de61dac06faa8858d732bc37795aba33783e1d3606480da9 WatchSource:0}: Error finding container 29deef9b69682c20de61dac06faa8858d732bc37795aba33783e1d3606480da9: Status 404 returned error can't find the container with id 29deef9b69682c20de61dac06faa8858d732bc37795aba33783e1d3606480da9 Jul 09 13:51:00.541158 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:00.541131 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-9fcb6c59f-blmj7"] Jul 09 13:51:00.546943 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:51:00.546917 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f964a6d_bb71_4efc_aa44_3fa94a53608b.slice/crio-5518c1e87d8e7b55856b051e47e5d2bbdc5cc385d83bd74e8e177bd37c3d563d WatchSource:0}: Error finding container 5518c1e87d8e7b55856b051e47e5d2bbdc5cc385d83bd74e8e177bd37c3d563d: Status 404 returned error can't find the container with id 5518c1e87d8e7b55856b051e47e5d2bbdc5cc385d83bd74e8e177bd37c3d563d Jul 09 13:51:01.161531 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:01.161495 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qs4qg" event={"ID":"e5a15c1c-ff3c-4162-9f34-3beac8095bba","Type":"ContainerStarted","Data":"29deef9b69682c20de61dac06faa8858d732bc37795aba33783e1d3606480da9"} Jul 09 13:51:01.163704 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:01.163636 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-br6cl" event={"ID":"355b7781-b0d3-467a-9f6c-370962faa278","Type":"ContainerStarted","Data":"264cc800dc7d1f7f2d1509bb28f7e6591567aec6896e01669f42c546e45eb993"} Jul 09 13:51:01.165621 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:01.165592 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-9fcb6c59f-blmj7" event={"ID":"9f964a6d-bb71-4efc-aa44-3fa94a53608b","Type":"ContainerStarted","Data":"4c0cd452ad9c94c88b935bd84f4d8ed219c4d84dad7d0b9ce1dc5265dec7bf3f"} Jul 09 13:51:01.165713 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:01.165641 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-9fcb6c59f-blmj7" event={"ID":"9f964a6d-bb71-4efc-aa44-3fa94a53608b","Type":"ContainerStarted","Data":"5518c1e87d8e7b55856b051e47e5d2bbdc5cc385d83bd74e8e177bd37c3d563d"} Jul 09 13:51:01.186216 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:01.186154 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-9fcb6c59f-blmj7" podStartSLOduration=34.186129459 podStartE2EDuration="34.186129459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:50:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:51:01.18489854 +0000 UTC m=+86.091472753" watchObservedRunningTime="2026-07-09 13:51:01.186129459 +0000 UTC m=+86.092703655" Jul 09 13:51:01.657334 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:01.657290 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-9fcb6c59f-blmj7" Jul 09 13:51:01.660330 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:01.660303 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-9fcb6c59f-blmj7" Jul 09 13:51:02.172533 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:02.172495 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-br6cl" event={"ID":"355b7781-b0d3-467a-9f6c-370962faa278","Type":"ContainerStarted","Data":"ee0762139ebeaa8cf376d2691931214764c57f673b9906dd8ce76ebf73c19f99"} Jul 09 13:51:02.172958 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:02.172909 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-9fcb6c59f-blmj7" Jul 09 13:51:02.174278 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:02.174257 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-9fcb6c59f-blmj7" Jul 09 13:51:02.188276 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:02.188222 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-br6cl" podStartSLOduration=34.01290364 podStartE2EDuration="35.188198743s" totalImagesPullingTime="1.175295103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:50:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:51:02.187873932 +0000 UTC m=+87.094448127" watchObservedRunningTime="2026-07-09 13:51:02.188198743 +0000 UTC m=+87.094772937" Jul 09 13:51:03.180337 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:03.180230 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qs4qg" event={"ID":"e5a15c1c-ff3c-4162-9f34-3beac8095bba","Type":"ContainerStarted","Data":"18b3bec0b8093b26ed0654d4e6275fb577a7c3357b0be103224a5eefe90d9c8f"} Jul 09 13:51:03.200431 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:03.200376 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qs4qg" podStartSLOduration=33.906197769 podStartE2EDuration="36.200359006s" totalImagesPullingTime="2.294161237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:50:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:51:03.198739424 +0000 UTC m=+88.105313618" watchObservedRunningTime="2026-07-09 13:51:03.200359006 +0000 UTC m=+88.106933198" Jul 09 13:51:05.190634 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:05.190589 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5884cf5d6-nswdk" event={"ID":"bd829d83-8101-402d-895a-80eb3ab24383","Type":"ContainerStarted","Data":"13436f42cca5db953ecf80874d41893469eb0a5e7a584599fcd691cc9c1accce"} Jul 09 13:51:05.191164 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:05.190849 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5884cf5d6-nswdk" Jul 09 13:51:05.192536 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:05.192506 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5884cf5d6-nswdk" Jul 09 13:51:05.206089 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:05.206039 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5884cf5d6-nswdk" podStartSLOduration=0.997517339 podStartE2EDuration="8.206020464s" totalImagesPullingTime="7.208503125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:50:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:51:05.205480032 +0000 UTC m=+90.112054226" watchObservedRunningTime="2026-07-09 13:51:05.206020464 +0000 UTC m=+90.112594659" Jul 09 13:51:12.062674 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:12.062643 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7btnh" Jul 09 13:51:14.468450 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:14.468410 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-registry-tls\") pod \"image-registry-cdbb9d64f-8bhxh\" (UID: \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\") " pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" Jul 09 13:51:14.471248 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:14.471225 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-registry-tls\") pod \"image-registry-cdbb9d64f-8bhxh\" (UID: \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\") " pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" Jul 09 13:51:14.633645 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:14.633566 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mvjq8\"" Jul 09 13:51:14.641684 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:14.641651 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" Jul 09 13:51:16.116306 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:16.116269 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-cdbb9d64f-8bhxh"] Jul 09 13:51:16.119158 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:51:16.119125 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d0c7810_9ef5_44fa_ab79_8ceaf4fce137.slice/crio-1ab7c5f38b1e2e8c340b69b0c57661a3e0600becd6e92ac500f55977579dbf7a WatchSource:0}: Error finding container 1ab7c5f38b1e2e8c340b69b0c57661a3e0600becd6e92ac500f55977579dbf7a: Status 404 returned error can't find the container with id 1ab7c5f38b1e2e8c340b69b0c57661a3e0600becd6e92ac500f55977579dbf7a Jul 09 13:51:16.238273 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:16.238183 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" event={"ID":"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137","Type":"ContainerStarted","Data":"1ab7c5f38b1e2e8c340b69b0c57661a3e0600becd6e92ac500f55977579dbf7a"} Jul 09 13:51:17.244845 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:17.244254 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-l6rt9" event={"ID":"40c503b2-14ca-49e1-a8cc-6b561ab8bcc7","Type":"ContainerStarted","Data":"dac7b8983bf0453b7645382834e02b1ed61981af20b2e74e88dc45fcfcbf72d4"} Jul 09 13:51:17.244845 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:17.244501 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-l6rt9" Jul 09 13:51:17.246316 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:17.246280 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" event={"ID":"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137","Type":"ContainerStarted","Data":"64c40286e7a68bba2d7786bdd9c90245e4a959ee8c2e8b193fd36a5abe484d9e"} Jul 09 13:51:17.246441 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:17.246349 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" Jul 09 13:51:17.259744 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:17.259714 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-l6rt9" Jul 09 13:51:17.262772 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:17.262729 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-l6rt9" podStartSLOduration=1.757353818 podStartE2EDuration="20.262715087s" totalImagesPullingTime="18.505361269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:50:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:51:17.260555952 +0000 UTC m=+102.167130146" watchObservedRunningTime="2026-07-09 13:51:17.262715087 +0000 UTC m=+102.169289279" Jul 09 13:51:17.285706 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:17.285644 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" podStartSLOduration=102.285624654 podStartE2EDuration="1m42.285624654s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:49:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:51:17.284274842 +0000 UTC m=+102.190849037" watchObservedRunningTime="2026-07-09 13:51:17.285624654 +0000 UTC m=+102.192198848" Jul 09 13:51:17.971840 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:17.971783 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-t6qnt"] Jul 09 13:51:18.002340 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:18.002303 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t6qnt" Jul 09 13:51:18.004943 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:18.004915 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 13:51:18.005097 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:18.005069 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 13:51:18.005162 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:18.005138 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 13:51:18.005275 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:18.005257 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tzl94\"" Jul 09 13:51:18.005322 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:18.005313 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 13:51:18.101869 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:18.101828 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b9b05569-f4a2-492c-9f7a-e5786de994ac-node-exporter-textfile\") pod \"node-exporter-t6qnt\" (UID: \"b9b05569-f4a2-492c-9f7a-e5786de994ac\") " pod="openshift-monitoring/node-exporter-t6qnt" Jul 09 13:51:18.102066 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:18.101885 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rt4lp\" (UniqueName: \"kubernetes.io/projected/b9b05569-f4a2-492c-9f7a-e5786de994ac-kube-api-access-rt4lp\") pod \"node-exporter-t6qnt\" (UID: \"b9b05569-f4a2-492c-9f7a-e5786de994ac\") " pod="openshift-monitoring/node-exporter-t6qnt" Jul 09 13:51:18.102066 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:18.101940 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b9b05569-f4a2-492c-9f7a-e5786de994ac-node-exporter-tls\") pod \"node-exporter-t6qnt\" (UID: \"b9b05569-f4a2-492c-9f7a-e5786de994ac\") " pod="openshift-monitoring/node-exporter-t6qnt" Jul 09 13:51:18.102066 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:18.101967 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b9b05569-f4a2-492c-9f7a-e5786de994ac-node-exporter-wtmp\") pod \"node-exporter-t6qnt\" (UID: \"b9b05569-f4a2-492c-9f7a-e5786de994ac\") " pod="openshift-monitoring/node-exporter-t6qnt" Jul 09 13:51:18.102066 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:18.102019 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9b05569-f4a2-492c-9f7a-e5786de994ac-sys\") pod \"node-exporter-t6qnt\" (UID: \"b9b05569-f4a2-492c-9f7a-e5786de994ac\") " pod="openshift-monitoring/node-exporter-t6qnt" Jul 09 13:51:18.102066 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:18.102044 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9b05569-f4a2-492c-9f7a-e5786de994ac-metrics-client-ca\") pod \"node-exporter-t6qnt\" (UID: \"b9b05569-f4a2-492c-9f7a-e5786de994ac\") " pod="openshift-monitoring/node-exporter-t6qnt" Jul 09 13:51:18.102346 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:18.102069 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b9b05569-f4a2-492c-9f7a-e5786de994ac-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t6qnt\" (UID: \"b9b05569-f4a2-492c-9f7a-e5786de994ac\") " pod="openshift-monitoring/node-exporter-t6qnt" Jul 09 13:51:18.102346 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:18.102096 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b9b05569-f4a2-492c-9f7a-e5786de994ac-node-exporter-accelerators-collector-config\") pod \"node-exporter-t6qnt\" (UID: \"b9b05569-f4a2-492c-9f7a-e5786de994ac\") " pod="openshift-monitoring/node-exporter-t6qnt" Jul 09 13:51:18.102346 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:18.102195 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b9b05569-f4a2-492c-9f7a-e5786de994ac-root\") pod \"node-exporter-t6qnt\" (UID: \"b9b05569-f4a2-492c-9f7a-e5786de994ac\") " pod="openshift-monitoring/node-exporter-t6qnt" Jul 09 13:51:18.202890 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:18.202845 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b9b05569-f4a2-492c-9f7a-e5786de994ac-node-exporter-tls\") pod \"node-exporter-t6qnt\" (UID: \"b9b05569-f4a2-492c-9f7a-e5786de994ac\") " pod="openshift-monitoring/node-exporter-t6qnt" Jul 09 13:51:18.203091 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:18.202900 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b9b05569-f4a2-492c-9f7a-e5786de994ac-node-exporter-wtmp\") pod \"node-exporter-t6qnt\" (UID: \"b9b05569-f4a2-492c-9f7a-e5786de994ac\") " pod="openshift-monitoring/node-exporter-t6qnt" Jul 09 13:51:18.203091 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:18.202952 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9b05569-f4a2-492c-9f7a-e5786de994ac-sys\") pod \"node-exporter-t6qnt\" (UID: \"b9b05569-f4a2-492c-9f7a-e5786de994ac\") " pod="openshift-monitoring/node-exporter-t6qnt" Jul 09 13:51:18.203091 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:18.202975 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9b05569-f4a2-492c-9f7a-e5786de994ac-metrics-client-ca\") pod \"node-exporter-t6qnt\" (UID: \"b9b05569-f4a2-492c-9f7a-e5786de994ac\") " pod="openshift-monitoring/node-exporter-t6qnt" Jul 09 13:51:18.203091 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:18.202992 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b9b05569-f4a2-492c-9f7a-e5786de994ac-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t6qnt\" (UID: \"b9b05569-f4a2-492c-9f7a-e5786de994ac\") " pod="openshift-monitoring/node-exporter-t6qnt" Jul 09 13:51:18.203091 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:18.203012 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b9b05569-f4a2-492c-9f7a-e5786de994ac-node-exporter-accelerators-collector-config\") pod \"node-exporter-t6qnt\" (UID: \"b9b05569-f4a2-492c-9f7a-e5786de994ac\") " pod="openshift-monitoring/node-exporter-t6qnt" Jul 09 13:51:18.203373 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:18.203103 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b9b05569-f4a2-492c-9f7a-e5786de994ac-root\") pod \"node-exporter-t6qnt\" (UID: \"b9b05569-f4a2-492c-9f7a-e5786de994ac\") " pod="openshift-monitoring/node-exporter-t6qnt" Jul 09 13:51:18.203373 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:18.203146 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b9b05569-f4a2-492c-9f7a-e5786de994ac-node-exporter-textfile\") pod \"node-exporter-t6qnt\" (UID: \"b9b05569-f4a2-492c-9f7a-e5786de994ac\") " pod="openshift-monitoring/node-exporter-t6qnt" Jul 09 13:51:18.203373 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:18.203169 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt4lp\" (UniqueName: \"kubernetes.io/projected/b9b05569-f4a2-492c-9f7a-e5786de994ac-kube-api-access-rt4lp\") pod \"node-exporter-t6qnt\" (UID: \"b9b05569-f4a2-492c-9f7a-e5786de994ac\") " pod="openshift-monitoring/node-exporter-t6qnt" Jul 09 13:51:18.203640 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:18.203615 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9b05569-f4a2-492c-9f7a-e5786de994ac-sys\") pod \"node-exporter-t6qnt\" (UID: \"b9b05569-f4a2-492c-9f7a-e5786de994ac\") " pod="openshift-monitoring/node-exporter-t6qnt" Jul 09 13:51:18.203784 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:18.203761 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b9b05569-f4a2-492c-9f7a-e5786de994ac-node-exporter-wtmp\") pod \"node-exporter-t6qnt\" (UID: \"b9b05569-f4a2-492c-9f7a-e5786de994ac\") " pod="openshift-monitoring/node-exporter-t6qnt" Jul 09 13:51:18.203890 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:18.203849 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b9b05569-f4a2-492c-9f7a-e5786de994ac-root\") pod \"node-exporter-t6qnt\" (UID: \"b9b05569-f4a2-492c-9f7a-e5786de994ac\") " pod="openshift-monitoring/node-exporter-t6qnt" Jul 09 13:51:18.204686 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:18.204655 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9b05569-f4a2-492c-9f7a-e5786de994ac-metrics-client-ca\") pod \"node-exporter-t6qnt\" (UID: \"b9b05569-f4a2-492c-9f7a-e5786de994ac\") " pod="openshift-monitoring/node-exporter-t6qnt" Jul 09 13:51:18.204798 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:18.204782 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b9b05569-f4a2-492c-9f7a-e5786de994ac-node-exporter-textfile\") pod \"node-exporter-t6qnt\" (UID: \"b9b05569-f4a2-492c-9f7a-e5786de994ac\") " pod="openshift-monitoring/node-exporter-t6qnt" Jul 09 13:51:18.205172 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:18.205145 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b9b05569-f4a2-492c-9f7a-e5786de994ac-node-exporter-accelerators-collector-config\") pod \"node-exporter-t6qnt\" (UID: \"b9b05569-f4a2-492c-9f7a-e5786de994ac\") " pod="openshift-monitoring/node-exporter-t6qnt" Jul 09 13:51:18.207058 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:18.207035 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b9b05569-f4a2-492c-9f7a-e5786de994ac-node-exporter-tls\") pod \"node-exporter-t6qnt\" (UID: \"b9b05569-f4a2-492c-9f7a-e5786de994ac\") " pod="openshift-monitoring/node-exporter-t6qnt" Jul 09 13:51:18.207612 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:18.207587 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b9b05569-f4a2-492c-9f7a-e5786de994ac-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t6qnt\" (UID: \"b9b05569-f4a2-492c-9f7a-e5786de994ac\") " pod="openshift-monitoring/node-exporter-t6qnt" Jul 09 13:51:18.212328 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:18.212281 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rt4lp\" (UniqueName: \"kubernetes.io/projected/b9b05569-f4a2-492c-9f7a-e5786de994ac-kube-api-access-rt4lp\") pod \"node-exporter-t6qnt\" (UID: \"b9b05569-f4a2-492c-9f7a-e5786de994ac\") " pod="openshift-monitoring/node-exporter-t6qnt" Jul 09 13:51:18.317825 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:18.315849 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t6qnt" Jul 09 13:51:18.357935 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:51:18.357879 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9b05569_f4a2_492c_9f7a_e5786de994ac.slice/crio-66184c97bae7dbed96e5635e1e990f7b8b30e272111ce7f13f13b96fc106df9b WatchSource:0}: Error finding container 66184c97bae7dbed96e5635e1e990f7b8b30e272111ce7f13f13b96fc106df9b: Status 404 returned error can't find the container with id 66184c97bae7dbed96e5635e1e990f7b8b30e272111ce7f13f13b96fc106df9b Jul 09 13:51:19.268676 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:19.268637 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t6qnt" event={"ID":"b9b05569-f4a2-492c-9f7a-e5786de994ac","Type":"ContainerStarted","Data":"66184c97bae7dbed96e5635e1e990f7b8b30e272111ce7f13f13b96fc106df9b"} Jul 09 13:51:20.275821 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:20.275758 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t6qnt" event={"ID":"b9b05569-f4a2-492c-9f7a-e5786de994ac","Type":"ContainerStarted","Data":"b9f3eded5aafe9f847052be99213eda47537082cba7d010a4154f34da9003cc0"} Jul 09 13:51:20.289198 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:20.289157 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-cdbb9d64f-8bhxh"] Jul 09 13:51:21.282327 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:21.282287 2573 generic.go:356] "Generic (PLEG): container finished" podID="b9b05569-f4a2-492c-9f7a-e5786de994ac" containerID="b9f3eded5aafe9f847052be99213eda47537082cba7d010a4154f34da9003cc0" exitCode=0 Jul 09 13:51:21.282770 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:21.282379 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t6qnt" event={"ID":"b9b05569-f4a2-492c-9f7a-e5786de994ac","Type":"ContainerDied","Data":"b9f3eded5aafe9f847052be99213eda47537082cba7d010a4154f34da9003cc0"} Jul 09 13:51:22.289916 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:22.289880 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t6qnt" event={"ID":"b9b05569-f4a2-492c-9f7a-e5786de994ac","Type":"ContainerStarted","Data":"fb112d15c90e1a9c5e931dd8c53d7bf3101ca9fe8ad5a066ce6dde56fce69130"} Jul 09 13:51:22.290471 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:22.289945 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t6qnt" event={"ID":"b9b05569-f4a2-492c-9f7a-e5786de994ac","Type":"ContainerStarted","Data":"50b4ba638de2b18fcb6358a48cbb531e9908217614d717db250b01fcabcf9add"} Jul 09 13:51:22.310336 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:22.310281 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-t6qnt" podStartSLOduration=3.518775832 podStartE2EDuration="5.310261781s" totalImagesPullingTime="1.683593878s" totalInitContainerRuntime="107.892071ms" isStatefulPod=true podCreationTimestamp="2026-07-09 13:51:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:51:22.310027571 +0000 UTC m=+107.216601775" watchObservedRunningTime="2026-07-09 13:51:22.310261781 +0000 UTC m=+107.216835974" Jul 09 13:51:40.295347 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:40.295317 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" Jul 09 13:51:44.543330 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:44.543294 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37ebd359-357d-4d89-b1b0-ce746eedeec9-metrics-certs\") pod \"network-metrics-daemon-5rs66\" (UID: \"37ebd359-357d-4d89-b1b0-ce746eedeec9\") " pod="openshift-multus/network-metrics-daemon-5rs66" Jul 09 13:51:44.545749 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:44.545725 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37ebd359-357d-4d89-b1b0-ce746eedeec9-metrics-certs\") pod \"network-metrics-daemon-5rs66\" (UID: \"37ebd359-357d-4d89-b1b0-ce746eedeec9\") " pod="openshift-multus/network-metrics-daemon-5rs66" Jul 09 13:51:44.819868 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:44.819785 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4kxnf\"" Jul 09 13:51:44.828136 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:44.828113 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rs66" Jul 09 13:51:44.991453 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:44.991420 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5rs66"] Jul 09 13:51:44.994683 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:51:44.994659 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37ebd359_357d_4d89_b1b0_ce746eedeec9.slice/crio-7b41a86b549cc3d5a8133bc89d3171523c0a87b78cc60ae0543c258d22b03609 WatchSource:0}: Error finding container 7b41a86b549cc3d5a8133bc89d3171523c0a87b78cc60ae0543c258d22b03609: Status 404 returned error can't find the container with id 7b41a86b549cc3d5a8133bc89d3171523c0a87b78cc60ae0543c258d22b03609 Jul 09 13:51:45.316205 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:45.316156 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" podUID="4d0c7810-9ef5-44fa-ab79-8ceaf4fce137" containerName="registry" containerID="cri-o://64c40286e7a68bba2d7786bdd9c90245e4a959ee8c2e8b193fd36a5abe484d9e" gracePeriod=30 Jul 09 13:51:45.373686 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:45.373653 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5rs66" event={"ID":"37ebd359-357d-4d89-b1b0-ce746eedeec9","Type":"ContainerStarted","Data":"7b41a86b549cc3d5a8133bc89d3171523c0a87b78cc60ae0543c258d22b03609"} Jul 09 13:51:45.593324 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:45.593293 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" Jul 09 13:51:45.753242 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:45.753203 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-installation-pull-secrets\") pod \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\" (UID: \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\") " Jul 09 13:51:45.753571 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:45.753255 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72fl8\" (UniqueName: \"kubernetes.io/projected/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-kube-api-access-72fl8\") pod \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\" (UID: \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\") " Jul 09 13:51:45.753571 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:45.753295 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-ca-trust-extracted\") pod \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\" (UID: \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\") " Jul 09 13:51:45.753571 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:45.753333 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-trusted-ca\") pod \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\" (UID: \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\") " Jul 09 13:51:45.753571 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:45.753359 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-bound-sa-token\") pod \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\" (UID: \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\") " Jul 09 13:51:45.753571 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:45.753387 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-registry-certificates\") pod \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\" (UID: \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\") " Jul 09 13:51:45.753571 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:45.753432 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-image-registry-private-configuration\") pod \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\" (UID: \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\") " Jul 09 13:51:45.753571 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:45.753484 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-registry-tls\") pod \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\" (UID: \"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137\") " Jul 09 13:51:45.754199 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:45.754165 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4d0c7810-9ef5-44fa-ab79-8ceaf4fce137" (UID: "4d0c7810-9ef5-44fa-ab79-8ceaf4fce137"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 13:51:45.754199 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:45.754183 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4d0c7810-9ef5-44fa-ab79-8ceaf4fce137" (UID: "4d0c7810-9ef5-44fa-ab79-8ceaf4fce137"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 13:51:45.757047 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:45.757021 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4d0c7810-9ef5-44fa-ab79-8ceaf4fce137" (UID: "4d0c7810-9ef5-44fa-ab79-8ceaf4fce137"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 13:51:45.757433 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:45.757393 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4d0c7810-9ef5-44fa-ab79-8ceaf4fce137" (UID: "4d0c7810-9ef5-44fa-ab79-8ceaf4fce137"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 13:51:45.757561 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:45.757509 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4d0c7810-9ef5-44fa-ab79-8ceaf4fce137" (UID: "4d0c7810-9ef5-44fa-ab79-8ceaf4fce137"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 13:51:45.757775 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:45.757739 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-kube-api-access-72fl8" (OuterVolumeSpecName: "kube-api-access-72fl8") pod "4d0c7810-9ef5-44fa-ab79-8ceaf4fce137" (UID: "4d0c7810-9ef5-44fa-ab79-8ceaf4fce137"). InnerVolumeSpecName "kube-api-access-72fl8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 13:51:45.757869 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:45.757834 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4d0c7810-9ef5-44fa-ab79-8ceaf4fce137" (UID: "4d0c7810-9ef5-44fa-ab79-8ceaf4fce137"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 13:51:45.765421 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:45.765393 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4d0c7810-9ef5-44fa-ab79-8ceaf4fce137" (UID: "4d0c7810-9ef5-44fa-ab79-8ceaf4fce137"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 13:51:45.854313 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:45.854233 2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-registry-tls\") on node \"ip-10-0-143-92.ec2.internal\" DevicePath \"\"" Jul 09 13:51:45.854313 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:45.854263 2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-installation-pull-secrets\") on node \"ip-10-0-143-92.ec2.internal\" DevicePath \"\"" Jul 09 13:51:45.854313 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:45.854276 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72fl8\" (UniqueName: \"kubernetes.io/projected/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-kube-api-access-72fl8\") on node \"ip-10-0-143-92.ec2.internal\" DevicePath \"\"" Jul 09 13:51:45.854313 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:45.854287 2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-ca-trust-extracted\") on node \"ip-10-0-143-92.ec2.internal\" DevicePath \"\"" Jul 09 13:51:45.854313 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:45.854300 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-trusted-ca\") on node \"ip-10-0-143-92.ec2.internal\" DevicePath \"\"" Jul 09 13:51:45.854313 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:45.854311 2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-bound-sa-token\") on node \"ip-10-0-143-92.ec2.internal\" DevicePath \"\"" Jul 09 13:51:45.854627 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:45.854322 2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-registry-certificates\") on node \"ip-10-0-143-92.ec2.internal\" DevicePath \"\"" Jul 09 13:51:45.854627 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:45.854335 2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137-image-registry-private-configuration\") on node \"ip-10-0-143-92.ec2.internal\" DevicePath \"\"" Jul 09 13:51:46.378115 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:46.378078 2573 generic.go:356] "Generic (PLEG): container finished" podID="4d0c7810-9ef5-44fa-ab79-8ceaf4fce137" containerID="64c40286e7a68bba2d7786bdd9c90245e4a959ee8c2e8b193fd36a5abe484d9e" exitCode=0 Jul 09 13:51:46.378299 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:46.378124 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" event={"ID":"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137","Type":"ContainerDied","Data":"64c40286e7a68bba2d7786bdd9c90245e4a959ee8c2e8b193fd36a5abe484d9e"} Jul 09 13:51:46.378299 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:46.378172 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" event={"ID":"4d0c7810-9ef5-44fa-ab79-8ceaf4fce137","Type":"ContainerDied","Data":"1ab7c5f38b1e2e8c340b69b0c57661a3e0600becd6e92ac500f55977579dbf7a"} Jul 09 13:51:46.378299 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:46.378197 2573 scope.go:117] "RemoveContainer" containerID="64c40286e7a68bba2d7786bdd9c90245e4a959ee8c2e8b193fd36a5abe484d9e" Jul 09 13:51:46.378299 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:46.378127 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cdbb9d64f-8bhxh" Jul 09 13:51:46.398748 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:46.398723 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-cdbb9d64f-8bhxh"] Jul 09 13:51:46.402271 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:46.402248 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-cdbb9d64f-8bhxh"] Jul 09 13:51:46.537093 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:46.537073 2573 scope.go:117] "RemoveContainer" containerID="64c40286e7a68bba2d7786bdd9c90245e4a959ee8c2e8b193fd36a5abe484d9e" Jul 09 13:51:46.537455 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:51:46.537428 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64c40286e7a68bba2d7786bdd9c90245e4a959ee8c2e8b193fd36a5abe484d9e\": container with ID starting with 64c40286e7a68bba2d7786bdd9c90245e4a959ee8c2e8b193fd36a5abe484d9e not found: ID does not exist" containerID="64c40286e7a68bba2d7786bdd9c90245e4a959ee8c2e8b193fd36a5abe484d9e" Jul 09 13:51:46.537542 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:46.537462 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64c40286e7a68bba2d7786bdd9c90245e4a959ee8c2e8b193fd36a5abe484d9e"} err="failed to get container status \"64c40286e7a68bba2d7786bdd9c90245e4a959ee8c2e8b193fd36a5abe484d9e\": rpc error: code = NotFound desc = could not find container \"64c40286e7a68bba2d7786bdd9c90245e4a959ee8c2e8b193fd36a5abe484d9e\": container with ID starting with 64c40286e7a68bba2d7786bdd9c90245e4a959ee8c2e8b193fd36a5abe484d9e not found: ID does not exist" Jul 09 13:51:47.384637 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:47.384596 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5rs66" event={"ID":"37ebd359-357d-4d89-b1b0-ce746eedeec9","Type":"ContainerStarted","Data":"00f16ecb179e5ff6b6d9fb909da2d1131ee8e2b1ccb03e86b9a89ba5fcedaad2"} Jul 09 13:51:47.385078 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:47.384672 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5rs66" event={"ID":"37ebd359-357d-4d89-b1b0-ce746eedeec9","Type":"ContainerStarted","Data":"bebea8374dafc1825f337ce8f8d13d0fe435a0978b18f53da7cc82793ca6673f"} Jul 09 13:51:47.401426 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:47.401381 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5rs66" podStartSLOduration=129.857788794 podStartE2EDuration="2m11.401364991s" totalImagesPullingTime="1.543576197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:49:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:51:47.400238108 +0000 UTC m=+132.306812302" watchObservedRunningTime="2026-07-09 13:51:47.401364991 +0000 UTC m=+132.307939183" Jul 09 13:51:47.612236 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:51:47.612197 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d0c7810-9ef5-44fa-ab79-8ceaf4fce137" path="/var/lib/kubelet/pods/4d0c7810-9ef5-44fa-ab79-8ceaf4fce137/volumes" Jul 09 13:52:00.437822 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:52:00.437774 2573 generic.go:356] "Generic (PLEG): container finished" podID="3d907576-86ea-4a33-928a-85df98300620" containerID="7bce108714a78ba217bc3a1b5fc5b1a1f30d30aec1aede90a0f4d19b7b2cf7ba" exitCode=0 Jul 09 13:52:00.438256 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:52:00.437836 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p6mh2" event={"ID":"3d907576-86ea-4a33-928a-85df98300620","Type":"ContainerDied","Data":"7bce108714a78ba217bc3a1b5fc5b1a1f30d30aec1aede90a0f4d19b7b2cf7ba"} Jul 09 13:52:00.438256 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:52:00.438157 2573 scope.go:117] "RemoveContainer" containerID="7bce108714a78ba217bc3a1b5fc5b1a1f30d30aec1aede90a0f4d19b7b2cf7ba" Jul 09 13:52:01.443392 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:52:01.443356 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-p6mh2" event={"ID":"3d907576-86ea-4a33-928a-85df98300620","Type":"ContainerStarted","Data":"e10b4736b9199d18546878e0fe11c53023adb8a39d122d39b2b37ae33ce88418"} Jul 09 13:52:04.455324 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:52:04.455287 2573 generic.go:356] "Generic (PLEG): container finished" podID="e870a285-4a50-429d-b74d-bc5b4ace1275" containerID="6e5659ccd636c8803ca32dee9e12ab1a3bb188cd85e0f8af18aa6ab31009a782" exitCode=0 Jul 09 13:52:04.455754 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:52:04.455363 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-j2j9h" event={"ID":"e870a285-4a50-429d-b74d-bc5b4ace1275","Type":"ContainerDied","Data":"6e5659ccd636c8803ca32dee9e12ab1a3bb188cd85e0f8af18aa6ab31009a782"} Jul 09 13:52:04.455754 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:52:04.455704 2573 scope.go:117] "RemoveContainer" containerID="6e5659ccd636c8803ca32dee9e12ab1a3bb188cd85e0f8af18aa6ab31009a782" Jul 09 13:52:04.457033 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:52:04.456922 2573 generic.go:356] "Generic (PLEG): container finished" podID="15e19452-d64a-46b3-9ca1-f39d4a955d45" containerID="ecfaea5400e11bc741d4997461e3c755ae88c16761779488bf4cb04b59300003" exitCode=0 Jul 09 13:52:04.457033 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:52:04.456970 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-q2tlh" event={"ID":"15e19452-d64a-46b3-9ca1-f39d4a955d45","Type":"ContainerDied","Data":"ecfaea5400e11bc741d4997461e3c755ae88c16761779488bf4cb04b59300003"} Jul 09 13:52:04.457232 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:52:04.457217 2573 scope.go:117] "RemoveContainer" containerID="ecfaea5400e11bc741d4997461e3c755ae88c16761779488bf4cb04b59300003" Jul 09 13:52:05.463548 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:52:05.463504 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-j2j9h" event={"ID":"e870a285-4a50-429d-b74d-bc5b4ace1275","Type":"ContainerStarted","Data":"e22b5a66f18e65e7f29fae36c72f96c3474eca94eb47e246404bdaee9ccc0837"} Jul 09 13:52:05.465266 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:52:05.465234 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-q2tlh" event={"ID":"15e19452-d64a-46b3-9ca1-f39d4a955d45","Type":"ContainerStarted","Data":"9e722d4ec38d5a0654647c66ed6f5e5d774594e6d2f17e71600a0bb584934786"} Jul 09 13:53:52.296362 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:52.296320 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-485tq"] Jul 09 13:53:52.296865 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:52.296638 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d0c7810-9ef5-44fa-ab79-8ceaf4fce137" containerName="registry" Jul 09 13:53:52.296865 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:52.296652 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d0c7810-9ef5-44fa-ab79-8ceaf4fce137" containerName="registry" Jul 09 13:53:52.296865 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:52.296709 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d0c7810-9ef5-44fa-ab79-8ceaf4fce137" containerName="registry" Jul 09 13:53:52.298762 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:52.298745 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-485tq" Jul 09 13:53:52.301513 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:52.301488 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-mfjtk\"" Jul 09 13:53:52.301677 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:52.301658 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 09 13:53:52.301724 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:52.301681 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 09 13:53:52.313082 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:52.313058 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-485tq"] Jul 09 13:53:52.444097 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:52.444056 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghnsv\" (UniqueName: \"kubernetes.io/projected/7d98bfaa-d98c-49b0-836c-87b655d1a655-kube-api-access-ghnsv\") pod \"cert-manager-operator-controller-manager-55c444bf86-485tq\" (UID: \"7d98bfaa-d98c-49b0-836c-87b655d1a655\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-485tq" Jul 09 13:53:52.444271 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:52.444122 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d98bfaa-d98c-49b0-836c-87b655d1a655-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-485tq\" (UID: \"7d98bfaa-d98c-49b0-836c-87b655d1a655\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-485tq" Jul 09 13:53:52.545138 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:52.545098 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d98bfaa-d98c-49b0-836c-87b655d1a655-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-485tq\" (UID: \"7d98bfaa-d98c-49b0-836c-87b655d1a655\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-485tq" Jul 09 13:53:52.545320 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:52.545163 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghnsv\" (UniqueName: \"kubernetes.io/projected/7d98bfaa-d98c-49b0-836c-87b655d1a655-kube-api-access-ghnsv\") pod \"cert-manager-operator-controller-manager-55c444bf86-485tq\" (UID: \"7d98bfaa-d98c-49b0-836c-87b655d1a655\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-485tq" Jul 09 13:53:52.545559 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:52.545536 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d98bfaa-d98c-49b0-836c-87b655d1a655-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-485tq\" (UID: \"7d98bfaa-d98c-49b0-836c-87b655d1a655\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-485tq" Jul 09 13:53:52.553647 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:52.553590 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghnsv\" (UniqueName: \"kubernetes.io/projected/7d98bfaa-d98c-49b0-836c-87b655d1a655-kube-api-access-ghnsv\") pod \"cert-manager-operator-controller-manager-55c444bf86-485tq\" (UID: \"7d98bfaa-d98c-49b0-836c-87b655d1a655\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-485tq" Jul 09 13:53:52.607939 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:52.607907 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-485tq" Jul 09 13:53:52.743412 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:52.743387 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-485tq"] Jul 09 13:53:52.746140 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:53:52.746105 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d98bfaa_d98c_49b0_836c_87b655d1a655.slice/crio-d1f61e87e417a3082b1140fc1fa421e5ce8d0031dcfaa57e95075c198ac48b8c WatchSource:0}: Error finding container d1f61e87e417a3082b1140fc1fa421e5ce8d0031dcfaa57e95075c198ac48b8c: Status 404 returned error can't find the container with id d1f61e87e417a3082b1140fc1fa421e5ce8d0031dcfaa57e95075c198ac48b8c Jul 09 13:53:52.862492 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:52.862405 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-485tq" event={"ID":"7d98bfaa-d98c-49b0-836c-87b655d1a655","Type":"ContainerStarted","Data":"d1f61e87e417a3082b1140fc1fa421e5ce8d0031dcfaa57e95075c198ac48b8c"} Jul 09 13:53:55.880253 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:55.880214 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-485tq" event={"ID":"7d98bfaa-d98c-49b0-836c-87b655d1a655","Type":"ContainerStarted","Data":"97a47b527e1715a935549c1e0cc4b9d49195afdda885505e25f506de667b4425"} Jul 09 13:53:55.901252 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:55.901190 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-485tq" podStartSLOduration=1.378051605 podStartE2EDuration="3.90117013s" totalImagesPullingTime="2.523118525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:53:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:53:55.898741271 +0000 UTC m=+260.805315463" watchObservedRunningTime="2026-07-09 13:53:55.90117013 +0000 UTC m=+260.807744325" Jul 09 13:53:56.775590 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:56.775508 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f45zzm"] Jul 09 13:53:56.778013 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:56.777994 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f45zzm" Jul 09 13:53:56.780419 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:56.780394 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 09 13:53:56.781050 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:56.781025 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 09 13:53:56.781100 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:56.781083 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dbbxz\"" Jul 09 13:53:56.787329 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:56.787296 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f45zzm"] Jul 09 13:53:56.879667 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:56.879629 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x74vh\" (UniqueName: \"kubernetes.io/projected/86604d61-93ca-46bd-87c4-fb79325fd56d-kube-api-access-x74vh\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f45zzm\" (UID: \"86604d61-93ca-46bd-87c4-fb79325fd56d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f45zzm" Jul 09 13:53:56.879861 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:56.879688 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86604d61-93ca-46bd-87c4-fb79325fd56d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f45zzm\" (UID: \"86604d61-93ca-46bd-87c4-fb79325fd56d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f45zzm" Jul 09 13:53:56.879861 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:56.879756 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86604d61-93ca-46bd-87c4-fb79325fd56d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f45zzm\" (UID: \"86604d61-93ca-46bd-87c4-fb79325fd56d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f45zzm" Jul 09 13:53:56.980354 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:56.980318 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x74vh\" (UniqueName: \"kubernetes.io/projected/86604d61-93ca-46bd-87c4-fb79325fd56d-kube-api-access-x74vh\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f45zzm\" (UID: \"86604d61-93ca-46bd-87c4-fb79325fd56d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f45zzm" Jul 09 13:53:56.980876 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:56.980398 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86604d61-93ca-46bd-87c4-fb79325fd56d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f45zzm\" (UID: \"86604d61-93ca-46bd-87c4-fb79325fd56d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f45zzm" Jul 09 13:53:56.980876 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:56.980432 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86604d61-93ca-46bd-87c4-fb79325fd56d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f45zzm\" (UID: \"86604d61-93ca-46bd-87c4-fb79325fd56d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f45zzm" Jul 09 13:53:56.980876 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:56.980780 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86604d61-93ca-46bd-87c4-fb79325fd56d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f45zzm\" (UID: \"86604d61-93ca-46bd-87c4-fb79325fd56d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f45zzm" Jul 09 13:53:56.980876 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:56.980853 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86604d61-93ca-46bd-87c4-fb79325fd56d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f45zzm\" (UID: \"86604d61-93ca-46bd-87c4-fb79325fd56d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f45zzm" Jul 09 13:53:56.988992 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:56.988970 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x74vh\" (UniqueName: \"kubernetes.io/projected/86604d61-93ca-46bd-87c4-fb79325fd56d-kube-api-access-x74vh\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f45zzm\" (UID: \"86604d61-93ca-46bd-87c4-fb79325fd56d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f45zzm" Jul 09 13:53:57.087219 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:57.087123 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f45zzm" Jul 09 13:53:57.222296 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:57.222273 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f45zzm"] Jul 09 13:53:57.224643 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:53:57.224616 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86604d61_93ca_46bd_87c4_fb79325fd56d.slice/crio-d98b1b9061feafe1b44b50970cfbf0b211d908e66d1295681dd72d5d4cb96d97 WatchSource:0}: Error finding container d98b1b9061feafe1b44b50970cfbf0b211d908e66d1295681dd72d5d4cb96d97: Status 404 returned error can't find the container with id d98b1b9061feafe1b44b50970cfbf0b211d908e66d1295681dd72d5d4cb96d97 Jul 09 13:53:57.892792 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:57.892086 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f45zzm" event={"ID":"86604d61-93ca-46bd-87c4-fb79325fd56d","Type":"ContainerStarted","Data":"d98b1b9061feafe1b44b50970cfbf0b211d908e66d1295681dd72d5d4cb96d97"} Jul 09 13:53:58.141252 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:58.141219 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-fwx78"] Jul 09 13:53:58.144011 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:58.143950 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-fwx78" Jul 09 13:53:58.146370 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:58.146345 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-jjgps\"" Jul 09 13:53:58.146370 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:58.146365 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 09 13:53:58.147032 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:58.147005 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 09 13:53:58.151761 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:58.151730 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-fwx78"] Jul 09 13:53:58.292090 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:58.292049 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfpmx\" (UniqueName: \"kubernetes.io/projected/e314b92e-e0f0-45f0-96b6-83cc6c0231d7-kube-api-access-rfpmx\") pod \"cert-manager-webhook-6486ffd997-fwx78\" (UID: \"e314b92e-e0f0-45f0-96b6-83cc6c0231d7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fwx78" Jul 09 13:53:58.292090 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:58.292092 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e314b92e-e0f0-45f0-96b6-83cc6c0231d7-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-fwx78\" (UID: \"e314b92e-e0f0-45f0-96b6-83cc6c0231d7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fwx78" Jul 09 13:53:58.393400 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:58.393363 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfpmx\" (UniqueName: \"kubernetes.io/projected/e314b92e-e0f0-45f0-96b6-83cc6c0231d7-kube-api-access-rfpmx\") pod \"cert-manager-webhook-6486ffd997-fwx78\" (UID: \"e314b92e-e0f0-45f0-96b6-83cc6c0231d7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fwx78" Jul 09 13:53:58.393400 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:58.393398 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e314b92e-e0f0-45f0-96b6-83cc6c0231d7-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-fwx78\" (UID: \"e314b92e-e0f0-45f0-96b6-83cc6c0231d7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fwx78" Jul 09 13:53:58.401495 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:58.401430 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e314b92e-e0f0-45f0-96b6-83cc6c0231d7-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-fwx78\" (UID: \"e314b92e-e0f0-45f0-96b6-83cc6c0231d7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fwx78" Jul 09 13:53:58.401611 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:58.401557 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfpmx\" (UniqueName: \"kubernetes.io/projected/e314b92e-e0f0-45f0-96b6-83cc6c0231d7-kube-api-access-rfpmx\") pod \"cert-manager-webhook-6486ffd997-fwx78\" (UID: \"e314b92e-e0f0-45f0-96b6-83cc6c0231d7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fwx78" Jul 09 13:53:58.465801 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:58.465765 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-fwx78" Jul 09 13:53:58.614742 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:58.614708 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-fwx78"] Jul 09 13:53:58.618167 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:53:58.618133 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode314b92e_e0f0_45f0_96b6_83cc6c0231d7.slice/crio-e3caa7790ca63e9ac98e711e8cc212a5f1f4bb91833a20af0b180895b0786348 WatchSource:0}: Error finding container e3caa7790ca63e9ac98e711e8cc212a5f1f4bb91833a20af0b180895b0786348: Status 404 returned error can't find the container with id e3caa7790ca63e9ac98e711e8cc212a5f1f4bb91833a20af0b180895b0786348 Jul 09 13:53:58.898303 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:53:58.898259 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-fwx78" event={"ID":"e314b92e-e0f0-45f0-96b6-83cc6c0231d7","Type":"ContainerStarted","Data":"e3caa7790ca63e9ac98e711e8cc212a5f1f4bb91833a20af0b180895b0786348"} Jul 09 13:54:01.915525 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:01.915483 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-fwx78" event={"ID":"e314b92e-e0f0-45f0-96b6-83cc6c0231d7","Type":"ContainerStarted","Data":"c9bac79522be5892de53875829ee6529d7ad3be23126b557c7f9dc4e5efa0600"} Jul 09 13:54:01.916007 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:01.915626 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-fwx78" Jul 09 13:54:01.939419 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:01.939355 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-fwx78" podStartSLOduration=1.226784113 podStartE2EDuration="3.939331301s" totalImagesPullingTime="2.712547188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:53:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:54:01.938091159 +0000 UTC m=+266.844665354" watchObservedRunningTime="2026-07-09 13:54:01.939331301 +0000 UTC m=+266.845905510" Jul 09 13:54:03.925726 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:03.925695 2573 generic.go:356] "Generic (PLEG): container finished" podID="86604d61-93ca-46bd-87c4-fb79325fd56d" containerID="1d3c88827939c7e1560a45b22a0cf49c928c3c31415ef26865e93748d316ef69" exitCode=0 Jul 09 13:54:03.926180 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:03.925773 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f45zzm" event={"ID":"86604d61-93ca-46bd-87c4-fb79325fd56d","Type":"ContainerDied","Data":"1d3c88827939c7e1560a45b22a0cf49c928c3c31415ef26865e93748d316ef69"} Jul 09 13:54:06.940288 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:06.940197 2573 generic.go:356] "Generic (PLEG): container finished" podID="86604d61-93ca-46bd-87c4-fb79325fd56d" containerID="07deba2d4d87568c6e912ec07c2a07556a668252c6315240c246397f2c166082" exitCode=0 Jul 09 13:54:06.940659 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:06.940281 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f45zzm" event={"ID":"86604d61-93ca-46bd-87c4-fb79325fd56d","Type":"ContainerDied","Data":"07deba2d4d87568c6e912ec07c2a07556a668252c6315240c246397f2c166082"} Jul 09 13:54:07.922125 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:07.922086 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-fwx78" Jul 09 13:54:13.974015 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:13.973973 2573 generic.go:356] "Generic (PLEG): container finished" podID="86604d61-93ca-46bd-87c4-fb79325fd56d" containerID="0e5c66a840c3990fe123030c6c3ed92df2a314316260e108d4ea3466f9a30285" exitCode=0 Jul 09 13:54:13.974342 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:13.974036 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f45zzm" event={"ID":"86604d61-93ca-46bd-87c4-fb79325fd56d","Type":"ContainerDied","Data":"0e5c66a840c3990fe123030c6c3ed92df2a314316260e108d4ea3466f9a30285"} Jul 09 13:54:15.104543 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:15.104517 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f45zzm" Jul 09 13:54:15.136627 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:15.136596 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86604d61-93ca-46bd-87c4-fb79325fd56d-util\") pod \"86604d61-93ca-46bd-87c4-fb79325fd56d\" (UID: \"86604d61-93ca-46bd-87c4-fb79325fd56d\") " Jul 09 13:54:15.136627 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:15.136631 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86604d61-93ca-46bd-87c4-fb79325fd56d-bundle\") pod \"86604d61-93ca-46bd-87c4-fb79325fd56d\" (UID: \"86604d61-93ca-46bd-87c4-fb79325fd56d\") " Jul 09 13:54:15.136854 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:15.136657 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x74vh\" (UniqueName: \"kubernetes.io/projected/86604d61-93ca-46bd-87c4-fb79325fd56d-kube-api-access-x74vh\") pod \"86604d61-93ca-46bd-87c4-fb79325fd56d\" (UID: \"86604d61-93ca-46bd-87c4-fb79325fd56d\") " Jul 09 13:54:15.137089 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:15.137058 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86604d61-93ca-46bd-87c4-fb79325fd56d-bundle" (OuterVolumeSpecName: "bundle") pod "86604d61-93ca-46bd-87c4-fb79325fd56d" (UID: "86604d61-93ca-46bd-87c4-fb79325fd56d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 13:54:15.139131 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:15.139090 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86604d61-93ca-46bd-87c4-fb79325fd56d-kube-api-access-x74vh" (OuterVolumeSpecName: "kube-api-access-x74vh") pod "86604d61-93ca-46bd-87c4-fb79325fd56d" (UID: "86604d61-93ca-46bd-87c4-fb79325fd56d"). InnerVolumeSpecName "kube-api-access-x74vh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 13:54:15.141886 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:15.141860 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86604d61-93ca-46bd-87c4-fb79325fd56d-util" (OuterVolumeSpecName: "util") pod "86604d61-93ca-46bd-87c4-fb79325fd56d" (UID: "86604d61-93ca-46bd-87c4-fb79325fd56d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 13:54:15.237324 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:15.237231 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86604d61-93ca-46bd-87c4-fb79325fd56d-util\") on node \"ip-10-0-143-92.ec2.internal\" DevicePath \"\"" Jul 09 13:54:15.237324 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:15.237272 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86604d61-93ca-46bd-87c4-fb79325fd56d-bundle\") on node \"ip-10-0-143-92.ec2.internal\" DevicePath \"\"" Jul 09 13:54:15.237324 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:15.237281 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x74vh\" (UniqueName: \"kubernetes.io/projected/86604d61-93ca-46bd-87c4-fb79325fd56d-kube-api-access-x74vh\") on node \"ip-10-0-143-92.ec2.internal\" DevicePath \"\"" Jul 09 13:54:15.983380 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:15.983284 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f45zzm" event={"ID":"86604d61-93ca-46bd-87c4-fb79325fd56d","Type":"ContainerDied","Data":"d98b1b9061feafe1b44b50970cfbf0b211d908e66d1295681dd72d5d4cb96d97"} Jul 09 13:54:15.983380 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:15.983318 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f45zzm" Jul 09 13:54:15.983380 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:15.983335 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d98b1b9061feafe1b44b50970cfbf0b211d908e66d1295681dd72d5d4cb96d97" Jul 09 13:54:19.993675 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:19.993640 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-62v8w"] Jul 09 13:54:19.994142 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:19.993936 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86604d61-93ca-46bd-87c4-fb79325fd56d" containerName="util" Jul 09 13:54:19.994142 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:19.993947 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="86604d61-93ca-46bd-87c4-fb79325fd56d" containerName="util" Jul 09 13:54:19.994142 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:19.993956 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86604d61-93ca-46bd-87c4-fb79325fd56d" containerName="pull" Jul 09 13:54:19.994142 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:19.993963 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="86604d61-93ca-46bd-87c4-fb79325fd56d" containerName="pull" Jul 09 13:54:19.994142 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:19.993978 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86604d61-93ca-46bd-87c4-fb79325fd56d" containerName="extract" Jul 09 13:54:19.994142 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:19.993983 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="86604d61-93ca-46bd-87c4-fb79325fd56d" containerName="extract" Jul 09 13:54:19.994142 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:19.994039 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="86604d61-93ca-46bd-87c4-fb79325fd56d" containerName="extract" Jul 09 13:54:20.057328 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:20.057292 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-62v8w"] Jul 09 13:54:20.057485 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:20.057396 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-62v8w" Jul 09 13:54:20.059894 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:20.059866 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 09 13:54:20.060518 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:20.060497 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-6jk6n\"" Jul 09 13:54:20.060518 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:20.060522 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 09 13:54:20.079072 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:20.079045 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p57l\" (UniqueName: \"kubernetes.io/projected/062731ec-ac8d-49ec-b5e6-25ee5d0dce78-kube-api-access-9p57l\") pod \"openshift-lws-operator-fd8ccff4c-62v8w\" (UID: \"062731ec-ac8d-49ec-b5e6-25ee5d0dce78\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-62v8w" Jul 09 13:54:20.079201 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:20.079126 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/062731ec-ac8d-49ec-b5e6-25ee5d0dce78-tmp\") pod \"openshift-lws-operator-fd8ccff4c-62v8w\" (UID: \"062731ec-ac8d-49ec-b5e6-25ee5d0dce78\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-62v8w" Jul 09 13:54:20.180139 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:20.180101 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p57l\" (UniqueName: \"kubernetes.io/projected/062731ec-ac8d-49ec-b5e6-25ee5d0dce78-kube-api-access-9p57l\") pod \"openshift-lws-operator-fd8ccff4c-62v8w\" (UID: \"062731ec-ac8d-49ec-b5e6-25ee5d0dce78\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-62v8w" Jul 09 13:54:20.180303 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:20.180217 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/062731ec-ac8d-49ec-b5e6-25ee5d0dce78-tmp\") pod \"openshift-lws-operator-fd8ccff4c-62v8w\" (UID: \"062731ec-ac8d-49ec-b5e6-25ee5d0dce78\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-62v8w" Jul 09 13:54:20.180604 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:20.180586 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/062731ec-ac8d-49ec-b5e6-25ee5d0dce78-tmp\") pod \"openshift-lws-operator-fd8ccff4c-62v8w\" (UID: \"062731ec-ac8d-49ec-b5e6-25ee5d0dce78\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-62v8w" Jul 09 13:54:20.193037 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:20.193007 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p57l\" (UniqueName: \"kubernetes.io/projected/062731ec-ac8d-49ec-b5e6-25ee5d0dce78-kube-api-access-9p57l\") pod \"openshift-lws-operator-fd8ccff4c-62v8w\" (UID: \"062731ec-ac8d-49ec-b5e6-25ee5d0dce78\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-62v8w" Jul 09 13:54:20.367560 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:20.367526 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-62v8w" Jul 09 13:54:20.526004 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:20.525929 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-62v8w"] Jul 09 13:54:20.528592 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:54:20.528566 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod062731ec_ac8d_49ec_b5e6_25ee5d0dce78.slice/crio-abf03c3d63bb2d0d8e8e18a072fe635cf85fe1cbafc3a4d80174254a2660bbf4 WatchSource:0}: Error finding container abf03c3d63bb2d0d8e8e18a072fe635cf85fe1cbafc3a4d80174254a2660bbf4: Status 404 returned error can't find the container with id abf03c3d63bb2d0d8e8e18a072fe635cf85fe1cbafc3a4d80174254a2660bbf4 Jul 09 13:54:21.005125 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:21.005090 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-62v8w" event={"ID":"062731ec-ac8d-49ec-b5e6-25ee5d0dce78","Type":"ContainerStarted","Data":"abf03c3d63bb2d0d8e8e18a072fe635cf85fe1cbafc3a4d80174254a2660bbf4"} Jul 09 13:54:23.016592 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:23.016546 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-62v8w" event={"ID":"062731ec-ac8d-49ec-b5e6-25ee5d0dce78","Type":"ContainerStarted","Data":"7ba0090cc86a6f2ce5f57358beb117f187a84800931e1271dbc05ab442889421"} Jul 09 13:54:23.033479 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:23.033426 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-62v8w" podStartSLOduration=1.854683488 podStartE2EDuration="4.033407543s" totalImagesPullingTime="2.178724055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:54:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:54:23.032265443 +0000 UTC m=+287.938839669" watchObservedRunningTime="2026-07-09 13:54:23.033407543 +0000 UTC m=+287.939981735" Jul 09 13:54:35.511831 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:35.511145 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tvsqr_c6be1427-c9fa-45b4-a6ca-3aaf2be3513b/console-operator/1.log" Jul 09 13:54:35.516827 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:35.516773 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tvsqr_c6be1427-c9fa-45b4-a6ca-3aaf2be3513b/console-operator/1.log" Jul 09 13:54:35.524578 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:35.524555 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wlg95_fe725cde-9e4a-4b8f-b96e-90fb61415652/ovn-acl-logging/0.log" Jul 09 13:54:35.527905 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:35.527884 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wlg95_fe725cde-9e4a-4b8f-b96e-90fb61415652/ovn-acl-logging/0.log" Jul 09 13:54:35.528475 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:35.528456 2573 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 13:54:42.614601 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:42.614560 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-744bdb4fbc-tfbjg"] Jul 09 13:54:42.616831 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:42.616793 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-744bdb4fbc-tfbjg" Jul 09 13:54:42.619208 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:42.619179 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 09 13:54:42.619382 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:42.619355 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 09 13:54:42.619382 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:42.619364 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 09 13:54:42.619509 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:42.619364 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lj4bc\"" Jul 09 13:54:42.619557 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:42.619526 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 09 13:54:42.639349 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:42.639322 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-744bdb4fbc-tfbjg"] Jul 09 13:54:42.668106 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:42.668076 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/70141934-48d2-4d3c-9425-7260b91ca5b9-webhook-cert\") pod \"opendatahub-operator-controller-manager-744bdb4fbc-tfbjg\" (UID: \"70141934-48d2-4d3c-9425-7260b91ca5b9\") " pod="opendatahub/opendatahub-operator-controller-manager-744bdb4fbc-tfbjg" Jul 09 13:54:42.668284 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:42.668124 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdv67\" (UniqueName: \"kubernetes.io/projected/70141934-48d2-4d3c-9425-7260b91ca5b9-kube-api-access-tdv67\") pod \"opendatahub-operator-controller-manager-744bdb4fbc-tfbjg\" (UID: \"70141934-48d2-4d3c-9425-7260b91ca5b9\") " pod="opendatahub/opendatahub-operator-controller-manager-744bdb4fbc-tfbjg" Jul 09 13:54:42.668284 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:42.668169 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/70141934-48d2-4d3c-9425-7260b91ca5b9-manifests\") pod \"opendatahub-operator-controller-manager-744bdb4fbc-tfbjg\" (UID: \"70141934-48d2-4d3c-9425-7260b91ca5b9\") " pod="opendatahub/opendatahub-operator-controller-manager-744bdb4fbc-tfbjg" Jul 09 13:54:42.668284 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:42.668191 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70141934-48d2-4d3c-9425-7260b91ca5b9-tmp\") pod \"opendatahub-operator-controller-manager-744bdb4fbc-tfbjg\" (UID: \"70141934-48d2-4d3c-9425-7260b91ca5b9\") " pod="opendatahub/opendatahub-operator-controller-manager-744bdb4fbc-tfbjg" Jul 09 13:54:42.668284 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:42.668220 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/70141934-48d2-4d3c-9425-7260b91ca5b9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-744bdb4fbc-tfbjg\" (UID: \"70141934-48d2-4d3c-9425-7260b91ca5b9\") " pod="opendatahub/opendatahub-operator-controller-manager-744bdb4fbc-tfbjg" Jul 09 13:54:42.769457 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:42.769414 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70141934-48d2-4d3c-9425-7260b91ca5b9-tmp\") pod \"opendatahub-operator-controller-manager-744bdb4fbc-tfbjg\" (UID: \"70141934-48d2-4d3c-9425-7260b91ca5b9\") " pod="opendatahub/opendatahub-operator-controller-manager-744bdb4fbc-tfbjg" Jul 09 13:54:42.769637 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:42.769467 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/70141934-48d2-4d3c-9425-7260b91ca5b9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-744bdb4fbc-tfbjg\" (UID: \"70141934-48d2-4d3c-9425-7260b91ca5b9\") " pod="opendatahub/opendatahub-operator-controller-manager-744bdb4fbc-tfbjg" Jul 09 13:54:42.769637 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:42.769513 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/70141934-48d2-4d3c-9425-7260b91ca5b9-webhook-cert\") pod \"opendatahub-operator-controller-manager-744bdb4fbc-tfbjg\" (UID: \"70141934-48d2-4d3c-9425-7260b91ca5b9\") " pod="opendatahub/opendatahub-operator-controller-manager-744bdb4fbc-tfbjg" Jul 09 13:54:42.769637 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:42.769538 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdv67\" (UniqueName: \"kubernetes.io/projected/70141934-48d2-4d3c-9425-7260b91ca5b9-kube-api-access-tdv67\") pod \"opendatahub-operator-controller-manager-744bdb4fbc-tfbjg\" (UID: \"70141934-48d2-4d3c-9425-7260b91ca5b9\") " pod="opendatahub/opendatahub-operator-controller-manager-744bdb4fbc-tfbjg" Jul 09 13:54:42.769776 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:42.769634 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/70141934-48d2-4d3c-9425-7260b91ca5b9-manifests\") pod \"opendatahub-operator-controller-manager-744bdb4fbc-tfbjg\" (UID: \"70141934-48d2-4d3c-9425-7260b91ca5b9\") " pod="opendatahub/opendatahub-operator-controller-manager-744bdb4fbc-tfbjg" Jul 09 13:54:42.770011 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:42.769986 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/70141934-48d2-4d3c-9425-7260b91ca5b9-manifests\") pod \"opendatahub-operator-controller-manager-744bdb4fbc-tfbjg\" (UID: \"70141934-48d2-4d3c-9425-7260b91ca5b9\") " pod="opendatahub/opendatahub-operator-controller-manager-744bdb4fbc-tfbjg" Jul 09 13:54:42.771887 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:42.771854 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70141934-48d2-4d3c-9425-7260b91ca5b9-tmp\") pod \"opendatahub-operator-controller-manager-744bdb4fbc-tfbjg\" (UID: \"70141934-48d2-4d3c-9425-7260b91ca5b9\") " pod="opendatahub/opendatahub-operator-controller-manager-744bdb4fbc-tfbjg" Jul 09 13:54:42.772156 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:42.772134 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/70141934-48d2-4d3c-9425-7260b91ca5b9-webhook-cert\") pod \"opendatahub-operator-controller-manager-744bdb4fbc-tfbjg\" (UID: \"70141934-48d2-4d3c-9425-7260b91ca5b9\") " pod="opendatahub/opendatahub-operator-controller-manager-744bdb4fbc-tfbjg" Jul 09 13:54:42.772245 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:42.772225 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/70141934-48d2-4d3c-9425-7260b91ca5b9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-744bdb4fbc-tfbjg\" (UID: \"70141934-48d2-4d3c-9425-7260b91ca5b9\") " pod="opendatahub/opendatahub-operator-controller-manager-744bdb4fbc-tfbjg" Jul 09 13:54:42.783925 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:42.783901 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdv67\" (UniqueName: \"kubernetes.io/projected/70141934-48d2-4d3c-9425-7260b91ca5b9-kube-api-access-tdv67\") pod \"opendatahub-operator-controller-manager-744bdb4fbc-tfbjg\" (UID: \"70141934-48d2-4d3c-9425-7260b91ca5b9\") " pod="opendatahub/opendatahub-operator-controller-manager-744bdb4fbc-tfbjg" Jul 09 13:54:42.927548 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:42.927467 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-744bdb4fbc-tfbjg" Jul 09 13:54:43.068865 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:43.068836 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-744bdb4fbc-tfbjg"] Jul 09 13:54:43.070048 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:54:43.070020 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70141934_48d2_4d3c_9425_7260b91ca5b9.slice/crio-3be91cb21b2f1a4eb2c49fb98229707dcb97a115973213dc21c981f2d9eb584a WatchSource:0}: Error finding container 3be91cb21b2f1a4eb2c49fb98229707dcb97a115973213dc21c981f2d9eb584a: Status 404 returned error can't find the container with id 3be91cb21b2f1a4eb2c49fb98229707dcb97a115973213dc21c981f2d9eb584a Jul 09 13:54:43.071983 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:43.071967 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 13:54:43.100688 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:43.100655 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-744bdb4fbc-tfbjg" event={"ID":"70141934-48d2-4d3c-9425-7260b91ca5b9","Type":"ContainerStarted","Data":"3be91cb21b2f1a4eb2c49fb98229707dcb97a115973213dc21c981f2d9eb584a"} Jul 09 13:54:46.117695 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:46.117651 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-744bdb4fbc-tfbjg" event={"ID":"70141934-48d2-4d3c-9425-7260b91ca5b9","Type":"ContainerStarted","Data":"c3af5221f4f7e5add482eb22a772e917612019a4d48a5ad643440569e40b4ae6"} Jul 09 13:54:47.124489 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:47.124447 2573 generic.go:356] "Generic (PLEG): container finished" podID="70141934-48d2-4d3c-9425-7260b91ca5b9" containerID="c3af5221f4f7e5add482eb22a772e917612019a4d48a5ad643440569e40b4ae6" exitCode=0 Jul 09 13:54:47.124891 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:47.124504 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-744bdb4fbc-tfbjg" event={"ID":"70141934-48d2-4d3c-9425-7260b91ca5b9","Type":"ContainerDied","Data":"c3af5221f4f7e5add482eb22a772e917612019a4d48a5ad643440569e40b4ae6"} Jul 09 13:54:48.131794 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:48.131760 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-744bdb4fbc-tfbjg" event={"ID":"70141934-48d2-4d3c-9425-7260b91ca5b9","Type":"ContainerStarted","Data":"52278d4dbf53d86a57595a354301728222e34a51619611b037f1c09b50e4ae57"} Jul 09 13:54:48.132189 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:48.131894 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-744bdb4fbc-tfbjg" Jul 09 13:54:48.152480 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:48.152427 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-744bdb4fbc-tfbjg" podStartSLOduration=1.859378921 podStartE2EDuration="6.152407645s" totalImagesPullingTime="3.274984483s" totalInitContainerRuntime="1.018044241s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:54:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:54:48.150225496 +0000 UTC m=+313.056799689" watchObservedRunningTime="2026-07-09 13:54:48.152407645 +0000 UTC m=+313.058981840" Jul 09 13:54:59.138419 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:54:59.138389 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-744bdb4fbc-tfbjg" Jul 09 13:55:03.056835 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:03.056784 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7bc8bc984f-xrlqm"] Jul 09 13:55:03.060834 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:03.060796 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7bc8bc984f-xrlqm" Jul 09 13:55:03.063140 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:03.063118 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 09 13:55:03.064775 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:03.064757 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 09 13:55:03.064979 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:03.064966 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-sqb7v\"" Jul 09 13:55:03.073301 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:03.073280 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7bc8bc984f-xrlqm"] Jul 09 13:55:03.139861 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:03.139795 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9f3b797-9d64-4842-9ea4-f118df373148-tmp\") pod \"kube-auth-proxy-7bc8bc984f-xrlqm\" (UID: \"d9f3b797-9d64-4842-9ea4-f118df373148\") " pod="openshift-ingress/kube-auth-proxy-7bc8bc984f-xrlqm" Jul 09 13:55:03.140020 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:03.139884 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp24k\" (UniqueName: \"kubernetes.io/projected/d9f3b797-9d64-4842-9ea4-f118df373148-kube-api-access-sp24k\") pod \"kube-auth-proxy-7bc8bc984f-xrlqm\" (UID: \"d9f3b797-9d64-4842-9ea4-f118df373148\") " pod="openshift-ingress/kube-auth-proxy-7bc8bc984f-xrlqm" Jul 09 13:55:03.140020 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:03.139923 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9f3b797-9d64-4842-9ea4-f118df373148-tls-certs\") pod \"kube-auth-proxy-7bc8bc984f-xrlqm\" (UID: \"d9f3b797-9d64-4842-9ea4-f118df373148\") " pod="openshift-ingress/kube-auth-proxy-7bc8bc984f-xrlqm" Jul 09 13:55:03.240976 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:03.240923 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9f3b797-9d64-4842-9ea4-f118df373148-tmp\") pod \"kube-auth-proxy-7bc8bc984f-xrlqm\" (UID: \"d9f3b797-9d64-4842-9ea4-f118df373148\") " pod="openshift-ingress/kube-auth-proxy-7bc8bc984f-xrlqm" Jul 09 13:55:03.240976 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:03.240971 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp24k\" (UniqueName: \"kubernetes.io/projected/d9f3b797-9d64-4842-9ea4-f118df373148-kube-api-access-sp24k\") pod \"kube-auth-proxy-7bc8bc984f-xrlqm\" (UID: \"d9f3b797-9d64-4842-9ea4-f118df373148\") " pod="openshift-ingress/kube-auth-proxy-7bc8bc984f-xrlqm" Jul 09 13:55:03.241237 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:03.240998 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9f3b797-9d64-4842-9ea4-f118df373148-tls-certs\") pod \"kube-auth-proxy-7bc8bc984f-xrlqm\" (UID: \"d9f3b797-9d64-4842-9ea4-f118df373148\") " pod="openshift-ingress/kube-auth-proxy-7bc8bc984f-xrlqm" Jul 09 13:55:03.241237 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:55:03.241143 2573 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 09 13:55:03.241237 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:55:03.241208 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9f3b797-9d64-4842-9ea4-f118df373148-tls-certs podName:d9f3b797-9d64-4842-9ea4-f118df373148 nodeName:}" failed. No retries permitted until 2026-07-09 13:55:03.741190598 +0000 UTC m=+328.647764769 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/d9f3b797-9d64-4842-9ea4-f118df373148-tls-certs") pod "kube-auth-proxy-7bc8bc984f-xrlqm" (UID: "d9f3b797-9d64-4842-9ea4-f118df373148") : secret "kube-auth-proxy-tls" not found Jul 09 13:55:03.243482 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:03.243450 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9f3b797-9d64-4842-9ea4-f118df373148-tmp\") pod \"kube-auth-proxy-7bc8bc984f-xrlqm\" (UID: \"d9f3b797-9d64-4842-9ea4-f118df373148\") " pod="openshift-ingress/kube-auth-proxy-7bc8bc984f-xrlqm" Jul 09 13:55:03.253642 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:03.253615 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp24k\" (UniqueName: \"kubernetes.io/projected/d9f3b797-9d64-4842-9ea4-f118df373148-kube-api-access-sp24k\") pod \"kube-auth-proxy-7bc8bc984f-xrlqm\" (UID: \"d9f3b797-9d64-4842-9ea4-f118df373148\") " pod="openshift-ingress/kube-auth-proxy-7bc8bc984f-xrlqm" Jul 09 13:55:03.563851 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:03.563799 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-n5c4n"] Jul 09 13:55:03.567351 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:03.567329 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-n5c4n" Jul 09 13:55:03.570840 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:03.570799 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 09 13:55:03.571183 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:03.570896 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-ww4w7\"" Jul 09 13:55:03.627208 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:03.627175 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-n5c4n"] Jul 09 13:55:03.745821 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:03.745765 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6wk5\" (UniqueName: \"kubernetes.io/projected/991de508-49b7-4534-a574-c766515a33b1-kube-api-access-g6wk5\") pod \"odh-model-controller-7998c67dc4-n5c4n\" (UID: \"991de508-49b7-4534-a574-c766515a33b1\") " pod="opendatahub/odh-model-controller-7998c67dc4-n5c4n" Jul 09 13:55:03.746011 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:03.745872 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/991de508-49b7-4534-a574-c766515a33b1-cert\") pod \"odh-model-controller-7998c67dc4-n5c4n\" (UID: \"991de508-49b7-4534-a574-c766515a33b1\") " pod="opendatahub/odh-model-controller-7998c67dc4-n5c4n" Jul 09 13:55:03.746094 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:03.746065 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9f3b797-9d64-4842-9ea4-f118df373148-tls-certs\") pod \"kube-auth-proxy-7bc8bc984f-xrlqm\" (UID: \"d9f3b797-9d64-4842-9ea4-f118df373148\") " pod="openshift-ingress/kube-auth-proxy-7bc8bc984f-xrlqm" Jul 09 13:55:03.748665 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:03.748641 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9f3b797-9d64-4842-9ea4-f118df373148-tls-certs\") pod \"kube-auth-proxy-7bc8bc984f-xrlqm\" (UID: \"d9f3b797-9d64-4842-9ea4-f118df373148\") " pod="openshift-ingress/kube-auth-proxy-7bc8bc984f-xrlqm" Jul 09 13:55:03.847330 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:03.847233 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6wk5\" (UniqueName: \"kubernetes.io/projected/991de508-49b7-4534-a574-c766515a33b1-kube-api-access-g6wk5\") pod \"odh-model-controller-7998c67dc4-n5c4n\" (UID: \"991de508-49b7-4534-a574-c766515a33b1\") " pod="opendatahub/odh-model-controller-7998c67dc4-n5c4n" Jul 09 13:55:03.847330 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:03.847284 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/991de508-49b7-4534-a574-c766515a33b1-cert\") pod \"odh-model-controller-7998c67dc4-n5c4n\" (UID: \"991de508-49b7-4534-a574-c766515a33b1\") " pod="opendatahub/odh-model-controller-7998c67dc4-n5c4n" Jul 09 13:55:03.847525 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:55:03.847377 2573 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 09 13:55:03.847525 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:55:03.847445 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/991de508-49b7-4534-a574-c766515a33b1-cert podName:991de508-49b7-4534-a574-c766515a33b1 nodeName:}" failed. No retries permitted until 2026-07-09 13:55:04.347428397 +0000 UTC m=+329.254002569 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/991de508-49b7-4534-a574-c766515a33b1-cert") pod "odh-model-controller-7998c67dc4-n5c4n" (UID: "991de508-49b7-4534-a574-c766515a33b1") : secret "odh-model-controller-webhook-cert" not found Jul 09 13:55:03.857376 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:03.857339 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6wk5\" (UniqueName: \"kubernetes.io/projected/991de508-49b7-4534-a574-c766515a33b1-kube-api-access-g6wk5\") pod \"odh-model-controller-7998c67dc4-n5c4n\" (UID: \"991de508-49b7-4534-a574-c766515a33b1\") " pod="opendatahub/odh-model-controller-7998c67dc4-n5c4n" Jul 09 13:55:03.970348 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:03.970309 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7bc8bc984f-xrlqm" Jul 09 13:55:04.116430 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.116336 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7bc8bc984f-xrlqm"] Jul 09 13:55:04.120233 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:55:04.120204 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9f3b797_9d64_4842_9ea4_f118df373148.slice/crio-ef60674f66c4f331968e435c1c8799574b687cc52521559cd9e352f162a4ccc7 WatchSource:0}: Error finding container ef60674f66c4f331968e435c1c8799574b687cc52521559cd9e352f162a4ccc7: Status 404 returned error can't find the container with id ef60674f66c4f331968e435c1c8799574b687cc52521559cd9e352f162a4ccc7 Jul 09 13:55:04.225226 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.225183 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7bc8bc984f-xrlqm" event={"ID":"d9f3b797-9d64-4842-9ea4-f118df373148","Type":"ContainerStarted","Data":"ef60674f66c4f331968e435c1c8799574b687cc52521559cd9e352f162a4ccc7"} Jul 09 13:55:04.352748 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.352710 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/991de508-49b7-4534-a574-c766515a33b1-cert\") pod \"odh-model-controller-7998c67dc4-n5c4n\" (UID: \"991de508-49b7-4534-a574-c766515a33b1\") " pod="opendatahub/odh-model-controller-7998c67dc4-n5c4n" Jul 09 13:55:04.355408 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.355379 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/991de508-49b7-4534-a574-c766515a33b1-cert\") pod \"odh-model-controller-7998c67dc4-n5c4n\" (UID: \"991de508-49b7-4534-a574-c766515a33b1\") " pod="opendatahub/odh-model-controller-7998c67dc4-n5c4n" Jul 09 13:55:04.486150 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.486049 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-n5c4n" Jul 09 13:55:04.549841 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.549702 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gx9fr"] Jul 09 13:55:04.554022 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.553999 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-gx9fr" Jul 09 13:55:04.558184 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.558160 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-v4c2z\"" Jul 09 13:55:04.558836 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.558796 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 09 13:55:04.569423 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.569350 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gx9fr"] Jul 09 13:55:04.655556 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.655520 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzr25\" (UniqueName: \"kubernetes.io/projected/f9ca3e65-a70d-43ab-aa3e-50735275898a-kube-api-access-hzr25\") pod \"model-serving-api-54d89bd5fc-gx9fr\" (UID: \"f9ca3e65-a70d-43ab-aa3e-50735275898a\") " pod="opendatahub/model-serving-api-54d89bd5fc-gx9fr" Jul 09 13:55:04.655732 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.655583 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9ca3e65-a70d-43ab-aa3e-50735275898a-tls-certs\") pod \"model-serving-api-54d89bd5fc-gx9fr\" (UID: \"f9ca3e65-a70d-43ab-aa3e-50735275898a\") " pod="opendatahub/model-serving-api-54d89bd5fc-gx9fr" Jul 09 13:55:04.660775 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.660713 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-n5c4n"] Jul 09 13:55:04.663559 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:55:04.663530 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod991de508_49b7_4534_a574_c766515a33b1.slice/crio-a72cce32394b6552d412c4fcf65ca73ff345187995a913525fbd36ece4d905e5 WatchSource:0}: Error finding container a72cce32394b6552d412c4fcf65ca73ff345187995a913525fbd36ece4d905e5: Status 404 returned error can't find the container with id a72cce32394b6552d412c4fcf65ca73ff345187995a913525fbd36ece4d905e5 Jul 09 13:55:04.670097 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.670070 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-6n56f"] Jul 09 13:55:04.673322 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.673303 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6n56f" Jul 09 13:55:04.677086 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.676238 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 09 13:55:04.677086 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.676494 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-kwlwp\"" Jul 09 13:55:04.677086 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.676651 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 09 13:55:04.677086 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.676839 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 09 13:55:04.677086 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.676978 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 09 13:55:04.688066 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.688035 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-6n56f"] Jul 09 13:55:04.756359 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.756322 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0b277253-dd6a-4edb-8be9-0fd2dbfc40be-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-6n56f\" (UID: \"0b277253-dd6a-4edb-8be9-0fd2dbfc40be\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6n56f" Jul 09 13:55:04.756529 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.756381 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzr25\" (UniqueName: \"kubernetes.io/projected/f9ca3e65-a70d-43ab-aa3e-50735275898a-kube-api-access-hzr25\") pod \"model-serving-api-54d89bd5fc-gx9fr\" (UID: \"f9ca3e65-a70d-43ab-aa3e-50735275898a\") " pod="opendatahub/model-serving-api-54d89bd5fc-gx9fr" Jul 09 13:55:04.756529 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.756473 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0b277253-dd6a-4edb-8be9-0fd2dbfc40be-cacerts\") pod \"istiod-openshift-gateway-7574459656-6n56f\" (UID: \"0b277253-dd6a-4edb-8be9-0fd2dbfc40be\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6n56f" Jul 09 13:55:04.756529 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.756522 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9ca3e65-a70d-43ab-aa3e-50735275898a-tls-certs\") pod \"model-serving-api-54d89bd5fc-gx9fr\" (UID: \"f9ca3e65-a70d-43ab-aa3e-50735275898a\") " pod="opendatahub/model-serving-api-54d89bd5fc-gx9fr" Jul 09 13:55:04.756676 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.756555 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0b277253-dd6a-4edb-8be9-0fd2dbfc40be-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-6n56f\" (UID: \"0b277253-dd6a-4edb-8be9-0fd2dbfc40be\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6n56f" Jul 09 13:55:04.756676 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.756581 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b277253-dd6a-4edb-8be9-0fd2dbfc40be-local-certs\") pod \"istiod-openshift-gateway-7574459656-6n56f\" (UID: \"0b277253-dd6a-4edb-8be9-0fd2dbfc40be\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6n56f" Jul 09 13:55:04.756676 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.756623 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqgtn\" (UniqueName: \"kubernetes.io/projected/0b277253-dd6a-4edb-8be9-0fd2dbfc40be-kube-api-access-nqgtn\") pod \"istiod-openshift-gateway-7574459656-6n56f\" (UID: \"0b277253-dd6a-4edb-8be9-0fd2dbfc40be\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6n56f" Jul 09 13:55:04.756676 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:55:04.756649 2573 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 09 13:55:04.756866 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.756715 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0b277253-dd6a-4edb-8be9-0fd2dbfc40be-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-6n56f\" (UID: \"0b277253-dd6a-4edb-8be9-0fd2dbfc40be\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6n56f" Jul 09 13:55:04.756866 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:55:04.756737 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9ca3e65-a70d-43ab-aa3e-50735275898a-tls-certs podName:f9ca3e65-a70d-43ab-aa3e-50735275898a nodeName:}" failed. No retries permitted until 2026-07-09 13:55:05.256715335 +0000 UTC m=+330.163289507 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/f9ca3e65-a70d-43ab-aa3e-50735275898a-tls-certs") pod "model-serving-api-54d89bd5fc-gx9fr" (UID: "f9ca3e65-a70d-43ab-aa3e-50735275898a") : secret "model-serving-api-tls" not found Jul 09 13:55:04.756866 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.756782 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b277253-dd6a-4edb-8be9-0fd2dbfc40be-istio-token\") pod \"istiod-openshift-gateway-7574459656-6n56f\" (UID: \"0b277253-dd6a-4edb-8be9-0fd2dbfc40be\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6n56f" Jul 09 13:55:04.765125 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.765098 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzr25\" (UniqueName: \"kubernetes.io/projected/f9ca3e65-a70d-43ab-aa3e-50735275898a-kube-api-access-hzr25\") pod \"model-serving-api-54d89bd5fc-gx9fr\" (UID: \"f9ca3e65-a70d-43ab-aa3e-50735275898a\") " pod="opendatahub/model-serving-api-54d89bd5fc-gx9fr" Jul 09 13:55:04.857308 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.857270 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0b277253-dd6a-4edb-8be9-0fd2dbfc40be-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-6n56f\" (UID: \"0b277253-dd6a-4edb-8be9-0fd2dbfc40be\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6n56f" Jul 09 13:55:04.857529 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.857368 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0b277253-dd6a-4edb-8be9-0fd2dbfc40be-cacerts\") pod \"istiod-openshift-gateway-7574459656-6n56f\" (UID: \"0b277253-dd6a-4edb-8be9-0fd2dbfc40be\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6n56f" Jul 09 13:55:04.857529 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.857434 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0b277253-dd6a-4edb-8be9-0fd2dbfc40be-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-6n56f\" (UID: \"0b277253-dd6a-4edb-8be9-0fd2dbfc40be\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6n56f" Jul 09 13:55:04.857529 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.857468 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b277253-dd6a-4edb-8be9-0fd2dbfc40be-local-certs\") pod \"istiod-openshift-gateway-7574459656-6n56f\" (UID: \"0b277253-dd6a-4edb-8be9-0fd2dbfc40be\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6n56f" Jul 09 13:55:04.857529 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.857501 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqgtn\" (UniqueName: \"kubernetes.io/projected/0b277253-dd6a-4edb-8be9-0fd2dbfc40be-kube-api-access-nqgtn\") pod \"istiod-openshift-gateway-7574459656-6n56f\" (UID: \"0b277253-dd6a-4edb-8be9-0fd2dbfc40be\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6n56f" Jul 09 13:55:04.857794 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.857773 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0b277253-dd6a-4edb-8be9-0fd2dbfc40be-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-6n56f\" (UID: \"0b277253-dd6a-4edb-8be9-0fd2dbfc40be\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6n56f" Jul 09 13:55:04.857976 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.857953 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b277253-dd6a-4edb-8be9-0fd2dbfc40be-istio-token\") pod \"istiod-openshift-gateway-7574459656-6n56f\" (UID: \"0b277253-dd6a-4edb-8be9-0fd2dbfc40be\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6n56f" Jul 09 13:55:04.858400 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.858370 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0b277253-dd6a-4edb-8be9-0fd2dbfc40be-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-6n56f\" (UID: \"0b277253-dd6a-4edb-8be9-0fd2dbfc40be\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6n56f" Jul 09 13:55:04.860076 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.860050 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0b277253-dd6a-4edb-8be9-0fd2dbfc40be-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-6n56f\" (UID: \"0b277253-dd6a-4edb-8be9-0fd2dbfc40be\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6n56f" Jul 09 13:55:04.860342 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.860322 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b277253-dd6a-4edb-8be9-0fd2dbfc40be-local-certs\") pod \"istiod-openshift-gateway-7574459656-6n56f\" (UID: \"0b277253-dd6a-4edb-8be9-0fd2dbfc40be\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6n56f" Jul 09 13:55:04.860571 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.860548 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0b277253-dd6a-4edb-8be9-0fd2dbfc40be-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-6n56f\" (UID: \"0b277253-dd6a-4edb-8be9-0fd2dbfc40be\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6n56f" Jul 09 13:55:04.860606 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.860549 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0b277253-dd6a-4edb-8be9-0fd2dbfc40be-cacerts\") pod \"istiod-openshift-gateway-7574459656-6n56f\" (UID: \"0b277253-dd6a-4edb-8be9-0fd2dbfc40be\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6n56f" Jul 09 13:55:04.867056 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.867025 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b277253-dd6a-4edb-8be9-0fd2dbfc40be-istio-token\") pod \"istiod-openshift-gateway-7574459656-6n56f\" (UID: \"0b277253-dd6a-4edb-8be9-0fd2dbfc40be\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6n56f" Jul 09 13:55:04.867194 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.867171 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqgtn\" (UniqueName: \"kubernetes.io/projected/0b277253-dd6a-4edb-8be9-0fd2dbfc40be-kube-api-access-nqgtn\") pod \"istiod-openshift-gateway-7574459656-6n56f\" (UID: \"0b277253-dd6a-4edb-8be9-0fd2dbfc40be\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6n56f" Jul 09 13:55:04.985878 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:04.985827 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6n56f" Jul 09 13:55:05.150108 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:05.149953 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-6n56f"] Jul 09 13:55:05.153108 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:55:05.153056 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b277253_dd6a_4edb_8be9_0fd2dbfc40be.slice/crio-5e1404dd13a4f8209f089c24d40c95631652ca8329eac3f90c3a80552a70509a WatchSource:0}: Error finding container 5e1404dd13a4f8209f089c24d40c95631652ca8329eac3f90c3a80552a70509a: Status 404 returned error can't find the container with id 5e1404dd13a4f8209f089c24d40c95631652ca8329eac3f90c3a80552a70509a Jul 09 13:55:05.232464 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:05.232422 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-n5c4n" event={"ID":"991de508-49b7-4534-a574-c766515a33b1","Type":"ContainerStarted","Data":"a72cce32394b6552d412c4fcf65ca73ff345187995a913525fbd36ece4d905e5"} Jul 09 13:55:05.234075 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:05.234037 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6n56f" event={"ID":"0b277253-dd6a-4edb-8be9-0fd2dbfc40be","Type":"ContainerStarted","Data":"5e1404dd13a4f8209f089c24d40c95631652ca8329eac3f90c3a80552a70509a"} Jul 09 13:55:05.262643 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:05.262603 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9ca3e65-a70d-43ab-aa3e-50735275898a-tls-certs\") pod \"model-serving-api-54d89bd5fc-gx9fr\" (UID: \"f9ca3e65-a70d-43ab-aa3e-50735275898a\") " pod="opendatahub/model-serving-api-54d89bd5fc-gx9fr" Jul 09 13:55:05.265681 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:05.265643 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9ca3e65-a70d-43ab-aa3e-50735275898a-tls-certs\") pod \"model-serving-api-54d89bd5fc-gx9fr\" (UID: \"f9ca3e65-a70d-43ab-aa3e-50735275898a\") " pod="opendatahub/model-serving-api-54d89bd5fc-gx9fr" Jul 09 13:55:05.470566 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:05.470473 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-gx9fr" Jul 09 13:55:05.622746 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:05.622719 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gx9fr"] Jul 09 13:55:05.625826 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:55:05.625778 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9ca3e65_a70d_43ab_aa3e_50735275898a.slice/crio-d53767cf977b166598e8af2ac63059e647bee8a686bd034d7358b25bf88c96e7 WatchSource:0}: Error finding container d53767cf977b166598e8af2ac63059e647bee8a686bd034d7358b25bf88c96e7: Status 404 returned error can't find the container with id d53767cf977b166598e8af2ac63059e647bee8a686bd034d7358b25bf88c96e7 Jul 09 13:55:06.244368 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:06.244323 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-gx9fr" event={"ID":"f9ca3e65-a70d-43ab-aa3e-50735275898a","Type":"ContainerStarted","Data":"d53767cf977b166598e8af2ac63059e647bee8a686bd034d7358b25bf88c96e7"} Jul 09 13:55:10.263031 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:10.262982 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 09 13:55:10.263455 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:10.263073 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 09 13:55:11.276115 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:11.276070 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-n5c4n" event={"ID":"991de508-49b7-4534-a574-c766515a33b1","Type":"ContainerStarted","Data":"2d45a5ed7760547b5341a3128867195816f19628efe99dbd9234bf95970a5cae"} Jul 09 13:55:11.276587 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:11.276148 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-n5c4n" Jul 09 13:55:11.277900 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:11.277874 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6n56f" event={"ID":"0b277253-dd6a-4edb-8be9-0fd2dbfc40be","Type":"ContainerStarted","Data":"71eaf099b5351253676661326c5496a9eb0b677735b5f8fa1e833053fb48cfb4"} Jul 09 13:55:11.278022 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:11.277917 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6n56f" Jul 09 13:55:11.279961 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:11.279918 2573 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-6n56f container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 09 13:55:11.280122 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:11.279980 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6n56f" podUID="0b277253-dd6a-4edb-8be9-0fd2dbfc40be" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 13:55:11.280122 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:11.280038 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-gx9fr" event={"ID":"f9ca3e65-a70d-43ab-aa3e-50735275898a","Type":"ContainerStarted","Data":"1b4c329fcdd9d1c15ad48eb207d784cb4aca10171a93411cd9efed57d0139273"} Jul 09 13:55:11.280122 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:11.280099 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-gx9fr" Jul 09 13:55:11.281588 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:11.281566 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7bc8bc984f-xrlqm" event={"ID":"d9f3b797-9d64-4842-9ea4-f118df373148","Type":"ContainerStarted","Data":"cc489a16354e5599d82cf052b6c944b5790c2a7018aa20fec2cc80c820e6ac1c"} Jul 09 13:55:11.311412 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:11.311361 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-n5c4n" podStartSLOduration=2.719966411 podStartE2EDuration="8.311346546s" totalImagesPullingTime="5.591380135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:55:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:55:11.310114903 +0000 UTC m=+336.216689098" watchObservedRunningTime="2026-07-09 13:55:11.311346546 +0000 UTC m=+336.217920761" Jul 09 13:55:11.358236 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:11.358184 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7bc8bc984f-xrlqm" podStartSLOduration=2.2876404839999998 podStartE2EDuration="8.35816581s" totalImagesPullingTime="6.070525326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:55:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:55:11.357328976 +0000 UTC m=+336.263903197" watchObservedRunningTime="2026-07-09 13:55:11.35816581 +0000 UTC m=+336.264740002" Jul 09 13:55:11.387229 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:11.387170 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-gx9fr" podStartSLOduration=2.7500828889999998 podStartE2EDuration="7.387146162s" totalImagesPullingTime="4.637063273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:55:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:55:11.38411852 +0000 UTC m=+336.290692734" watchObservedRunningTime="2026-07-09 13:55:11.387146162 +0000 UTC m=+336.293720356" Jul 09 13:55:11.411405 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:11.411034 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6n56f" podStartSLOduration=2.304027755 podStartE2EDuration="7.411001154s" totalImagesPullingTime="5.106973399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:55:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:55:11.409782186 +0000 UTC m=+336.316356416" watchObservedRunningTime="2026-07-09 13:55:11.411001154 +0000 UTC m=+336.317575350" Jul 09 13:55:12.287219 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:12.287190 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6n56f" Jul 09 13:55:14.886445 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:14.886409 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-982m6"] Jul 09 13:55:14.890489 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:14.890470 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-982m6" Jul 09 13:55:14.892961 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:14.892938 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 09 13:55:14.894188 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:14.894172 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-lrpms\"" Jul 09 13:55:14.907146 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:14.907120 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-dx7v9"] Jul 09 13:55:14.911578 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:14.911321 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-982m6"] Jul 09 13:55:14.911578 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:14.911453 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dx7v9" Jul 09 13:55:14.914748 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:14.914730 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 09 13:55:14.914893 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:14.914779 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-cqfx6\"" Jul 09 13:55:14.925057 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:14.925031 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-dx7v9"] Jul 09 13:55:14.952057 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:14.952028 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78836108-c50f-4386-a1c4-63bdf5dff34e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dx7v9\" (UID: \"78836108-c50f-4386-a1c4-63bdf5dff34e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dx7v9" Jul 09 13:55:14.952252 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:14.952106 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfb5t\" (UniqueName: \"kubernetes.io/projected/78836108-c50f-4386-a1c4-63bdf5dff34e-kube-api-access-hfb5t\") pod \"llmisvc-controller-manager-777c6bd7d5-dx7v9\" (UID: \"78836108-c50f-4386-a1c4-63bdf5dff34e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dx7v9" Jul 09 13:55:15.053284 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:15.053247 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9924a967-2103-4b7c-acf4-28f56eabee1e-cert\") pod \"kserve-controller-manager-d6f4b65b8-982m6\" (UID: \"9924a967-2103-4b7c-acf4-28f56eabee1e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-982m6" Jul 09 13:55:15.053466 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:15.053301 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfb5t\" (UniqueName: \"kubernetes.io/projected/78836108-c50f-4386-a1c4-63bdf5dff34e-kube-api-access-hfb5t\") pod \"llmisvc-controller-manager-777c6bd7d5-dx7v9\" (UID: \"78836108-c50f-4386-a1c4-63bdf5dff34e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dx7v9" Jul 09 13:55:15.053466 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:15.053366 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2wdv\" (UniqueName: \"kubernetes.io/projected/9924a967-2103-4b7c-acf4-28f56eabee1e-kube-api-access-p2wdv\") pod \"kserve-controller-manager-d6f4b65b8-982m6\" (UID: \"9924a967-2103-4b7c-acf4-28f56eabee1e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-982m6" Jul 09 13:55:15.053466 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:15.053419 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78836108-c50f-4386-a1c4-63bdf5dff34e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dx7v9\" (UID: \"78836108-c50f-4386-a1c4-63bdf5dff34e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dx7v9" Jul 09 13:55:15.056342 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:15.056315 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78836108-c50f-4386-a1c4-63bdf5dff34e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dx7v9\" (UID: \"78836108-c50f-4386-a1c4-63bdf5dff34e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dx7v9" Jul 09 13:55:15.064095 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:15.064069 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfb5t\" (UniqueName: \"kubernetes.io/projected/78836108-c50f-4386-a1c4-63bdf5dff34e-kube-api-access-hfb5t\") pod \"llmisvc-controller-manager-777c6bd7d5-dx7v9\" (UID: \"78836108-c50f-4386-a1c4-63bdf5dff34e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dx7v9" Jul 09 13:55:15.153963 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:15.153866 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2wdv\" (UniqueName: \"kubernetes.io/projected/9924a967-2103-4b7c-acf4-28f56eabee1e-kube-api-access-p2wdv\") pod \"kserve-controller-manager-d6f4b65b8-982m6\" (UID: \"9924a967-2103-4b7c-acf4-28f56eabee1e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-982m6" Jul 09 13:55:15.153963 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:15.153956 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9924a967-2103-4b7c-acf4-28f56eabee1e-cert\") pod \"kserve-controller-manager-d6f4b65b8-982m6\" (UID: \"9924a967-2103-4b7c-acf4-28f56eabee1e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-982m6" Jul 09 13:55:15.156553 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:15.156527 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9924a967-2103-4b7c-acf4-28f56eabee1e-cert\") pod \"kserve-controller-manager-d6f4b65b8-982m6\" (UID: \"9924a967-2103-4b7c-acf4-28f56eabee1e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-982m6" Jul 09 13:55:15.182185 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:15.182154 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2wdv\" (UniqueName: \"kubernetes.io/projected/9924a967-2103-4b7c-acf4-28f56eabee1e-kube-api-access-p2wdv\") pod \"kserve-controller-manager-d6f4b65b8-982m6\" (UID: \"9924a967-2103-4b7c-acf4-28f56eabee1e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-982m6" Jul 09 13:55:15.201558 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:15.201533 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-982m6" Jul 09 13:55:15.223747 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:15.223710 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dx7v9" Jul 09 13:55:15.435596 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:55:15.435568 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod78836108_c50f_4386_a1c4_63bdf5dff34e.slice/crio-5ec15721bb63da7146bffb1d9092226c549869f53348fb9f9bbe3eecd1187fee WatchSource:0}: Error finding container 5ec15721bb63da7146bffb1d9092226c549869f53348fb9f9bbe3eecd1187fee: Status 404 returned error can't find the container with id 5ec15721bb63da7146bffb1d9092226c549869f53348fb9f9bbe3eecd1187fee Jul 09 13:55:15.438502 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:15.438480 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-dx7v9"] Jul 09 13:55:15.441301 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:55:15.441273 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9924a967_2103_4b7c_acf4_28f56eabee1e.slice/crio-12b94e546ca01f45a36f8883767d598e9c22259d8527004ce3a3c81d4250b65e WatchSource:0}: Error finding container 12b94e546ca01f45a36f8883767d598e9c22259d8527004ce3a3c81d4250b65e: Status 404 returned error can't find the container with id 12b94e546ca01f45a36f8883767d598e9c22259d8527004ce3a3c81d4250b65e Jul 09 13:55:15.441587 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:15.441567 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-982m6"] Jul 09 13:55:16.257189 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:16.257153 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-6n56f"] Jul 09 13:55:16.257631 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:16.257369 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6n56f" podUID="0b277253-dd6a-4edb-8be9-0fd2dbfc40be" containerName="discovery" containerID="cri-o://71eaf099b5351253676661326c5496a9eb0b677735b5f8fa1e833053fb48cfb4" gracePeriod=30 Jul 09 13:55:16.310302 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:16.310263 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dx7v9" event={"ID":"78836108-c50f-4386-a1c4-63bdf5dff34e","Type":"ContainerStarted","Data":"5ec15721bb63da7146bffb1d9092226c549869f53348fb9f9bbe3eecd1187fee"} Jul 09 13:55:16.311702 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:16.311675 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-982m6" event={"ID":"9924a967-2103-4b7c-acf4-28f56eabee1e","Type":"ContainerStarted","Data":"12b94e546ca01f45a36f8883767d598e9c22259d8527004ce3a3c81d4250b65e"} Jul 09 13:55:16.515290 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:16.515201 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6n56f" Jul 09 13:55:16.564007 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:16.563960 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0b277253-dd6a-4edb-8be9-0fd2dbfc40be-istio-csr-dns-cert\") pod \"0b277253-dd6a-4edb-8be9-0fd2dbfc40be\" (UID: \"0b277253-dd6a-4edb-8be9-0fd2dbfc40be\") " Jul 09 13:55:16.564179 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:16.564013 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b277253-dd6a-4edb-8be9-0fd2dbfc40be-istio-token\") pod \"0b277253-dd6a-4edb-8be9-0fd2dbfc40be\" (UID: \"0b277253-dd6a-4edb-8be9-0fd2dbfc40be\") " Jul 09 13:55:16.564248 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:16.564192 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0b277253-dd6a-4edb-8be9-0fd2dbfc40be-istio-csr-ca-configmap\") pod \"0b277253-dd6a-4edb-8be9-0fd2dbfc40be\" (UID: \"0b277253-dd6a-4edb-8be9-0fd2dbfc40be\") " Jul 09 13:55:16.564248 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:16.564239 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b277253-dd6a-4edb-8be9-0fd2dbfc40be-local-certs\") pod \"0b277253-dd6a-4edb-8be9-0fd2dbfc40be\" (UID: \"0b277253-dd6a-4edb-8be9-0fd2dbfc40be\") " Jul 09 13:55:16.564354 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:16.564267 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0b277253-dd6a-4edb-8be9-0fd2dbfc40be-istio-kubeconfig\") pod \"0b277253-dd6a-4edb-8be9-0fd2dbfc40be\" (UID: \"0b277253-dd6a-4edb-8be9-0fd2dbfc40be\") " Jul 09 13:55:16.564354 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:16.564294 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqgtn\" (UniqueName: \"kubernetes.io/projected/0b277253-dd6a-4edb-8be9-0fd2dbfc40be-kube-api-access-nqgtn\") pod \"0b277253-dd6a-4edb-8be9-0fd2dbfc40be\" (UID: \"0b277253-dd6a-4edb-8be9-0fd2dbfc40be\") " Jul 09 13:55:16.564446 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:16.564372 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0b277253-dd6a-4edb-8be9-0fd2dbfc40be-cacerts\") pod \"0b277253-dd6a-4edb-8be9-0fd2dbfc40be\" (UID: \"0b277253-dd6a-4edb-8be9-0fd2dbfc40be\") " Jul 09 13:55:16.565374 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:16.565325 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b277253-dd6a-4edb-8be9-0fd2dbfc40be-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "0b277253-dd6a-4edb-8be9-0fd2dbfc40be" (UID: "0b277253-dd6a-4edb-8be9-0fd2dbfc40be"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 13:55:16.568644 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:16.568608 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b277253-dd6a-4edb-8be9-0fd2dbfc40be-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "0b277253-dd6a-4edb-8be9-0fd2dbfc40be" (UID: "0b277253-dd6a-4edb-8be9-0fd2dbfc40be"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 13:55:16.569004 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:16.568949 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b277253-dd6a-4edb-8be9-0fd2dbfc40be-istio-token" (OuterVolumeSpecName: "istio-token") pod "0b277253-dd6a-4edb-8be9-0fd2dbfc40be" (UID: "0b277253-dd6a-4edb-8be9-0fd2dbfc40be"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 13:55:16.569101 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:16.569080 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b277253-dd6a-4edb-8be9-0fd2dbfc40be-cacerts" (OuterVolumeSpecName: "cacerts") pod "0b277253-dd6a-4edb-8be9-0fd2dbfc40be" (UID: "0b277253-dd6a-4edb-8be9-0fd2dbfc40be"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 13:55:16.569300 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:16.569266 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b277253-dd6a-4edb-8be9-0fd2dbfc40be-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "0b277253-dd6a-4edb-8be9-0fd2dbfc40be" (UID: "0b277253-dd6a-4edb-8be9-0fd2dbfc40be"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 13:55:16.569373 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:16.569313 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b277253-dd6a-4edb-8be9-0fd2dbfc40be-local-certs" (OuterVolumeSpecName: "local-certs") pod "0b277253-dd6a-4edb-8be9-0fd2dbfc40be" (UID: "0b277253-dd6a-4edb-8be9-0fd2dbfc40be"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 13:55:16.569567 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:16.569538 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b277253-dd6a-4edb-8be9-0fd2dbfc40be-kube-api-access-nqgtn" (OuterVolumeSpecName: "kube-api-access-nqgtn") pod "0b277253-dd6a-4edb-8be9-0fd2dbfc40be" (UID: "0b277253-dd6a-4edb-8be9-0fd2dbfc40be"). InnerVolumeSpecName "kube-api-access-nqgtn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 13:55:16.665205 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:16.665158 2573 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0b277253-dd6a-4edb-8be9-0fd2dbfc40be-istio-csr-dns-cert\") on node \"ip-10-0-143-92.ec2.internal\" DevicePath \"\"" Jul 09 13:55:16.665205 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:16.665193 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b277253-dd6a-4edb-8be9-0fd2dbfc40be-istio-token\") on node \"ip-10-0-143-92.ec2.internal\" DevicePath \"\"" Jul 09 13:55:16.665205 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:16.665207 2573 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0b277253-dd6a-4edb-8be9-0fd2dbfc40be-istio-csr-ca-configmap\") on node \"ip-10-0-143-92.ec2.internal\" DevicePath \"\"" Jul 09 13:55:16.665507 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:16.665223 2573 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b277253-dd6a-4edb-8be9-0fd2dbfc40be-local-certs\") on node \"ip-10-0-143-92.ec2.internal\" DevicePath \"\"" Jul 09 13:55:16.665507 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:16.665238 2573 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0b277253-dd6a-4edb-8be9-0fd2dbfc40be-istio-kubeconfig\") on node \"ip-10-0-143-92.ec2.internal\" DevicePath \"\"" Jul 09 13:55:16.665507 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:16.665250 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqgtn\" (UniqueName: \"kubernetes.io/projected/0b277253-dd6a-4edb-8be9-0fd2dbfc40be-kube-api-access-nqgtn\") on node \"ip-10-0-143-92.ec2.internal\" DevicePath \"\"" Jul 09 13:55:16.665507 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:16.665264 2573 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0b277253-dd6a-4edb-8be9-0fd2dbfc40be-cacerts\") on node \"ip-10-0-143-92.ec2.internal\" DevicePath \"\"" Jul 09 13:55:17.320498 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:17.320463 2573 generic.go:356] "Generic (PLEG): container finished" podID="0b277253-dd6a-4edb-8be9-0fd2dbfc40be" containerID="71eaf099b5351253676661326c5496a9eb0b677735b5f8fa1e833053fb48cfb4" exitCode=0 Jul 09 13:55:17.321058 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:17.320545 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6n56f" event={"ID":"0b277253-dd6a-4edb-8be9-0fd2dbfc40be","Type":"ContainerDied","Data":"71eaf099b5351253676661326c5496a9eb0b677735b5f8fa1e833053fb48cfb4"} Jul 09 13:55:17.321058 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:17.320636 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6n56f" event={"ID":"0b277253-dd6a-4edb-8be9-0fd2dbfc40be","Type":"ContainerDied","Data":"5e1404dd13a4f8209f089c24d40c95631652ca8329eac3f90c3a80552a70509a"} Jul 09 13:55:17.321058 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:17.320550 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6n56f" Jul 09 13:55:17.321058 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:17.320664 2573 scope.go:117] "RemoveContainer" containerID="71eaf099b5351253676661326c5496a9eb0b677735b5f8fa1e833053fb48cfb4" Jul 09 13:55:17.355797 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:17.355751 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-6n56f"] Jul 09 13:55:17.367513 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:17.367481 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-6n56f"] Jul 09 13:55:17.462653 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:17.452420 2573 scope.go:117] "RemoveContainer" containerID="71eaf099b5351253676661326c5496a9eb0b677735b5f8fa1e833053fb48cfb4" Jul 09 13:55:17.462653 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:55:17.452879 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71eaf099b5351253676661326c5496a9eb0b677735b5f8fa1e833053fb48cfb4\": container with ID starting with 71eaf099b5351253676661326c5496a9eb0b677735b5f8fa1e833053fb48cfb4 not found: ID does not exist" containerID="71eaf099b5351253676661326c5496a9eb0b677735b5f8fa1e833053fb48cfb4" Jul 09 13:55:17.462653 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:17.452915 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71eaf099b5351253676661326c5496a9eb0b677735b5f8fa1e833053fb48cfb4"} err="failed to get container status \"71eaf099b5351253676661326c5496a9eb0b677735b5f8fa1e833053fb48cfb4\": rpc error: code = NotFound desc = could not find container \"71eaf099b5351253676661326c5496a9eb0b677735b5f8fa1e833053fb48cfb4\": container with ID starting with 71eaf099b5351253676661326c5496a9eb0b677735b5f8fa1e833053fb48cfb4 not found: ID does not exist" Jul 09 13:55:17.613633 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:17.613559 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b277253-dd6a-4edb-8be9-0fd2dbfc40be" path="/var/lib/kubelet/pods/0b277253-dd6a-4edb-8be9-0fd2dbfc40be/volumes" Jul 09 13:55:19.335373 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:19.335332 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-982m6" event={"ID":"9924a967-2103-4b7c-acf4-28f56eabee1e","Type":"ContainerStarted","Data":"6e12b88c5d191822aad05332f9883d50e90ccf192067a2588bf7d98a2bf3b789"} Jul 09 13:55:19.335929 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:19.335412 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-982m6" Jul 09 13:55:19.337180 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:19.337149 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dx7v9" event={"ID":"78836108-c50f-4386-a1c4-63bdf5dff34e","Type":"ContainerStarted","Data":"76adc80c7b1fd9eb9b6c40017e26d436c39359987de51a4c8f510422f13773d9"} Jul 09 13:55:19.337296 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:19.337216 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dx7v9" Jul 09 13:55:19.355169 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:19.355108 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-982m6" podStartSLOduration=1.9985053910000001 podStartE2EDuration="5.355088024s" totalImagesPullingTime="3.356582633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:55:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:55:19.353980779 +0000 UTC m=+344.260554972" watchObservedRunningTime="2026-07-09 13:55:19.355088024 +0000 UTC m=+344.261662218" Jul 09 13:55:19.382708 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:19.382632 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dx7v9" podStartSLOduration=2.017183152 podStartE2EDuration="5.382615504s" totalImagesPullingTime="3.365432352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:55:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:55:19.382056539 +0000 UTC m=+344.288630733" watchObservedRunningTime="2026-07-09 13:55:19.382615504 +0000 UTC m=+344.289189697" Jul 09 13:55:22.289232 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:22.289202 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-n5c4n" Jul 09 13:55:22.291272 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:22.291249 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-gx9fr" Jul 09 13:55:50.344608 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:50.344576 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dx7v9" Jul 09 13:55:50.347399 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:55:50.347375 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-982m6" Jul 09 13:56:04.249582 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:04.249547 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2lfr2"] Jul 09 13:56:04.250038 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:04.249907 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b277253-dd6a-4edb-8be9-0fd2dbfc40be" containerName="discovery" Jul 09 13:56:04.250038 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:04.249919 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b277253-dd6a-4edb-8be9-0fd2dbfc40be" containerName="discovery" Jul 09 13:56:04.250038 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:04.249985 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b277253-dd6a-4edb-8be9-0fd2dbfc40be" containerName="discovery" Jul 09 13:56:04.252205 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:04.252189 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2lfr2" Jul 09 13:56:04.254709 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:04.254686 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 09 13:56:04.255566 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:04.255549 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-vt9vd\"" Jul 09 13:56:04.255632 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:04.255563 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 09 13:56:04.266782 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:04.266753 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2lfr2"] Jul 09 13:56:04.278027 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:04.277999 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwl8g\" (UniqueName: \"kubernetes.io/projected/f7b19de2-790a-457d-b2c0-51ed8629fceb-kube-api-access-rwl8g\") pod \"kuadrant-operator-catalog-2lfr2\" (UID: \"f7b19de2-790a-457d-b2c0-51ed8629fceb\") " pod="kuadrant-system/kuadrant-operator-catalog-2lfr2" Jul 09 13:56:04.378558 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:04.378521 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwl8g\" (UniqueName: \"kubernetes.io/projected/f7b19de2-790a-457d-b2c0-51ed8629fceb-kube-api-access-rwl8g\") pod \"kuadrant-operator-catalog-2lfr2\" (UID: \"f7b19de2-790a-457d-b2c0-51ed8629fceb\") " pod="kuadrant-system/kuadrant-operator-catalog-2lfr2" Jul 09 13:56:04.386393 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:04.386360 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwl8g\" (UniqueName: \"kubernetes.io/projected/f7b19de2-790a-457d-b2c0-51ed8629fceb-kube-api-access-rwl8g\") pod \"kuadrant-operator-catalog-2lfr2\" (UID: \"f7b19de2-790a-457d-b2c0-51ed8629fceb\") " pod="kuadrant-system/kuadrant-operator-catalog-2lfr2" Jul 09 13:56:04.562133 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:04.562104 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2lfr2" Jul 09 13:56:04.605926 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:04.605885 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2lfr2"] Jul 09 13:56:04.691944 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:04.691924 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2lfr2"] Jul 09 13:56:04.696799 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:56:04.694522 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7b19de2_790a_457d_b2c0_51ed8629fceb.slice/crio-622a7335be11758d043915a43da89ea8b263e59e2d8d02494b0086b801999402 WatchSource:0}: Error finding container 622a7335be11758d043915a43da89ea8b263e59e2d8d02494b0086b801999402: Status 404 returned error can't find the container with id 622a7335be11758d043915a43da89ea8b263e59e2d8d02494b0086b801999402 Jul 09 13:56:04.818102 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:04.818008 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kqhr5"] Jul 09 13:56:04.821629 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:04.821605 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kqhr5" Jul 09 13:56:04.829557 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:04.829530 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kqhr5"] Jul 09 13:56:04.881999 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:04.881956 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfcnm\" (UniqueName: \"kubernetes.io/projected/c67d75a3-38b0-4926-8fee-a0371c61cf81-kube-api-access-vfcnm\") pod \"kuadrant-operator-catalog-kqhr5\" (UID: \"c67d75a3-38b0-4926-8fee-a0371c61cf81\") " pod="kuadrant-system/kuadrant-operator-catalog-kqhr5" Jul 09 13:56:04.982990 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:04.982953 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfcnm\" (UniqueName: \"kubernetes.io/projected/c67d75a3-38b0-4926-8fee-a0371c61cf81-kube-api-access-vfcnm\") pod \"kuadrant-operator-catalog-kqhr5\" (UID: \"c67d75a3-38b0-4926-8fee-a0371c61cf81\") " pod="kuadrant-system/kuadrant-operator-catalog-kqhr5" Jul 09 13:56:04.991387 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:04.991352 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfcnm\" (UniqueName: \"kubernetes.io/projected/c67d75a3-38b0-4926-8fee-a0371c61cf81-kube-api-access-vfcnm\") pod \"kuadrant-operator-catalog-kqhr5\" (UID: \"c67d75a3-38b0-4926-8fee-a0371c61cf81\") " pod="kuadrant-system/kuadrant-operator-catalog-kqhr5" Jul 09 13:56:05.132834 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:05.132721 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kqhr5" Jul 09 13:56:05.291838 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:05.291794 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kqhr5"] Jul 09 13:56:05.293795 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:56:05.293768 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc67d75a3_38b0_4926_8fee_a0371c61cf81.slice/crio-be3d2d8cc9c6f65ecb5a981b8e062b3eed1aa39ee0a916893fd92f11f977644e WatchSource:0}: Error finding container be3d2d8cc9c6f65ecb5a981b8e062b3eed1aa39ee0a916893fd92f11f977644e: Status 404 returned error can't find the container with id be3d2d8cc9c6f65ecb5a981b8e062b3eed1aa39ee0a916893fd92f11f977644e Jul 09 13:56:05.554627 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:05.554582 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kqhr5" event={"ID":"c67d75a3-38b0-4926-8fee-a0371c61cf81","Type":"ContainerStarted","Data":"be3d2d8cc9c6f65ecb5a981b8e062b3eed1aa39ee0a916893fd92f11f977644e"} Jul 09 13:56:05.556205 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:05.556176 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2lfr2" event={"ID":"f7b19de2-790a-457d-b2c0-51ed8629fceb","Type":"ContainerStarted","Data":"622a7335be11758d043915a43da89ea8b263e59e2d8d02494b0086b801999402"} Jul 09 13:56:07.569291 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:07.569248 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kqhr5" event={"ID":"c67d75a3-38b0-4926-8fee-a0371c61cf81","Type":"ContainerStarted","Data":"870e1092af1e16b8b272466c55facafa3e3b60d7c43f9bfb58dc25d033684428"} Jul 09 13:56:07.570789 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:07.570765 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2lfr2" event={"ID":"f7b19de2-790a-457d-b2c0-51ed8629fceb","Type":"ContainerStarted","Data":"4bb1ea4111a5caa0d3b35869a10805473de532f4dc894d5abc9a67417203fa0c"} Jul 09 13:56:07.570906 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:07.570841 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-2lfr2" podUID="f7b19de2-790a-457d-b2c0-51ed8629fceb" containerName="registry-server" containerID="cri-o://4bb1ea4111a5caa0d3b35869a10805473de532f4dc894d5abc9a67417203fa0c" gracePeriod=2 Jul 09 13:56:07.584850 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:07.584792 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-kqhr5" podStartSLOduration=2.165011281 podStartE2EDuration="3.584777203s" totalImagesPullingTime="1.419765922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:56:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:56:07.583684661 +0000 UTC m=+392.490258855" watchObservedRunningTime="2026-07-09 13:56:07.584777203 +0000 UTC m=+392.491351387" Jul 09 13:56:07.598412 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:07.598369 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-2lfr2" podStartSLOduration=1.578109328 podStartE2EDuration="3.598355906s" totalImagesPullingTime="2.020246578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:56:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:56:07.597070655 +0000 UTC m=+392.503644847" watchObservedRunningTime="2026-07-09 13:56:07.598355906 +0000 UTC m=+392.504930099" Jul 09 13:56:07.818083 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:07.818059 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2lfr2" Jul 09 13:56:07.902700 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:07.902612 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwl8g\" (UniqueName: \"kubernetes.io/projected/f7b19de2-790a-457d-b2c0-51ed8629fceb-kube-api-access-rwl8g\") pod \"f7b19de2-790a-457d-b2c0-51ed8629fceb\" (UID: \"f7b19de2-790a-457d-b2c0-51ed8629fceb\") " Jul 09 13:56:07.904939 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:07.904915 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7b19de2-790a-457d-b2c0-51ed8629fceb-kube-api-access-rwl8g" (OuterVolumeSpecName: "kube-api-access-rwl8g") pod "f7b19de2-790a-457d-b2c0-51ed8629fceb" (UID: "f7b19de2-790a-457d-b2c0-51ed8629fceb"). InnerVolumeSpecName "kube-api-access-rwl8g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 13:56:08.003607 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:08.003572 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwl8g\" (UniqueName: \"kubernetes.io/projected/f7b19de2-790a-457d-b2c0-51ed8629fceb-kube-api-access-rwl8g\") on node \"ip-10-0-143-92.ec2.internal\" DevicePath \"\"" Jul 09 13:56:08.577127 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:08.577087 2573 generic.go:356] "Generic (PLEG): container finished" podID="f7b19de2-790a-457d-b2c0-51ed8629fceb" containerID="4bb1ea4111a5caa0d3b35869a10805473de532f4dc894d5abc9a67417203fa0c" exitCode=0 Jul 09 13:56:08.577595 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:08.577137 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2lfr2" Jul 09 13:56:08.577595 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:08.577184 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2lfr2" event={"ID":"f7b19de2-790a-457d-b2c0-51ed8629fceb","Type":"ContainerDied","Data":"4bb1ea4111a5caa0d3b35869a10805473de532f4dc894d5abc9a67417203fa0c"} Jul 09 13:56:08.577595 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:08.577262 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2lfr2" event={"ID":"f7b19de2-790a-457d-b2c0-51ed8629fceb","Type":"ContainerDied","Data":"622a7335be11758d043915a43da89ea8b263e59e2d8d02494b0086b801999402"} Jul 09 13:56:08.577595 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:08.577292 2573 scope.go:117] "RemoveContainer" containerID="4bb1ea4111a5caa0d3b35869a10805473de532f4dc894d5abc9a67417203fa0c" Jul 09 13:56:08.587178 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:08.587161 2573 scope.go:117] "RemoveContainer" containerID="4bb1ea4111a5caa0d3b35869a10805473de532f4dc894d5abc9a67417203fa0c" Jul 09 13:56:08.587417 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:56:08.587397 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bb1ea4111a5caa0d3b35869a10805473de532f4dc894d5abc9a67417203fa0c\": container with ID starting with 4bb1ea4111a5caa0d3b35869a10805473de532f4dc894d5abc9a67417203fa0c not found: ID does not exist" containerID="4bb1ea4111a5caa0d3b35869a10805473de532f4dc894d5abc9a67417203fa0c" Jul 09 13:56:08.587479 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:08.587431 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bb1ea4111a5caa0d3b35869a10805473de532f4dc894d5abc9a67417203fa0c"} err="failed to get container status \"4bb1ea4111a5caa0d3b35869a10805473de532f4dc894d5abc9a67417203fa0c\": rpc error: code = NotFound desc = could not find container \"4bb1ea4111a5caa0d3b35869a10805473de532f4dc894d5abc9a67417203fa0c\": container with ID starting with 4bb1ea4111a5caa0d3b35869a10805473de532f4dc894d5abc9a67417203fa0c not found: ID does not exist" Jul 09 13:56:08.596662 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:08.596636 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2lfr2"] Jul 09 13:56:08.600692 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:08.600670 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2lfr2"] Jul 09 13:56:09.612953 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:09.612919 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7b19de2-790a-457d-b2c0-51ed8629fceb" path="/var/lib/kubelet/pods/f7b19de2-790a-457d-b2c0-51ed8629fceb/volumes" Jul 09 13:56:15.132981 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:15.132948 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-kqhr5" Jul 09 13:56:15.133418 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:15.133004 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-kqhr5" Jul 09 13:56:15.156000 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:15.155970 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-kqhr5" Jul 09 13:56:15.635925 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:15.635899 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-kqhr5" Jul 09 13:56:19.852980 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:19.852944 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4gcm"] Jul 09 13:56:19.853357 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:19.853313 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7b19de2-790a-457d-b2c0-51ed8629fceb" containerName="registry-server" Jul 09 13:56:19.853357 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:19.853325 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7b19de2-790a-457d-b2c0-51ed8629fceb" containerName="registry-server" Jul 09 13:56:19.853424 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:19.853394 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7b19de2-790a-457d-b2c0-51ed8629fceb" containerName="registry-server" Jul 09 13:56:19.857919 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:19.857899 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4gcm" Jul 09 13:56:19.860321 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:19.860303 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-s4wpn\"" Jul 09 13:56:19.863714 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:19.863693 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4gcm"] Jul 09 13:56:19.900330 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:19.900287 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91d41912-a03d-4fde-990a-c2106133b28f-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4gcm\" (UID: \"91d41912-a03d-4fde-990a-c2106133b28f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4gcm" Jul 09 13:56:19.900330 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:19.900335 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrwth\" (UniqueName: \"kubernetes.io/projected/91d41912-a03d-4fde-990a-c2106133b28f-kube-api-access-hrwth\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4gcm\" (UID: \"91d41912-a03d-4fde-990a-c2106133b28f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4gcm" Jul 09 13:56:19.900581 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:19.900441 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91d41912-a03d-4fde-990a-c2106133b28f-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4gcm\" (UID: \"91d41912-a03d-4fde-990a-c2106133b28f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4gcm" Jul 09 13:56:20.000861 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:20.000828 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91d41912-a03d-4fde-990a-c2106133b28f-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4gcm\" (UID: \"91d41912-a03d-4fde-990a-c2106133b28f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4gcm" Jul 09 13:56:20.001049 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:20.000873 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrwth\" (UniqueName: \"kubernetes.io/projected/91d41912-a03d-4fde-990a-c2106133b28f-kube-api-access-hrwth\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4gcm\" (UID: \"91d41912-a03d-4fde-990a-c2106133b28f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4gcm" Jul 09 13:56:20.001049 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:20.000916 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91d41912-a03d-4fde-990a-c2106133b28f-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4gcm\" (UID: \"91d41912-a03d-4fde-990a-c2106133b28f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4gcm" Jul 09 13:56:20.001288 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:20.001265 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91d41912-a03d-4fde-990a-c2106133b28f-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4gcm\" (UID: \"91d41912-a03d-4fde-990a-c2106133b28f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4gcm" Jul 09 13:56:20.001288 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:20.001285 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91d41912-a03d-4fde-990a-c2106133b28f-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4gcm\" (UID: \"91d41912-a03d-4fde-990a-c2106133b28f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4gcm" Jul 09 13:56:20.009454 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:20.009428 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrwth\" (UniqueName: \"kubernetes.io/projected/91d41912-a03d-4fde-990a-c2106133b28f-kube-api-access-hrwth\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4gcm\" (UID: \"91d41912-a03d-4fde-990a-c2106133b28f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4gcm" Jul 09 13:56:20.168404 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:20.168324 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4gcm" Jul 09 13:56:20.250880 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:20.250848 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zrk56"] Jul 09 13:56:20.256234 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:20.255960 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zrk56" Jul 09 13:56:20.262832 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:20.262776 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zrk56"] Jul 09 13:56:20.303685 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:20.303652 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94gpc\" (UniqueName: \"kubernetes.io/projected/dbe1f4a6-7951-48d9-bb0b-83cf322b1d22-kube-api-access-94gpc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zrk56\" (UID: \"dbe1f4a6-7951-48d9-bb0b-83cf322b1d22\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zrk56" Jul 09 13:56:20.303853 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:20.303693 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dbe1f4a6-7951-48d9-bb0b-83cf322b1d22-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zrk56\" (UID: \"dbe1f4a6-7951-48d9-bb0b-83cf322b1d22\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zrk56" Jul 09 13:56:20.303853 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:20.303813 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dbe1f4a6-7951-48d9-bb0b-83cf322b1d22-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zrk56\" (UID: \"dbe1f4a6-7951-48d9-bb0b-83cf322b1d22\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zrk56" Jul 09 13:56:20.308235 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:20.308216 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4gcm"] Jul 09 13:56:20.310686 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:56:20.310661 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91d41912_a03d_4fde_990a_c2106133b28f.slice/crio-d63a009faea6d7fee7e273cd3796e4378c31a27fd608c6616158f501d62b937b WatchSource:0}: Error finding container d63a009faea6d7fee7e273cd3796e4378c31a27fd608c6616158f501d62b937b: Status 404 returned error can't find the container with id d63a009faea6d7fee7e273cd3796e4378c31a27fd608c6616158f501d62b937b Jul 09 13:56:20.404681 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:20.404633 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94gpc\" (UniqueName: \"kubernetes.io/projected/dbe1f4a6-7951-48d9-bb0b-83cf322b1d22-kube-api-access-94gpc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zrk56\" (UID: \"dbe1f4a6-7951-48d9-bb0b-83cf322b1d22\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zrk56" Jul 09 13:56:20.404863 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:20.404694 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dbe1f4a6-7951-48d9-bb0b-83cf322b1d22-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zrk56\" (UID: \"dbe1f4a6-7951-48d9-bb0b-83cf322b1d22\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zrk56" Jul 09 13:56:20.404863 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:20.404767 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dbe1f4a6-7951-48d9-bb0b-83cf322b1d22-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zrk56\" (UID: \"dbe1f4a6-7951-48d9-bb0b-83cf322b1d22\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zrk56" Jul 09 13:56:20.405242 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:20.405217 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dbe1f4a6-7951-48d9-bb0b-83cf322b1d22-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zrk56\" (UID: \"dbe1f4a6-7951-48d9-bb0b-83cf322b1d22\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zrk56" Jul 09 13:56:20.405285 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:20.405220 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dbe1f4a6-7951-48d9-bb0b-83cf322b1d22-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zrk56\" (UID: \"dbe1f4a6-7951-48d9-bb0b-83cf322b1d22\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zrk56" Jul 09 13:56:20.413363 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:20.413314 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94gpc\" (UniqueName: \"kubernetes.io/projected/dbe1f4a6-7951-48d9-bb0b-83cf322b1d22-kube-api-access-94gpc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zrk56\" (UID: \"dbe1f4a6-7951-48d9-bb0b-83cf322b1d22\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zrk56" Jul 09 13:56:20.570124 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:20.570078 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zrk56" Jul 09 13:56:20.639278 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:20.639233 2573 generic.go:356] "Generic (PLEG): container finished" podID="91d41912-a03d-4fde-990a-c2106133b28f" containerID="8378d2298fa7073b3cb754c5349250d05effb5ac93bd6cb6e497f278424b55d8" exitCode=0 Jul 09 13:56:20.639417 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:20.639302 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4gcm" event={"ID":"91d41912-a03d-4fde-990a-c2106133b28f","Type":"ContainerDied","Data":"8378d2298fa7073b3cb754c5349250d05effb5ac93bd6cb6e497f278424b55d8"} Jul 09 13:56:20.639417 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:20.639355 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4gcm" event={"ID":"91d41912-a03d-4fde-990a-c2106133b28f","Type":"ContainerStarted","Data":"d63a009faea6d7fee7e273cd3796e4378c31a27fd608c6616158f501d62b937b"} Jul 09 13:56:20.653028 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:20.652998 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svnfh"] Jul 09 13:56:20.658276 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:20.658249 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svnfh" Jul 09 13:56:20.664788 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:20.664434 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svnfh"] Jul 09 13:56:20.708274 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:20.708194 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee101ac7-66a8-40ed-916c-246fd44d58ec-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svnfh\" (UID: \"ee101ac7-66a8-40ed-916c-246fd44d58ec\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svnfh" Jul 09 13:56:20.708274 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:20.708239 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sph8p\" (UniqueName: \"kubernetes.io/projected/ee101ac7-66a8-40ed-916c-246fd44d58ec-kube-api-access-sph8p\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svnfh\" (UID: \"ee101ac7-66a8-40ed-916c-246fd44d58ec\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svnfh" Jul 09 13:56:20.708477 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:20.708375 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee101ac7-66a8-40ed-916c-246fd44d58ec-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svnfh\" (UID: \"ee101ac7-66a8-40ed-916c-246fd44d58ec\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svnfh" Jul 09 13:56:20.714672 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:20.714648 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zrk56"] Jul 09 13:56:20.716409 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:56:20.716387 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbe1f4a6_7951_48d9_bb0b_83cf322b1d22.slice/crio-124701e03ca7ae9b59078e6c26e068088089e686e6d1a561a87bee29bd860da5 WatchSource:0}: Error finding container 124701e03ca7ae9b59078e6c26e068088089e686e6d1a561a87bee29bd860da5: Status 404 returned error can't find the container with id 124701e03ca7ae9b59078e6c26e068088089e686e6d1a561a87bee29bd860da5 Jul 09 13:56:20.809199 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:20.809158 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee101ac7-66a8-40ed-916c-246fd44d58ec-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svnfh\" (UID: \"ee101ac7-66a8-40ed-916c-246fd44d58ec\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svnfh" Jul 09 13:56:20.809434 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:20.809259 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee101ac7-66a8-40ed-916c-246fd44d58ec-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svnfh\" (UID: \"ee101ac7-66a8-40ed-916c-246fd44d58ec\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svnfh" Jul 09 13:56:20.809434 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:20.809304 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sph8p\" (UniqueName: \"kubernetes.io/projected/ee101ac7-66a8-40ed-916c-246fd44d58ec-kube-api-access-sph8p\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svnfh\" (UID: \"ee101ac7-66a8-40ed-916c-246fd44d58ec\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svnfh" Jul 09 13:56:20.809617 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:20.809599 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee101ac7-66a8-40ed-916c-246fd44d58ec-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svnfh\" (UID: \"ee101ac7-66a8-40ed-916c-246fd44d58ec\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svnfh" Jul 09 13:56:20.809784 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:20.809760 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee101ac7-66a8-40ed-916c-246fd44d58ec-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svnfh\" (UID: \"ee101ac7-66a8-40ed-916c-246fd44d58ec\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svnfh" Jul 09 13:56:20.818065 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:20.818029 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sph8p\" (UniqueName: \"kubernetes.io/projected/ee101ac7-66a8-40ed-916c-246fd44d58ec-kube-api-access-sph8p\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svnfh\" (UID: \"ee101ac7-66a8-40ed-916c-246fd44d58ec\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svnfh" Jul 09 13:56:20.971406 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:20.971307 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svnfh" Jul 09 13:56:21.051247 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:21.051216 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nmktf"] Jul 09 13:56:21.064272 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:21.064141 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nmktf" Jul 09 13:56:21.064688 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:21.064662 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nmktf"] Jul 09 13:56:21.112657 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:21.112625 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a1629ba-808d-4825-a6b0-f38b9c1c693a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nmktf\" (UID: \"3a1629ba-808d-4825-a6b0-f38b9c1c693a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nmktf" Jul 09 13:56:21.112657 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:21.112659 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a1629ba-808d-4825-a6b0-f38b9c1c693a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nmktf\" (UID: \"3a1629ba-808d-4825-a6b0-f38b9c1c693a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nmktf" Jul 09 13:56:21.112887 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:21.112691 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ht4k\" (UniqueName: \"kubernetes.io/projected/3a1629ba-808d-4825-a6b0-f38b9c1c693a-kube-api-access-5ht4k\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nmktf\" (UID: \"3a1629ba-808d-4825-a6b0-f38b9c1c693a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nmktf" Jul 09 13:56:21.117456 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:21.117432 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svnfh"] Jul 09 13:56:21.119578 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:56:21.119552 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee101ac7_66a8_40ed_916c_246fd44d58ec.slice/crio-7deb0e10ede7d6cd8c2d177749a44bd2f4da6e53c65429a8fcbbca81b56483b4 WatchSource:0}: Error finding container 7deb0e10ede7d6cd8c2d177749a44bd2f4da6e53c65429a8fcbbca81b56483b4: Status 404 returned error can't find the container with id 7deb0e10ede7d6cd8c2d177749a44bd2f4da6e53c65429a8fcbbca81b56483b4 Jul 09 13:56:21.213535 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:21.213509 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a1629ba-808d-4825-a6b0-f38b9c1c693a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nmktf\" (UID: \"3a1629ba-808d-4825-a6b0-f38b9c1c693a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nmktf" Jul 09 13:56:21.213737 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:21.213542 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a1629ba-808d-4825-a6b0-f38b9c1c693a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nmktf\" (UID: \"3a1629ba-808d-4825-a6b0-f38b9c1c693a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nmktf" Jul 09 13:56:21.213737 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:21.213593 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ht4k\" (UniqueName: \"kubernetes.io/projected/3a1629ba-808d-4825-a6b0-f38b9c1c693a-kube-api-access-5ht4k\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nmktf\" (UID: \"3a1629ba-808d-4825-a6b0-f38b9c1c693a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nmktf" Jul 09 13:56:21.213997 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:21.213975 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a1629ba-808d-4825-a6b0-f38b9c1c693a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nmktf\" (UID: \"3a1629ba-808d-4825-a6b0-f38b9c1c693a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nmktf" Jul 09 13:56:21.213997 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:21.213990 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a1629ba-808d-4825-a6b0-f38b9c1c693a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nmktf\" (UID: \"3a1629ba-808d-4825-a6b0-f38b9c1c693a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nmktf" Jul 09 13:56:21.222384 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:21.222332 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ht4k\" (UniqueName: \"kubernetes.io/projected/3a1629ba-808d-4825-a6b0-f38b9c1c693a-kube-api-access-5ht4k\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nmktf\" (UID: \"3a1629ba-808d-4825-a6b0-f38b9c1c693a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nmktf" Jul 09 13:56:21.375457 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:21.375425 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nmktf" Jul 09 13:56:21.514607 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:21.514577 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nmktf"] Jul 09 13:56:21.517679 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:56:21.517651 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a1629ba_808d_4825_a6b0_f38b9c1c693a.slice/crio-4605500fc6811f2e69ce42cee7f05f1b278ee4c32e25195cdd2847e32fef674b WatchSource:0}: Error finding container 4605500fc6811f2e69ce42cee7f05f1b278ee4c32e25195cdd2847e32fef674b: Status 404 returned error can't find the container with id 4605500fc6811f2e69ce42cee7f05f1b278ee4c32e25195cdd2847e32fef674b Jul 09 13:56:21.646794 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:21.646759 2573 generic.go:356] "Generic (PLEG): container finished" podID="91d41912-a03d-4fde-990a-c2106133b28f" containerID="234ba63be6714bbbd953b87a864f4d42255fef2fcc5ae1eb42e0d6aafe3c04ba" exitCode=0 Jul 09 13:56:21.646794 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:21.646852 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4gcm" event={"ID":"91d41912-a03d-4fde-990a-c2106133b28f","Type":"ContainerDied","Data":"234ba63be6714bbbd953b87a864f4d42255fef2fcc5ae1eb42e0d6aafe3c04ba"} Jul 09 13:56:21.648426 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:21.648406 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nmktf" event={"ID":"3a1629ba-808d-4825-a6b0-f38b9c1c693a","Type":"ContainerStarted","Data":"df5c2f2e9ebce6a94b50dac0ff366c3ac229c4dd68a338bbacd08d2cca9a2d5f"} Jul 09 13:56:21.648492 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:21.648449 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nmktf" event={"ID":"3a1629ba-808d-4825-a6b0-f38b9c1c693a","Type":"ContainerStarted","Data":"4605500fc6811f2e69ce42cee7f05f1b278ee4c32e25195cdd2847e32fef674b"} Jul 09 13:56:21.650079 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:21.650056 2573 generic.go:356] "Generic (PLEG): container finished" podID="ee101ac7-66a8-40ed-916c-246fd44d58ec" containerID="9dda76996ca79c40156255156cd179c36a41400e488f2f6b4c91320523c61d68" exitCode=0 Jul 09 13:56:21.650192 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:21.650087 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svnfh" event={"ID":"ee101ac7-66a8-40ed-916c-246fd44d58ec","Type":"ContainerDied","Data":"9dda76996ca79c40156255156cd179c36a41400e488f2f6b4c91320523c61d68"} Jul 09 13:56:21.650192 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:21.650135 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svnfh" event={"ID":"ee101ac7-66a8-40ed-916c-246fd44d58ec","Type":"ContainerStarted","Data":"7deb0e10ede7d6cd8c2d177749a44bd2f4da6e53c65429a8fcbbca81b56483b4"} Jul 09 13:56:21.651860 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:21.651841 2573 generic.go:356] "Generic (PLEG): container finished" podID="dbe1f4a6-7951-48d9-bb0b-83cf322b1d22" containerID="36f43cff69c0e65c0a6f6fcf68a60adfa4712c9910cd9e397adbdb6a4782e6b2" exitCode=0 Jul 09 13:56:21.651931 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:21.651899 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zrk56" event={"ID":"dbe1f4a6-7951-48d9-bb0b-83cf322b1d22","Type":"ContainerDied","Data":"36f43cff69c0e65c0a6f6fcf68a60adfa4712c9910cd9e397adbdb6a4782e6b2"} Jul 09 13:56:21.651986 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:21.651946 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zrk56" event={"ID":"dbe1f4a6-7951-48d9-bb0b-83cf322b1d22","Type":"ContainerStarted","Data":"124701e03ca7ae9b59078e6c26e068088089e686e6d1a561a87bee29bd860da5"} Jul 09 13:56:22.659043 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:22.658998 2573 generic.go:356] "Generic (PLEG): container finished" podID="91d41912-a03d-4fde-990a-c2106133b28f" containerID="660d98884f13a7e10d502733380e1cbd23d8a892efa8636d327ed91b7c0ab78a" exitCode=0 Jul 09 13:56:22.659422 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:22.659090 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4gcm" event={"ID":"91d41912-a03d-4fde-990a-c2106133b28f","Type":"ContainerDied","Data":"660d98884f13a7e10d502733380e1cbd23d8a892efa8636d327ed91b7c0ab78a"} Jul 09 13:56:22.660746 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:22.660726 2573 generic.go:356] "Generic (PLEG): container finished" podID="3a1629ba-808d-4825-a6b0-f38b9c1c693a" containerID="df5c2f2e9ebce6a94b50dac0ff366c3ac229c4dd68a338bbacd08d2cca9a2d5f" exitCode=0 Jul 09 13:56:22.660870 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:22.660826 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nmktf" event={"ID":"3a1629ba-808d-4825-a6b0-f38b9c1c693a","Type":"ContainerDied","Data":"df5c2f2e9ebce6a94b50dac0ff366c3ac229c4dd68a338bbacd08d2cca9a2d5f"} Jul 09 13:56:22.662567 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:22.662548 2573 generic.go:356] "Generic (PLEG): container finished" podID="ee101ac7-66a8-40ed-916c-246fd44d58ec" containerID="dd31e43ab1c706e37284f0a0cea27b9eaa5119336d5da352a5e979009155b6e6" exitCode=0 Jul 09 13:56:22.662662 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:22.662613 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svnfh" event={"ID":"ee101ac7-66a8-40ed-916c-246fd44d58ec","Type":"ContainerDied","Data":"dd31e43ab1c706e37284f0a0cea27b9eaa5119336d5da352a5e979009155b6e6"} Jul 09 13:56:23.669865 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:23.669826 2573 generic.go:356] "Generic (PLEG): container finished" podID="3a1629ba-808d-4825-a6b0-f38b9c1c693a" containerID="711f757c8f179907db1fc1a756583bd63f906d51c42d9e9d9fbb69f8c63d19b7" exitCode=0 Jul 09 13:56:23.670276 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:23.669896 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nmktf" event={"ID":"3a1629ba-808d-4825-a6b0-f38b9c1c693a","Type":"ContainerDied","Data":"711f757c8f179907db1fc1a756583bd63f906d51c42d9e9d9fbb69f8c63d19b7"} Jul 09 13:56:23.672254 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:23.672227 2573 generic.go:356] "Generic (PLEG): container finished" podID="ee101ac7-66a8-40ed-916c-246fd44d58ec" containerID="e2d88628fdf87c31c1e2c15040565796feb97ac36cd44213aaf32c6af88221eb" exitCode=0 Jul 09 13:56:23.672372 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:23.672299 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svnfh" event={"ID":"ee101ac7-66a8-40ed-916c-246fd44d58ec","Type":"ContainerDied","Data":"e2d88628fdf87c31c1e2c15040565796feb97ac36cd44213aaf32c6af88221eb"} Jul 09 13:56:23.674204 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:23.674174 2573 generic.go:356] "Generic (PLEG): container finished" podID="dbe1f4a6-7951-48d9-bb0b-83cf322b1d22" containerID="f60c74fd36c438305abab23a6b4e45ebd3f56cb6f671f50cbcf210125a841833" exitCode=0 Jul 09 13:56:23.674300 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:23.674247 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zrk56" event={"ID":"dbe1f4a6-7951-48d9-bb0b-83cf322b1d22","Type":"ContainerDied","Data":"f60c74fd36c438305abab23a6b4e45ebd3f56cb6f671f50cbcf210125a841833"} Jul 09 13:56:23.830116 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:23.830091 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4gcm" Jul 09 13:56:23.938957 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:23.938878 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91d41912-a03d-4fde-990a-c2106133b28f-bundle\") pod \"91d41912-a03d-4fde-990a-c2106133b28f\" (UID: \"91d41912-a03d-4fde-990a-c2106133b28f\") " Jul 09 13:56:23.939088 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:23.938991 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91d41912-a03d-4fde-990a-c2106133b28f-util\") pod \"91d41912-a03d-4fde-990a-c2106133b28f\" (UID: \"91d41912-a03d-4fde-990a-c2106133b28f\") " Jul 09 13:56:23.939088 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:23.939020 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrwth\" (UniqueName: \"kubernetes.io/projected/91d41912-a03d-4fde-990a-c2106133b28f-kube-api-access-hrwth\") pod \"91d41912-a03d-4fde-990a-c2106133b28f\" (UID: \"91d41912-a03d-4fde-990a-c2106133b28f\") " Jul 09 13:56:23.939509 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:23.939482 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91d41912-a03d-4fde-990a-c2106133b28f-bundle" (OuterVolumeSpecName: "bundle") pod "91d41912-a03d-4fde-990a-c2106133b28f" (UID: "91d41912-a03d-4fde-990a-c2106133b28f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 13:56:23.941246 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:23.941221 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91d41912-a03d-4fde-990a-c2106133b28f-kube-api-access-hrwth" (OuterVolumeSpecName: "kube-api-access-hrwth") pod "91d41912-a03d-4fde-990a-c2106133b28f" (UID: "91d41912-a03d-4fde-990a-c2106133b28f"). InnerVolumeSpecName "kube-api-access-hrwth". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 13:56:23.944515 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:23.944491 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91d41912-a03d-4fde-990a-c2106133b28f-util" (OuterVolumeSpecName: "util") pod "91d41912-a03d-4fde-990a-c2106133b28f" (UID: "91d41912-a03d-4fde-990a-c2106133b28f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 13:56:24.040021 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:24.039988 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91d41912-a03d-4fde-990a-c2106133b28f-util\") on node \"ip-10-0-143-92.ec2.internal\" DevicePath \"\"" Jul 09 13:56:24.040021 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:24.040017 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrwth\" (UniqueName: \"kubernetes.io/projected/91d41912-a03d-4fde-990a-c2106133b28f-kube-api-access-hrwth\") on node \"ip-10-0-143-92.ec2.internal\" DevicePath \"\"" Jul 09 13:56:24.040021 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:24.040027 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91d41912-a03d-4fde-990a-c2106133b28f-bundle\") on node \"ip-10-0-143-92.ec2.internal\" DevicePath \"\"" Jul 09 13:56:24.681090 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:24.681055 2573 generic.go:356] "Generic (PLEG): container finished" podID="dbe1f4a6-7951-48d9-bb0b-83cf322b1d22" containerID="71aa010dd6369ba612b3798a5fb1571b98dad005160d237df83f5521b522b860" exitCode=0 Jul 09 13:56:24.681518 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:24.681139 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zrk56" event={"ID":"dbe1f4a6-7951-48d9-bb0b-83cf322b1d22","Type":"ContainerDied","Data":"71aa010dd6369ba612b3798a5fb1571b98dad005160d237df83f5521b522b860"} Jul 09 13:56:24.682966 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:24.682944 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4gcm" event={"ID":"91d41912-a03d-4fde-990a-c2106133b28f","Type":"ContainerDied","Data":"d63a009faea6d7fee7e273cd3796e4378c31a27fd608c6616158f501d62b937b"} Jul 09 13:56:24.683097 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:24.682986 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d63a009faea6d7fee7e273cd3796e4378c31a27fd608c6616158f501d62b937b" Jul 09 13:56:24.683097 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:24.682949 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4gcm" Jul 09 13:56:24.684976 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:24.684956 2573 generic.go:356] "Generic (PLEG): container finished" podID="3a1629ba-808d-4825-a6b0-f38b9c1c693a" containerID="d79f3d3ad66b43c56314290ab8ebb766c2bc633759f8cf367f4d528f2471b51a" exitCode=0 Jul 09 13:56:24.685092 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:24.685029 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nmktf" event={"ID":"3a1629ba-808d-4825-a6b0-f38b9c1c693a","Type":"ContainerDied","Data":"d79f3d3ad66b43c56314290ab8ebb766c2bc633759f8cf367f4d528f2471b51a"} Jul 09 13:56:24.827262 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:24.827235 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svnfh" Jul 09 13:56:24.948548 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:24.948467 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sph8p\" (UniqueName: \"kubernetes.io/projected/ee101ac7-66a8-40ed-916c-246fd44d58ec-kube-api-access-sph8p\") pod \"ee101ac7-66a8-40ed-916c-246fd44d58ec\" (UID: \"ee101ac7-66a8-40ed-916c-246fd44d58ec\") " Jul 09 13:56:24.948548 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:24.948519 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee101ac7-66a8-40ed-916c-246fd44d58ec-bundle\") pod \"ee101ac7-66a8-40ed-916c-246fd44d58ec\" (UID: \"ee101ac7-66a8-40ed-916c-246fd44d58ec\") " Jul 09 13:56:24.948727 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:24.948603 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee101ac7-66a8-40ed-916c-246fd44d58ec-util\") pod \"ee101ac7-66a8-40ed-916c-246fd44d58ec\" (UID: \"ee101ac7-66a8-40ed-916c-246fd44d58ec\") " Jul 09 13:56:24.949034 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:24.949009 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee101ac7-66a8-40ed-916c-246fd44d58ec-bundle" (OuterVolumeSpecName: "bundle") pod "ee101ac7-66a8-40ed-916c-246fd44d58ec" (UID: "ee101ac7-66a8-40ed-916c-246fd44d58ec"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 13:56:24.950748 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:24.950723 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee101ac7-66a8-40ed-916c-246fd44d58ec-kube-api-access-sph8p" (OuterVolumeSpecName: "kube-api-access-sph8p") pod "ee101ac7-66a8-40ed-916c-246fd44d58ec" (UID: "ee101ac7-66a8-40ed-916c-246fd44d58ec"). InnerVolumeSpecName "kube-api-access-sph8p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 13:56:24.956576 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:24.956532 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee101ac7-66a8-40ed-916c-246fd44d58ec-util" (OuterVolumeSpecName: "util") pod "ee101ac7-66a8-40ed-916c-246fd44d58ec" (UID: "ee101ac7-66a8-40ed-916c-246fd44d58ec"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 13:56:25.049260 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:25.049217 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee101ac7-66a8-40ed-916c-246fd44d58ec-bundle\") on node \"ip-10-0-143-92.ec2.internal\" DevicePath \"\"" Jul 09 13:56:25.049260 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:25.049256 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee101ac7-66a8-40ed-916c-246fd44d58ec-util\") on node \"ip-10-0-143-92.ec2.internal\" DevicePath \"\"" Jul 09 13:56:25.049260 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:25.049265 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sph8p\" (UniqueName: \"kubernetes.io/projected/ee101ac7-66a8-40ed-916c-246fd44d58ec-kube-api-access-sph8p\") on node \"ip-10-0-143-92.ec2.internal\" DevicePath \"\"" Jul 09 13:56:25.691347 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:25.691320 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svnfh" Jul 09 13:56:25.691347 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:25.691333 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svnfh" event={"ID":"ee101ac7-66a8-40ed-916c-246fd44d58ec","Type":"ContainerDied","Data":"7deb0e10ede7d6cd8c2d177749a44bd2f4da6e53c65429a8fcbbca81b56483b4"} Jul 09 13:56:25.691906 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:25.691388 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7deb0e10ede7d6cd8c2d177749a44bd2f4da6e53c65429a8fcbbca81b56483b4" Jul 09 13:56:25.828467 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:25.828442 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zrk56" Jul 09 13:56:25.871012 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:25.870932 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nmktf" Jul 09 13:56:25.957297 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:25.957266 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dbe1f4a6-7951-48d9-bb0b-83cf322b1d22-bundle\") pod \"dbe1f4a6-7951-48d9-bb0b-83cf322b1d22\" (UID: \"dbe1f4a6-7951-48d9-bb0b-83cf322b1d22\") " Jul 09 13:56:25.957487 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:25.957319 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94gpc\" (UniqueName: \"kubernetes.io/projected/dbe1f4a6-7951-48d9-bb0b-83cf322b1d22-kube-api-access-94gpc\") pod \"dbe1f4a6-7951-48d9-bb0b-83cf322b1d22\" (UID: \"dbe1f4a6-7951-48d9-bb0b-83cf322b1d22\") " Jul 09 13:56:25.957487 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:25.957363 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a1629ba-808d-4825-a6b0-f38b9c1c693a-util\") pod \"3a1629ba-808d-4825-a6b0-f38b9c1c693a\" (UID: \"3a1629ba-808d-4825-a6b0-f38b9c1c693a\") " Jul 09 13:56:25.957487 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:25.957389 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dbe1f4a6-7951-48d9-bb0b-83cf322b1d22-util\") pod \"dbe1f4a6-7951-48d9-bb0b-83cf322b1d22\" (UID: \"dbe1f4a6-7951-48d9-bb0b-83cf322b1d22\") " Jul 09 13:56:25.957487 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:25.957420 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ht4k\" (UniqueName: \"kubernetes.io/projected/3a1629ba-808d-4825-a6b0-f38b9c1c693a-kube-api-access-5ht4k\") pod \"3a1629ba-808d-4825-a6b0-f38b9c1c693a\" (UID: \"3a1629ba-808d-4825-a6b0-f38b9c1c693a\") " Jul 09 13:56:25.957686 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:25.957510 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a1629ba-808d-4825-a6b0-f38b9c1c693a-bundle\") pod \"3a1629ba-808d-4825-a6b0-f38b9c1c693a\" (UID: \"3a1629ba-808d-4825-a6b0-f38b9c1c693a\") " Jul 09 13:56:25.957989 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:25.957961 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbe1f4a6-7951-48d9-bb0b-83cf322b1d22-bundle" (OuterVolumeSpecName: "bundle") pod "dbe1f4a6-7951-48d9-bb0b-83cf322b1d22" (UID: "dbe1f4a6-7951-48d9-bb0b-83cf322b1d22"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 13:56:25.958201 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:25.958172 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a1629ba-808d-4825-a6b0-f38b9c1c693a-bundle" (OuterVolumeSpecName: "bundle") pod "3a1629ba-808d-4825-a6b0-f38b9c1c693a" (UID: "3a1629ba-808d-4825-a6b0-f38b9c1c693a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 13:56:25.959766 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:25.959743 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbe1f4a6-7951-48d9-bb0b-83cf322b1d22-kube-api-access-94gpc" (OuterVolumeSpecName: "kube-api-access-94gpc") pod "dbe1f4a6-7951-48d9-bb0b-83cf322b1d22" (UID: "dbe1f4a6-7951-48d9-bb0b-83cf322b1d22"). InnerVolumeSpecName "kube-api-access-94gpc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 13:56:25.959948 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:25.959832 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a1629ba-808d-4825-a6b0-f38b9c1c693a-kube-api-access-5ht4k" (OuterVolumeSpecName: "kube-api-access-5ht4k") pod "3a1629ba-808d-4825-a6b0-f38b9c1c693a" (UID: "3a1629ba-808d-4825-a6b0-f38b9c1c693a"). InnerVolumeSpecName "kube-api-access-5ht4k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 13:56:25.965059 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:25.965034 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbe1f4a6-7951-48d9-bb0b-83cf322b1d22-util" (OuterVolumeSpecName: "util") pod "dbe1f4a6-7951-48d9-bb0b-83cf322b1d22" (UID: "dbe1f4a6-7951-48d9-bb0b-83cf322b1d22"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 13:56:25.966129 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:25.966097 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a1629ba-808d-4825-a6b0-f38b9c1c693a-util" (OuterVolumeSpecName: "util") pod "3a1629ba-808d-4825-a6b0-f38b9c1c693a" (UID: "3a1629ba-808d-4825-a6b0-f38b9c1c693a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 13:56:26.058916 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:26.058878 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ht4k\" (UniqueName: \"kubernetes.io/projected/3a1629ba-808d-4825-a6b0-f38b9c1c693a-kube-api-access-5ht4k\") on node \"ip-10-0-143-92.ec2.internal\" DevicePath \"\"" Jul 09 13:56:26.058916 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:26.058910 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a1629ba-808d-4825-a6b0-f38b9c1c693a-bundle\") on node \"ip-10-0-143-92.ec2.internal\" DevicePath \"\"" Jul 09 13:56:26.058916 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:26.058922 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dbe1f4a6-7951-48d9-bb0b-83cf322b1d22-bundle\") on node \"ip-10-0-143-92.ec2.internal\" DevicePath \"\"" Jul 09 13:56:26.059117 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:26.058930 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94gpc\" (UniqueName: \"kubernetes.io/projected/dbe1f4a6-7951-48d9-bb0b-83cf322b1d22-kube-api-access-94gpc\") on node \"ip-10-0-143-92.ec2.internal\" DevicePath \"\"" Jul 09 13:56:26.059117 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:26.058939 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a1629ba-808d-4825-a6b0-f38b9c1c693a-util\") on node \"ip-10-0-143-92.ec2.internal\" DevicePath \"\"" Jul 09 13:56:26.059117 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:26.058948 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dbe1f4a6-7951-48d9-bb0b-83cf322b1d22-util\") on node \"ip-10-0-143-92.ec2.internal\" DevicePath \"\"" Jul 09 13:56:26.698525 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:26.698494 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nmktf" Jul 09 13:56:26.698992 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:26.698533 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nmktf" event={"ID":"3a1629ba-808d-4825-a6b0-f38b9c1c693a","Type":"ContainerDied","Data":"4605500fc6811f2e69ce42cee7f05f1b278ee4c32e25195cdd2847e32fef674b"} Jul 09 13:56:26.698992 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:26.698590 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4605500fc6811f2e69ce42cee7f05f1b278ee4c32e25195cdd2847e32fef674b" Jul 09 13:56:26.700334 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:26.700316 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zrk56" Jul 09 13:56:26.700451 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:26.700331 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zrk56" event={"ID":"dbe1f4a6-7951-48d9-bb0b-83cf322b1d22","Type":"ContainerDied","Data":"124701e03ca7ae9b59078e6c26e068088089e686e6d1a561a87bee29bd860da5"} Jul 09 13:56:26.700451 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:26.700374 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="124701e03ca7ae9b59078e6c26e068088089e686e6d1a561a87bee29bd860da5" Jul 09 13:56:35.290316 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:35.290281 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-5swv5"] Jul 09 13:56:35.290668 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:35.290610 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee101ac7-66a8-40ed-916c-246fd44d58ec" containerName="util" Jul 09 13:56:35.290668 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:35.290621 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee101ac7-66a8-40ed-916c-246fd44d58ec" containerName="util" Jul 09 13:56:35.290668 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:35.290636 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a1629ba-808d-4825-a6b0-f38b9c1c693a" containerName="util" Jul 09 13:56:35.290668 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:35.290641 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a1629ba-808d-4825-a6b0-f38b9c1c693a" containerName="util" Jul 09 13:56:35.290668 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:35.290646 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a1629ba-808d-4825-a6b0-f38b9c1c693a" containerName="pull" Jul 09 13:56:35.290668 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:35.290652 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a1629ba-808d-4825-a6b0-f38b9c1c693a" containerName="pull" Jul 09 13:56:35.290668 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:35.290658 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbe1f4a6-7951-48d9-bb0b-83cf322b1d22" containerName="pull" Jul 09 13:56:35.290668 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:35.290663 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbe1f4a6-7951-48d9-bb0b-83cf322b1d22" containerName="pull" Jul 09 13:56:35.290668 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:35.290668 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee101ac7-66a8-40ed-916c-246fd44d58ec" containerName="extract" Jul 09 13:56:35.290668 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:35.290673 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee101ac7-66a8-40ed-916c-246fd44d58ec" containerName="extract" Jul 09 13:56:35.290995 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:35.290681 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbe1f4a6-7951-48d9-bb0b-83cf322b1d22" containerName="util" Jul 09 13:56:35.290995 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:35.290686 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbe1f4a6-7951-48d9-bb0b-83cf322b1d22" containerName="util" Jul 09 13:56:35.290995 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:35.290691 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91d41912-a03d-4fde-990a-c2106133b28f" containerName="extract" Jul 09 13:56:35.290995 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:35.290696 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="91d41912-a03d-4fde-990a-c2106133b28f" containerName="extract" Jul 09 13:56:35.290995 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:35.290701 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a1629ba-808d-4825-a6b0-f38b9c1c693a" containerName="extract" Jul 09 13:56:35.290995 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:35.290706 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a1629ba-808d-4825-a6b0-f38b9c1c693a" containerName="extract" Jul 09 13:56:35.290995 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:35.290714 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91d41912-a03d-4fde-990a-c2106133b28f" containerName="util" Jul 09 13:56:35.290995 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:35.290718 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="91d41912-a03d-4fde-990a-c2106133b28f" containerName="util" Jul 09 13:56:35.290995 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:35.290724 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbe1f4a6-7951-48d9-bb0b-83cf322b1d22" containerName="extract" Jul 09 13:56:35.290995 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:35.290729 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbe1f4a6-7951-48d9-bb0b-83cf322b1d22" containerName="extract" Jul 09 13:56:35.290995 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:35.290735 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee101ac7-66a8-40ed-916c-246fd44d58ec" containerName="pull" Jul 09 13:56:35.290995 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:35.290740 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee101ac7-66a8-40ed-916c-246fd44d58ec" containerName="pull" Jul 09 13:56:35.290995 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:35.290746 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91d41912-a03d-4fde-990a-c2106133b28f" containerName="pull" Jul 09 13:56:35.290995 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:35.290751 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="91d41912-a03d-4fde-990a-c2106133b28f" containerName="pull" Jul 09 13:56:35.290995 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:35.290820 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="91d41912-a03d-4fde-990a-c2106133b28f" containerName="extract" Jul 09 13:56:35.290995 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:35.290834 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a1629ba-808d-4825-a6b0-f38b9c1c693a" containerName="extract" Jul 09 13:56:35.290995 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:35.290841 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee101ac7-66a8-40ed-916c-246fd44d58ec" containerName="extract" Jul 09 13:56:35.290995 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:35.290847 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbe1f4a6-7951-48d9-bb0b-83cf322b1d22" containerName="extract" Jul 09 13:56:35.293888 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:35.293871 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5swv5" Jul 09 13:56:35.296302 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:35.296278 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-zq9gx\"" Jul 09 13:56:35.296585 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:35.296561 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 09 13:56:35.307521 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:35.307490 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-5swv5"] Jul 09 13:56:35.438601 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:35.438568 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgc2j\" (UniqueName: \"kubernetes.io/projected/e554efeb-6d02-419b-9035-f5b8671d7dcf-kube-api-access-wgc2j\") pod \"dns-operator-controller-manager-864dd78c4c-5swv5\" (UID: \"e554efeb-6d02-419b-9035-f5b8671d7dcf\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5swv5" Jul 09 13:56:35.539178 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:35.539146 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgc2j\" (UniqueName: \"kubernetes.io/projected/e554efeb-6d02-419b-9035-f5b8671d7dcf-kube-api-access-wgc2j\") pod \"dns-operator-controller-manager-864dd78c4c-5swv5\" (UID: \"e554efeb-6d02-419b-9035-f5b8671d7dcf\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5swv5" Jul 09 13:56:35.549736 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:35.549716 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgc2j\" (UniqueName: \"kubernetes.io/projected/e554efeb-6d02-419b-9035-f5b8671d7dcf-kube-api-access-wgc2j\") pod \"dns-operator-controller-manager-864dd78c4c-5swv5\" (UID: \"e554efeb-6d02-419b-9035-f5b8671d7dcf\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5swv5" Jul 09 13:56:35.606978 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:35.606955 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-zq9gx\"" Jul 09 13:56:35.615509 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:35.615482 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5swv5" Jul 09 13:56:35.761956 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:35.761932 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-5swv5"] Jul 09 13:56:35.764281 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:56:35.764260 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode554efeb_6d02_419b_9035_f5b8671d7dcf.slice/crio-0f3dbd882df33f596e84d5a4d3a54765efbf9329d1b1cdcafab38ecb8d68b711 WatchSource:0}: Error finding container 0f3dbd882df33f596e84d5a4d3a54765efbf9329d1b1cdcafab38ecb8d68b711: Status 404 returned error can't find the container with id 0f3dbd882df33f596e84d5a4d3a54765efbf9329d1b1cdcafab38ecb8d68b711 Jul 09 13:56:36.752919 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:36.752887 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5swv5" event={"ID":"e554efeb-6d02-419b-9035-f5b8671d7dcf","Type":"ContainerStarted","Data":"0f3dbd882df33f596e84d5a4d3a54765efbf9329d1b1cdcafab38ecb8d68b711"} Jul 09 13:56:37.494260 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:37.494234 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 09 13:56:37.759129 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:37.759088 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5swv5" event={"ID":"e554efeb-6d02-419b-9035-f5b8671d7dcf","Type":"ContainerStarted","Data":"37ef1b8c6a6b4c15787e52c2d2bbe519ae5a1eb24f08f26a87fbf30ebfdc556e"} Jul 09 13:56:37.759530 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:37.759153 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5swv5" Jul 09 13:56:37.776154 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:37.776104 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5swv5" podStartSLOduration=1.0506163609999999 podStartE2EDuration="2.776085541s" totalImagesPullingTime="1.72546918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:56:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:56:37.77473915 +0000 UTC m=+422.681313350" watchObservedRunningTime="2026-07-09 13:56:37.776085541 +0000 UTC m=+422.682659739" Jul 09 13:56:38.972141 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:38.972105 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm6qk"] Jul 09 13:56:38.975652 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:38.975631 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm6qk" Jul 09 13:56:38.978056 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:38.978036 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-57cfh\"" Jul 09 13:56:38.987433 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:38.987412 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm6qk"] Jul 09 13:56:39.069899 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:39.069864 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt7tn\" (UniqueName: \"kubernetes.io/projected/c1567efa-0e54-4e74-b43c-107b367f7ae9-kube-api-access-tt7tn\") pod \"limitador-operator-controller-manager-859d7b78bd-qm6qk\" (UID: \"c1567efa-0e54-4e74-b43c-107b367f7ae9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm6qk" Jul 09 13:56:39.171062 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:39.171021 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt7tn\" (UniqueName: \"kubernetes.io/projected/c1567efa-0e54-4e74-b43c-107b367f7ae9-kube-api-access-tt7tn\") pod \"limitador-operator-controller-manager-859d7b78bd-qm6qk\" (UID: \"c1567efa-0e54-4e74-b43c-107b367f7ae9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm6qk" Jul 09 13:56:39.182350 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:39.182317 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt7tn\" (UniqueName: \"kubernetes.io/projected/c1567efa-0e54-4e74-b43c-107b367f7ae9-kube-api-access-tt7tn\") pod \"limitador-operator-controller-manager-859d7b78bd-qm6qk\" (UID: \"c1567efa-0e54-4e74-b43c-107b367f7ae9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm6qk" Jul 09 13:56:39.286461 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:39.286412 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm6qk" Jul 09 13:56:39.442602 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:39.442576 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm6qk"] Jul 09 13:56:39.444234 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:56:39.444197 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1567efa_0e54_4e74_b43c_107b367f7ae9.slice/crio-3b7aef1815d89ac785ba5a12f599f925309401c9ce9af2fd2b5248775e118520 WatchSource:0}: Error finding container 3b7aef1815d89ac785ba5a12f599f925309401c9ce9af2fd2b5248775e118520: Status 404 returned error can't find the container with id 3b7aef1815d89ac785ba5a12f599f925309401c9ce9af2fd2b5248775e118520 Jul 09 13:56:39.770152 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:39.770113 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm6qk" event={"ID":"c1567efa-0e54-4e74-b43c-107b367f7ae9","Type":"ContainerStarted","Data":"3b7aef1815d89ac785ba5a12f599f925309401c9ce9af2fd2b5248775e118520"} Jul 09 13:56:41.783211 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:41.783178 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm6qk" event={"ID":"c1567efa-0e54-4e74-b43c-107b367f7ae9","Type":"ContainerStarted","Data":"428654daa81d9b824344077aa11a993770fbd87fd18b35d2616acb22fd7ea83e"} Jul 09 13:56:41.783591 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:41.783280 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm6qk" Jul 09 13:56:41.802640 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:41.802587 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm6qk" podStartSLOduration=2.032624745 podStartE2EDuration="3.802568167s" totalImagesPullingTime="1.769943422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:56:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:56:41.801184842 +0000 UTC m=+426.707759034" watchObservedRunningTime="2026-07-09 13:56:41.802568167 +0000 UTC m=+426.709142359" Jul 09 13:56:42.868194 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:42.868152 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-nppw9"] Jul 09 13:56:42.874654 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:42.874625 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nppw9" Jul 09 13:56:42.877752 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:42.877717 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-c578n\"" Jul 09 13:56:42.884573 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:42.884547 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-nppw9"] Jul 09 13:56:43.011941 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:43.011899 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-675tv\" (UniqueName: \"kubernetes.io/projected/4950cc4b-3455-4bb3-a4a0-c71495dc44f7-kube-api-access-675tv\") pod \"authorino-operator-75cc8d5cb7-nppw9\" (UID: \"4950cc4b-3455-4bb3-a4a0-c71495dc44f7\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-nppw9" Jul 09 13:56:43.112527 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:43.112492 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-675tv\" (UniqueName: \"kubernetes.io/projected/4950cc4b-3455-4bb3-a4a0-c71495dc44f7-kube-api-access-675tv\") pod \"authorino-operator-75cc8d5cb7-nppw9\" (UID: \"4950cc4b-3455-4bb3-a4a0-c71495dc44f7\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-nppw9" Jul 09 13:56:43.120977 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:43.120893 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-675tv\" (UniqueName: \"kubernetes.io/projected/4950cc4b-3455-4bb3-a4a0-c71495dc44f7-kube-api-access-675tv\") pod \"authorino-operator-75cc8d5cb7-nppw9\" (UID: \"4950cc4b-3455-4bb3-a4a0-c71495dc44f7\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-nppw9" Jul 09 13:56:43.186727 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:43.186690 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nppw9" Jul 09 13:56:43.324236 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:43.324213 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-nppw9"] Jul 09 13:56:43.326193 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:56:43.326165 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4950cc4b_3455_4bb3_a4a0_c71495dc44f7.slice/crio-e7fb9363ac981a37eb87bbed211df85de62637c29db2f65f1699f6051fca25e7 WatchSource:0}: Error finding container e7fb9363ac981a37eb87bbed211df85de62637c29db2f65f1699f6051fca25e7: Status 404 returned error can't find the container with id e7fb9363ac981a37eb87bbed211df85de62637c29db2f65f1699f6051fca25e7 Jul 09 13:56:43.794611 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:43.794574 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nppw9" event={"ID":"4950cc4b-3455-4bb3-a4a0-c71495dc44f7","Type":"ContainerStarted","Data":"e7fb9363ac981a37eb87bbed211df85de62637c29db2f65f1699f6051fca25e7"} Jul 09 13:56:46.812397 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:46.812361 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nppw9" event={"ID":"4950cc4b-3455-4bb3-a4a0-c71495dc44f7","Type":"ContainerStarted","Data":"4c762506986feaa3d8e4ba79e4135bff45d9128f4c198ae88bf642c26db5be7e"} Jul 09 13:56:46.812786 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:46.812466 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nppw9" Jul 09 13:56:46.833534 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:46.833473 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nppw9" podStartSLOduration=2.39621131 podStartE2EDuration="4.833455595s" totalImagesPullingTime="2.437244285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:56:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:56:46.831784109 +0000 UTC m=+431.738358302" watchObservedRunningTime="2026-07-09 13:56:46.833455595 +0000 UTC m=+431.740029787" Jul 09 13:56:47.769255 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:47.769222 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x5tw8"] Jul 09 13:56:47.772801 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:47.772785 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x5tw8" Jul 09 13:56:47.775592 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:47.775570 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-dxjdk\"" Jul 09 13:56:47.787215 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:47.787193 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x5tw8"] Jul 09 13:56:47.952010 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:47.951976 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f94f06c-1c01-4b60-ba2b-a146aa30fd19-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x5tw8\" (UID: \"0f94f06c-1c01-4b60-ba2b-a146aa30fd19\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x5tw8" Jul 09 13:56:47.952377 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:47.952015 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42jkc\" (UniqueName: \"kubernetes.io/projected/0f94f06c-1c01-4b60-ba2b-a146aa30fd19-kube-api-access-42jkc\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x5tw8\" (UID: \"0f94f06c-1c01-4b60-ba2b-a146aa30fd19\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x5tw8" Jul 09 13:56:48.053492 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:48.053408 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f94f06c-1c01-4b60-ba2b-a146aa30fd19-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x5tw8\" (UID: \"0f94f06c-1c01-4b60-ba2b-a146aa30fd19\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x5tw8" Jul 09 13:56:48.053492 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:48.053446 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42jkc\" (UniqueName: \"kubernetes.io/projected/0f94f06c-1c01-4b60-ba2b-a146aa30fd19-kube-api-access-42jkc\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x5tw8\" (UID: \"0f94f06c-1c01-4b60-ba2b-a146aa30fd19\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x5tw8" Jul 09 13:56:48.053848 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:48.053791 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f94f06c-1c01-4b60-ba2b-a146aa30fd19-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x5tw8\" (UID: \"0f94f06c-1c01-4b60-ba2b-a146aa30fd19\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x5tw8" Jul 09 13:56:48.064692 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:48.064668 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42jkc\" (UniqueName: \"kubernetes.io/projected/0f94f06c-1c01-4b60-ba2b-a146aa30fd19-kube-api-access-42jkc\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x5tw8\" (UID: \"0f94f06c-1c01-4b60-ba2b-a146aa30fd19\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x5tw8" Jul 09 13:56:48.082678 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:48.082646 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x5tw8" Jul 09 13:56:48.223414 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:48.223387 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x5tw8"] Jul 09 13:56:48.224799 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:56:48.224775 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f94f06c_1c01_4b60_ba2b_a146aa30fd19.slice/crio-e751fb4e9f185966075c7778affbf01ddd0120af5d3daefcc783f1a47ad4f0bb WatchSource:0}: Error finding container e751fb4e9f185966075c7778affbf01ddd0120af5d3daefcc783f1a47ad4f0bb: Status 404 returned error can't find the container with id e751fb4e9f185966075c7778affbf01ddd0120af5d3daefcc783f1a47ad4f0bb Jul 09 13:56:48.766474 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:48.766433 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5swv5" Jul 09 13:56:48.825105 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:48.825073 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x5tw8" event={"ID":"0f94f06c-1c01-4b60-ba2b-a146aa30fd19","Type":"ContainerStarted","Data":"e751fb4e9f185966075c7778affbf01ddd0120af5d3daefcc783f1a47ad4f0bb"} Jul 09 13:56:52.790821 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:52.790789 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm6qk" Jul 09 13:56:54.861776 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:54.861736 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x5tw8" event={"ID":"0f94f06c-1c01-4b60-ba2b-a146aa30fd19","Type":"ContainerStarted","Data":"8be18d1c9ed16093ed4f9e589a7453b651413f8a37b27a518b4baf8781524af7"} Jul 09 13:56:54.862210 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:54.861893 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x5tw8" Jul 09 13:56:54.882707 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:54.882659 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x5tw8" podStartSLOduration=2.019812787 podStartE2EDuration="7.882641549s" totalImagesPullingTime="5.862828762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:56:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:56:54.880786478 +0000 UTC m=+439.787360672" watchObservedRunningTime="2026-07-09 13:56:54.882641549 +0000 UTC m=+439.789215741" Jul 09 13:56:56.718724 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:56.718637 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9522k"] Jul 09 13:56:56.723600 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:56.723578 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9522k" Jul 09 13:56:56.725986 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:56.725968 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 09 13:56:56.726232 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:56.726213 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-s4wpn\"" Jul 09 13:56:56.726324 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:56.726233 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 09 13:56:56.733739 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:56.733709 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/87ea7dbe-04f4-4490-8f94-724218435c7b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9522k\" (UID: \"87ea7dbe-04f4-4490-8f94-724218435c7b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9522k" Jul 09 13:56:56.733867 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:56.733826 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/87ea7dbe-04f4-4490-8f94-724218435c7b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9522k\" (UID: \"87ea7dbe-04f4-4490-8f94-724218435c7b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9522k" Jul 09 13:56:56.733867 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:56.733857 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mbrw\" (UniqueName: \"kubernetes.io/projected/87ea7dbe-04f4-4490-8f94-724218435c7b-kube-api-access-2mbrw\") pod \"kuadrant-console-plugin-66b5774985-9522k\" (UID: \"87ea7dbe-04f4-4490-8f94-724218435c7b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9522k" Jul 09 13:56:56.735517 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:56.735496 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9522k"] Jul 09 13:56:56.835259 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:56.835223 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/87ea7dbe-04f4-4490-8f94-724218435c7b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9522k\" (UID: \"87ea7dbe-04f4-4490-8f94-724218435c7b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9522k" Jul 09 13:56:56.835441 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:56.835305 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/87ea7dbe-04f4-4490-8f94-724218435c7b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9522k\" (UID: \"87ea7dbe-04f4-4490-8f94-724218435c7b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9522k" Jul 09 13:56:56.835441 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:56.835325 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mbrw\" (UniqueName: \"kubernetes.io/projected/87ea7dbe-04f4-4490-8f94-724218435c7b-kube-api-access-2mbrw\") pod \"kuadrant-console-plugin-66b5774985-9522k\" (UID: \"87ea7dbe-04f4-4490-8f94-724218435c7b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9522k" Jul 09 13:56:56.835441 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:56:56.835343 2573 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 09 13:56:56.835441 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:56:56.835415 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87ea7dbe-04f4-4490-8f94-724218435c7b-plugin-serving-cert podName:87ea7dbe-04f4-4490-8f94-724218435c7b nodeName:}" failed. No retries permitted until 2026-07-09 13:56:57.335397014 +0000 UTC m=+442.241971185 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/87ea7dbe-04f4-4490-8f94-724218435c7b-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-9522k" (UID: "87ea7dbe-04f4-4490-8f94-724218435c7b") : secret "plugin-serving-cert" not found Jul 09 13:56:56.836417 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:56.836397 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/87ea7dbe-04f4-4490-8f94-724218435c7b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9522k\" (UID: \"87ea7dbe-04f4-4490-8f94-724218435c7b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9522k" Jul 09 13:56:56.846602 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:56.846578 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mbrw\" (UniqueName: \"kubernetes.io/projected/87ea7dbe-04f4-4490-8f94-724218435c7b-kube-api-access-2mbrw\") pod \"kuadrant-console-plugin-66b5774985-9522k\" (UID: \"87ea7dbe-04f4-4490-8f94-724218435c7b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9522k" Jul 09 13:56:57.339511 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:57.339471 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/87ea7dbe-04f4-4490-8f94-724218435c7b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9522k\" (UID: \"87ea7dbe-04f4-4490-8f94-724218435c7b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9522k" Jul 09 13:56:57.342092 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:57.342060 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/87ea7dbe-04f4-4490-8f94-724218435c7b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9522k\" (UID: \"87ea7dbe-04f4-4490-8f94-724218435c7b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9522k" Jul 09 13:56:57.637168 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:57.637086 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9522k" Jul 09 13:56:57.771885 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:57.771848 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9522k"] Jul 09 13:56:57.773518 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:56:57.773484 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod87ea7dbe_04f4_4490_8f94_724218435c7b.slice/crio-e72217429d5ff5a5678acf6da6eaa210113329b780b8c72448c1774dc4bce49c WatchSource:0}: Error finding container e72217429d5ff5a5678acf6da6eaa210113329b780b8c72448c1774dc4bce49c: Status 404 returned error can't find the container with id e72217429d5ff5a5678acf6da6eaa210113329b780b8c72448c1774dc4bce49c Jul 09 13:56:57.819154 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:57.819130 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nppw9" Jul 09 13:56:57.878827 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:56:57.878777 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9522k" event={"ID":"87ea7dbe-04f4-4490-8f94-724218435c7b","Type":"ContainerStarted","Data":"e72217429d5ff5a5678acf6da6eaa210113329b780b8c72448c1774dc4bce49c"} Jul 09 13:57:05.870057 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:05.870022 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x5tw8" Jul 09 13:57:07.660461 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:07.660426 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x5tw8"] Jul 09 13:57:07.661049 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:07.660636 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x5tw8" podUID="0f94f06c-1c01-4b60-ba2b-a146aa30fd19" containerName="manager" containerID="cri-o://8be18d1c9ed16093ed4f9e589a7453b651413f8a37b27a518b4baf8781524af7" gracePeriod=2 Jul 09 13:57:07.674752 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:07.674431 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x5tw8"] Jul 09 13:57:07.688369 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:57:07.688315 2573 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"0f94f06c-1c01-4b60-ba2b-a146aa30fd19\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-x5tw8\": pods \"kuadrant-operator-controller-manager-8684c9ff49-x5tw8\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x5tw8" Jul 09 13:57:07.691128 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:07.691100 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nqv29"] Jul 09 13:57:07.691575 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:07.691554 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f94f06c-1c01-4b60-ba2b-a146aa30fd19" containerName="manager" Jul 09 13:57:07.691673 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:07.691579 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f94f06c-1c01-4b60-ba2b-a146aa30fd19" containerName="manager" Jul 09 13:57:07.691673 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:07.691669 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f94f06c-1c01-4b60-ba2b-a146aa30fd19" containerName="manager" Jul 09 13:57:07.695049 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:07.695024 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nqv29" Jul 09 13:57:07.699092 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:07.699067 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm6qk"] Jul 09 13:57:07.699337 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:07.699313 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm6qk" podUID="c1567efa-0e54-4e74-b43c-107b367f7ae9" containerName="manager" containerID="cri-o://428654daa81d9b824344077aa11a993770fbd87fd18b35d2616acb22fd7ea83e" gracePeriod=2 Jul 09 13:57:07.706955 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:07.706931 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm6qk"] Jul 09 13:57:07.714649 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:07.714619 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nqv29"] Jul 09 13:57:07.721899 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:07.721868 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lgsk\" (UniqueName: \"kubernetes.io/projected/824b8fcb-162d-4fa9-aa5b-6a2b51609c81-kube-api-access-8lgsk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nqv29\" (UID: \"824b8fcb-162d-4fa9-aa5b-6a2b51609c81\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nqv29" Jul 09 13:57:07.722025 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:07.721928 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/824b8fcb-162d-4fa9-aa5b-6a2b51609c81-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nqv29\" (UID: \"824b8fcb-162d-4fa9-aa5b-6a2b51609c81\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nqv29" Jul 09 13:57:07.732138 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:07.732074 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9rjl"] Jul 09 13:57:07.732917 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:07.732892 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1567efa-0e54-4e74-b43c-107b367f7ae9" containerName="manager" Jul 09 13:57:07.732917 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:07.732919 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1567efa-0e54-4e74-b43c-107b367f7ae9" containerName="manager" Jul 09 13:57:07.733158 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:07.733021 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1567efa-0e54-4e74-b43c-107b367f7ae9" containerName="manager" Jul 09 13:57:07.734141 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:57:07.734110 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-x5tw8\" is forbidden: User \"system:node:ip-10-0-143-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-92.ec2.internal' and this object" podUID="0f94f06c-1c01-4b60-ba2b-a146aa30fd19" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x5tw8" Jul 09 13:57:07.736312 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:57:07.736276 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-x5tw8\" is forbidden: User \"system:node:ip-10-0-143-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-92.ec2.internal' and this object" podUID="0f94f06c-1c01-4b60-ba2b-a146aa30fd19" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x5tw8" Jul 09 13:57:07.737581 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:07.737550 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9rjl" Jul 09 13:57:07.738396 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:57:07.738181 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qm6qk\" is forbidden: User \"system:node:ip-10-0-143-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-92.ec2.internal' and this object" podUID="c1567efa-0e54-4e74-b43c-107b367f7ae9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm6qk" Jul 09 13:57:07.740095 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:57:07.740055 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qm6qk\" is forbidden: User \"system:node:ip-10-0-143-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-92.ec2.internal' and this object" podUID="c1567efa-0e54-4e74-b43c-107b367f7ae9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm6qk" Jul 09 13:57:07.742123 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:57:07.742083 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-x5tw8\" is forbidden: User \"system:node:ip-10-0-143-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-92.ec2.internal' and this object" podUID="0f94f06c-1c01-4b60-ba2b-a146aa30fd19" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x5tw8" Jul 09 13:57:07.745038 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:07.745014 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9rjl"] Jul 09 13:57:07.823025 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:07.822978 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mckwf\" (UniqueName: \"kubernetes.io/projected/325e9be6-d5db-4131-9ae7-7da95b5b5168-kube-api-access-mckwf\") pod \"limitador-operator-controller-manager-859d7b78bd-k9rjl\" (UID: \"325e9be6-d5db-4131-9ae7-7da95b5b5168\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9rjl" Jul 09 13:57:07.823279 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:07.823252 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lgsk\" (UniqueName: \"kubernetes.io/projected/824b8fcb-162d-4fa9-aa5b-6a2b51609c81-kube-api-access-8lgsk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nqv29\" (UID: \"824b8fcb-162d-4fa9-aa5b-6a2b51609c81\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nqv29" Jul 09 13:57:07.823413 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:07.823301 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/824b8fcb-162d-4fa9-aa5b-6a2b51609c81-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nqv29\" (UID: \"824b8fcb-162d-4fa9-aa5b-6a2b51609c81\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nqv29" Jul 09 13:57:07.823685 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:07.823664 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/824b8fcb-162d-4fa9-aa5b-6a2b51609c81-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nqv29\" (UID: \"824b8fcb-162d-4fa9-aa5b-6a2b51609c81\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nqv29" Jul 09 13:57:07.836840 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:07.836779 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lgsk\" (UniqueName: \"kubernetes.io/projected/824b8fcb-162d-4fa9-aa5b-6a2b51609c81-kube-api-access-8lgsk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nqv29\" (UID: \"824b8fcb-162d-4fa9-aa5b-6a2b51609c81\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nqv29" Jul 09 13:57:07.924595 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:07.924508 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mckwf\" (UniqueName: \"kubernetes.io/projected/325e9be6-d5db-4131-9ae7-7da95b5b5168-kube-api-access-mckwf\") pod \"limitador-operator-controller-manager-859d7b78bd-k9rjl\" (UID: \"325e9be6-d5db-4131-9ae7-7da95b5b5168\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9rjl" Jul 09 13:57:07.934468 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:07.934432 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mckwf\" (UniqueName: \"kubernetes.io/projected/325e9be6-d5db-4131-9ae7-7da95b5b5168-kube-api-access-mckwf\") pod \"limitador-operator-controller-manager-859d7b78bd-k9rjl\" (UID: \"325e9be6-d5db-4131-9ae7-7da95b5b5168\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9rjl" Jul 09 13:57:08.078316 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:08.078281 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nqv29" Jul 09 13:57:08.085421 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:08.085383 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9rjl" Jul 09 13:57:20.039595 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:20.039511 2573 generic.go:356] "Generic (PLEG): container finished" podID="c1567efa-0e54-4e74-b43c-107b367f7ae9" containerID="428654daa81d9b824344077aa11a993770fbd87fd18b35d2616acb22fd7ea83e" exitCode=0 Jul 09 13:57:20.042204 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:20.042115 2573 generic.go:356] "Generic (PLEG): container finished" podID="0f94f06c-1c01-4b60-ba2b-a146aa30fd19" containerID="8be18d1c9ed16093ed4f9e589a7453b651413f8a37b27a518b4baf8781524af7" exitCode=0 Jul 09 13:57:20.145304 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:20.145237 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm6qk" Jul 09 13:57:20.150421 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:57:20.150383 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qm6qk\" is forbidden: User \"system:node:ip-10-0-143-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-92.ec2.internal' and this object" podUID="c1567efa-0e54-4e74-b43c-107b367f7ae9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm6qk" Jul 09 13:57:20.169041 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:20.169002 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x5tw8" Jul 09 13:57:20.173913 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:57:20.173876 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-x5tw8\" is forbidden: User \"system:node:ip-10-0-143-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-92.ec2.internal' and this object" podUID="0f94f06c-1c01-4b60-ba2b-a146aa30fd19" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x5tw8" Jul 09 13:57:20.176166 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:57:20.176130 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qm6qk\" is forbidden: User \"system:node:ip-10-0-143-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-92.ec2.internal' and this object" podUID="c1567efa-0e54-4e74-b43c-107b367f7ae9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm6qk" Jul 09 13:57:20.186075 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:20.186050 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9rjl"] Jul 09 13:57:20.188482 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:57:20.188454 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod325e9be6_d5db_4131_9ae7_7da95b5b5168.slice/crio-a56affcd6d94b36ea00133147c758c79e90dc33f3cc2cd7e76ac308be2c26dd1 WatchSource:0}: Error finding container a56affcd6d94b36ea00133147c758c79e90dc33f3cc2cd7e76ac308be2c26dd1: Status 404 returned error can't find the container with id a56affcd6d94b36ea00133147c758c79e90dc33f3cc2cd7e76ac308be2c26dd1 Jul 09 13:57:20.208148 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:20.208119 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nqv29"] Jul 09 13:57:20.209895 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:57:20.209870 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod824b8fcb_162d_4fa9_aa5b_6a2b51609c81.slice/crio-fb71f17d1cd147d4843e5f9144d35e1682618f22802a84e61bc1dc7afab3eaed WatchSource:0}: Error finding container fb71f17d1cd147d4843e5f9144d35e1682618f22802a84e61bc1dc7afab3eaed: Status 404 returned error can't find the container with id fb71f17d1cd147d4843e5f9144d35e1682618f22802a84e61bc1dc7afab3eaed Jul 09 13:57:20.236609 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:20.236576 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tt7tn\" (UniqueName: \"kubernetes.io/projected/c1567efa-0e54-4e74-b43c-107b367f7ae9-kube-api-access-tt7tn\") pod \"c1567efa-0e54-4e74-b43c-107b367f7ae9\" (UID: \"c1567efa-0e54-4e74-b43c-107b367f7ae9\") " Jul 09 13:57:20.236698 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:20.236631 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42jkc\" (UniqueName: \"kubernetes.io/projected/0f94f06c-1c01-4b60-ba2b-a146aa30fd19-kube-api-access-42jkc\") pod \"0f94f06c-1c01-4b60-ba2b-a146aa30fd19\" (UID: \"0f94f06c-1c01-4b60-ba2b-a146aa30fd19\") " Jul 09 13:57:20.236779 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:20.236762 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f94f06c-1c01-4b60-ba2b-a146aa30fd19-extensions-socket-volume\") pod \"0f94f06c-1c01-4b60-ba2b-a146aa30fd19\" (UID: \"0f94f06c-1c01-4b60-ba2b-a146aa30fd19\") " Jul 09 13:57:20.237242 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:20.237215 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f94f06c-1c01-4b60-ba2b-a146aa30fd19-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0f94f06c-1c01-4b60-ba2b-a146aa30fd19" (UID: "0f94f06c-1c01-4b60-ba2b-a146aa30fd19"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 13:57:20.238945 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:20.238924 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1567efa-0e54-4e74-b43c-107b367f7ae9-kube-api-access-tt7tn" (OuterVolumeSpecName: "kube-api-access-tt7tn") pod "c1567efa-0e54-4e74-b43c-107b367f7ae9" (UID: "c1567efa-0e54-4e74-b43c-107b367f7ae9"). InnerVolumeSpecName "kube-api-access-tt7tn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 13:57:20.239463 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:20.239435 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f94f06c-1c01-4b60-ba2b-a146aa30fd19-kube-api-access-42jkc" (OuterVolumeSpecName: "kube-api-access-42jkc") pod "0f94f06c-1c01-4b60-ba2b-a146aa30fd19" (UID: "0f94f06c-1c01-4b60-ba2b-a146aa30fd19"). InnerVolumeSpecName "kube-api-access-42jkc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 13:57:20.337878 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:20.337846 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f94f06c-1c01-4b60-ba2b-a146aa30fd19-extensions-socket-volume\") on node \"ip-10-0-143-92.ec2.internal\" DevicePath \"\"" Jul 09 13:57:20.337878 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:20.337873 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tt7tn\" (UniqueName: \"kubernetes.io/projected/c1567efa-0e54-4e74-b43c-107b367f7ae9-kube-api-access-tt7tn\") on node \"ip-10-0-143-92.ec2.internal\" DevicePath \"\"" Jul 09 13:57:20.337878 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:20.337883 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42jkc\" (UniqueName: \"kubernetes.io/projected/0f94f06c-1c01-4b60-ba2b-a146aa30fd19-kube-api-access-42jkc\") on node \"ip-10-0-143-92.ec2.internal\" DevicePath \"\"" Jul 09 13:57:21.048892 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:21.048845 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9522k" event={"ID":"87ea7dbe-04f4-4490-8f94-724218435c7b","Type":"ContainerStarted","Data":"e98fa49c02de0b4f024e710983fa2ad3fe2852459d5ab14435b7b1ba2903a2be"} Jul 09 13:57:21.050435 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:21.050413 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nqv29" event={"ID":"824b8fcb-162d-4fa9-aa5b-6a2b51609c81","Type":"ContainerStarted","Data":"beceade0786b421a7e7be7c881d6751220b6ecdf7e7c9594da10fef7aab1a8fb"} Jul 09 13:57:21.050661 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:21.050461 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nqv29" event={"ID":"824b8fcb-162d-4fa9-aa5b-6a2b51609c81","Type":"ContainerStarted","Data":"fb71f17d1cd147d4843e5f9144d35e1682618f22802a84e61bc1dc7afab3eaed"} Jul 09 13:57:21.050661 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:21.050507 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nqv29" Jul 09 13:57:21.050999 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:57:21.050975 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qm6qk\" is forbidden: User \"system:node:ip-10-0-143-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-92.ec2.internal' and this object" podUID="c1567efa-0e54-4e74-b43c-107b367f7ae9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm6qk" Jul 09 13:57:21.051746 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:21.051731 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm6qk" Jul 09 13:57:21.051837 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:21.051774 2573 scope.go:117] "RemoveContainer" containerID="428654daa81d9b824344077aa11a993770fbd87fd18b35d2616acb22fd7ea83e" Jul 09 13:57:21.053343 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:21.053232 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x5tw8" Jul 09 13:57:21.054948 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:21.054924 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9rjl" event={"ID":"325e9be6-d5db-4131-9ae7-7da95b5b5168","Type":"ContainerStarted","Data":"af8efad30d1061d64514466b4acd3d1845accb58948cb8c4fd5a5aa87a9fef52"} Jul 09 13:57:21.055073 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:21.054969 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9rjl" event={"ID":"325e9be6-d5db-4131-9ae7-7da95b5b5168","Type":"ContainerStarted","Data":"a56affcd6d94b36ea00133147c758c79e90dc33f3cc2cd7e76ac308be2c26dd1"} Jul 09 13:57:21.055134 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:21.055076 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9rjl" Jul 09 13:57:21.062060 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:21.062043 2573 scope.go:117] "RemoveContainer" containerID="8be18d1c9ed16093ed4f9e589a7453b651413f8a37b27a518b4baf8781524af7" Jul 09 13:57:21.068543 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:21.068504 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9522k" podStartSLOduration=2.789455592 podStartE2EDuration="25.068490085s" totalImagesPullingTime="22.279034493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:56:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:57:21.066915256 +0000 UTC m=+465.973489450" watchObservedRunningTime="2026-07-09 13:57:21.068490085 +0000 UTC m=+465.975064278" Jul 09 13:57:21.068968 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:57:21.068942 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-x5tw8\" is forbidden: User \"system:node:ip-10-0-143-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-92.ec2.internal' and this object" podUID="0f94f06c-1c01-4b60-ba2b-a146aa30fd19" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x5tw8" Jul 09 13:57:21.070727 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:57:21.070699 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qm6qk\" is forbidden: User \"system:node:ip-10-0-143-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-92.ec2.internal' and this object" podUID="c1567efa-0e54-4e74-b43c-107b367f7ae9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm6qk" Jul 09 13:57:21.095408 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:21.095357 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nqv29" podStartSLOduration=14.095338211 podStartE2EDuration="14.095338211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:57:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:57:21.094073985 +0000 UTC m=+466.000648178" watchObservedRunningTime="2026-07-09 13:57:21.095338211 +0000 UTC m=+466.001912422" Jul 09 13:57:21.096454 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:57:21.096420 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-x5tw8\" is forbidden: User \"system:node:ip-10-0-143-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-92.ec2.internal' and this object" podUID="0f94f06c-1c01-4b60-ba2b-a146aa30fd19" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x5tw8" Jul 09 13:57:21.116196 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:21.116147 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9rjl" podStartSLOduration=14.11613123 podStartE2EDuration="14.11613123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:57:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:57:21.115488529 +0000 UTC m=+466.022062723" watchObservedRunningTime="2026-07-09 13:57:21.11613123 +0000 UTC m=+466.022705424" Jul 09 13:57:21.613540 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:21.613508 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f94f06c-1c01-4b60-ba2b-a146aa30fd19" path="/var/lib/kubelet/pods/0f94f06c-1c01-4b60-ba2b-a146aa30fd19/volumes" Jul 09 13:57:21.613857 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:21.613844 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1567efa-0e54-4e74-b43c-107b367f7ae9" path="/var/lib/kubelet/pods/c1567efa-0e54-4e74-b43c-107b367f7ae9/volumes" Jul 09 13:57:23.499688 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:23.499646 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nqv29"] Jul 09 13:57:23.500152 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:23.499848 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nqv29" podUID="824b8fcb-162d-4fa9-aa5b-6a2b51609c81" containerName="manager" containerID="cri-o://beceade0786b421a7e7be7c881d6751220b6ecdf7e7c9594da10fef7aab1a8fb" gracePeriod=10 Jul 09 13:57:23.741080 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:23.741054 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nqv29" Jul 09 13:57:23.865837 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:23.865775 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/824b8fcb-162d-4fa9-aa5b-6a2b51609c81-extensions-socket-volume\") pod \"824b8fcb-162d-4fa9-aa5b-6a2b51609c81\" (UID: \"824b8fcb-162d-4fa9-aa5b-6a2b51609c81\") " Jul 09 13:57:23.865990 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:23.865891 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8lgsk\" (UniqueName: \"kubernetes.io/projected/824b8fcb-162d-4fa9-aa5b-6a2b51609c81-kube-api-access-8lgsk\") pod \"824b8fcb-162d-4fa9-aa5b-6a2b51609c81\" (UID: \"824b8fcb-162d-4fa9-aa5b-6a2b51609c81\") " Jul 09 13:57:23.866101 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:23.866081 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/824b8fcb-162d-4fa9-aa5b-6a2b51609c81-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "824b8fcb-162d-4fa9-aa5b-6a2b51609c81" (UID: "824b8fcb-162d-4fa9-aa5b-6a2b51609c81"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 13:57:23.868128 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:23.868098 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/824b8fcb-162d-4fa9-aa5b-6a2b51609c81-kube-api-access-8lgsk" (OuterVolumeSpecName: "kube-api-access-8lgsk") pod "824b8fcb-162d-4fa9-aa5b-6a2b51609c81" (UID: "824b8fcb-162d-4fa9-aa5b-6a2b51609c81"). InnerVolumeSpecName "kube-api-access-8lgsk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 13:57:23.966832 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:23.966778 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/824b8fcb-162d-4fa9-aa5b-6a2b51609c81-extensions-socket-volume\") on node \"ip-10-0-143-92.ec2.internal\" DevicePath \"\"" Jul 09 13:57:23.967008 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:23.966842 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8lgsk\" (UniqueName: \"kubernetes.io/projected/824b8fcb-162d-4fa9-aa5b-6a2b51609c81-kube-api-access-8lgsk\") on node \"ip-10-0-143-92.ec2.internal\" DevicePath \"\"" Jul 09 13:57:24.073537 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:24.073498 2573 generic.go:356] "Generic (PLEG): container finished" podID="824b8fcb-162d-4fa9-aa5b-6a2b51609c81" containerID="beceade0786b421a7e7be7c881d6751220b6ecdf7e7c9594da10fef7aab1a8fb" exitCode=0 Jul 09 13:57:24.073708 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:24.073553 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nqv29" Jul 09 13:57:24.073708 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:24.073555 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nqv29" event={"ID":"824b8fcb-162d-4fa9-aa5b-6a2b51609c81","Type":"ContainerDied","Data":"beceade0786b421a7e7be7c881d6751220b6ecdf7e7c9594da10fef7aab1a8fb"} Jul 09 13:57:24.073708 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:24.073626 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nqv29" event={"ID":"824b8fcb-162d-4fa9-aa5b-6a2b51609c81","Type":"ContainerDied","Data":"fb71f17d1cd147d4843e5f9144d35e1682618f22802a84e61bc1dc7afab3eaed"} Jul 09 13:57:24.073708 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:24.073655 2573 scope.go:117] "RemoveContainer" containerID="beceade0786b421a7e7be7c881d6751220b6ecdf7e7c9594da10fef7aab1a8fb" Jul 09 13:57:24.083127 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:24.083112 2573 scope.go:117] "RemoveContainer" containerID="beceade0786b421a7e7be7c881d6751220b6ecdf7e7c9594da10fef7aab1a8fb" Jul 09 13:57:24.083376 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:57:24.083358 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"beceade0786b421a7e7be7c881d6751220b6ecdf7e7c9594da10fef7aab1a8fb\": container with ID starting with beceade0786b421a7e7be7c881d6751220b6ecdf7e7c9594da10fef7aab1a8fb not found: ID does not exist" containerID="beceade0786b421a7e7be7c881d6751220b6ecdf7e7c9594da10fef7aab1a8fb" Jul 09 13:57:24.083434 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:24.083381 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"beceade0786b421a7e7be7c881d6751220b6ecdf7e7c9594da10fef7aab1a8fb"} err="failed to get container status \"beceade0786b421a7e7be7c881d6751220b6ecdf7e7c9594da10fef7aab1a8fb\": rpc error: code = NotFound desc = could not find container \"beceade0786b421a7e7be7c881d6751220b6ecdf7e7c9594da10fef7aab1a8fb\": container with ID starting with beceade0786b421a7e7be7c881d6751220b6ecdf7e7c9594da10fef7aab1a8fb not found: ID does not exist" Jul 09 13:57:24.100960 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:24.100939 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nqv29"] Jul 09 13:57:24.104409 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:24.104387 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nqv29"] Jul 09 13:57:25.613408 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:25.613367 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="824b8fcb-162d-4fa9-aa5b-6a2b51609c81" path="/var/lib/kubelet/pods/824b8fcb-162d-4fa9-aa5b-6a2b51609c81/volumes" Jul 09 13:57:32.064966 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:32.064935 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9rjl" Jul 09 13:57:39.957687 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:39.957654 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vx6gs"] Jul 09 13:57:39.958122 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:39.958044 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="824b8fcb-162d-4fa9-aa5b-6a2b51609c81" containerName="manager" Jul 09 13:57:39.958122 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:39.958058 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="824b8fcb-162d-4fa9-aa5b-6a2b51609c81" containerName="manager" Jul 09 13:57:39.958199 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:39.958129 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="824b8fcb-162d-4fa9-aa5b-6a2b51609c81" containerName="manager" Jul 09 13:57:39.972708 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:39.972678 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vx6gs" Jul 09 13:57:39.975406 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:39.975381 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vx6gs"] Jul 09 13:57:39.975753 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:39.975736 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 09 13:57:39.975872 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:39.975826 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-9rqjn\"" Jul 09 13:57:40.110714 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:40.110676 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31f687a9-9b6c-4374-ba98-0d9c8efe1249-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-vx6gs\" (UID: \"31f687a9-9b6c-4374-ba98-0d9c8efe1249\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vx6gs" Jul 09 13:57:40.110714 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:40.110714 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31f687a9-9b6c-4374-ba98-0d9c8efe1249-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-vx6gs\" (UID: \"31f687a9-9b6c-4374-ba98-0d9c8efe1249\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vx6gs" Jul 09 13:57:40.110957 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:40.110735 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31f687a9-9b6c-4374-ba98-0d9c8efe1249-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vx6gs\" (UID: \"31f687a9-9b6c-4374-ba98-0d9c8efe1249\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vx6gs" Jul 09 13:57:40.110957 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:40.110792 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31f687a9-9b6c-4374-ba98-0d9c8efe1249-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vx6gs\" (UID: \"31f687a9-9b6c-4374-ba98-0d9c8efe1249\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vx6gs" Jul 09 13:57:40.110957 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:40.110833 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hngq\" (UniqueName: \"kubernetes.io/projected/31f687a9-9b6c-4374-ba98-0d9c8efe1249-kube-api-access-7hngq\") pod \"maas-default-gateway-openshift-default-56654dcf7-vx6gs\" (UID: \"31f687a9-9b6c-4374-ba98-0d9c8efe1249\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vx6gs" Jul 09 13:57:40.111082 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:40.110952 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31f687a9-9b6c-4374-ba98-0d9c8efe1249-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-vx6gs\" (UID: \"31f687a9-9b6c-4374-ba98-0d9c8efe1249\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vx6gs" Jul 09 13:57:40.111082 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:40.111009 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31f687a9-9b6c-4374-ba98-0d9c8efe1249-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-vx6gs\" (UID: \"31f687a9-9b6c-4374-ba98-0d9c8efe1249\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vx6gs" Jul 09 13:57:40.111082 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:40.111051 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31f687a9-9b6c-4374-ba98-0d9c8efe1249-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-vx6gs\" (UID: \"31f687a9-9b6c-4374-ba98-0d9c8efe1249\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vx6gs" Jul 09 13:57:40.111082 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:40.111075 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31f687a9-9b6c-4374-ba98-0d9c8efe1249-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-vx6gs\" (UID: \"31f687a9-9b6c-4374-ba98-0d9c8efe1249\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vx6gs" Jul 09 13:57:40.212412 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:40.212331 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31f687a9-9b6c-4374-ba98-0d9c8efe1249-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-vx6gs\" (UID: \"31f687a9-9b6c-4374-ba98-0d9c8efe1249\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vx6gs" Jul 09 13:57:40.212412 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:40.212365 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31f687a9-9b6c-4374-ba98-0d9c8efe1249-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-vx6gs\" (UID: \"31f687a9-9b6c-4374-ba98-0d9c8efe1249\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vx6gs" Jul 09 13:57:40.212412 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:40.212391 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31f687a9-9b6c-4374-ba98-0d9c8efe1249-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vx6gs\" (UID: \"31f687a9-9b6c-4374-ba98-0d9c8efe1249\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vx6gs" Jul 09 13:57:40.212690 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:40.212523 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31f687a9-9b6c-4374-ba98-0d9c8efe1249-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vx6gs\" (UID: \"31f687a9-9b6c-4374-ba98-0d9c8efe1249\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vx6gs" Jul 09 13:57:40.212690 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:40.212585 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hngq\" (UniqueName: \"kubernetes.io/projected/31f687a9-9b6c-4374-ba98-0d9c8efe1249-kube-api-access-7hngq\") pod \"maas-default-gateway-openshift-default-56654dcf7-vx6gs\" (UID: \"31f687a9-9b6c-4374-ba98-0d9c8efe1249\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vx6gs" Jul 09 13:57:40.212785 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:40.212695 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31f687a9-9b6c-4374-ba98-0d9c8efe1249-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-vx6gs\" (UID: \"31f687a9-9b6c-4374-ba98-0d9c8efe1249\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vx6gs" Jul 09 13:57:40.212879 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:40.212788 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31f687a9-9b6c-4374-ba98-0d9c8efe1249-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vx6gs\" (UID: \"31f687a9-9b6c-4374-ba98-0d9c8efe1249\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vx6gs" Jul 09 13:57:40.212879 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:40.212848 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31f687a9-9b6c-4374-ba98-0d9c8efe1249-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-vx6gs\" (UID: \"31f687a9-9b6c-4374-ba98-0d9c8efe1249\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vx6gs" Jul 09 13:57:40.212953 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:40.212883 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31f687a9-9b6c-4374-ba98-0d9c8efe1249-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vx6gs\" (UID: \"31f687a9-9b6c-4374-ba98-0d9c8efe1249\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vx6gs" Jul 09 13:57:40.213362 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:40.213343 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31f687a9-9b6c-4374-ba98-0d9c8efe1249-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-vx6gs\" (UID: \"31f687a9-9b6c-4374-ba98-0d9c8efe1249\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vx6gs" Jul 09 13:57:40.213412 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:40.213380 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31f687a9-9b6c-4374-ba98-0d9c8efe1249-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-vx6gs\" (UID: \"31f687a9-9b6c-4374-ba98-0d9c8efe1249\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vx6gs" Jul 09 13:57:40.213412 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:40.213397 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31f687a9-9b6c-4374-ba98-0d9c8efe1249-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-vx6gs\" (UID: \"31f687a9-9b6c-4374-ba98-0d9c8efe1249\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vx6gs" Jul 09 13:57:40.213516 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:40.213413 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31f687a9-9b6c-4374-ba98-0d9c8efe1249-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-vx6gs\" (UID: \"31f687a9-9b6c-4374-ba98-0d9c8efe1249\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vx6gs" Jul 09 13:57:40.213663 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:40.213633 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31f687a9-9b6c-4374-ba98-0d9c8efe1249-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-vx6gs\" (UID: \"31f687a9-9b6c-4374-ba98-0d9c8efe1249\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vx6gs" Jul 09 13:57:40.215729 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:40.215706 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31f687a9-9b6c-4374-ba98-0d9c8efe1249-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-vx6gs\" (UID: \"31f687a9-9b6c-4374-ba98-0d9c8efe1249\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vx6gs" Jul 09 13:57:40.215863 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:40.215845 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31f687a9-9b6c-4374-ba98-0d9c8efe1249-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-vx6gs\" (UID: \"31f687a9-9b6c-4374-ba98-0d9c8efe1249\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vx6gs" Jul 09 13:57:40.221519 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:40.221491 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hngq\" (UniqueName: \"kubernetes.io/projected/31f687a9-9b6c-4374-ba98-0d9c8efe1249-kube-api-access-7hngq\") pod \"maas-default-gateway-openshift-default-56654dcf7-vx6gs\" (UID: \"31f687a9-9b6c-4374-ba98-0d9c8efe1249\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vx6gs" Jul 09 13:57:40.222753 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:40.222731 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31f687a9-9b6c-4374-ba98-0d9c8efe1249-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-vx6gs\" (UID: \"31f687a9-9b6c-4374-ba98-0d9c8efe1249\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vx6gs" Jul 09 13:57:40.285861 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:40.285800 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vx6gs" Jul 09 13:57:40.446717 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:40.446695 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vx6gs"] Jul 09 13:57:40.448788 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:57:40.448755 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31f687a9_9b6c_4374_ba98_0d9c8efe1249.slice/crio-0df2ecb0d1527d365d9011c7046472a1abf529007b69d2db9f2b7a4df2945571 WatchSource:0}: Error finding container 0df2ecb0d1527d365d9011c7046472a1abf529007b69d2db9f2b7a4df2945571: Status 404 returned error can't find the container with id 0df2ecb0d1527d365d9011c7046472a1abf529007b69d2db9f2b7a4df2945571 Jul 09 13:57:41.178150 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:41.178117 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vx6gs" event={"ID":"31f687a9-9b6c-4374-ba98-0d9c8efe1249","Type":"ContainerStarted","Data":"0df2ecb0d1527d365d9011c7046472a1abf529007b69d2db9f2b7a4df2945571"} Jul 09 13:57:44.946741 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:44.946700 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 09 13:57:44.947077 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:44.946779 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 09 13:57:44.947077 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:44.946864 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 09 13:57:45.204341 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:45.204260 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vx6gs" event={"ID":"31f687a9-9b6c-4374-ba98-0d9c8efe1249","Type":"ContainerStarted","Data":"54fe00b5e1c5cf17c891b36fd1d4647610661f5c5b7978342aa64d06b63a2086"} Jul 09 13:57:45.228851 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:45.228774 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vx6gs" podStartSLOduration=1.733311762 podStartE2EDuration="6.228758167s" totalImagesPullingTime="4.495446405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:57:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:57:45.227290391 +0000 UTC m=+490.133864577" watchObservedRunningTime="2026-07-09 13:57:45.228758167 +0000 UTC m=+490.135332359" Jul 09 13:57:45.286296 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:45.286264 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vx6gs" Jul 09 13:57:46.291410 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:46.291379 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vx6gs" Jul 09 13:57:47.215385 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:47.215356 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vx6gs" Jul 09 13:57:47.216524 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:47.216503 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vx6gs" Jul 09 13:57:53.799834 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:53.799785 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vrxgj"] Jul 09 13:57:53.880252 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:53.880215 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vrxgj"] Jul 09 13:57:53.880441 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:53.880301 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-vrxgj" Jul 09 13:57:53.882525 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:53.882499 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 09 13:57:53.898775 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:53.898744 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vrxgj"] Jul 09 13:57:54.040995 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:54.040958 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md746\" (UniqueName: \"kubernetes.io/projected/184a6bde-1031-4a90-9d5c-9e6cfac7110c-kube-api-access-md746\") pod \"limitador-limitador-64c94fd64f-vrxgj\" (UID: \"184a6bde-1031-4a90-9d5c-9e6cfac7110c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vrxgj" Jul 09 13:57:54.041182 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:54.041005 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/184a6bde-1031-4a90-9d5c-9e6cfac7110c-config-file\") pod \"limitador-limitador-64c94fd64f-vrxgj\" (UID: \"184a6bde-1031-4a90-9d5c-9e6cfac7110c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vrxgj" Jul 09 13:57:54.142380 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:54.142294 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md746\" (UniqueName: \"kubernetes.io/projected/184a6bde-1031-4a90-9d5c-9e6cfac7110c-kube-api-access-md746\") pod \"limitador-limitador-64c94fd64f-vrxgj\" (UID: \"184a6bde-1031-4a90-9d5c-9e6cfac7110c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vrxgj" Jul 09 13:57:54.142380 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:54.142347 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/184a6bde-1031-4a90-9d5c-9e6cfac7110c-config-file\") pod \"limitador-limitador-64c94fd64f-vrxgj\" (UID: \"184a6bde-1031-4a90-9d5c-9e6cfac7110c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vrxgj" Jul 09 13:57:54.143001 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:54.142983 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/184a6bde-1031-4a90-9d5c-9e6cfac7110c-config-file\") pod \"limitador-limitador-64c94fd64f-vrxgj\" (UID: \"184a6bde-1031-4a90-9d5c-9e6cfac7110c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vrxgj" Jul 09 13:57:54.150455 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:54.150417 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-md746\" (UniqueName: \"kubernetes.io/projected/184a6bde-1031-4a90-9d5c-9e6cfac7110c-kube-api-access-md746\") pod \"limitador-limitador-64c94fd64f-vrxgj\" (UID: \"184a6bde-1031-4a90-9d5c-9e6cfac7110c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vrxgj" Jul 09 13:57:54.196107 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:54.196071 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-vrxgj" Jul 09 13:57:54.206724 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:54.206686 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nng55"] Jul 09 13:57:54.218309 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:54.218274 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-nng55" Jul 09 13:57:54.222076 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:54.222049 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nng55"] Jul 09 13:57:54.257528 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:54.257498 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nng55"] Jul 09 13:57:54.344200 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:54.344162 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl9nd\" (UniqueName: \"kubernetes.io/projected/a9e080de-80b3-4492-a03f-2e34e1f4315b-kube-api-access-sl9nd\") pod \"limitador-limitador-54d6d988d5-nng55\" (UID: \"a9e080de-80b3-4492-a03f-2e34e1f4315b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nng55" Jul 09 13:57:54.344360 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:54.344215 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a9e080de-80b3-4492-a03f-2e34e1f4315b-config-file\") pod \"limitador-limitador-54d6d988d5-nng55\" (UID: \"a9e080de-80b3-4492-a03f-2e34e1f4315b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nng55" Jul 09 13:57:54.350188 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:54.350115 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vrxgj"] Jul 09 13:57:54.352860 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:57:54.352830 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod184a6bde_1031_4a90_9d5c_9e6cfac7110c.slice/crio-10a95d0e3496747256eef46df3c10089c606701f5c3e44d87f785f0d28eacc83 WatchSource:0}: Error finding container 10a95d0e3496747256eef46df3c10089c606701f5c3e44d87f785f0d28eacc83: Status 404 returned error can't find the container with id 10a95d0e3496747256eef46df3c10089c606701f5c3e44d87f785f0d28eacc83 Jul 09 13:57:54.444783 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:54.444697 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl9nd\" (UniqueName: \"kubernetes.io/projected/a9e080de-80b3-4492-a03f-2e34e1f4315b-kube-api-access-sl9nd\") pod \"limitador-limitador-54d6d988d5-nng55\" (UID: \"a9e080de-80b3-4492-a03f-2e34e1f4315b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nng55" Jul 09 13:57:54.444783 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:54.444752 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a9e080de-80b3-4492-a03f-2e34e1f4315b-config-file\") pod \"limitador-limitador-54d6d988d5-nng55\" (UID: \"a9e080de-80b3-4492-a03f-2e34e1f4315b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nng55" Jul 09 13:57:54.445372 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:54.445353 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a9e080de-80b3-4492-a03f-2e34e1f4315b-config-file\") pod \"limitador-limitador-54d6d988d5-nng55\" (UID: \"a9e080de-80b3-4492-a03f-2e34e1f4315b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nng55" Jul 09 13:57:54.454459 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:54.454437 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl9nd\" (UniqueName: \"kubernetes.io/projected/a9e080de-80b3-4492-a03f-2e34e1f4315b-kube-api-access-sl9nd\") pod \"limitador-limitador-54d6d988d5-nng55\" (UID: \"a9e080de-80b3-4492-a03f-2e34e1f4315b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nng55" Jul 09 13:57:54.536649 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:54.536615 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-nng55" Jul 09 13:57:54.677450 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:54.677416 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nng55"] Jul 09 13:57:54.679336 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:57:54.679307 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9e080de_80b3_4492_a03f_2e34e1f4315b.slice/crio-d8318fbd0c43c403f8e823bc4aedf576a9246054eadd3f6a65aaed43e4897ba0 WatchSource:0}: Error finding container d8318fbd0c43c403f8e823bc4aedf576a9246054eadd3f6a65aaed43e4897ba0: Status 404 returned error can't find the container with id d8318fbd0c43c403f8e823bc4aedf576a9246054eadd3f6a65aaed43e4897ba0 Jul 09 13:57:55.268631 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:55.268587 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-nng55" event={"ID":"a9e080de-80b3-4492-a03f-2e34e1f4315b","Type":"ContainerStarted","Data":"d8318fbd0c43c403f8e823bc4aedf576a9246054eadd3f6a65aaed43e4897ba0"} Jul 09 13:57:55.271911 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:55.271877 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-vrxgj" event={"ID":"184a6bde-1031-4a90-9d5c-9e6cfac7110c","Type":"ContainerStarted","Data":"10a95d0e3496747256eef46df3c10089c606701f5c3e44d87f785f0d28eacc83"} Jul 09 13:57:58.293462 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:58.293422 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-nng55" event={"ID":"a9e080de-80b3-4492-a03f-2e34e1f4315b","Type":"ContainerStarted","Data":"095a9d9789197c7090961ee8dba0a242a28ce5fd610700e7a5fe6da81fea5394"} Jul 09 13:57:58.293944 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:58.293550 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-nng55" Jul 09 13:57:58.295184 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:58.295161 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-vrxgj" event={"ID":"184a6bde-1031-4a90-9d5c-9e6cfac7110c","Type":"ContainerStarted","Data":"745e1f7331096758be64680eec991a78f262284f6bdf0e4cd14a5a342226f8d7"} Jul 09 13:57:58.295302 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:58.295289 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-vrxgj" Jul 09 13:57:58.310042 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:58.309997 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-nng55" podStartSLOduration=1.7243448620000001 podStartE2EDuration="4.309983663s" totalImagesPullingTime="2.585638801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:57:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:57:58.308855367 +0000 UTC m=+503.215429559" watchObservedRunningTime="2026-07-09 13:57:58.309983663 +0000 UTC m=+503.216557856" Jul 09 13:57:58.326144 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:57:58.326103 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-vrxgj" podStartSLOduration=2.4212551319999998 podStartE2EDuration="5.326088675s" totalImagesPullingTime="2.904833543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:57:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:57:58.323995793 +0000 UTC m=+503.230570009" watchObservedRunningTime="2026-07-09 13:57:58.326088675 +0000 UTC m=+503.232662892" Jul 09 13:58:09.301332 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:58:09.301301 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-vrxgj" Jul 09 13:58:09.301787 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:58:09.301372 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-nng55" Jul 09 13:58:09.364565 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:58:09.364532 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vrxgj"] Jul 09 13:58:09.364733 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:58:09.364713 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-vrxgj" podUID="184a6bde-1031-4a90-9d5c-9e6cfac7110c" containerName="limitador" containerID="cri-o://745e1f7331096758be64680eec991a78f262284f6bdf0e4cd14a5a342226f8d7" gracePeriod=30 Jul 09 13:58:09.928816 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:58:09.928748 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-vrxgj" Jul 09 13:58:09.982430 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:58:09.982399 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/184a6bde-1031-4a90-9d5c-9e6cfac7110c-config-file\") pod \"184a6bde-1031-4a90-9d5c-9e6cfac7110c\" (UID: \"184a6bde-1031-4a90-9d5c-9e6cfac7110c\") " Jul 09 13:58:09.982624 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:58:09.982469 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-md746\" (UniqueName: \"kubernetes.io/projected/184a6bde-1031-4a90-9d5c-9e6cfac7110c-kube-api-access-md746\") pod \"184a6bde-1031-4a90-9d5c-9e6cfac7110c\" (UID: \"184a6bde-1031-4a90-9d5c-9e6cfac7110c\") " Jul 09 13:58:09.982770 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:58:09.982732 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/184a6bde-1031-4a90-9d5c-9e6cfac7110c-config-file" (OuterVolumeSpecName: "config-file") pod "184a6bde-1031-4a90-9d5c-9e6cfac7110c" (UID: "184a6bde-1031-4a90-9d5c-9e6cfac7110c"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 13:58:09.984687 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:58:09.984664 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/184a6bde-1031-4a90-9d5c-9e6cfac7110c-kube-api-access-md746" (OuterVolumeSpecName: "kube-api-access-md746") pod "184a6bde-1031-4a90-9d5c-9e6cfac7110c" (UID: "184a6bde-1031-4a90-9d5c-9e6cfac7110c"). InnerVolumeSpecName "kube-api-access-md746". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 13:58:10.083955 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:58:10.083915 2573 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/184a6bde-1031-4a90-9d5c-9e6cfac7110c-config-file\") on node \"ip-10-0-143-92.ec2.internal\" DevicePath \"\"" Jul 09 13:58:10.083955 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:58:10.083953 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-md746\" (UniqueName: \"kubernetes.io/projected/184a6bde-1031-4a90-9d5c-9e6cfac7110c-kube-api-access-md746\") on node \"ip-10-0-143-92.ec2.internal\" DevicePath \"\"" Jul 09 13:58:10.360309 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:58:10.360268 2573 generic.go:356] "Generic (PLEG): container finished" podID="184a6bde-1031-4a90-9d5c-9e6cfac7110c" containerID="745e1f7331096758be64680eec991a78f262284f6bdf0e4cd14a5a342226f8d7" exitCode=0 Jul 09 13:58:10.360756 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:58:10.360380 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-vrxgj" event={"ID":"184a6bde-1031-4a90-9d5c-9e6cfac7110c","Type":"ContainerDied","Data":"745e1f7331096758be64680eec991a78f262284f6bdf0e4cd14a5a342226f8d7"} Jul 09 13:58:10.360756 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:58:10.360469 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-vrxgj" event={"ID":"184a6bde-1031-4a90-9d5c-9e6cfac7110c","Type":"ContainerDied","Data":"10a95d0e3496747256eef46df3c10089c606701f5c3e44d87f785f0d28eacc83"} Jul 09 13:58:10.360756 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:58:10.360511 2573 scope.go:117] "RemoveContainer" containerID="745e1f7331096758be64680eec991a78f262284f6bdf0e4cd14a5a342226f8d7" Jul 09 13:58:10.360756 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:58:10.360734 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-vrxgj" Jul 09 13:58:10.372842 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:58:10.372638 2573 scope.go:117] "RemoveContainer" containerID="745e1f7331096758be64680eec991a78f262284f6bdf0e4cd14a5a342226f8d7" Jul 09 13:58:10.372959 ip-10-0-143-92 kubenswrapper[2573]: E0709 13:58:10.372940 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"745e1f7331096758be64680eec991a78f262284f6bdf0e4cd14a5a342226f8d7\": container with ID starting with 745e1f7331096758be64680eec991a78f262284f6bdf0e4cd14a5a342226f8d7 not found: ID does not exist" containerID="745e1f7331096758be64680eec991a78f262284f6bdf0e4cd14a5a342226f8d7" Jul 09 13:58:10.373004 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:58:10.372968 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"745e1f7331096758be64680eec991a78f262284f6bdf0e4cd14a5a342226f8d7"} err="failed to get container status \"745e1f7331096758be64680eec991a78f262284f6bdf0e4cd14a5a342226f8d7\": rpc error: code = NotFound desc = could not find container \"745e1f7331096758be64680eec991a78f262284f6bdf0e4cd14a5a342226f8d7\": container with ID starting with 745e1f7331096758be64680eec991a78f262284f6bdf0e4cd14a5a342226f8d7 not found: ID does not exist" Jul 09 13:58:10.384623 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:58:10.384600 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vrxgj"] Jul 09 13:58:10.388027 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:58:10.388001 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vrxgj"] Jul 09 13:58:11.613278 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:58:11.613241 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="184a6bde-1031-4a90-9d5c-9e6cfac7110c" path="/var/lib/kubelet/pods/184a6bde-1031-4a90-9d5c-9e6cfac7110c/volumes" Jul 09 13:58:13.123723 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:58:13.123689 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-p9mtk"] Jul 09 13:58:13.124410 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:58:13.124385 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="184a6bde-1031-4a90-9d5c-9e6cfac7110c" containerName="limitador" Jul 09 13:58:13.124468 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:58:13.124417 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="184a6bde-1031-4a90-9d5c-9e6cfac7110c" containerName="limitador" Jul 09 13:58:13.124578 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:58:13.124565 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="184a6bde-1031-4a90-9d5c-9e6cfac7110c" containerName="limitador" Jul 09 13:58:13.128035 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:58:13.128009 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-p9mtk" Jul 09 13:58:13.130507 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:58:13.130488 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 09 13:58:13.130637 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:58:13.130494 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-4986d\"" Jul 09 13:58:13.138880 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:58:13.138856 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-p9mtk"] Jul 09 13:58:13.208681 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:58:13.208649 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e9a5c987-e961-43b1-b0b7-c2b78bab72ef-data\") pod \"postgres-69fb4594cf-p9mtk\" (UID: \"e9a5c987-e961-43b1-b0b7-c2b78bab72ef\") " pod="opendatahub/postgres-69fb4594cf-p9mtk" Jul 09 13:58:13.208864 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:58:13.208704 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg8lb\" (UniqueName: \"kubernetes.io/projected/e9a5c987-e961-43b1-b0b7-c2b78bab72ef-kube-api-access-sg8lb\") pod \"postgres-69fb4594cf-p9mtk\" (UID: \"e9a5c987-e961-43b1-b0b7-c2b78bab72ef\") " pod="opendatahub/postgres-69fb4594cf-p9mtk" Jul 09 13:58:13.309994 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:58:13.309961 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e9a5c987-e961-43b1-b0b7-c2b78bab72ef-data\") pod \"postgres-69fb4594cf-p9mtk\" (UID: \"e9a5c987-e961-43b1-b0b7-c2b78bab72ef\") " pod="opendatahub/postgres-69fb4594cf-p9mtk" Jul 09 13:58:13.310184 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:58:13.310022 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg8lb\" (UniqueName: \"kubernetes.io/projected/e9a5c987-e961-43b1-b0b7-c2b78bab72ef-kube-api-access-sg8lb\") pod \"postgres-69fb4594cf-p9mtk\" (UID: \"e9a5c987-e961-43b1-b0b7-c2b78bab72ef\") " pod="opendatahub/postgres-69fb4594cf-p9mtk" Jul 09 13:58:13.310360 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:58:13.310339 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e9a5c987-e961-43b1-b0b7-c2b78bab72ef-data\") pod \"postgres-69fb4594cf-p9mtk\" (UID: \"e9a5c987-e961-43b1-b0b7-c2b78bab72ef\") " pod="opendatahub/postgres-69fb4594cf-p9mtk" Jul 09 13:58:13.318018 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:58:13.317988 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg8lb\" (UniqueName: \"kubernetes.io/projected/e9a5c987-e961-43b1-b0b7-c2b78bab72ef-kube-api-access-sg8lb\") pod \"postgres-69fb4594cf-p9mtk\" (UID: \"e9a5c987-e961-43b1-b0b7-c2b78bab72ef\") " pod="opendatahub/postgres-69fb4594cf-p9mtk" Jul 09 13:58:13.442391 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:58:13.442305 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-p9mtk" Jul 09 13:58:13.577237 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:58:13.577212 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-p9mtk"] Jul 09 13:58:13.578985 ip-10-0-143-92 kubenswrapper[2573]: W0709 13:58:13.578955 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9a5c987_e961_43b1_b0b7_c2b78bab72ef.slice/crio-d8af653873d7cd444fd3ff404003c1b8670dd3e41b2d524ce29b32365229edcb WatchSource:0}: Error finding container d8af653873d7cd444fd3ff404003c1b8670dd3e41b2d524ce29b32365229edcb: Status 404 returned error can't find the container with id d8af653873d7cd444fd3ff404003c1b8670dd3e41b2d524ce29b32365229edcb Jul 09 13:58:14.383116 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:58:14.383074 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-p9mtk" event={"ID":"e9a5c987-e961-43b1-b0b7-c2b78bab72ef","Type":"ContainerStarted","Data":"d8af653873d7cd444fd3ff404003c1b8670dd3e41b2d524ce29b32365229edcb"} Jul 09 13:58:27.460019 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:58:27.459980 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-p9mtk" event={"ID":"e9a5c987-e961-43b1-b0b7-c2b78bab72ef","Type":"ContainerStarted","Data":"41edc699a6a5cb1893bba6afd4b618e4b6ce9bbbcd6e9c492401ae52c5d9da1f"} Jul 09 13:58:27.460444 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:58:27.460091 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-p9mtk" Jul 09 13:58:27.476228 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:58:27.476171 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-p9mtk" podStartSLOduration=1.3820323079999999 podStartE2EDuration="14.476154819s" totalImagesPullingTime="13.094122511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:58:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:58:27.474861253 +0000 UTC m=+532.381435446" watchObservedRunningTime="2026-07-09 13:58:27.476154819 +0000 UTC m=+532.382729022" Jul 09 13:58:33.496150 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:58:33.496121 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-p9mtk" Jul 09 13:59:35.552980 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:59:35.552943 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tvsqr_c6be1427-c9fa-45b4-a6ca-3aaf2be3513b/console-operator/1.log" Jul 09 13:59:35.553515 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:59:35.553199 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tvsqr_c6be1427-c9fa-45b4-a6ca-3aaf2be3513b/console-operator/1.log" Jul 09 13:59:35.561135 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:59:35.561115 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wlg95_fe725cde-9e4a-4b8f-b96e-90fb61415652/ovn-acl-logging/0.log" Jul 09 13:59:35.561237 ip-10-0-143-92 kubenswrapper[2573]: I0709 13:59:35.561120 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wlg95_fe725cde-9e4a-4b8f-b96e-90fb61415652/ovn-acl-logging/0.log" Jul 09 14:00:44.249661 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:00:44.249632 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-982m6_9924a967-2103-4b7c-acf4-28f56eabee1e/manager/0.log" Jul 09 14:00:44.367794 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:00:44.367762 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-dx7v9_78836108-c50f-4386-a1c4-63bdf5dff34e/manager/0.log" Jul 09 14:00:44.720221 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:00:44.720192 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-gx9fr_f9ca3e65-a70d-43ab-aa3e-50735275898a/server/0.log" Jul 09 14:00:44.836351 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:00:44.836323 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-n5c4n_991de508-49b7-4534-a574-c766515a33b1/manager/0.log" Jul 09 14:00:45.200492 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:00:45.200467 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-744bdb4fbc-tfbjg_70141934-48d2-4d3c-9425-7260b91ca5b9/copy-manifests/0.log" Jul 09 14:00:45.213167 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:00:45.213142 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-744bdb4fbc-tfbjg_70141934-48d2-4d3c-9425-7260b91ca5b9/manager/0.log" Jul 09 14:00:45.320566 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:00:45.320542 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-p9mtk_e9a5c987-e961-43b1-b0b7-c2b78bab72ef/postgres/0.log" Jul 09 14:00:45.976482 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:00:45.976452 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svnfh_ee101ac7-66a8-40ed-916c-246fd44d58ec/util/0.log" Jul 09 14:00:45.982801 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:00:45.982780 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svnfh_ee101ac7-66a8-40ed-916c-246fd44d58ec/pull/0.log" Jul 09 14:00:45.988491 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:00:45.988469 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svnfh_ee101ac7-66a8-40ed-916c-246fd44d58ec/extract/0.log" Jul 09 14:00:46.098799 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:00:46.098769 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zrk56_dbe1f4a6-7951-48d9-bb0b-83cf322b1d22/util/0.log" Jul 09 14:00:46.104859 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:00:46.104835 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zrk56_dbe1f4a6-7951-48d9-bb0b-83cf322b1d22/pull/0.log" Jul 09 14:00:46.110350 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:00:46.110335 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zrk56_dbe1f4a6-7951-48d9-bb0b-83cf322b1d22/extract/0.log" Jul 09 14:00:46.224658 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:00:46.224634 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4gcm_91d41912-a03d-4fde-990a-c2106133b28f/util/0.log" Jul 09 14:00:46.232133 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:00:46.232078 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4gcm_91d41912-a03d-4fde-990a-c2106133b28f/pull/0.log" Jul 09 14:00:46.237996 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:00:46.237979 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4gcm_91d41912-a03d-4fde-990a-c2106133b28f/extract/0.log" Jul 09 14:00:46.349874 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:00:46.349852 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nmktf_3a1629ba-808d-4825-a6b0-f38b9c1c693a/pull/0.log" Jul 09 14:00:46.356646 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:00:46.356621 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nmktf_3a1629ba-808d-4825-a6b0-f38b9c1c693a/extract/0.log" Jul 09 14:00:46.362318 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:00:46.362300 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nmktf_3a1629ba-808d-4825-a6b0-f38b9c1c693a/util/0.log" Jul 09 14:00:46.588112 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:00:46.588087 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-nppw9_4950cc4b-3455-4bb3-a4a0-c71495dc44f7/manager/0.log" Jul 09 14:00:46.709585 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:00:46.709550 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-5swv5_e554efeb-6d02-419b-9035-f5b8671d7dcf/manager/0.log" Jul 09 14:00:46.826646 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:00:46.826618 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-9522k_87ea7dbe-04f4-4490-8f94-724218435c7b/kuadrant-console-plugin/0.log" Jul 09 14:00:46.934564 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:00:46.934494 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-kqhr5_c67d75a3-38b0-4926-8fee-a0371c61cf81/registry-server/0.log" Jul 09 14:00:47.159588 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:00:47.159553 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-nng55_a9e080de-80b3-4492-a03f-2e34e1f4315b/limitador/0.log" Jul 09 14:00:47.270582 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:00:47.270542 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-k9rjl_325e9be6-d5db-4131-9ae7-7da95b5b5168/manager/0.log" Jul 09 14:00:47.946018 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:00:47.945992 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bc8bc984f-xrlqm_d9f3b797-9d64-4842-9ea4-f118df373148/kube-auth-proxy/0.log" Jul 09 14:00:48.055330 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:00:48.055298 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vx6gs_31f687a9-9b6c-4374-ba98-0d9c8efe1249/istio-proxy/0.log" Jul 09 14:00:48.162726 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:00:48.162696 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9fcb6c59f-blmj7_9f964a6d-bb71-4efc-aa44-3fa94a53608b/router/0.log" Jul 09 14:00:55.262759 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:00:55.262731 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lth82_36917a3c-dc1c-4371-8a99-f3fd743cfd9a/global-pull-secret-syncer/0.log" Jul 09 14:00:55.406368 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:00:55.406339 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-txs25_8fae885f-7d7e-4ffa-ac4b-8521097c9cb4/konnectivity-agent/0.log" Jul 09 14:00:55.479127 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:00:55.479098 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-92.ec2.internal_34bea405b2b687d739a81e962ab7a92d/haproxy/0.log" Jul 09 14:00:59.706026 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:00:59.705997 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svnfh_ee101ac7-66a8-40ed-916c-246fd44d58ec/extract/0.log" Jul 09 14:00:59.728032 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:00:59.728000 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svnfh_ee101ac7-66a8-40ed-916c-246fd44d58ec/util/0.log" Jul 09 14:00:59.749872 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:00:59.749850 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svnfh_ee101ac7-66a8-40ed-916c-246fd44d58ec/pull/0.log" Jul 09 14:00:59.778553 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:00:59.778533 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zrk56_dbe1f4a6-7951-48d9-bb0b-83cf322b1d22/extract/0.log" Jul 09 14:00:59.805414 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:00:59.805387 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zrk56_dbe1f4a6-7951-48d9-bb0b-83cf322b1d22/util/0.log" Jul 09 14:00:59.827864 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:00:59.827836 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zrk56_dbe1f4a6-7951-48d9-bb0b-83cf322b1d22/pull/0.log" Jul 09 14:00:59.857853 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:00:59.857830 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4gcm_91d41912-a03d-4fde-990a-c2106133b28f/extract/0.log" Jul 09 14:00:59.882044 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:00:59.882018 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4gcm_91d41912-a03d-4fde-990a-c2106133b28f/util/0.log" Jul 09 14:00:59.914573 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:00:59.914545 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4gcm_91d41912-a03d-4fde-990a-c2106133b28f/pull/0.log" Jul 09 14:00:59.959537 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:00:59.959456 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nmktf_3a1629ba-808d-4825-a6b0-f38b9c1c693a/extract/0.log" Jul 09 14:00:59.986339 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:00:59.986304 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nmktf_3a1629ba-808d-4825-a6b0-f38b9c1c693a/util/0.log" Jul 09 14:01:00.008538 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:00.008512 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nmktf_3a1629ba-808d-4825-a6b0-f38b9c1c693a/pull/0.log" Jul 09 14:01:00.109670 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:00.109641 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-nppw9_4950cc4b-3455-4bb3-a4a0-c71495dc44f7/manager/0.log" Jul 09 14:01:00.143971 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:00.143948 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-5swv5_e554efeb-6d02-419b-9035-f5b8671d7dcf/manager/0.log" Jul 09 14:01:00.173922 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:00.173899 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-9522k_87ea7dbe-04f4-4490-8f94-724218435c7b/kuadrant-console-plugin/0.log" Jul 09 14:01:00.245606 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:00.245533 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-kqhr5_c67d75a3-38b0-4926-8fee-a0371c61cf81/registry-server/0.log" Jul 09 14:01:00.307840 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:00.307794 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-nng55_a9e080de-80b3-4492-a03f-2e34e1f4315b/limitador/0.log" Jul 09 14:01:00.344734 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:00.344708 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-k9rjl_325e9be6-d5db-4131-9ae7-7da95b5b5168/manager/0.log" Jul 09 14:01:02.159896 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:02.159869 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-qs4qg_e5a15c1c-ff3c-4162-9f34-3beac8095bba/cluster-monitoring-operator/0.log" Jul 09 14:01:02.561748 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:02.561715 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t6qnt_b9b05569-f4a2-492c-9f7a-e5786de994ac/node-exporter/0.log" Jul 09 14:01:02.590163 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:02.590142 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t6qnt_b9b05569-f4a2-492c-9f7a-e5786de994ac/kube-rbac-proxy/0.log" Jul 09 14:01:02.618188 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:02.618158 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t6qnt_b9b05569-f4a2-492c-9f7a-e5786de994ac/init-textfile/0.log" Jul 09 14:01:04.572181 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:04.572153 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-br6cl_355b7781-b0d3-467a-9f6c-370962faa278/networking-console-plugin/0.log" Jul 09 14:01:05.200865 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:05.200841 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tvsqr_c6be1427-c9fa-45b4-a6ca-3aaf2be3513b/console-operator/1.log" Jul 09 14:01:05.206217 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:05.206194 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tvsqr_c6be1427-c9fa-45b4-a6ca-3aaf2be3513b/console-operator/2.log" Jul 09 14:01:05.755627 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:05.755596 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-l6rt9_40c503b2-14ca-49e1-a8cc-6b561ab8bcc7/download-server/0.log" Jul 09 14:01:05.955894 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:05.955862 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9fh6k/perf-node-gather-daemonset-k78q6"] Jul 09 14:01:05.959456 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:05.959436 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9fh6k/perf-node-gather-daemonset-k78q6" Jul 09 14:01:05.961689 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:05.961661 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9fh6k\"/\"openshift-service-ca.crt\"" Jul 09 14:01:05.961828 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:05.961676 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9fh6k\"/\"kube-root-ca.crt\"" Jul 09 14:01:05.961828 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:05.961714 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9fh6k\"/\"default-dockercfg-dpcfw\"" Jul 09 14:01:05.969684 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:05.969665 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9fh6k/perf-node-gather-daemonset-k78q6"] Jul 09 14:01:05.995479 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:05.995449 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5a8ee95c-d1fc-459c-a202-c87a8818630d-podres\") pod \"perf-node-gather-daemonset-k78q6\" (UID: \"5a8ee95c-d1fc-459c-a202-c87a8818630d\") " pod="openshift-must-gather-9fh6k/perf-node-gather-daemonset-k78q6" Jul 09 14:01:05.995628 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:05.995491 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a8ee95c-d1fc-459c-a202-c87a8818630d-sys\") pod \"perf-node-gather-daemonset-k78q6\" (UID: \"5a8ee95c-d1fc-459c-a202-c87a8818630d\") " pod="openshift-must-gather-9fh6k/perf-node-gather-daemonset-k78q6" Jul 09 14:01:05.995628 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:05.995509 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5a8ee95c-d1fc-459c-a202-c87a8818630d-lib-modules\") pod \"perf-node-gather-daemonset-k78q6\" (UID: \"5a8ee95c-d1fc-459c-a202-c87a8818630d\") " pod="openshift-must-gather-9fh6k/perf-node-gather-daemonset-k78q6" Jul 09 14:01:05.995628 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:05.995526 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkt72\" (UniqueName: \"kubernetes.io/projected/5a8ee95c-d1fc-459c-a202-c87a8818630d-kube-api-access-jkt72\") pod \"perf-node-gather-daemonset-k78q6\" (UID: \"5a8ee95c-d1fc-459c-a202-c87a8818630d\") " pod="openshift-must-gather-9fh6k/perf-node-gather-daemonset-k78q6" Jul 09 14:01:05.995628 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:05.995616 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5a8ee95c-d1fc-459c-a202-c87a8818630d-proc\") pod \"perf-node-gather-daemonset-k78q6\" (UID: \"5a8ee95c-d1fc-459c-a202-c87a8818630d\") " pod="openshift-must-gather-9fh6k/perf-node-gather-daemonset-k78q6" Jul 09 14:01:06.096615 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:06.096528 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5a8ee95c-d1fc-459c-a202-c87a8818630d-proc\") pod \"perf-node-gather-daemonset-k78q6\" (UID: \"5a8ee95c-d1fc-459c-a202-c87a8818630d\") " pod="openshift-must-gather-9fh6k/perf-node-gather-daemonset-k78q6" Jul 09 14:01:06.096615 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:06.096591 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5a8ee95c-d1fc-459c-a202-c87a8818630d-podres\") pod \"perf-node-gather-daemonset-k78q6\" (UID: \"5a8ee95c-d1fc-459c-a202-c87a8818630d\") " pod="openshift-must-gather-9fh6k/perf-node-gather-daemonset-k78q6" Jul 09 14:01:06.096800 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:06.096629 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a8ee95c-d1fc-459c-a202-c87a8818630d-sys\") pod \"perf-node-gather-daemonset-k78q6\" (UID: \"5a8ee95c-d1fc-459c-a202-c87a8818630d\") " pod="openshift-must-gather-9fh6k/perf-node-gather-daemonset-k78q6" Jul 09 14:01:06.096800 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:06.096646 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5a8ee95c-d1fc-459c-a202-c87a8818630d-lib-modules\") pod \"perf-node-gather-daemonset-k78q6\" (UID: \"5a8ee95c-d1fc-459c-a202-c87a8818630d\") " pod="openshift-must-gather-9fh6k/perf-node-gather-daemonset-k78q6" Jul 09 14:01:06.096800 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:06.096661 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkt72\" (UniqueName: \"kubernetes.io/projected/5a8ee95c-d1fc-459c-a202-c87a8818630d-kube-api-access-jkt72\") pod \"perf-node-gather-daemonset-k78q6\" (UID: \"5a8ee95c-d1fc-459c-a202-c87a8818630d\") " pod="openshift-must-gather-9fh6k/perf-node-gather-daemonset-k78q6" Jul 09 14:01:06.096800 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:06.096668 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5a8ee95c-d1fc-459c-a202-c87a8818630d-proc\") pod \"perf-node-gather-daemonset-k78q6\" (UID: \"5a8ee95c-d1fc-459c-a202-c87a8818630d\") " pod="openshift-must-gather-9fh6k/perf-node-gather-daemonset-k78q6" Jul 09 14:01:06.096800 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:06.096737 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a8ee95c-d1fc-459c-a202-c87a8818630d-sys\") pod \"perf-node-gather-daemonset-k78q6\" (UID: \"5a8ee95c-d1fc-459c-a202-c87a8818630d\") " pod="openshift-must-gather-9fh6k/perf-node-gather-daemonset-k78q6" Jul 09 14:01:06.097024 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:06.096841 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5a8ee95c-d1fc-459c-a202-c87a8818630d-podres\") pod \"perf-node-gather-daemonset-k78q6\" (UID: \"5a8ee95c-d1fc-459c-a202-c87a8818630d\") " pod="openshift-must-gather-9fh6k/perf-node-gather-daemonset-k78q6" Jul 09 14:01:06.097024 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:06.096851 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5a8ee95c-d1fc-459c-a202-c87a8818630d-lib-modules\") pod \"perf-node-gather-daemonset-k78q6\" (UID: \"5a8ee95c-d1fc-459c-a202-c87a8818630d\") " pod="openshift-must-gather-9fh6k/perf-node-gather-daemonset-k78q6" Jul 09 14:01:06.106664 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:06.106639 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkt72\" (UniqueName: \"kubernetes.io/projected/5a8ee95c-d1fc-459c-a202-c87a8818630d-kube-api-access-jkt72\") pod \"perf-node-gather-daemonset-k78q6\" (UID: \"5a8ee95c-d1fc-459c-a202-c87a8818630d\") " pod="openshift-must-gather-9fh6k/perf-node-gather-daemonset-k78q6" Jul 09 14:01:06.271707 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:06.271674 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9fh6k/perf-node-gather-daemonset-k78q6" Jul 09 14:01:06.389072 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:06.389036 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-gfgjz_180dbcfb-3d0e-4ea9-8cf0-1731de5e6fe7/volume-data-source-validator/0.log" Jul 09 14:01:06.414477 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:06.414453 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9fh6k/perf-node-gather-daemonset-k78q6"] Jul 09 14:01:06.416132 ip-10-0-143-92 kubenswrapper[2573]: W0709 14:01:06.416106 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5a8ee95c_d1fc_459c_a202_c87a8818630d.slice/crio-3d46a8e2deccd187da20dca1d3465a79b13691b3b0445ec5fda90576ff35ae70 WatchSource:0}: Error finding container 3d46a8e2deccd187da20dca1d3465a79b13691b3b0445ec5fda90576ff35ae70: Status 404 returned error can't find the container with id 3d46a8e2deccd187da20dca1d3465a79b13691b3b0445ec5fda90576ff35ae70 Jul 09 14:01:07.317459 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:07.317423 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9fh6k/perf-node-gather-daemonset-k78q6" event={"ID":"5a8ee95c-d1fc-459c-a202-c87a8818630d","Type":"ContainerStarted","Data":"e94b714706bf58c6b18dbf6982430aec53cfa23a667188db4118e1283bba6305"} Jul 09 14:01:07.317949 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:07.317531 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9fh6k/perf-node-gather-daemonset-k78q6" Jul 09 14:01:07.317949 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:07.317554 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9fh6k/perf-node-gather-daemonset-k78q6" event={"ID":"5a8ee95c-d1fc-459c-a202-c87a8818630d","Type":"ContainerStarted","Data":"3d46a8e2deccd187da20dca1d3465a79b13691b3b0445ec5fda90576ff35ae70"} Jul 09 14:01:07.333247 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:07.333189 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9fh6k/perf-node-gather-daemonset-k78q6" podStartSLOduration=2.3331747849999998 podStartE2EDuration="2.333174785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:01:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:01:07.331231396 +0000 UTC m=+692.237805589" watchObservedRunningTime="2026-07-09 14:01:07.333174785 +0000 UTC m=+692.239748978" Jul 09 14:01:07.411172 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:07.411125 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bj8dh_9ee58331-355b-4a78-a3f5-b3e312ba9c70/dns/0.log" Jul 09 14:01:07.431715 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:07.431693 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bj8dh_9ee58331-355b-4a78-a3f5-b3e312ba9c70/kube-rbac-proxy/0.log" Jul 09 14:01:07.569326 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:07.569237 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gcld7_3d676a82-9c69-4065-b7e0-87787f3cc7bd/dns-node-resolver/0.log" Jul 09 14:01:08.159720 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:08.159692 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l6z74_0bec2f7c-c273-4005-993e-0aa98a8d95dd/node-ca/0.log" Jul 09 14:01:09.195264 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:09.195228 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bc8bc984f-xrlqm_d9f3b797-9d64-4842-9ea4-f118df373148/kube-auth-proxy/0.log" Jul 09 14:01:09.221184 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:09.221160 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vx6gs_31f687a9-9b6c-4374-ba98-0d9c8efe1249/istio-proxy/0.log" Jul 09 14:01:09.247482 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:09.247458 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9fcb6c59f-blmj7_9f964a6d-bb71-4efc-aa44-3fa94a53608b/router/0.log" Jul 09 14:01:09.876833 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:09.876787 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z4hbz_49134287-0ad9-48b8-932e-c94dba92401c/serve-healthcheck-canary/0.log" Jul 09 14:01:10.377065 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:10.377040 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-q2tlh_15e19452-d64a-46b3-9ca1-f39d4a955d45/insights-operator/1.log" Jul 09 14:01:10.377440 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:10.377078 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-q2tlh_15e19452-d64a-46b3-9ca1-f39d4a955d45/insights-operator/0.log" Jul 09 14:01:10.546057 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:10.546031 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vr64v_97ae6181-9332-4b9e-a573-4ae3d779466c/kube-rbac-proxy/0.log" Jul 09 14:01:10.567525 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:10.567498 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vr64v_97ae6181-9332-4b9e-a573-4ae3d779466c/exporter/0.log" Jul 09 14:01:10.588875 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:10.588851 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vr64v_97ae6181-9332-4b9e-a573-4ae3d779466c/extractor/0.log" Jul 09 14:01:12.649605 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:12.649564 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-982m6_9924a967-2103-4b7c-acf4-28f56eabee1e/manager/0.log" Jul 09 14:01:12.673189 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:12.673157 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-dx7v9_78836108-c50f-4386-a1c4-63bdf5dff34e/manager/0.log" Jul 09 14:01:12.747860 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:12.747835 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-gx9fr_f9ca3e65-a70d-43ab-aa3e-50735275898a/server/0.log" Jul 09 14:01:12.789217 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:12.789186 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-n5c4n_991de508-49b7-4534-a574-c766515a33b1/manager/0.log" Jul 09 14:01:12.930273 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:12.930191 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-744bdb4fbc-tfbjg_70141934-48d2-4d3c-9425-7260b91ca5b9/manager/0.log" Jul 09 14:01:12.946517 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:12.946492 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-744bdb4fbc-tfbjg_70141934-48d2-4d3c-9425-7260b91ca5b9/copy-manifests/0.log" Jul 09 14:01:12.969344 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:12.969316 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-p9mtk_e9a5c987-e961-43b1-b0b7-c2b78bab72ef/postgres/0.log" Jul 09 14:01:13.333235 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:13.333210 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9fh6k/perf-node-gather-daemonset-k78q6" Jul 09 14:01:14.168966 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:14.168938 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-62v8w_062731ec-ac8d-49ec-b5e6-25ee5d0dce78/openshift-lws-operator/0.log" Jul 09 14:01:16.251217 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:16.251131 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bc8bc984f-xrlqm_d9f3b797-9d64-4842-9ea4-f118df373148/kube-auth-proxy/0.log" Jul 09 14:01:16.273930 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:16.273904 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vx6gs_31f687a9-9b6c-4374-ba98-0d9c8efe1249/istio-proxy/0.log" Jul 09 14:01:16.295061 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:16.295030 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9fcb6c59f-blmj7_9f964a6d-bb71-4efc-aa44-3fa94a53608b/router/0.log" Jul 09 14:01:17.488898 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:17.488873 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bc8bc984f-xrlqm_d9f3b797-9d64-4842-9ea4-f118df373148/kube-auth-proxy/0.log" Jul 09 14:01:17.519943 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:17.519913 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vx6gs_31f687a9-9b6c-4374-ba98-0d9c8efe1249/istio-proxy/0.log" Jul 09 14:01:17.550239 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:17.550209 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9fcb6c59f-blmj7_9f964a6d-bb71-4efc-aa44-3fa94a53608b/router/0.log" Jul 09 14:01:19.878657 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:19.878625 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-p6mh2_3d907576-86ea-4a33-928a-85df98300620/kube-storage-version-migrator-operator/1.log" Jul 09 14:01:19.879766 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:19.879744 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-p6mh2_3d907576-86ea-4a33-928a-85df98300620/kube-storage-version-migrator-operator/0.log" Jul 09 14:01:20.967998 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:20.967970 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dgjhm_d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0/kube-multus-additional-cni-plugins/0.log" Jul 09 14:01:20.990004 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:20.989978 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dgjhm_d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0/egress-router-binary-copy/0.log" Jul 09 14:01:21.011190 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:21.011168 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dgjhm_d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0/cni-plugins/0.log" Jul 09 14:01:21.033423 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:21.033399 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dgjhm_d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0/bond-cni-plugin/0.log" Jul 09 14:01:21.053465 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:21.053444 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dgjhm_d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0/routeoverride-cni/0.log" Jul 09 14:01:21.074572 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:21.074548 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dgjhm_d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0/whereabouts-cni-bincopy/0.log" Jul 09 14:01:21.095141 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:21.095114 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dgjhm_d8cf6dc8-f653-4c6a-abc4-94f6a4df08c0/whereabouts-cni/0.log" Jul 09 14:01:21.336913 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:21.336883 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xl2jp_ad02c56f-c72c-49ff-9bfb-fc188743cfcb/kube-multus/0.log" Jul 09 14:01:21.356236 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:21.356210 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5rs66_37ebd359-357d-4d89-b1b0-ce746eedeec9/network-metrics-daemon/0.log" Jul 09 14:01:21.377025 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:21.376997 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5rs66_37ebd359-357d-4d89-b1b0-ce746eedeec9/kube-rbac-proxy/0.log" Jul 09 14:01:22.694759 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:22.694726 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wlg95_fe725cde-9e4a-4b8f-b96e-90fb61415652/ovn-controller/0.log" Jul 09 14:01:22.713617 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:22.713587 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wlg95_fe725cde-9e4a-4b8f-b96e-90fb61415652/ovn-acl-logging/0.log" Jul 09 14:01:22.713617 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:22.713609 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wlg95_fe725cde-9e4a-4b8f-b96e-90fb61415652/ovn-acl-logging/1.log" Jul 09 14:01:22.732393 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:22.732361 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wlg95_fe725cde-9e4a-4b8f-b96e-90fb61415652/kube-rbac-proxy-node/0.log" Jul 09 14:01:22.755108 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:22.755079 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wlg95_fe725cde-9e4a-4b8f-b96e-90fb61415652/kube-rbac-proxy-ovn-metrics/0.log" Jul 09 14:01:22.778550 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:22.778526 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wlg95_fe725cde-9e4a-4b8f-b96e-90fb61415652/northd/0.log" Jul 09 14:01:22.803697 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:22.803667 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wlg95_fe725cde-9e4a-4b8f-b96e-90fb61415652/nbdb/0.log" Jul 09 14:01:22.825914 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:22.825888 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wlg95_fe725cde-9e4a-4b8f-b96e-90fb61415652/sbdb/0.log" Jul 09 14:01:22.867892 ip-10-0-143-92 kubenswrapper[2573]: I0709 14:01:22.867862 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wlg95_fe725cde-9e4a-4b8f-b96e-90fb61415652/ovnkube-controller/0.log"