Jun 03 20:40:05.662121 ip-10-0-141-159 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 03 20:40:05.662131 ip-10-0-141-159 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 03 20:40:05.662139 ip-10-0-141-159 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 03 20:40:05.662284 ip-10-0-141-159 systemd[1]: Failed to start Kubernetes Kubelet. Jun 03 20:40:15.764341 ip-10-0-141-159 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 03 20:40:15.764360 ip-10-0-141-159 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 3851d80561854195a9f0e769419608a9 -- Jun 03 20:42:53.634729 ip-10-0-141-159 systemd[1]: Starting Kubernetes Kubelet... Jun 03 20:42:54.057028 ip-10-0-141-159 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 20:42:54.057028 ip-10-0-141-159 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 20:42:54.057028 ip-10-0-141-159 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 20:42:54.057028 ip-10-0-141-159 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 20:42:54.057028 ip-10-0-141-159 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 20:42:54.057695 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.057081 2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 20:42:54.062946 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.062925 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 20:42:54.062946 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.062943 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 20:42:54.062946 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.062948 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 20:42:54.062946 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.062951 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 20:42:54.063116 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.062954 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 20:42:54.063116 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.062958 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 20:42:54.063116 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.062961 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 20:42:54.063116 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.062965 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 20:42:54.063116 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.062969 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 20:42:54.063116 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.062972 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 20:42:54.063116 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.062975 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 20:42:54.063116 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.062978 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 20:42:54.063116 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.062981 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 20:42:54.063116 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.062984 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 20:42:54.063116 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.062987 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 20:42:54.063116 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.062990 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 20:42:54.063116 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.062993 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 20:42:54.063116 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.062996 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 20:42:54.063116 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.062999 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 20:42:54.063116 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063001 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 20:42:54.063116 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063004 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 03 20:42:54.063116 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063006 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 20:42:54.063116 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063009 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 20:42:54.063116 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063012 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 20:42:54.063640 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063014 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 20:42:54.063640 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063018 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 20:42:54.063640 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063022 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 20:42:54.063640 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063025 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 20:42:54.063640 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063027 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 20:42:54.063640 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063030 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 20:42:54.063640 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063039 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 20:42:54.063640 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063042 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 20:42:54.063640 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063045 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 20:42:54.063640 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063052 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 20:42:54.063640 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063054 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 20:42:54.063640 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063057 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 20:42:54.063640 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063060 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 20:42:54.063640 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063063 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 20:42:54.063640 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063066 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 20:42:54.063640 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063069 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 20:42:54.063640 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063071 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 20:42:54.063640 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063074 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 20:42:54.063640 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063077 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 20:42:54.064107 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063080 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 20:42:54.064107 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063083 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 20:42:54.064107 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063085 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 20:42:54.064107 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063089 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 20:42:54.064107 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063092 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 20:42:54.064107 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063094 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 20:42:54.064107 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063097 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 20:42:54.064107 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063100 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 20:42:54.064107 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063103 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 20:42:54.064107 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063105 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 20:42:54.064107 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063108 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 20:42:54.064107 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063111 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 20:42:54.064107 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063113 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 20:42:54.064107 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063116 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 20:42:54.064107 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063118 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 20:42:54.064107 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063121 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 20:42:54.064107 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063124 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 20:42:54.064107 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063126 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 20:42:54.064107 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063129 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 20:42:54.064107 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063132 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 20:42:54.064685 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063134 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 20:42:54.064685 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063137 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 20:42:54.064685 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063140 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 20:42:54.064685 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063143 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 20:42:54.064685 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063145 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 20:42:54.064685 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063148 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 20:42:54.064685 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063152 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 20:42:54.064685 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063154 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 20:42:54.064685 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063157 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 20:42:54.064685 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063160 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 20:42:54.064685 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063164 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 20:42:54.064685 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063166 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 20:42:54.064685 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063169 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 20:42:54.064685 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063172 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 20:42:54.064685 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063174 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 20:42:54.064685 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063177 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 20:42:54.064685 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063179 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 20:42:54.064685 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063182 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 20:42:54.064685 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063185 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 20:42:54.064685 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063187 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 20:42:54.065166 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063191 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 20:42:54.065166 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063194 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 20:42:54.065166 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063197 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 20:42:54.065166 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063200 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 20:42:54.065166 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063202 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 20:42:54.065166 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063204 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 20:42:54.065166 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063207 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 20:42:54.065166 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063210 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 20:42:54.065166 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063212 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 20:42:54.065166 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063215 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 20:42:54.065166 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063217 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 20:42:54.065166 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063221 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 20:42:54.065166 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063225 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 20:42:54.065166 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063228 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 20:42:54.065166 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063231 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 20:42:54.065166 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063960 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 20:42:54.065166 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063967 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 20:42:54.065166 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063971 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 20:42:54.065166 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063977 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 20:42:54.065643 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063981 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 20:42:54.065643 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063984 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 20:42:54.065643 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063987 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 20:42:54.065643 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063989 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 20:42:54.065643 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063992 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 20:42:54.065643 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063995 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 20:42:54.065643 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.063997 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 20:42:54.065643 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064000 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 20:42:54.065643 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064004 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 20:42:54.065643 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064007 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 20:42:54.065643 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064010 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 20:42:54.065643 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064013 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 20:42:54.065643 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064015 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 20:42:54.065643 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064017 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 20:42:54.065643 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064021 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 20:42:54.065643 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064024 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 20:42:54.065643 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064026 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 20:42:54.065643 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064029 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 20:42:54.065643 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064032 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 20:42:54.065643 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064035 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 20:42:54.066186 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064037 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 20:42:54.066186 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064040 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 20:42:54.066186 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064043 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 20:42:54.066186 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064046 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 20:42:54.066186 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064048 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 20:42:54.066186 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064051 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 20:42:54.066186 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064054 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 20:42:54.066186 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064056 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 20:42:54.066186 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064059 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 20:42:54.066186 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064061 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 20:42:54.066186 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064064 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 20:42:54.066186 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064067 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 20:42:54.066186 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064070 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 20:42:54.066186 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064072 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 20:42:54.066186 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064076 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 20:42:54.066186 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064078 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 20:42:54.066186 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064081 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 20:42:54.066186 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064084 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 20:42:54.066186 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064086 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 20:42:54.066186 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064089 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 20:42:54.066684 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064093 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 20:42:54.066684 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064096 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 20:42:54.066684 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064099 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 20:42:54.066684 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064102 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 20:42:54.066684 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064105 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 20:42:54.066684 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064108 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 20:42:54.066684 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064111 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 03 20:42:54.066684 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064115 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 20:42:54.066684 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064119 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 20:42:54.066684 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064122 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 20:42:54.066684 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064124 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 20:42:54.066684 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064127 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 20:42:54.066684 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064130 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 20:42:54.066684 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064134 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 20:42:54.066684 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064136 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 20:42:54.066684 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064138 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 20:42:54.066684 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064141 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 20:42:54.066684 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064144 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 20:42:54.066684 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064146 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 20:42:54.067149 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064149 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 20:42:54.067149 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064151 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 20:42:54.067149 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064154 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 20:42:54.067149 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064156 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 20:42:54.067149 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064159 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 20:42:54.067149 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064162 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 20:42:54.067149 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064165 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 20:42:54.067149 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064168 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 20:42:54.067149 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064170 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 20:42:54.067149 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064173 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 20:42:54.067149 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064175 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 20:42:54.067149 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064178 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 20:42:54.067149 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064181 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 20:42:54.067149 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064183 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 20:42:54.067149 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064186 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 20:42:54.067149 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064188 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 20:42:54.067149 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064191 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 20:42:54.067149 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064194 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 20:42:54.067149 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064196 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 20:42:54.067630 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064199 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 20:42:54.067630 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064201 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 20:42:54.067630 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064204 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 20:42:54.067630 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064207 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 20:42:54.067630 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064210 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 20:42:54.067630 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064212 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 20:42:54.067630 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064215 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 20:42:54.067630 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064217 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 20:42:54.067630 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064220 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 20:42:54.067630 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064222 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 20:42:54.067630 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064225 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 20:42:54.067630 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064227 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 20:42:54.067630 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064230 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 20:42:54.067630 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064232 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 20:42:54.067630 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064234 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 20:42:54.067630 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064237 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 20:42:54.067630 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064604 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 20:42:54.067630 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064610 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 20:42:54.067630 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064614 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 20:42:54.067630 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064617 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 20:42:54.068119 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064619 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 20:42:54.068119 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064622 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 20:42:54.068119 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064625 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 20:42:54.068119 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064628 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 20:42:54.068119 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064630 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 20:42:54.068119 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064633 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 20:42:54.068119 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064636 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 20:42:54.068119 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064638 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 20:42:54.068119 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064641 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 20:42:54.068119 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064644 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 20:42:54.068119 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064647 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 20:42:54.068119 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064649 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 20:42:54.068119 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064652 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 20:42:54.068119 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064654 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 20:42:54.068119 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064657 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 20:42:54.068119 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064663 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 20:42:54.068119 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064666 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 20:42:54.068119 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064670 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 20:42:54.068119 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064674 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 20:42:54.068119 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064676 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 20:42:54.068627 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064679 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 20:42:54.068627 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064682 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 20:42:54.068627 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064684 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 20:42:54.068627 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064687 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 20:42:54.068627 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064690 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 20:42:54.068627 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064693 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 20:42:54.068627 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064695 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 20:42:54.068627 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064698 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 20:42:54.068627 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064701 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 20:42:54.068627 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064703 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 20:42:54.068627 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064706 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 20:42:54.068627 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064709 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 20:42:54.068627 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064711 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 20:42:54.068627 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064714 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 20:42:54.068627 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064716 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 20:42:54.068627 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064719 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 20:42:54.068627 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064721 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 20:42:54.068627 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064724 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 20:42:54.068627 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064727 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 20:42:54.068627 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064729 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 20:42:54.069112 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064732 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 20:42:54.069112 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064734 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 20:42:54.069112 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064737 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 20:42:54.069112 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064740 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 20:42:54.069112 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064742 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 20:42:54.069112 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064745 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 20:42:54.069112 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064750 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 20:42:54.069112 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064755 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 20:42:54.069112 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064758 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 20:42:54.069112 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064761 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 20:42:54.069112 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064764 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 20:42:54.069112 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064767 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 20:42:54.069112 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064769 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 20:42:54.069112 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064772 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 20:42:54.069112 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064774 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 20:42:54.069112 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064777 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 20:42:54.069112 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064780 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 20:42:54.069112 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064782 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 20:42:54.069112 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064785 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 20:42:54.069636 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064787 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 03 20:42:54.069636 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064790 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 20:42:54.069636 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064793 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 20:42:54.069636 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064796 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 20:42:54.069636 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064798 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 20:42:54.069636 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064801 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 20:42:54.069636 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064804 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 20:42:54.069636 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064807 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 20:42:54.069636 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064809 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 20:42:54.069636 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064812 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 20:42:54.069636 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064816 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 20:42:54.069636 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064819 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 20:42:54.069636 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064821 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 20:42:54.069636 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064824 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 20:42:54.069636 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064826 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 20:42:54.069636 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064829 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 20:42:54.069636 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064831 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 20:42:54.069636 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064833 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 20:42:54.069636 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064836 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 20:42:54.069636 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064838 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 20:42:54.070137 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064842 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 20:42:54.070137 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064847 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 20:42:54.070137 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064850 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 20:42:54.070137 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064853 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 20:42:54.070137 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064856 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 20:42:54.070137 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064860 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 20:42:54.070137 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064863 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 20:42:54.070137 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064866 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 20:42:54.070137 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064869 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 20:42:54.070137 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064872 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 20:42:54.070137 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064874 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 20:42:54.070137 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064877 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 20:42:54.070137 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064879 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 20:42:54.070137 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064882 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 20:42:54.070137 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.064884 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 20:42:54.070137 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.064955 2573 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 20:42:54.070137 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.064961 2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 20:42:54.070137 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.064966 2573 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 20:42:54.070137 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.064971 2573 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 20:42:54.070137 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.064975 2573 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 20:42:54.070646 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.064978 2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 20:42:54.070646 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.064982 2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 20:42:54.070646 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.064987 2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 20:42:54.070646 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.064990 2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 20:42:54.070646 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.064993 2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 20:42:54.070646 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.064996 2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 20:42:54.070646 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.064999 2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 20:42:54.070646 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065002 2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 20:42:54.070646 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065005 2573 flags.go:64] FLAG: --cgroup-root="" Jun 03 20:42:54.070646 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065008 2573 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 20:42:54.070646 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065011 2573 flags.go:64] FLAG: --client-ca-file="" Jun 03 20:42:54.070646 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065014 2573 flags.go:64] FLAG: --cloud-provider="external" Jun 03 20:42:54.070646 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065019 2573 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 20:42:54.070646 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065023 2573 flags.go:64] FLAG: --cluster-domain="" Jun 03 20:42:54.070646 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065027 2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 20:42:54.070646 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065030 2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 03 20:42:54.070646 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065033 2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 20:42:54.070646 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065037 2573 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 20:42:54.070646 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065041 2573 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 20:42:54.070646 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065044 2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 20:42:54.070646 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065047 2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 20:42:54.070646 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065051 2573 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 20:42:54.070646 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065053 2573 flags.go:64] FLAG: --contention-profiling="false" Jun 03 20:42:54.070646 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065057 2573 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 20:42:54.071224 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065060 2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 20:42:54.071224 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065063 2573 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 20:42:54.071224 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065066 2573 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 20:42:54.071224 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065070 2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 20:42:54.071224 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065072 2573 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 20:42:54.071224 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065075 2573 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 20:42:54.071224 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065078 2573 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 20:42:54.071224 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065081 2573 flags.go:64] FLAG: --enable-server="true" Jun 03 20:42:54.071224 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065084 2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 20:42:54.071224 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065088 2573 flags.go:64] FLAG: --event-burst="100" Jun 03 20:42:54.071224 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065091 2573 flags.go:64] FLAG: --event-qps="50" Jun 03 20:42:54.071224 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065094 2573 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 20:42:54.071224 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065097 2573 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 20:42:54.071224 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065100 2573 flags.go:64] FLAG: --eviction-hard="" Jun 03 20:42:54.071224 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065104 2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 20:42:54.071224 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065107 2573 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 20:42:54.071224 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065109 2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 20:42:54.071224 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065112 2573 flags.go:64] FLAG: --eviction-soft="" Jun 03 20:42:54.071224 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065115 2573 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 20:42:54.071224 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065118 2573 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 20:42:54.071224 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065122 2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 20:42:54.071224 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065125 2573 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 20:42:54.071224 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065128 2573 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 20:42:54.071224 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065131 2573 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 20:42:54.071224 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065134 2573 flags.go:64] FLAG: --feature-gates="" Jun 03 20:42:54.071884 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065139 2573 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 20:42:54.071884 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065142 2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 20:42:54.071884 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065145 2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 20:42:54.071884 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065148 2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 20:42:54.071884 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065151 2573 flags.go:64] FLAG: --healthz-port="10248" Jun 03 20:42:54.071884 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065154 2573 flags.go:64] FLAG: --help="false" Jun 03 20:42:54.071884 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065157 2573 flags.go:64] FLAG: --hostname-override="ip-10-0-141-159.ec2.internal" Jun 03 20:42:54.071884 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065160 2573 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 20:42:54.071884 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065163 2573 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 20:42:54.071884 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065166 2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 20:42:54.071884 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065169 2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 20:42:54.071884 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065172 2573 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 20:42:54.071884 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065175 2573 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 20:42:54.071884 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065178 2573 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 20:42:54.071884 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065182 2573 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 20:42:54.071884 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065185 2573 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 20:42:54.071884 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065187 2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 20:42:54.071884 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065190 2573 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 20:42:54.071884 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065193 2573 flags.go:64] FLAG: --kube-reserved="" Jun 03 20:42:54.071884 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065196 2573 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 20:42:54.071884 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065199 2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 20:42:54.071884 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065202 2573 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 20:42:54.071884 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065204 2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 20:42:54.071884 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065207 2573 flags.go:64] FLAG: --lock-file="" Jun 03 20:42:54.072479 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065210 2573 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 20:42:54.072479 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065212 2573 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 20:42:54.072479 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065215 2573 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 20:42:54.072479 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065221 2573 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 20:42:54.072479 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065224 2573 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 20:42:54.072479 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065227 2573 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 20:42:54.072479 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065230 2573 flags.go:64] FLAG: --logging-format="text" Jun 03 20:42:54.072479 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065233 2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 20:42:54.072479 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065240 2573 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 20:42:54.072479 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065243 2573 flags.go:64] FLAG: --manifest-url="" Jun 03 20:42:54.072479 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065246 2573 flags.go:64] FLAG: --manifest-url-header="" Jun 03 20:42:54.072479 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065250 2573 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 20:42:54.072479 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065253 2573 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 20:42:54.072479 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065257 2573 flags.go:64] FLAG: --max-pods="110" Jun 03 20:42:54.072479 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065260 2573 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 20:42:54.072479 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065262 2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 20:42:54.072479 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065265 2573 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 20:42:54.072479 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065268 2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 20:42:54.072479 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065272 2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 20:42:54.072479 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065275 2573 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 20:42:54.072479 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065278 2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 20:42:54.072479 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065284 2573 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 20:42:54.072479 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065287 2573 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 20:42:54.072479 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065290 2573 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 20:42:54.072479 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065293 2573 flags.go:64] FLAG: --pod-cidr="" Jun 03 20:42:54.073125 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065295 2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 03 20:42:54.073125 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065301 2573 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 20:42:54.073125 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065304 2573 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 20:42:54.073125 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065307 2573 flags.go:64] FLAG: --pods-per-core="0" Jun 03 20:42:54.073125 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065310 2573 flags.go:64] FLAG: --port="10250" Jun 03 20:42:54.073125 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065313 2573 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 20:42:54.073125 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065316 2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-073d601cb9b947dae" Jun 03 20:42:54.073125 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065319 2573 flags.go:64] FLAG: --qos-reserved="" Jun 03 20:42:54.073125 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065321 2573 flags.go:64] FLAG: --read-only-port="10255" Jun 03 20:42:54.073125 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065324 2573 flags.go:64] FLAG: --register-node="true" Jun 03 20:42:54.073125 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065327 2573 flags.go:64] FLAG: --register-with-taints="" Jun 03 20:42:54.073125 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065331 2573 flags.go:64] FLAG: --registry-burst="10" Jun 03 20:42:54.073125 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065333 2573 flags.go:64] FLAG: --registry-qps="5" Jun 03 20:42:54.073125 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065336 2573 flags.go:64] FLAG: --reserved-cpus="" Jun 03 20:42:54.073125 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065339 2573 flags.go:64] FLAG: --reserved-memory="" Jun 03 20:42:54.073125 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065344 2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 20:42:54.073125 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065347 2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 20:42:54.073125 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065350 2573 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 20:42:54.073125 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065353 2573 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 20:42:54.073125 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065355 2573 flags.go:64] FLAG: --runonce="false" Jun 03 20:42:54.073125 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065358 2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 20:42:54.073125 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065361 2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 20:42:54.073125 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065364 2573 flags.go:64] FLAG: --seccomp-default="false" Jun 03 20:42:54.073125 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065367 2573 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 20:42:54.073125 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065369 2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 20:42:54.073768 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065372 2573 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 20:42:54.073768 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065375 2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 20:42:54.073768 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065378 2573 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 20:42:54.073768 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065381 2573 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 20:42:54.073768 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065383 2573 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 20:42:54.073768 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065386 2573 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 20:42:54.073768 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065389 2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 20:42:54.073768 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065392 2573 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 20:42:54.073768 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065395 2573 flags.go:64] FLAG: --system-cgroups="" Jun 03 20:42:54.073768 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065397 2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 20:42:54.073768 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065402 2573 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 20:42:54.073768 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065405 2573 flags.go:64] FLAG: --tls-cert-file="" Jun 03 20:42:54.073768 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065408 2573 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 20:42:54.073768 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065413 2573 flags.go:64] FLAG: --tls-min-version="" Jun 03 20:42:54.073768 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065416 2573 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 20:42:54.073768 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065419 2573 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 20:42:54.073768 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065421 2573 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 20:42:54.073768 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065424 2573 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 20:42:54.073768 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065427 2573 flags.go:64] FLAG: --v="2" Jun 03 20:42:54.073768 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065431 2573 flags.go:64] FLAG: --version="false" Jun 03 20:42:54.073768 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065434 2573 flags.go:64] FLAG: --vmodule="" Jun 03 20:42:54.073768 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065438 2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 20:42:54.073768 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.065442 2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 20:42:54.073768 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065570 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 20:42:54.073768 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065574 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 20:42:54.074373 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065578 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 20:42:54.074373 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065581 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 20:42:54.074373 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065584 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 20:42:54.074373 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065586 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 20:42:54.074373 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065589 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 20:42:54.074373 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065591 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 20:42:54.074373 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065595 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 20:42:54.074373 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065599 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 20:42:54.074373 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065602 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 20:42:54.074373 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065605 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 20:42:54.074373 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065608 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 20:42:54.074373 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065611 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 20:42:54.074373 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065614 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 20:42:54.074373 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065616 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 20:42:54.074373 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065619 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 20:42:54.074373 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065622 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 20:42:54.074373 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065626 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 20:42:54.074373 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065629 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 20:42:54.074373 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065632 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 20:42:54.074860 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065634 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 20:42:54.074860 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065637 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 20:42:54.074860 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065639 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 20:42:54.074860 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065642 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 20:42:54.074860 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065645 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 20:42:54.074860 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065647 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 20:42:54.074860 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065657 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 20:42:54.074860 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065660 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 20:42:54.074860 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065663 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 03 20:42:54.074860 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065665 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 20:42:54.074860 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065669 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 20:42:54.074860 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065672 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 20:42:54.074860 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065676 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 20:42:54.074860 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065680 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 20:42:54.074860 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065683 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 20:42:54.074860 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065686 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 20:42:54.074860 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065689 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 20:42:54.074860 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065691 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 20:42:54.074860 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065694 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 20:42:54.074860 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065696 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 20:42:54.075347 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065699 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 20:42:54.075347 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065702 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 20:42:54.075347 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065704 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 20:42:54.075347 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065707 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 20:42:54.075347 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065710 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 20:42:54.075347 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065712 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 20:42:54.075347 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065715 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 20:42:54.075347 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065718 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 20:42:54.075347 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065720 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 20:42:54.075347 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065723 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 20:42:54.075347 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065725 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 20:42:54.075347 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065728 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 20:42:54.075347 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065730 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 20:42:54.075347 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065733 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 20:42:54.075347 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065736 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 20:42:54.075347 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065738 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 20:42:54.075347 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065741 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 20:42:54.075347 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065743 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 20:42:54.075347 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065748 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 20:42:54.075347 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065750 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 20:42:54.075857 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065753 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 20:42:54.075857 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065756 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 20:42:54.075857 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065759 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 20:42:54.075857 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065762 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 20:42:54.075857 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065765 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 20:42:54.075857 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065768 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 20:42:54.075857 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065771 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 20:42:54.075857 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065773 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 20:42:54.075857 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065776 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 20:42:54.075857 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065779 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 20:42:54.075857 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065781 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 20:42:54.075857 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065784 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 20:42:54.075857 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065786 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 20:42:54.075857 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065789 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 20:42:54.075857 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065791 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 20:42:54.075857 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065794 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 20:42:54.075857 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065796 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 20:42:54.075857 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065799 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 20:42:54.075857 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065802 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 20:42:54.075857 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065804 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 20:42:54.076334 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065807 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 20:42:54.076334 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065809 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 20:42:54.076334 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065812 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 20:42:54.076334 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065815 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 20:42:54.076334 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065817 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 20:42:54.076334 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065820 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 20:42:54.076334 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065822 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 20:42:54.076334 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065825 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 20:42:54.076334 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065827 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 20:42:54.076334 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065830 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 20:42:54.076334 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065834 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 20:42:54.076334 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065837 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 20:42:54.076334 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065840 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 20:42:54.076334 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065842 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 20:42:54.076334 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065846 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 20:42:54.076334 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065849 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 20:42:54.076334 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.065852 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 20:42:54.076772 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.066369 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 20:42:54.076772 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.072927 2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 03 20:42:54.076772 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.072940 2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 20:42:54.076772 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.074027 2573 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 03 20:42:54.076772 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.074035 2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 20:42:54.076772 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074091 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 20:42:54.076772 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074097 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 20:42:54.076772 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074100 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 20:42:54.076772 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074103 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 20:42:54.076772 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074106 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 20:42:54.076772 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074110 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 20:42:54.076772 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074112 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 20:42:54.076772 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074115 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 20:42:54.076772 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074118 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 20:42:54.076772 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074120 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 20:42:54.077190 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074123 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 20:42:54.077190 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074126 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 20:42:54.077190 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074129 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 20:42:54.077190 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074131 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 20:42:54.077190 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074134 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 20:42:54.077190 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074137 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 20:42:54.077190 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074139 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 20:42:54.077190 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074142 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 20:42:54.077190 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074145 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 20:42:54.077190 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074147 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 20:42:54.077190 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074150 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 20:42:54.077190 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074153 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 20:42:54.077190 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074155 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 20:42:54.077190 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074158 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 20:42:54.077190 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074160 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 20:42:54.077190 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074163 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 20:42:54.077190 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074166 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 20:42:54.077190 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074168 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 20:42:54.077190 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074172 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 20:42:54.077190 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074176 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 20:42:54.077696 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074179 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 20:42:54.077696 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074181 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 20:42:54.077696 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074184 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 20:42:54.077696 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074187 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 20:42:54.077696 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074190 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 20:42:54.077696 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074192 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 20:42:54.077696 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074195 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 20:42:54.077696 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074198 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 20:42:54.077696 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074200 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 20:42:54.077696 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074203 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 20:42:54.077696 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074206 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 20:42:54.077696 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074209 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 20:42:54.077696 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074213 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 20:42:54.077696 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074216 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 20:42:54.077696 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074218 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 20:42:54.077696 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074223 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 20:42:54.077696 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074226 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 20:42:54.077696 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074229 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 20:42:54.077696 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074232 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 20:42:54.078158 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074235 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 20:42:54.078158 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074238 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 20:42:54.078158 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074240 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 20:42:54.078158 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074243 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 20:42:54.078158 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074246 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 20:42:54.078158 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074248 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 20:42:54.078158 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074251 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 20:42:54.078158 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074254 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 20:42:54.078158 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074257 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 03 20:42:54.078158 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074259 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 20:42:54.078158 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074262 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 20:42:54.078158 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074264 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 20:42:54.078158 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074269 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 20:42:54.078158 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074272 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 20:42:54.078158 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074275 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 20:42:54.078158 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074277 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 20:42:54.078158 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074280 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 20:42:54.078158 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074283 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 20:42:54.078158 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074286 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 20:42:54.078158 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074289 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 20:42:54.078836 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074291 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 20:42:54.078836 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074294 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 20:42:54.078836 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074297 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 20:42:54.078836 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074300 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 20:42:54.078836 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074302 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 20:42:54.078836 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074305 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 20:42:54.078836 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074307 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 20:42:54.078836 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074310 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 20:42:54.078836 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074312 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 20:42:54.078836 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074315 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 20:42:54.078836 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074317 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 20:42:54.078836 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074320 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 20:42:54.078836 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074323 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 20:42:54.078836 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074325 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 20:42:54.078836 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074328 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 20:42:54.078836 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074330 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 20:42:54.078836 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074333 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 20:42:54.078836 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074335 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 20:42:54.078836 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074337 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 20:42:54.078836 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074340 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 20:42:54.079322 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074343 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 20:42:54.079322 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074345 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 20:42:54.079322 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074348 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 20:42:54.079322 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074350 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 20:42:54.079322 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074353 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 20:42:54.079322 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074358 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 20:42:54.079322 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074361 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 20:42:54.079322 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074364 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 20:42:54.079322 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074367 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 20:42:54.079322 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.074372 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 20:42:54.079322 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074519 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 20:42:54.079322 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074526 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 20:42:54.079322 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074530 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 20:42:54.079322 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074535 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 20:42:54.079687 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074538 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 20:42:54.079687 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074540 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 20:42:54.079687 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074543 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 20:42:54.079687 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074546 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 20:42:54.079687 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074549 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 20:42:54.079687 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074552 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 20:42:54.079687 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074554 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 20:42:54.079687 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074557 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 20:42:54.079687 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074559 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 20:42:54.079687 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074562 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 20:42:54.079687 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074566 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 20:42:54.079687 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074569 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 20:42:54.079687 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074572 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 20:42:54.079687 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074575 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 20:42:54.079687 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074578 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 20:42:54.079687 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074581 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 20:42:54.079687 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074584 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 20:42:54.079687 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074587 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 20:42:54.079687 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074590 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 20:42:54.080144 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074592 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 20:42:54.080144 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074595 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 20:42:54.080144 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074598 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 20:42:54.080144 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074601 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 20:42:54.080144 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074605 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 20:42:54.080144 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074608 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 20:42:54.080144 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074611 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 20:42:54.080144 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074614 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 20:42:54.080144 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074617 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 20:42:54.080144 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074619 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 20:42:54.080144 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074622 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 20:42:54.080144 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074625 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 20:42:54.080144 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074627 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 20:42:54.080144 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074630 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 20:42:54.080144 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074633 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 20:42:54.080144 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074635 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 20:42:54.080144 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074638 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 20:42:54.080144 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074640 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 20:42:54.080144 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074643 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 20:42:54.080144 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074645 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 03 20:42:54.080650 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074648 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 20:42:54.080650 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074650 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 20:42:54.080650 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074653 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 20:42:54.080650 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074656 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 20:42:54.080650 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074658 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 20:42:54.080650 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074661 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 20:42:54.080650 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074663 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 20:42:54.080650 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074666 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 20:42:54.080650 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074668 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 20:42:54.080650 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074671 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 20:42:54.080650 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074673 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 20:42:54.080650 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074676 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 20:42:54.080650 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074678 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 20:42:54.080650 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074681 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 20:42:54.080650 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074685 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 20:42:54.080650 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074689 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 20:42:54.080650 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074692 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 20:42:54.080650 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074695 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 20:42:54.080650 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074698 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 20:42:54.081110 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074701 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 20:42:54.081110 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074704 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 20:42:54.081110 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074707 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 20:42:54.081110 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074709 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 20:42:54.081110 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074712 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 20:42:54.081110 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074714 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 20:42:54.081110 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074717 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 20:42:54.081110 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074719 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 20:42:54.081110 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074722 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 20:42:54.081110 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074725 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 20:42:54.081110 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074727 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 20:42:54.081110 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074730 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 20:42:54.081110 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074732 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 20:42:54.081110 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074735 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 20:42:54.081110 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074737 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 20:42:54.081110 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074740 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 20:42:54.081110 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074743 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 20:42:54.081110 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074745 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 20:42:54.081110 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074748 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 20:42:54.081571 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074750 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 20:42:54.081571 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074753 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 20:42:54.081571 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074756 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 20:42:54.081571 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074758 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 20:42:54.081571 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074761 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 20:42:54.081571 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074763 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 20:42:54.081571 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074766 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 20:42:54.081571 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074768 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 20:42:54.081571 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074771 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 20:42:54.081571 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074773 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 20:42:54.081571 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074776 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 20:42:54.081571 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074778 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 20:42:54.081571 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074781 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 20:42:54.081571 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074787 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 20:42:54.081571 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074789 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 20:42:54.081571 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074792 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 20:42:54.081571 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:54.074794 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 20:42:54.081998 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.074799 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 20:42:54.081998 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.074898 2573 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 20:42:54.081998 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.076944 2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 20:42:54.081998 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.078293 2573 server.go:1019] "Starting client certificate rotation" Jun 03 20:42:54.081998 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.078388 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 20:42:54.081998 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.078421 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 20:42:54.081998 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.080673 2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 20:42:54.082206 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.082194 2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 20:42:54.092906 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.092887 2573 log.go:25] "Validated CRI v1 runtime API" Jun 03 20:42:54.096299 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.096276 2573 log.go:25] "Validated CRI v1 image API" Jun 03 20:42:54.098284 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.098268 2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 20:42:54.104059 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.104041 2573 fs.go:135] Filesystem UUIDs: map[01d16fbe-6b96-4ebb-bd7d-7e59d4ef4c22:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 9983368d-5ba0-462c-b168-cc2bc67be5e7:/dev/nvme0n1p4] Jun 03 20:42:54.104133 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.104058 2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 20:42:54.106179 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.106162 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 20:42:54.110140 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.110027 2573 manager.go:216] Machine: {Timestamp:2026-06-03 20:42:54.108787905 +0000 UTC m=+0.358198391 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099581 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2044f1451009f77849c9803ed65455 SystemUUID:ec2044f1-4510-09f7-7849-c9803ed65455 BootID:3851d805-6185-4195-a9f0-e769419608a9 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f1:69:5a:a0:4f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f1:69:5a:a0:4f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:b2:10:ca:8a:5f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 20:42:54.110140 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.110134 2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 20:42:54.110252 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.110236 2573 manager.go:232] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 20:42:54.113443 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.113421 2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 20:42:54.113579 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.113446 2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-159.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 20:42:54.114153 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.114143 2573 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 20:42:54.114189 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.114155 2573 container_manager_linux.go:309] "Creating device plugin manager" Jun 03 20:42:54.114189 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.114162 2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 20:42:54.115638 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.115628 2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 20:42:54.116369 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.116360 2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 03 20:42:54.118812 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.118801 2573 state_mem.go:36] "Initialized new in-memory state store" Jun 03 20:42:54.118932 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.118922 2573 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 03 20:42:54.118964 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.118952 2573 kubelet.go:486] "Attempting to sync node with API server" Jun 03 20:42:54.118964 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.118961 2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 20:42:54.119016 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.118974 2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 20:42:54.119016 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.118983 2573 kubelet.go:398] "Adding apiserver pod source" Jun 03 20:42:54.119016 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.118992 2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 20:42:54.119599 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.119346 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 20:42:54.119599 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.119365 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 20:42:54.122106 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.122091 2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 03 20:42:54.123379 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.123363 2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 20:42:54.123451 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.123394 2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 03 20:42:54.124702 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.124689 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 20:42:54.124763 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.124708 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 20:42:54.124763 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.124715 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 20:42:54.124763 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.124720 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 20:42:54.124763 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.124729 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 20:42:54.124763 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.124734 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 20:42:54.124763 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.124742 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 20:42:54.124763 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.124747 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 20:42:54.124763 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.124759 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 20:42:54.124763 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.124766 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 20:42:54.125010 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.124786 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 20:42:54.125010 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.124793 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 20:42:54.126173 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.126155 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 20:42:54.126173 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.126171 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 20:42:54.128302 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.128284 2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-159.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 20:42:54.128924 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:54.128903 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-159.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 20:42:54.128978 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:54.128907 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 20:42:54.129323 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.129312 2573 server.go:1268] "Started kubelet" Jun 03 20:42:54.129450 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.129406 2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 20:42:54.129561 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.129447 2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 20:42:54.129561 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.129532 2573 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 03 20:42:54.130062 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.130028 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p8n22" Jun 03 20:42:54.130200 ip-10-0-141-159 systemd[1]: Started Kubernetes Kubelet. Jun 03 20:42:54.130834 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.130700 2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 20:42:54.132614 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.132600 2573 server.go:310] "Adding debug handlers to kubelet server" Jun 03 20:42:54.135765 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.135748 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p8n22" Jun 03 20:42:54.136397 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:54.136379 2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 20:42:54.137126 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.137107 2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 20:42:54.137126 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.137122 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 20:42:54.137246 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:54.137200 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-159.ec2.internal\" not found" Jun 03 20:42:54.137605 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.137587 2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 03 20:42:54.137768 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.137602 2573 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 03 20:42:54.137768 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.137622 2573 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 03 20:42:54.141273 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.141248 2573 reconstruct.go:97] "Volume reconstruction finished" Jun 03 20:42:54.141273 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.141270 2573 reconciler.go:29] "Reconciler: start to sync state" Jun 03 20:42:54.141407 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:54.136885 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-159.ec2.internal.18b5acefeaad4266 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-159.ec2.internal,UID:ip-10-0-141-159.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-159.ec2.internal,},FirstTimestamp:2026-06-03 20:42:54.129283686 +0000 UTC m=+0.378694152,LastTimestamp:2026-06-03 20:42:54.129283686 +0000 UTC m=+0.378694152,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-159.ec2.internal,}" Jun 03 20:42:54.141967 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.141949 2573 factory.go:55] Registering systemd factory Jun 03 20:42:54.142057 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.141971 2573 factory.go:223] Registration of the systemd container factory successfully Jun 03 20:42:54.143447 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.143317 2573 factory.go:153] Registering CRI-O factory Jun 03 20:42:54.143447 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.143331 2573 factory.go:223] Registration of the crio container factory successfully Jun 03 20:42:54.143447 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.143375 2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 20:42:54.143447 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.143397 2573 factory.go:103] Registering Raw factory Jun 03 20:42:54.143447 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.143419 2573 manager.go:1196] Started watching for new ooms in manager Jun 03 20:42:54.143896 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.143872 2573 manager.go:349] Starting recovery of all containers Jun 03 20:42:54.146821 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.146801 2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 20:42:54.152844 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:54.152825 2573 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-159.ec2.internal\" not found" node="ip-10-0-141-159.ec2.internal" Jun 03 20:42:54.154783 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.154767 2573 manager.go:354] Recovery completed Jun 03 20:42:54.158786 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.158774 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 20:42:54.160803 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.160788 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeHasSufficientMemory" Jun 03 20:42:54.160850 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.160815 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 20:42:54.160850 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.160825 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeHasSufficientPID" Jun 03 20:42:54.161292 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.161279 2573 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 20:42:54.161292 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.161291 2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 20:42:54.161367 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.161308 2573 state_mem.go:36] "Initialized new in-memory state store" Jun 03 20:42:54.161367 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.161315 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 20:42:54.162009 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.161994 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeHasSufficientMemory" Jun 03 20:42:54.162074 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.162019 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 20:42:54.162074 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.162028 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeHasSufficientPID" Jun 03 20:42:54.162584 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.162573 2573 policy_none.go:49] "None policy: Start" Jun 03 20:42:54.162623 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.162588 2573 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 03 20:42:54.162623 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.162598 2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 03 20:42:54.163514 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.163504 2573 policy_none.go:47] "Start" Jun 03 20:42:54.201099 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.201086 2573 manager.go:337] "Starting Device Plugin manager" Jun 03 20:42:54.210866 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:54.201138 2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 20:42:54.210866 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.201152 2573 server.go:87] "Starting device plugin registration server" Jun 03 20:42:54.210866 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.201372 2573 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 20:42:54.210866 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.201383 2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 20:42:54.210866 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.201889 2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 20:42:54.210866 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.201988 2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 20:42:54.210866 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.201997 2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 20:42:54.210866 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:54.202505 2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 20:42:54.210866 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:54.202542 2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-159.ec2.internal\" not found" Jun 03 20:42:54.210866 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.204263 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 03 20:42:54.210866 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.205533 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 03 20:42:54.210866 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.205564 2573 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 03 20:42:54.210866 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.205580 2573 kubelet.go:2448] "Starting kubelet main sync loop" Jun 03 20:42:54.210866 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:54.205631 2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 20:42:54.210866 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.207420 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 20:42:54.302628 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.302611 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 20:42:54.303458 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.303442 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeHasSufficientMemory" Jun 03 20:42:54.303565 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.303494 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 20:42:54.303565 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.303511 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeHasSufficientPID" Jun 03 20:42:54.303565 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.303540 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-159.ec2.internal" Jun 03 20:42:54.306492 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.306454 2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-159.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-159.ec2.internal"] Jun 03 20:42:54.306551 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.306528 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 20:42:54.307194 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.307147 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeHasSufficientMemory" Jun 03 20:42:54.307194 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.307172 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 20:42:54.307194 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.307187 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeHasSufficientPID" Jun 03 20:42:54.308341 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.308329 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 20:42:54.308503 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.308488 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-159.ec2.internal" Jun 03 20:42:54.308557 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.308520 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 20:42:54.308964 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.308948 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeHasSufficientMemory" Jun 03 20:42:54.309034 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.308963 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeHasSufficientMemory" Jun 03 20:42:54.309034 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.308974 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 20:42:54.309034 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.308984 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 20:42:54.309034 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.308988 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeHasSufficientPID" Jun 03 20:42:54.309034 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.309005 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeHasSufficientPID" Jun 03 20:42:54.310082 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.310068 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-159.ec2.internal" Jun 03 20:42:54.310126 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.310098 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 20:42:54.310755 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.310737 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeHasSufficientMemory" Jun 03 20:42:54.310850 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.310766 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 20:42:54.310850 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.310779 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeHasSufficientPID" Jun 03 20:42:54.312119 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.312106 2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-159.ec2.internal" Jun 03 20:42:54.312180 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:54.312123 2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-159.ec2.internal\": node \"ip-10-0-141-159.ec2.internal\" not found" Jun 03 20:42:54.324799 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:54.324783 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-159.ec2.internal\" not found" Jun 03 20:42:54.341905 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.341879 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2cfaf7f25e0479ec5ca04027253aa5e2-config\") pod \"kube-apiserver-proxy-ip-10-0-141-159.ec2.internal\" (UID: \"2cfaf7f25e0479ec5ca04027253aa5e2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-159.ec2.internal" Jun 03 20:42:54.341989 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.341912 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/14c7604689d2953ccbf42e9f811949bd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-159.ec2.internal\" (UID: \"14c7604689d2953ccbf42e9f811949bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-159.ec2.internal" Jun 03 20:42:54.341989 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.341929 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14c7604689d2953ccbf42e9f811949bd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-159.ec2.internal\" (UID: \"14c7604689d2953ccbf42e9f811949bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-159.ec2.internal" Jun 03 20:42:54.344052 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:54.344036 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-159.ec2.internal\" not found" node="ip-10-0-141-159.ec2.internal" Jun 03 20:42:54.348595 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:54.348580 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-159.ec2.internal\" not found" node="ip-10-0-141-159.ec2.internal" Jun 03 20:42:54.425549 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:54.425524 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-159.ec2.internal\" not found" Jun 03 20:42:54.442960 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.442939 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2cfaf7f25e0479ec5ca04027253aa5e2-config\") pod \"kube-apiserver-proxy-ip-10-0-141-159.ec2.internal\" (UID: \"2cfaf7f25e0479ec5ca04027253aa5e2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-159.ec2.internal" Jun 03 20:42:54.443061 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.442963 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/14c7604689d2953ccbf42e9f811949bd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-159.ec2.internal\" (UID: \"14c7604689d2953ccbf42e9f811949bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-159.ec2.internal" Jun 03 20:42:54.443061 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.442980 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14c7604689d2953ccbf42e9f811949bd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-159.ec2.internal\" (UID: \"14c7604689d2953ccbf42e9f811949bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-159.ec2.internal" Jun 03 20:42:54.443061 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.443019 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14c7604689d2953ccbf42e9f811949bd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-159.ec2.internal\" (UID: \"14c7604689d2953ccbf42e9f811949bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-159.ec2.internal" Jun 03 20:42:54.443061 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.443050 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/14c7604689d2953ccbf42e9f811949bd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-159.ec2.internal\" (UID: \"14c7604689d2953ccbf42e9f811949bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-159.ec2.internal" Jun 03 20:42:54.443177 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.443050 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2cfaf7f25e0479ec5ca04027253aa5e2-config\") pod \"kube-apiserver-proxy-ip-10-0-141-159.ec2.internal\" (UID: \"2cfaf7f25e0479ec5ca04027253aa5e2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-159.ec2.internal" Jun 03 20:42:54.525686 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:54.525647 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-159.ec2.internal\" not found" Jun 03 20:42:54.626382 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:54.626309 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-159.ec2.internal\" not found" Jun 03 20:42:54.647832 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.647811 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-159.ec2.internal" Jun 03 20:42:54.652336 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.652313 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-159.ec2.internal" Jun 03 20:42:54.727152 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:54.727123 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-159.ec2.internal\" not found" Jun 03 20:42:54.827622 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:54.827592 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-159.ec2.internal\" not found" Jun 03 20:42:54.928108 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:54.928044 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-159.ec2.internal\" not found" Jun 03 20:42:54.975711 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:54.975688 2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 20:42:55.037831 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.037696 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-159.ec2.internal" Jun 03 20:42:55.054673 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.054647 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 20:42:55.057150 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.057132 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-159.ec2.internal" Jun 03 20:42:55.066891 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.066875 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 20:42:55.078020 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.078001 2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 20:42:55.078185 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.078140 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 20:42:55.078283 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.078179 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 20:42:55.078283 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.078192 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 20:42:55.101421 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:55.101384 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cfaf7f25e0479ec5ca04027253aa5e2.slice/crio-6d6bb7fc69a934f9cf9d4d229bb61ebe84e5c01ea5ee37b658ec529265657309 WatchSource:0}: Error finding container 6d6bb7fc69a934f9cf9d4d229bb61ebe84e5c01ea5ee37b658ec529265657309: Status 404 returned error can't find the container with id 6d6bb7fc69a934f9cf9d4d229bb61ebe84e5c01ea5ee37b658ec529265657309 Jun 03 20:42:55.101787 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:55.101767 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14c7604689d2953ccbf42e9f811949bd.slice/crio-66e81c4cd92eacc4c58f13a7806d1d241bac118e455f9657d4d1f26549d54741 WatchSource:0}: Error finding container 66e81c4cd92eacc4c58f13a7806d1d241bac118e455f9657d4d1f26549d54741: Status 404 returned error can't find the container with id 66e81c4cd92eacc4c58f13a7806d1d241bac118e455f9657d4d1f26549d54741 Jun 03 20:42:55.105505 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.105488 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 20:42:55.119258 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.119236 2573 apiserver.go:52] "Watching apiserver" Jun 03 20:42:55.125804 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.125751 2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 20:42:55.125955 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.125941 2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 20:42:55.128009 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.127990 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-159.ec2.internal","openshift-cluster-node-tuning-operator/tuned-7sm44","openshift-dns/node-resolver-vf4jz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-159.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jknxv","openshift-image-registry/node-ca-4kgfh","openshift-multus/multus-additional-cni-plugins-hh664","openshift-multus/multus-qv9w9","openshift-multus/network-metrics-daemon-5qxdz","openshift-network-diagnostics/network-check-target-jnfc6","openshift-network-operator/iptables-alerter-hzpmd","openshift-ovn-kubernetes/ovnkube-node-8cpfl","kube-system/global-pull-secret-syncer-m7dmv","kube-system/konnectivity-agent-fgv2m"] Jun 03 20:42:55.129835 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.129812 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnfc6" Jun 03 20:42:55.129936 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:55.129879 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnfc6" podUID="8e4786f6-75ea-4291-87b8-9f436beae16c" Jun 03 20:42:55.130901 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.130885 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m7dmv" Jun 03 20:42:55.130988 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:55.130945 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m7dmv" podUID="025eda00-3ac0-406d-8bcc-48ea3697528f" Jun 03 20:42:55.132262 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.132248 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vf4jz" Jun 03 20:42:55.133221 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.133205 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fgv2m" Jun 03 20:42:55.134634 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.134355 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jknxv" Jun 03 20:42:55.134634 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.134415 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 20:42:55.134634 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.134417 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 20:42:55.134634 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.134492 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-r9mrs\"" Jun 03 20:42:55.135284 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.135263 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 20:42:55.135355 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.135334 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4kgfh" Jun 03 20:42:55.135569 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.135549 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vvvtj\"" Jun 03 20:42:55.135827 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.135808 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 20:42:55.136533 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.136512 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qxdz" Jun 03 20:42:55.136624 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:55.136566 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qxdz" podUID="a19725e1-b81e-4b3b-8cb9-173528f14f9d" Jun 03 20:42:55.136624 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.136573 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 20:42:55.137120 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.137107 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 20:42:55.137195 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.137120 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 20:42:55.137195 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.137126 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-svfzz\"" Jun 03 20:42:55.137280 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.137233 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 20:42:55.137562 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.137545 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hh664" Jun 03 20:42:55.137681 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.137664 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 20:42:55.138373 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.137987 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 20:42:55.139324 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.139261 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-f2ssg\"" Jun 03 20:42:55.139421 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.139353 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 20:42:55.140654 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.140288 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 20:42:55.140717 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.140690 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 20:42:55.140764 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.140734 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rdhc5\"" Jun 03 20:42:55.140984 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.140967 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 20:42:55.140984 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.140974 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 20:42:55.141191 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.141173 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.141545 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.141434 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 20:42:55.142063 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.142021 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 20:37:54 +0000 UTC" deadline="2027-10-29 20:44:36.121790535 +0000 UTC" Jun 03 20:42:55.142063 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.142062 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12312h1m40.979731593s" Jun 03 20:42:55.142865 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.142849 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.143512 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.143465 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 20:42:55.143604 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.143520 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 20:42:55.143604 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.143540 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-clnl9\"" Jun 03 20:42:55.143951 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.143936 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hzpmd" Jun 03 20:42:55.144870 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.144854 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 20:42:55.145040 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.145026 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xwm48\"" Jun 03 20:42:55.145254 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.145240 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.146089 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.146070 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 20:42:55.146181 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.146165 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 20:42:55.146241 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.146167 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-68bzm\"" Jun 03 20:42:55.146324 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.146289 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 20:42:55.147047 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.146905 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3052984c-1fbe-473f-ac39-8c597c47c315-host\") pod \"node-ca-4kgfh\" (UID: \"3052984c-1fbe-473f-ac39-8c597c47c315\") " pod="openshift-image-registry/node-ca-4kgfh" Jun 03 20:42:55.147047 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.146933 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1823acc8-b08e-42f8-8f2c-419d2adeba34-etc-tuned\") pod \"tuned-7sm44\" (UID: \"1823acc8-b08e-42f8-8f2c-419d2adeba34\") " pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.147047 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.146955 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/af1b38f2-1aca-4850-8da0-2a34544d3cab-socket-dir\") pod \"aws-ebs-csi-driver-node-jknxv\" (UID: \"af1b38f2-1aca-4850-8da0-2a34544d3cab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jknxv" Jun 03 20:42:55.147047 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.147014 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1823acc8-b08e-42f8-8f2c-419d2adeba34-etc-sysconfig\") pod \"tuned-7sm44\" (UID: \"1823acc8-b08e-42f8-8f2c-419d2adeba34\") " pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.147276 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.147057 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1823acc8-b08e-42f8-8f2c-419d2adeba34-etc-sysctl-conf\") pod \"tuned-7sm44\" (UID: \"1823acc8-b08e-42f8-8f2c-419d2adeba34\") " pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.147276 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.147083 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1823acc8-b08e-42f8-8f2c-419d2adeba34-etc-systemd\") pod \"tuned-7sm44\" (UID: \"1823acc8-b08e-42f8-8f2c-419d2adeba34\") " pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.147276 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.147118 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8999c8ff-31e0-4203-82b6-9969dd68a29e-tmp-dir\") pod \"node-resolver-vf4jz\" (UID: \"8999c8ff-31e0-4203-82b6-9969dd68a29e\") " pod="openshift-dns/node-resolver-vf4jz" Jun 03 20:42:55.147276 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.147144 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1823acc8-b08e-42f8-8f2c-419d2adeba34-etc-modprobe-d\") pod \"tuned-7sm44\" (UID: \"1823acc8-b08e-42f8-8f2c-419d2adeba34\") " pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.147276 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.147168 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1823acc8-b08e-42f8-8f2c-419d2adeba34-var-lib-kubelet\") pod \"tuned-7sm44\" (UID: \"1823acc8-b08e-42f8-8f2c-419d2adeba34\") " pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.147276 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.147190 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1823acc8-b08e-42f8-8f2c-419d2adeba34-host\") pod \"tuned-7sm44\" (UID: \"1823acc8-b08e-42f8-8f2c-419d2adeba34\") " pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.147276 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.147212 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1823acc8-b08e-42f8-8f2c-419d2adeba34-tmp\") pod \"tuned-7sm44\" (UID: \"1823acc8-b08e-42f8-8f2c-419d2adeba34\") " pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.147276 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.147235 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5rds\" (UniqueName: \"kubernetes.io/projected/1823acc8-b08e-42f8-8f2c-419d2adeba34-kube-api-access-v5rds\") pod \"tuned-7sm44\" (UID: \"1823acc8-b08e-42f8-8f2c-419d2adeba34\") " pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.147276 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.147257 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/af1b38f2-1aca-4850-8da0-2a34544d3cab-device-dir\") pod \"aws-ebs-csi-driver-node-jknxv\" (UID: \"af1b38f2-1aca-4850-8da0-2a34544d3cab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jknxv" Jun 03 20:42:55.147276 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.147281 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/af1b38f2-1aca-4850-8da0-2a34544d3cab-etc-selinux\") pod \"aws-ebs-csi-driver-node-jknxv\" (UID: \"af1b38f2-1aca-4850-8da0-2a34544d3cab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jknxv" Jun 03 20:42:55.147824 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.147304 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4rb9\" (UniqueName: \"kubernetes.io/projected/c16d78e4-4fa7-4f14-9b41-3281ad9058d1-kube-api-access-f4rb9\") pod \"multus-additional-cni-plugins-hh664\" (UID: \"c16d78e4-4fa7-4f14-9b41-3281ad9058d1\") " pod="openshift-multus/multus-additional-cni-plugins-hh664" Jun 03 20:42:55.147824 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.147326 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1823acc8-b08e-42f8-8f2c-419d2adeba34-etc-kubernetes\") pod \"tuned-7sm44\" (UID: \"1823acc8-b08e-42f8-8f2c-419d2adeba34\") " pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.147824 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.147381 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8999c8ff-31e0-4203-82b6-9969dd68a29e-hosts-file\") pod \"node-resolver-vf4jz\" (UID: \"8999c8ff-31e0-4203-82b6-9969dd68a29e\") " pod="openshift-dns/node-resolver-vf4jz" Jun 03 20:42:55.147824 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.147417 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4xjf\" (UniqueName: \"kubernetes.io/projected/3052984c-1fbe-473f-ac39-8c597c47c315-kube-api-access-q4xjf\") pod \"node-ca-4kgfh\" (UID: \"3052984c-1fbe-473f-ac39-8c597c47c315\") " pod="openshift-image-registry/node-ca-4kgfh" Jun 03 20:42:55.147824 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.147455 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c16d78e4-4fa7-4f14-9b41-3281ad9058d1-system-cni-dir\") pod \"multus-additional-cni-plugins-hh664\" (UID: \"c16d78e4-4fa7-4f14-9b41-3281ad9058d1\") " pod="openshift-multus/multus-additional-cni-plugins-hh664" Jun 03 20:42:55.147824 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.147544 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c16d78e4-4fa7-4f14-9b41-3281ad9058d1-cnibin\") pod \"multus-additional-cni-plugins-hh664\" (UID: \"c16d78e4-4fa7-4f14-9b41-3281ad9058d1\") " pod="openshift-multus/multus-additional-cni-plugins-hh664" Jun 03 20:42:55.147824 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.147573 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c16d78e4-4fa7-4f14-9b41-3281ad9058d1-cni-binary-copy\") pod \"multus-additional-cni-plugins-hh664\" (UID: \"c16d78e4-4fa7-4f14-9b41-3281ad9058d1\") " pod="openshift-multus/multus-additional-cni-plugins-hh664" Jun 03 20:42:55.147824 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.147596 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c16d78e4-4fa7-4f14-9b41-3281ad9058d1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hh664\" (UID: \"c16d78e4-4fa7-4f14-9b41-3281ad9058d1\") " pod="openshift-multus/multus-additional-cni-plugins-hh664" Jun 03 20:42:55.147824 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.147611 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-n4sh9\"" Jun 03 20:42:55.147824 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.147619 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3052984c-1fbe-473f-ac39-8c597c47c315-serviceca\") pod \"node-ca-4kgfh\" (UID: \"3052984c-1fbe-473f-ac39-8c597c47c315\") " pod="openshift-image-registry/node-ca-4kgfh" Jun 03 20:42:55.147824 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.147642 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c16d78e4-4fa7-4f14-9b41-3281ad9058d1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hh664\" (UID: \"c16d78e4-4fa7-4f14-9b41-3281ad9058d1\") " pod="openshift-multus/multus-additional-cni-plugins-hh664" Jun 03 20:42:55.147824 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.147666 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/025eda00-3ac0-406d-8bcc-48ea3697528f-kubelet-config\") pod \"global-pull-secret-syncer-m7dmv\" (UID: \"025eda00-3ac0-406d-8bcc-48ea3697528f\") " pod="kube-system/global-pull-secret-syncer-m7dmv" Jun 03 20:42:55.147824 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.147687 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/025eda00-3ac0-406d-8bcc-48ea3697528f-dbus\") pod \"global-pull-secret-syncer-m7dmv\" (UID: \"025eda00-3ac0-406d-8bcc-48ea3697528f\") " pod="kube-system/global-pull-secret-syncer-m7dmv" Jun 03 20:42:55.147824 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.147729 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22vp9\" (UniqueName: \"kubernetes.io/projected/8999c8ff-31e0-4203-82b6-9969dd68a29e-kube-api-access-22vp9\") pod \"node-resolver-vf4jz\" (UID: \"8999c8ff-31e0-4203-82b6-9969dd68a29e\") " pod="openshift-dns/node-resolver-vf4jz" Jun 03 20:42:55.147824 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.147752 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c16d78e4-4fa7-4f14-9b41-3281ad9058d1-os-release\") pod \"multus-additional-cni-plugins-hh664\" (UID: \"c16d78e4-4fa7-4f14-9b41-3281ad9058d1\") " pod="openshift-multus/multus-additional-cni-plugins-hh664" Jun 03 20:42:55.147824 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.147779 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1823acc8-b08e-42f8-8f2c-419d2adeba34-etc-sysctl-d\") pod \"tuned-7sm44\" (UID: \"1823acc8-b08e-42f8-8f2c-419d2adeba34\") " pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.147824 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.147804 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1823acc8-b08e-42f8-8f2c-419d2adeba34-sys\") pod \"tuned-7sm44\" (UID: \"1823acc8-b08e-42f8-8f2c-419d2adeba34\") " pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.148601 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.147835 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1823acc8-b08e-42f8-8f2c-419d2adeba34-lib-modules\") pod \"tuned-7sm44\" (UID: \"1823acc8-b08e-42f8-8f2c-419d2adeba34\") " pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.148601 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.147809 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 20:42:55.148601 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.147839 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 20:42:55.148601 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.147838 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 20:42:55.148601 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.147876 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/025eda00-3ac0-406d-8bcc-48ea3697528f-original-pull-secret\") pod \"global-pull-secret-syncer-m7dmv\" (UID: \"025eda00-3ac0-406d-8bcc-48ea3697528f\") " pod="kube-system/global-pull-secret-syncer-m7dmv" Jun 03 20:42:55.148601 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.147923 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/af1b38f2-1aca-4850-8da0-2a34544d3cab-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jknxv\" (UID: \"af1b38f2-1aca-4850-8da0-2a34544d3cab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jknxv" Jun 03 20:42:55.148601 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.147953 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/af1b38f2-1aca-4850-8da0-2a34544d3cab-registration-dir\") pod \"aws-ebs-csi-driver-node-jknxv\" (UID: \"af1b38f2-1aca-4850-8da0-2a34544d3cab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jknxv" Jun 03 20:42:55.148601 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.147997 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aee2b45f-422e-44e2-9cc1-eca625d64f5e-agent-certs\") pod \"konnectivity-agent-fgv2m\" (UID: \"aee2b45f-422e-44e2-9cc1-eca625d64f5e\") " pod="kube-system/konnectivity-agent-fgv2m" Jun 03 20:42:55.148601 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.148032 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aee2b45f-422e-44e2-9cc1-eca625d64f5e-konnectivity-ca\") pod \"konnectivity-agent-fgv2m\" (UID: \"aee2b45f-422e-44e2-9cc1-eca625d64f5e\") " pod="kube-system/konnectivity-agent-fgv2m" Jun 03 20:42:55.148601 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.148076 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm845\" (UniqueName: \"kubernetes.io/projected/8e4786f6-75ea-4291-87b8-9f436beae16c-kube-api-access-cm845\") pod \"network-check-target-jnfc6\" (UID: \"8e4786f6-75ea-4291-87b8-9f436beae16c\") " pod="openshift-network-diagnostics/network-check-target-jnfc6" Jun 03 20:42:55.148601 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.148093 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 20:42:55.148601 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.148108 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 20:42:55.148601 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.148106 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/af1b38f2-1aca-4850-8da0-2a34544d3cab-sys-fs\") pod \"aws-ebs-csi-driver-node-jknxv\" (UID: \"af1b38f2-1aca-4850-8da0-2a34544d3cab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jknxv" Jun 03 20:42:55.148601 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.148148 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krcn4\" (UniqueName: \"kubernetes.io/projected/af1b38f2-1aca-4850-8da0-2a34544d3cab-kube-api-access-krcn4\") pod \"aws-ebs-csi-driver-node-jknxv\" (UID: \"af1b38f2-1aca-4850-8da0-2a34544d3cab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jknxv" Jun 03 20:42:55.148601 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.148173 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a19725e1-b81e-4b3b-8cb9-173528f14f9d-metrics-certs\") pod \"network-metrics-daemon-5qxdz\" (UID: \"a19725e1-b81e-4b3b-8cb9-173528f14f9d\") " pod="openshift-multus/network-metrics-daemon-5qxdz" Jun 03 20:42:55.148601 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.148194 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1823acc8-b08e-42f8-8f2c-419d2adeba34-run\") pod \"tuned-7sm44\" (UID: \"1823acc8-b08e-42f8-8f2c-419d2adeba34\") " pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.148601 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.148219 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c16d78e4-4fa7-4f14-9b41-3281ad9058d1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hh664\" (UID: \"c16d78e4-4fa7-4f14-9b41-3281ad9058d1\") " pod="openshift-multus/multus-additional-cni-plugins-hh664" Jun 03 20:42:55.148601 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.148245 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8vfx\" (UniqueName: \"kubernetes.io/projected/a19725e1-b81e-4b3b-8cb9-173528f14f9d-kube-api-access-d8vfx\") pod \"network-metrics-daemon-5qxdz\" (UID: \"a19725e1-b81e-4b3b-8cb9-173528f14f9d\") " pod="openshift-multus/network-metrics-daemon-5qxdz" Jun 03 20:42:55.148601 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.148572 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 20:42:55.150138 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.150123 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 20:42:55.168636 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.168570 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fh5kv" Jun 03 20:42:55.175820 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.175805 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fh5kv" Jun 03 20:42:55.208276 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.208240 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-159.ec2.internal" event={"ID":"2cfaf7f25e0479ec5ca04027253aa5e2","Type":"ContainerStarted","Data":"6d6bb7fc69a934f9cf9d4d229bb61ebe84e5c01ea5ee37b658ec529265657309"} Jun 03 20:42:55.209270 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.209250 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-159.ec2.internal" event={"ID":"14c7604689d2953ccbf42e9f811949bd","Type":"ContainerStarted","Data":"66e81c4cd92eacc4c58f13a7806d1d241bac118e455f9657d4d1f26549d54741"} Jun 03 20:42:55.238744 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.238723 2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 03 20:42:55.248452 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.248428 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-host-run-netns\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.248549 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.248457 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-node-log\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.248549 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.248490 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-host-run-ovn-kubernetes\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.248549 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.248523 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ee74555b-6958-4016-aeaf-7ceec6fd794f-host-var-lib-cni-multus\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.248654 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.248554 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1823acc8-b08e-42f8-8f2c-419d2adeba34-run\") pod \"tuned-7sm44\" (UID: \"1823acc8-b08e-42f8-8f2c-419d2adeba34\") " pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.248654 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.248586 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8vfx\" (UniqueName: \"kubernetes.io/projected/a19725e1-b81e-4b3b-8cb9-173528f14f9d-kube-api-access-d8vfx\") pod \"network-metrics-daemon-5qxdz\" (UID: \"a19725e1-b81e-4b3b-8cb9-173528f14f9d\") " pod="openshift-multus/network-metrics-daemon-5qxdz" Jun 03 20:42:55.248654 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.248612 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-host-cni-netd\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.248654 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.248628 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1823acc8-b08e-42f8-8f2c-419d2adeba34-run\") pod \"tuned-7sm44\" (UID: \"1823acc8-b08e-42f8-8f2c-419d2adeba34\") " pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.248654 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.248635 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/51f5ccb5-b246-47b7-82cb-9524ff802fae-ovnkube-config\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.248858 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.248690 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee74555b-6958-4016-aeaf-7ceec6fd794f-system-cni-dir\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.248858 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.248734 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ee74555b-6958-4016-aeaf-7ceec6fd794f-multus-conf-dir\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.248858 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.248768 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/af1b38f2-1aca-4850-8da0-2a34544d3cab-socket-dir\") pod \"aws-ebs-csi-driver-node-jknxv\" (UID: \"af1b38f2-1aca-4850-8da0-2a34544d3cab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jknxv" Jun 03 20:42:55.248858 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.248810 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-systemd-units\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.248858 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.248845 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-var-lib-openvswitch\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.249058 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.248876 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-run-openvswitch\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.249058 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.248907 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ee74555b-6958-4016-aeaf-7ceec6fd794f-hostroot\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.249058 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.248906 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/af1b38f2-1aca-4850-8da0-2a34544d3cab-socket-dir\") pod \"aws-ebs-csi-driver-node-jknxv\" (UID: \"af1b38f2-1aca-4850-8da0-2a34544d3cab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jknxv" Jun 03 20:42:55.249058 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.248946 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1823acc8-b08e-42f8-8f2c-419d2adeba34-etc-sysconfig\") pod \"tuned-7sm44\" (UID: \"1823acc8-b08e-42f8-8f2c-419d2adeba34\") " pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.249058 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.248964 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1823acc8-b08e-42f8-8f2c-419d2adeba34-etc-sysctl-conf\") pod \"tuned-7sm44\" (UID: \"1823acc8-b08e-42f8-8f2c-419d2adeba34\") " pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.249058 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.248977 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1823acc8-b08e-42f8-8f2c-419d2adeba34-etc-systemd\") pod \"tuned-7sm44\" (UID: \"1823acc8-b08e-42f8-8f2c-419d2adeba34\") " pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.249058 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.248992 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-run-ovn\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.249058 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.248997 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1823acc8-b08e-42f8-8f2c-419d2adeba34-etc-sysconfig\") pod \"tuned-7sm44\" (UID: \"1823acc8-b08e-42f8-8f2c-419d2adeba34\") " pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.249058 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249013 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ee74555b-6958-4016-aeaf-7ceec6fd794f-os-release\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.249058 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249041 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1823acc8-b08e-42f8-8f2c-419d2adeba34-etc-systemd\") pod \"tuned-7sm44\" (UID: \"1823acc8-b08e-42f8-8f2c-419d2adeba34\") " pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.249058 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249061 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ee74555b-6958-4016-aeaf-7ceec6fd794f-host-run-netns\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.249533 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249084 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ee74555b-6958-4016-aeaf-7ceec6fd794f-multus-daemon-config\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.249533 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249098 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-etc-openvswitch\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.249533 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249116 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1823acc8-b08e-42f8-8f2c-419d2adeba34-etc-modprobe-d\") pod \"tuned-7sm44\" (UID: \"1823acc8-b08e-42f8-8f2c-419d2adeba34\") " pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.249533 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249123 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1823acc8-b08e-42f8-8f2c-419d2adeba34-etc-sysctl-conf\") pod \"tuned-7sm44\" (UID: \"1823acc8-b08e-42f8-8f2c-419d2adeba34\") " pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.249533 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249137 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1823acc8-b08e-42f8-8f2c-419d2adeba34-var-lib-kubelet\") pod \"tuned-7sm44\" (UID: \"1823acc8-b08e-42f8-8f2c-419d2adeba34\") " pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.249533 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249198 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1823acc8-b08e-42f8-8f2c-419d2adeba34-var-lib-kubelet\") pod \"tuned-7sm44\" (UID: \"1823acc8-b08e-42f8-8f2c-419d2adeba34\") " pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.249533 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249214 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1823acc8-b08e-42f8-8f2c-419d2adeba34-host\") pod \"tuned-7sm44\" (UID: \"1823acc8-b08e-42f8-8f2c-419d2adeba34\") " pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.249533 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249236 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/af1b38f2-1aca-4850-8da0-2a34544d3cab-device-dir\") pod \"aws-ebs-csi-driver-node-jknxv\" (UID: \"af1b38f2-1aca-4850-8da0-2a34544d3cab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jknxv" Jun 03 20:42:55.249533 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249253 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.249533 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249268 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee74555b-6958-4016-aeaf-7ceec6fd794f-etc-kubernetes\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.249533 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249217 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1823acc8-b08e-42f8-8f2c-419d2adeba34-etc-modprobe-d\") pod \"tuned-7sm44\" (UID: \"1823acc8-b08e-42f8-8f2c-419d2adeba34\") " pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.249533 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249298 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1823acc8-b08e-42f8-8f2c-419d2adeba34-host\") pod \"tuned-7sm44\" (UID: \"1823acc8-b08e-42f8-8f2c-419d2adeba34\") " pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.249533 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249320 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c8af318f-da88-4811-b82a-c958cdcd739e-iptables-alerter-script\") pod \"iptables-alerter-hzpmd\" (UID: \"c8af318f-da88-4811-b82a-c958cdcd739e\") " pod="openshift-network-operator/iptables-alerter-hzpmd" Jun 03 20:42:55.249533 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249325 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/af1b38f2-1aca-4850-8da0-2a34544d3cab-device-dir\") pod \"aws-ebs-csi-driver-node-jknxv\" (UID: \"af1b38f2-1aca-4850-8da0-2a34544d3cab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jknxv" Jun 03 20:42:55.249533 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249338 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4rb9\" (UniqueName: \"kubernetes.io/projected/c16d78e4-4fa7-4f14-9b41-3281ad9058d1-kube-api-access-f4rb9\") pod \"multus-additional-cni-plugins-hh664\" (UID: \"c16d78e4-4fa7-4f14-9b41-3281ad9058d1\") " pod="openshift-multus/multus-additional-cni-plugins-hh664" Jun 03 20:42:55.249533 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249360 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8999c8ff-31e0-4203-82b6-9969dd68a29e-hosts-file\") pod \"node-resolver-vf4jz\" (UID: \"8999c8ff-31e0-4203-82b6-9969dd68a29e\") " pod="openshift-dns/node-resolver-vf4jz" Jun 03 20:42:55.249533 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249385 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4xjf\" (UniqueName: \"kubernetes.io/projected/3052984c-1fbe-473f-ac39-8c597c47c315-kube-api-access-q4xjf\") pod \"node-ca-4kgfh\" (UID: \"3052984c-1fbe-473f-ac39-8c597c47c315\") " pod="openshift-image-registry/node-ca-4kgfh" Jun 03 20:42:55.250218 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249409 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c16d78e4-4fa7-4f14-9b41-3281ad9058d1-cnibin\") pod \"multus-additional-cni-plugins-hh664\" (UID: \"c16d78e4-4fa7-4f14-9b41-3281ad9058d1\") " pod="openshift-multus/multus-additional-cni-plugins-hh664" Jun 03 20:42:55.250218 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249409 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8999c8ff-31e0-4203-82b6-9969dd68a29e-hosts-file\") pod \"node-resolver-vf4jz\" (UID: \"8999c8ff-31e0-4203-82b6-9969dd68a29e\") " pod="openshift-dns/node-resolver-vf4jz" Jun 03 20:42:55.250218 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249431 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c16d78e4-4fa7-4f14-9b41-3281ad9058d1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hh664\" (UID: \"c16d78e4-4fa7-4f14-9b41-3281ad9058d1\") " pod="openshift-multus/multus-additional-cni-plugins-hh664" Jun 03 20:42:55.250218 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249454 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3052984c-1fbe-473f-ac39-8c597c47c315-serviceca\") pod \"node-ca-4kgfh\" (UID: \"3052984c-1fbe-473f-ac39-8c597c47c315\") " pod="openshift-image-registry/node-ca-4kgfh" Jun 03 20:42:55.250218 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249490 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1823acc8-b08e-42f8-8f2c-419d2adeba34-sys\") pod \"tuned-7sm44\" (UID: \"1823acc8-b08e-42f8-8f2c-419d2adeba34\") " pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.250218 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249512 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/af1b38f2-1aca-4850-8da0-2a34544d3cab-registration-dir\") pod \"aws-ebs-csi-driver-node-jknxv\" (UID: \"af1b38f2-1aca-4850-8da0-2a34544d3cab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jknxv" Jun 03 20:42:55.250218 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249536 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krcn4\" (UniqueName: \"kubernetes.io/projected/af1b38f2-1aca-4850-8da0-2a34544d3cab-kube-api-access-krcn4\") pod \"aws-ebs-csi-driver-node-jknxv\" (UID: \"af1b38f2-1aca-4850-8da0-2a34544d3cab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jknxv" Jun 03 20:42:55.250218 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249561 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm845\" (UniqueName: \"kubernetes.io/projected/8e4786f6-75ea-4291-87b8-9f436beae16c-kube-api-access-cm845\") pod \"network-check-target-jnfc6\" (UID: \"8e4786f6-75ea-4291-87b8-9f436beae16c\") " pod="openshift-network-diagnostics/network-check-target-jnfc6" Jun 03 20:42:55.250218 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249577 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1823acc8-b08e-42f8-8f2c-419d2adeba34-sys\") pod \"tuned-7sm44\" (UID: \"1823acc8-b08e-42f8-8f2c-419d2adeba34\") " pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.250218 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249585 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c8af318f-da88-4811-b82a-c958cdcd739e-host-slash\") pod \"iptables-alerter-hzpmd\" (UID: \"c8af318f-da88-4811-b82a-c958cdcd739e\") " pod="openshift-network-operator/iptables-alerter-hzpmd" Jun 03 20:42:55.250218 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249489 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c16d78e4-4fa7-4f14-9b41-3281ad9058d1-cnibin\") pod \"multus-additional-cni-plugins-hh664\" (UID: \"c16d78e4-4fa7-4f14-9b41-3281ad9058d1\") " pod="openshift-multus/multus-additional-cni-plugins-hh664" Jun 03 20:42:55.250218 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249602 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/af1b38f2-1aca-4850-8da0-2a34544d3cab-registration-dir\") pod \"aws-ebs-csi-driver-node-jknxv\" (UID: \"af1b38f2-1aca-4850-8da0-2a34544d3cab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jknxv" Jun 03 20:42:55.250218 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249610 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c16d78e4-4fa7-4f14-9b41-3281ad9058d1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hh664\" (UID: \"c16d78e4-4fa7-4f14-9b41-3281ad9058d1\") " pod="openshift-multus/multus-additional-cni-plugins-hh664" Jun 03 20:42:55.250218 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249667 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/51f5ccb5-b246-47b7-82cb-9524ff802fae-ovn-node-metrics-cert\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.250218 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249695 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ee74555b-6958-4016-aeaf-7ceec6fd794f-host-run-k8s-cni-cncf-io\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.250218 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249716 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ee74555b-6958-4016-aeaf-7ceec6fd794f-host-var-lib-cni-bin\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.250218 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249738 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee74555b-6958-4016-aeaf-7ceec6fd794f-host-var-lib-kubelet\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.250961 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249760 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvswx\" (UniqueName: \"kubernetes.io/projected/ee74555b-6958-4016-aeaf-7ceec6fd794f-kube-api-access-mvswx\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.250961 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249786 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3052984c-1fbe-473f-ac39-8c597c47c315-host\") pod \"node-ca-4kgfh\" (UID: \"3052984c-1fbe-473f-ac39-8c597c47c315\") " pod="openshift-image-registry/node-ca-4kgfh" Jun 03 20:42:55.250961 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249815 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1823acc8-b08e-42f8-8f2c-419d2adeba34-etc-tuned\") pod \"tuned-7sm44\" (UID: \"1823acc8-b08e-42f8-8f2c-419d2adeba34\") " pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.250961 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249881 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3052984c-1fbe-473f-ac39-8c597c47c315-host\") pod \"node-ca-4kgfh\" (UID: \"3052984c-1fbe-473f-ac39-8c597c47c315\") " pod="openshift-image-registry/node-ca-4kgfh" Jun 03 20:42:55.250961 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249882 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-run-systemd\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.250961 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249931 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-host-cni-bin\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.250961 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249954 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/51f5ccb5-b246-47b7-82cb-9524ff802fae-env-overrides\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.250961 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249978 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ee74555b-6958-4016-aeaf-7ceec6fd794f-cnibin\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.250961 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.249997 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3052984c-1fbe-473f-ac39-8c597c47c315-serviceca\") pod \"node-ca-4kgfh\" (UID: \"3052984c-1fbe-473f-ac39-8c597c47c315\") " pod="openshift-image-registry/node-ca-4kgfh" Jun 03 20:42:55.250961 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250001 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-host-kubelet\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.250961 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250029 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8999c8ff-31e0-4203-82b6-9969dd68a29e-tmp-dir\") pod \"node-resolver-vf4jz\" (UID: \"8999c8ff-31e0-4203-82b6-9969dd68a29e\") " pod="openshift-dns/node-resolver-vf4jz" Jun 03 20:42:55.250961 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250058 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c16d78e4-4fa7-4f14-9b41-3281ad9058d1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hh664\" (UID: \"c16d78e4-4fa7-4f14-9b41-3281ad9058d1\") " pod="openshift-multus/multus-additional-cni-plugins-hh664" Jun 03 20:42:55.250961 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250059 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1823acc8-b08e-42f8-8f2c-419d2adeba34-tmp\") pod \"tuned-7sm44\" (UID: \"1823acc8-b08e-42f8-8f2c-419d2adeba34\") " pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.250961 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250079 2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 20:42:55.250961 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250106 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5rds\" (UniqueName: \"kubernetes.io/projected/1823acc8-b08e-42f8-8f2c-419d2adeba34-kube-api-access-v5rds\") pod \"tuned-7sm44\" (UID: \"1823acc8-b08e-42f8-8f2c-419d2adeba34\") " pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.250961 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250111 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c16d78e4-4fa7-4f14-9b41-3281ad9058d1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hh664\" (UID: \"c16d78e4-4fa7-4f14-9b41-3281ad9058d1\") " pod="openshift-multus/multus-additional-cni-plugins-hh664" Jun 03 20:42:55.250961 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250129 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/af1b38f2-1aca-4850-8da0-2a34544d3cab-etc-selinux\") pod \"aws-ebs-csi-driver-node-jknxv\" (UID: \"af1b38f2-1aca-4850-8da0-2a34544d3cab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jknxv" Jun 03 20:42:55.250961 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250154 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fstdv\" (UniqueName: \"kubernetes.io/projected/51f5ccb5-b246-47b7-82cb-9524ff802fae-kube-api-access-fstdv\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.251598 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250182 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee74555b-6958-4016-aeaf-7ceec6fd794f-multus-cni-dir\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.251598 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250205 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ee74555b-6958-4016-aeaf-7ceec6fd794f-multus-socket-dir-parent\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.251598 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250218 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/af1b38f2-1aca-4850-8da0-2a34544d3cab-etc-selinux\") pod \"aws-ebs-csi-driver-node-jknxv\" (UID: \"af1b38f2-1aca-4850-8da0-2a34544d3cab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jknxv" Jun 03 20:42:55.251598 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250228 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1823acc8-b08e-42f8-8f2c-419d2adeba34-etc-kubernetes\") pod \"tuned-7sm44\" (UID: \"1823acc8-b08e-42f8-8f2c-419d2adeba34\") " pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.251598 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250252 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c16d78e4-4fa7-4f14-9b41-3281ad9058d1-system-cni-dir\") pod \"multus-additional-cni-plugins-hh664\" (UID: \"c16d78e4-4fa7-4f14-9b41-3281ad9058d1\") " pod="openshift-multus/multus-additional-cni-plugins-hh664" Jun 03 20:42:55.251598 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250277 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c16d78e4-4fa7-4f14-9b41-3281ad9058d1-cni-binary-copy\") pod \"multus-additional-cni-plugins-hh664\" (UID: \"c16d78e4-4fa7-4f14-9b41-3281ad9058d1\") " pod="openshift-multus/multus-additional-cni-plugins-hh664" Jun 03 20:42:55.251598 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250280 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8999c8ff-31e0-4203-82b6-9969dd68a29e-tmp-dir\") pod \"node-resolver-vf4jz\" (UID: \"8999c8ff-31e0-4203-82b6-9969dd68a29e\") " pod="openshift-dns/node-resolver-vf4jz" Jun 03 20:42:55.251598 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250301 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/025eda00-3ac0-406d-8bcc-48ea3697528f-kubelet-config\") pod \"global-pull-secret-syncer-m7dmv\" (UID: \"025eda00-3ac0-406d-8bcc-48ea3697528f\") " pod="kube-system/global-pull-secret-syncer-m7dmv" Jun 03 20:42:55.251598 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250320 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1823acc8-b08e-42f8-8f2c-419d2adeba34-etc-kubernetes\") pod \"tuned-7sm44\" (UID: \"1823acc8-b08e-42f8-8f2c-419d2adeba34\") " pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.251598 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250331 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c16d78e4-4fa7-4f14-9b41-3281ad9058d1-system-cni-dir\") pod \"multus-additional-cni-plugins-hh664\" (UID: \"c16d78e4-4fa7-4f14-9b41-3281ad9058d1\") " pod="openshift-multus/multus-additional-cni-plugins-hh664" Jun 03 20:42:55.251598 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250326 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/51f5ccb5-b246-47b7-82cb-9524ff802fae-ovnkube-script-lib\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.251598 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250364 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/025eda00-3ac0-406d-8bcc-48ea3697528f-kubelet-config\") pod \"global-pull-secret-syncer-m7dmv\" (UID: \"025eda00-3ac0-406d-8bcc-48ea3697528f\") " pod="kube-system/global-pull-secret-syncer-m7dmv" Jun 03 20:42:55.251598 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250371 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ee74555b-6958-4016-aeaf-7ceec6fd794f-host-run-multus-certs\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.251598 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250396 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c16d78e4-4fa7-4f14-9b41-3281ad9058d1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hh664\" (UID: \"c16d78e4-4fa7-4f14-9b41-3281ad9058d1\") " pod="openshift-multus/multus-additional-cni-plugins-hh664" Jun 03 20:42:55.251598 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250451 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/025eda00-3ac0-406d-8bcc-48ea3697528f-dbus\") pod \"global-pull-secret-syncer-m7dmv\" (UID: \"025eda00-3ac0-406d-8bcc-48ea3697528f\") " pod="kube-system/global-pull-secret-syncer-m7dmv" Jun 03 20:42:55.251598 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250494 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-log-socket\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.251598 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250520 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ee74555b-6958-4016-aeaf-7ceec6fd794f-cni-binary-copy\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.252068 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250536 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/025eda00-3ac0-406d-8bcc-48ea3697528f-dbus\") pod \"global-pull-secret-syncer-m7dmv\" (UID: \"025eda00-3ac0-406d-8bcc-48ea3697528f\") " pod="kube-system/global-pull-secret-syncer-m7dmv" Jun 03 20:42:55.252068 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250524 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c16d78e4-4fa7-4f14-9b41-3281ad9058d1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hh664\" (UID: \"c16d78e4-4fa7-4f14-9b41-3281ad9058d1\") " pod="openshift-multus/multus-additional-cni-plugins-hh664" Jun 03 20:42:55.252068 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250570 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk6cl\" (UniqueName: \"kubernetes.io/projected/c8af318f-da88-4811-b82a-c958cdcd739e-kube-api-access-fk6cl\") pod \"iptables-alerter-hzpmd\" (UID: \"c8af318f-da88-4811-b82a-c958cdcd739e\") " pod="openshift-network-operator/iptables-alerter-hzpmd" Jun 03 20:42:55.252068 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250601 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22vp9\" (UniqueName: \"kubernetes.io/projected/8999c8ff-31e0-4203-82b6-9969dd68a29e-kube-api-access-22vp9\") pod \"node-resolver-vf4jz\" (UID: \"8999c8ff-31e0-4203-82b6-9969dd68a29e\") " pod="openshift-dns/node-resolver-vf4jz" Jun 03 20:42:55.252068 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250628 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c16d78e4-4fa7-4f14-9b41-3281ad9058d1-os-release\") pod \"multus-additional-cni-plugins-hh664\" (UID: \"c16d78e4-4fa7-4f14-9b41-3281ad9058d1\") " pod="openshift-multus/multus-additional-cni-plugins-hh664" Jun 03 20:42:55.252068 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250651 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1823acc8-b08e-42f8-8f2c-419d2adeba34-etc-sysctl-d\") pod \"tuned-7sm44\" (UID: \"1823acc8-b08e-42f8-8f2c-419d2adeba34\") " pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.252068 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250673 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1823acc8-b08e-42f8-8f2c-419d2adeba34-lib-modules\") pod \"tuned-7sm44\" (UID: \"1823acc8-b08e-42f8-8f2c-419d2adeba34\") " pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.252068 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250699 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/025eda00-3ac0-406d-8bcc-48ea3697528f-original-pull-secret\") pod \"global-pull-secret-syncer-m7dmv\" (UID: \"025eda00-3ac0-406d-8bcc-48ea3697528f\") " pod="kube-system/global-pull-secret-syncer-m7dmv" Jun 03 20:42:55.252068 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250723 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/af1b38f2-1aca-4850-8da0-2a34544d3cab-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jknxv\" (UID: \"af1b38f2-1aca-4850-8da0-2a34544d3cab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jknxv" Jun 03 20:42:55.252068 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250729 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c16d78e4-4fa7-4f14-9b41-3281ad9058d1-cni-binary-copy\") pod \"multus-additional-cni-plugins-hh664\" (UID: \"c16d78e4-4fa7-4f14-9b41-3281ad9058d1\") " pod="openshift-multus/multus-additional-cni-plugins-hh664" Jun 03 20:42:55.252068 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250745 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/af1b38f2-1aca-4850-8da0-2a34544d3cab-sys-fs\") pod \"aws-ebs-csi-driver-node-jknxv\" (UID: \"af1b38f2-1aca-4850-8da0-2a34544d3cab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jknxv" Jun 03 20:42:55.252068 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250768 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-host-slash\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.252068 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250792 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aee2b45f-422e-44e2-9cc1-eca625d64f5e-agent-certs\") pod \"konnectivity-agent-fgv2m\" (UID: \"aee2b45f-422e-44e2-9cc1-eca625d64f5e\") " pod="kube-system/konnectivity-agent-fgv2m" Jun 03 20:42:55.252068 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250808 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1823acc8-b08e-42f8-8f2c-419d2adeba34-lib-modules\") pod \"tuned-7sm44\" (UID: \"1823acc8-b08e-42f8-8f2c-419d2adeba34\") " pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.252068 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250818 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aee2b45f-422e-44e2-9cc1-eca625d64f5e-konnectivity-ca\") pod \"konnectivity-agent-fgv2m\" (UID: \"aee2b45f-422e-44e2-9cc1-eca625d64f5e\") " pod="kube-system/konnectivity-agent-fgv2m" Jun 03 20:42:55.252068 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250809 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/af1b38f2-1aca-4850-8da0-2a34544d3cab-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jknxv\" (UID: \"af1b38f2-1aca-4850-8da0-2a34544d3cab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jknxv" Jun 03 20:42:55.252068 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250840 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c16d78e4-4fa7-4f14-9b41-3281ad9058d1-os-release\") pod \"multus-additional-cni-plugins-hh664\" (UID: \"c16d78e4-4fa7-4f14-9b41-3281ad9058d1\") " pod="openshift-multus/multus-additional-cni-plugins-hh664" Jun 03 20:42:55.252687 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250792 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1823acc8-b08e-42f8-8f2c-419d2adeba34-etc-sysctl-d\") pod \"tuned-7sm44\" (UID: \"1823acc8-b08e-42f8-8f2c-419d2adeba34\") " pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.252687 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:55.250842 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 20:42:55.252687 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250866 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/af1b38f2-1aca-4850-8da0-2a34544d3cab-sys-fs\") pod \"aws-ebs-csi-driver-node-jknxv\" (UID: \"af1b38f2-1aca-4850-8da0-2a34544d3cab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jknxv" Jun 03 20:42:55.252687 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.250898 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a19725e1-b81e-4b3b-8cb9-173528f14f9d-metrics-certs\") pod \"network-metrics-daemon-5qxdz\" (UID: \"a19725e1-b81e-4b3b-8cb9-173528f14f9d\") " pod="openshift-multus/network-metrics-daemon-5qxdz" Jun 03 20:42:55.252687 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:55.251019 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/025eda00-3ac0-406d-8bcc-48ea3697528f-original-pull-secret podName:025eda00-3ac0-406d-8bcc-48ea3697528f nodeName:}" failed. No retries permitted until 2026-06-03 20:42:55.750988084 +0000 UTC m=+2.000398564 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/025eda00-3ac0-406d-8bcc-48ea3697528f-original-pull-secret") pod "global-pull-secret-syncer-m7dmv" (UID: "025eda00-3ac0-406d-8bcc-48ea3697528f") : object "kube-system"/"original-pull-secret" not registered Jun 03 20:42:55.252687 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:55.251034 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:42:55.252687 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:55.251096 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a19725e1-b81e-4b3b-8cb9-173528f14f9d-metrics-certs podName:a19725e1-b81e-4b3b-8cb9-173528f14f9d nodeName:}" failed. No retries permitted until 2026-06-03 20:42:55.751077078 +0000 UTC m=+2.000487548 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a19725e1-b81e-4b3b-8cb9-173528f14f9d-metrics-certs") pod "network-metrics-daemon-5qxdz" (UID: "a19725e1-b81e-4b3b-8cb9-173528f14f9d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:42:55.252687 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.251268 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aee2b45f-422e-44e2-9cc1-eca625d64f5e-konnectivity-ca\") pod \"konnectivity-agent-fgv2m\" (UID: \"aee2b45f-422e-44e2-9cc1-eca625d64f5e\") " pod="kube-system/konnectivity-agent-fgv2m" Jun 03 20:42:55.253239 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.253215 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1823acc8-b08e-42f8-8f2c-419d2adeba34-tmp\") pod \"tuned-7sm44\" (UID: \"1823acc8-b08e-42f8-8f2c-419d2adeba34\") " pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.253290 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.253238 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1823acc8-b08e-42f8-8f2c-419d2adeba34-etc-tuned\") pod \"tuned-7sm44\" (UID: \"1823acc8-b08e-42f8-8f2c-419d2adeba34\") " pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.253290 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.253251 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aee2b45f-422e-44e2-9cc1-eca625d64f5e-agent-certs\") pod \"konnectivity-agent-fgv2m\" (UID: \"aee2b45f-422e-44e2-9cc1-eca625d64f5e\") " pod="kube-system/konnectivity-agent-fgv2m" Jun 03 20:42:55.256009 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:55.255980 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 20:42:55.256074 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:55.256018 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 20:42:55.256074 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:55.256031 2573 projected.go:196] Error preparing data for projected volume kube-api-access-cm845 for pod openshift-network-diagnostics/network-check-target-jnfc6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:42:55.256164 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:55.256083 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e4786f6-75ea-4291-87b8-9f436beae16c-kube-api-access-cm845 podName:8e4786f6-75ea-4291-87b8-9f436beae16c nodeName:}" failed. No retries permitted until 2026-06-03 20:42:55.756068906 +0000 UTC m=+2.005479376 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cm845" (UniqueName: "kubernetes.io/projected/8e4786f6-75ea-4291-87b8-9f436beae16c-kube-api-access-cm845") pod "network-check-target-jnfc6" (UID: "8e4786f6-75ea-4291-87b8-9f436beae16c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:42:55.258256 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.258230 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4rb9\" (UniqueName: \"kubernetes.io/projected/c16d78e4-4fa7-4f14-9b41-3281ad9058d1-kube-api-access-f4rb9\") pod \"multus-additional-cni-plugins-hh664\" (UID: \"c16d78e4-4fa7-4f14-9b41-3281ad9058d1\") " pod="openshift-multus/multus-additional-cni-plugins-hh664" Jun 03 20:42:55.258341 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.258255 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krcn4\" (UniqueName: \"kubernetes.io/projected/af1b38f2-1aca-4850-8da0-2a34544d3cab-kube-api-access-krcn4\") pod \"aws-ebs-csi-driver-node-jknxv\" (UID: \"af1b38f2-1aca-4850-8da0-2a34544d3cab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jknxv" Jun 03 20:42:55.258437 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.258417 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4xjf\" (UniqueName: \"kubernetes.io/projected/3052984c-1fbe-473f-ac39-8c597c47c315-kube-api-access-q4xjf\") pod \"node-ca-4kgfh\" (UID: \"3052984c-1fbe-473f-ac39-8c597c47c315\") " pod="openshift-image-registry/node-ca-4kgfh" Jun 03 20:42:55.258547 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.258528 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5rds\" (UniqueName: \"kubernetes.io/projected/1823acc8-b08e-42f8-8f2c-419d2adeba34-kube-api-access-v5rds\") pod \"tuned-7sm44\" (UID: \"1823acc8-b08e-42f8-8f2c-419d2adeba34\") " pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.258931 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.258917 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8vfx\" (UniqueName: \"kubernetes.io/projected/a19725e1-b81e-4b3b-8cb9-173528f14f9d-kube-api-access-d8vfx\") pod \"network-metrics-daemon-5qxdz\" (UID: \"a19725e1-b81e-4b3b-8cb9-173528f14f9d\") " pod="openshift-multus/network-metrics-daemon-5qxdz" Jun 03 20:42:55.261173 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.261158 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22vp9\" (UniqueName: \"kubernetes.io/projected/8999c8ff-31e0-4203-82b6-9969dd68a29e-kube-api-access-22vp9\") pod \"node-resolver-vf4jz\" (UID: \"8999c8ff-31e0-4203-82b6-9969dd68a29e\") " pod="openshift-dns/node-resolver-vf4jz" Jun 03 20:42:55.351738 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.351700 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.351903 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.351746 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee74555b-6958-4016-aeaf-7ceec6fd794f-etc-kubernetes\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.351903 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.351805 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c8af318f-da88-4811-b82a-c958cdcd739e-iptables-alerter-script\") pod \"iptables-alerter-hzpmd\" (UID: \"c8af318f-da88-4811-b82a-c958cdcd739e\") " pod="openshift-network-operator/iptables-alerter-hzpmd" Jun 03 20:42:55.351903 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.351854 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c8af318f-da88-4811-b82a-c958cdcd739e-host-slash\") pod \"iptables-alerter-hzpmd\" (UID: \"c8af318f-da88-4811-b82a-c958cdcd739e\") " pod="openshift-network-operator/iptables-alerter-hzpmd" Jun 03 20:42:55.351903 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.351869 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee74555b-6958-4016-aeaf-7ceec6fd794f-etc-kubernetes\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.351903 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.351884 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/51f5ccb5-b246-47b7-82cb-9524ff802fae-ovn-node-metrics-cert\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.352147 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.351908 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ee74555b-6958-4016-aeaf-7ceec6fd794f-host-run-k8s-cni-cncf-io\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.352147 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.351852 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.352147 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.351921 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c8af318f-da88-4811-b82a-c958cdcd739e-host-slash\") pod \"iptables-alerter-hzpmd\" (UID: \"c8af318f-da88-4811-b82a-c958cdcd739e\") " pod="openshift-network-operator/iptables-alerter-hzpmd" Jun 03 20:42:55.352147 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.351936 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ee74555b-6958-4016-aeaf-7ceec6fd794f-host-var-lib-cni-bin\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.352147 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.351966 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ee74555b-6958-4016-aeaf-7ceec6fd794f-host-run-k8s-cni-cncf-io\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.352147 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.351990 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee74555b-6958-4016-aeaf-7ceec6fd794f-host-var-lib-kubelet\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.352147 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.351991 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ee74555b-6958-4016-aeaf-7ceec6fd794f-host-var-lib-cni-bin\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.352147 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.352023 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee74555b-6958-4016-aeaf-7ceec6fd794f-host-var-lib-kubelet\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.352147 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.352015 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvswx\" (UniqueName: \"kubernetes.io/projected/ee74555b-6958-4016-aeaf-7ceec6fd794f-kube-api-access-mvswx\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.352147 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.352069 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-run-systemd\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.352147 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.352097 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-host-cni-bin\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.352147 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.352119 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/51f5ccb5-b246-47b7-82cb-9524ff802fae-env-overrides\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.352147 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.352141 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ee74555b-6958-4016-aeaf-7ceec6fd794f-cnibin\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.352732 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.352165 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-host-kubelet\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.352732 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.352192 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fstdv\" (UniqueName: \"kubernetes.io/projected/51f5ccb5-b246-47b7-82cb-9524ff802fae-kube-api-access-fstdv\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.352732 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.352200 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-host-cni-bin\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.352732 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.352212 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ee74555b-6958-4016-aeaf-7ceec6fd794f-cnibin\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.352732 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.352214 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee74555b-6958-4016-aeaf-7ceec6fd794f-multus-cni-dir\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.352732 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.352264 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-host-kubelet\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.352732 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.352353 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee74555b-6958-4016-aeaf-7ceec6fd794f-multus-cni-dir\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.352732 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.352405 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ee74555b-6958-4016-aeaf-7ceec6fd794f-multus-socket-dir-parent\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.352732 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.352446 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/51f5ccb5-b246-47b7-82cb-9524ff802fae-ovnkube-script-lib\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.352732 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.352488 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ee74555b-6958-4016-aeaf-7ceec6fd794f-host-run-multus-certs\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.352732 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.352506 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c8af318f-da88-4811-b82a-c958cdcd739e-iptables-alerter-script\") pod \"iptables-alerter-hzpmd\" (UID: \"c8af318f-da88-4811-b82a-c958cdcd739e\") " pod="openshift-network-operator/iptables-alerter-hzpmd" Jun 03 20:42:55.352732 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.352506 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ee74555b-6958-4016-aeaf-7ceec6fd794f-multus-socket-dir-parent\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.352732 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.352518 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-log-socket\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.352732 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.352542 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ee74555b-6958-4016-aeaf-7ceec6fd794f-host-run-multus-certs\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.352732 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.352556 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-log-socket\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.352732 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.352566 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ee74555b-6958-4016-aeaf-7ceec6fd794f-cni-binary-copy\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.352732 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.352624 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk6cl\" (UniqueName: \"kubernetes.io/projected/c8af318f-da88-4811-b82a-c958cdcd739e-kube-api-access-fk6cl\") pod \"iptables-alerter-hzpmd\" (UID: \"c8af318f-da88-4811-b82a-c958cdcd739e\") " pod="openshift-network-operator/iptables-alerter-hzpmd" Jun 03 20:42:55.352732 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.352627 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/51f5ccb5-b246-47b7-82cb-9524ff802fae-env-overrides\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.353493 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.352671 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-host-slash\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.353493 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.352689 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-run-systemd\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.353493 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.352707 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-host-run-netns\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.353493 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.352771 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-node-log\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.353493 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.352795 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-host-run-ovn-kubernetes\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.353493 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.352820 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ee74555b-6958-4016-aeaf-7ceec6fd794f-host-var-lib-cni-multus\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.353493 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.352810 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-host-run-netns\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.353493 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.352850 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-host-cni-netd\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.353493 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.352866 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-node-log\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.353493 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.352897 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ee74555b-6958-4016-aeaf-7ceec6fd794f-host-var-lib-cni-multus\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.353493 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.352897 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-host-cni-netd\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.353493 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.352898 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-host-run-ovn-kubernetes\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.353493 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.352962 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/51f5ccb5-b246-47b7-82cb-9524ff802fae-ovnkube-config\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.353493 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.352994 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee74555b-6958-4016-aeaf-7ceec6fd794f-system-cni-dir\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.353493 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.353010 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/51f5ccb5-b246-47b7-82cb-9524ff802fae-ovnkube-script-lib\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.353493 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.352996 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-host-slash\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.353493 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.353021 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ee74555b-6958-4016-aeaf-7ceec6fd794f-multus-conf-dir\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.353493 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.353056 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee74555b-6958-4016-aeaf-7ceec6fd794f-system-cni-dir\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.354136 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.353075 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ee74555b-6958-4016-aeaf-7ceec6fd794f-cni-binary-copy\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.354136 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.353077 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-systemd-units\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.354136 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.353095 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ee74555b-6958-4016-aeaf-7ceec6fd794f-multus-conf-dir\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.354136 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.353119 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-var-lib-openvswitch\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.354136 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.353120 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-systemd-units\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.354136 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.353146 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-run-openvswitch\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.354136 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.353153 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-var-lib-openvswitch\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.354136 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.353177 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ee74555b-6958-4016-aeaf-7ceec6fd794f-hostroot\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.354136 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.353207 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-run-ovn\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.354136 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.353230 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ee74555b-6958-4016-aeaf-7ceec6fd794f-os-release\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.354136 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.353228 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ee74555b-6958-4016-aeaf-7ceec6fd794f-hostroot\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.354136 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.353254 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ee74555b-6958-4016-aeaf-7ceec6fd794f-host-run-netns\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.354136 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.353262 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-run-ovn\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.354136 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.353179 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-run-openvswitch\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.354136 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.353279 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ee74555b-6958-4016-aeaf-7ceec6fd794f-multus-daemon-config\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.354136 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.353308 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ee74555b-6958-4016-aeaf-7ceec6fd794f-os-release\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.354136 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.353319 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-etc-openvswitch\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.354136 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.353347 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ee74555b-6958-4016-aeaf-7ceec6fd794f-host-run-netns\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.354746 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.353351 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51f5ccb5-b246-47b7-82cb-9524ff802fae-etc-openvswitch\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.354746 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.353461 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/51f5ccb5-b246-47b7-82cb-9524ff802fae-ovnkube-config\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.354746 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.353762 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ee74555b-6958-4016-aeaf-7ceec6fd794f-multus-daemon-config\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.354746 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.354508 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/51f5ccb5-b246-47b7-82cb-9524ff802fae-ovn-node-metrics-cert\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.363887 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.363856 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvswx\" (UniqueName: \"kubernetes.io/projected/ee74555b-6958-4016-aeaf-7ceec6fd794f-kube-api-access-mvswx\") pod \"multus-qv9w9\" (UID: \"ee74555b-6958-4016-aeaf-7ceec6fd794f\") " pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.364662 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.364644 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fstdv\" (UniqueName: \"kubernetes.io/projected/51f5ccb5-b246-47b7-82cb-9524ff802fae-kube-api-access-fstdv\") pod \"ovnkube-node-8cpfl\" (UID: \"51f5ccb5-b246-47b7-82cb-9524ff802fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.364910 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.364894 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk6cl\" (UniqueName: \"kubernetes.io/projected/c8af318f-da88-4811-b82a-c958cdcd739e-kube-api-access-fk6cl\") pod \"iptables-alerter-hzpmd\" (UID: \"c8af318f-da88-4811-b82a-c958cdcd739e\") " pod="openshift-network-operator/iptables-alerter-hzpmd" Jun 03 20:42:55.445141 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.445073 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vf4jz" Jun 03 20:42:55.450839 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.450818 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fgv2m" Jun 03 20:42:55.453974 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:55.453947 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8999c8ff_31e0_4203_82b6_9969dd68a29e.slice/crio-4823385a4e6e72cadc5da5f8e1007329deca10c7c0ae61d8597116f06637a8d7 WatchSource:0}: Error finding container 4823385a4e6e72cadc5da5f8e1007329deca10c7c0ae61d8597116f06637a8d7: Status 404 returned error can't find the container with id 4823385a4e6e72cadc5da5f8e1007329deca10c7c0ae61d8597116f06637a8d7 Jun 03 20:42:55.456274 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.456252 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jknxv" Jun 03 20:42:55.459980 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:55.459950 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaee2b45f_422e_44e2_9cc1_eca625d64f5e.slice/crio-77953c7f8dce2135ef1c24f14259624e62cd30559f790dcddc0fc2403c79e4a3 WatchSource:0}: Error finding container 77953c7f8dce2135ef1c24f14259624e62cd30559f790dcddc0fc2403c79e4a3: Status 404 returned error can't find the container with id 77953c7f8dce2135ef1c24f14259624e62cd30559f790dcddc0fc2403c79e4a3 Jun 03 20:42:55.461119 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.461046 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4kgfh" Jun 03 20:42:55.465842 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.465825 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hh664" Jun 03 20:42:55.468139 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:55.468116 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf1b38f2_1aca_4850_8da0_2a34544d3cab.slice/crio-7c10dbe4db7a9feedff4c0f01c8e8975c12aa2b6feec792c193c971ac0abab01 WatchSource:0}: Error finding container 7c10dbe4db7a9feedff4c0f01c8e8975c12aa2b6feec792c193c971ac0abab01: Status 404 returned error can't find the container with id 7c10dbe4db7a9feedff4c0f01c8e8975c12aa2b6feec792c193c971ac0abab01 Jun 03 20:42:55.471186 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.471167 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7sm44" Jun 03 20:42:55.474420 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:55.474391 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3052984c_1fbe_473f_ac39_8c597c47c315.slice/crio-2e3997d5fb484cce5c36b30fed1c068b22bd97c4ca95659f264f7b35ec29b691 WatchSource:0}: Error finding container 2e3997d5fb484cce5c36b30fed1c068b22bd97c4ca95659f264f7b35ec29b691: Status 404 returned error can't find the container with id 2e3997d5fb484cce5c36b30fed1c068b22bd97c4ca95659f264f7b35ec29b691 Jun 03 20:42:55.475620 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.475597 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qv9w9" Jun 03 20:42:55.477909 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:55.477710 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc16d78e4_4fa7_4f14_9b41_3281ad9058d1.slice/crio-a9c460abcb6c1751ddf092308ea4db7cd1de4dc349ee0deb7288c6800712ae82 WatchSource:0}: Error finding container a9c460abcb6c1751ddf092308ea4db7cd1de4dc349ee0deb7288c6800712ae82: Status 404 returned error can't find the container with id a9c460abcb6c1751ddf092308ea4db7cd1de4dc349ee0deb7288c6800712ae82 Jun 03 20:42:55.480595 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:55.480558 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1823acc8_b08e_42f8_8f2c_419d2adeba34.slice/crio-49753ec2974d5062499cde9d636dcee30fe5ff09169c756a5b26c45fe710ce25 WatchSource:0}: Error finding container 49753ec2974d5062499cde9d636dcee30fe5ff09169c756a5b26c45fe710ce25: Status 404 returned error can't find the container with id 49753ec2974d5062499cde9d636dcee30fe5ff09169c756a5b26c45fe710ce25 Jun 03 20:42:55.481536 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.481516 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hzpmd" Jun 03 20:42:55.486073 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.486043 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:42:55.486250 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:55.486220 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee74555b_6958_4016_aeaf_7ceec6fd794f.slice/crio-3a5c5a1d27570019e7846a20434a5cbae44b378b6f951e74501193986dd49905 WatchSource:0}: Error finding container 3a5c5a1d27570019e7846a20434a5cbae44b378b6f951e74501193986dd49905: Status 404 returned error can't find the container with id 3a5c5a1d27570019e7846a20434a5cbae44b378b6f951e74501193986dd49905 Jun 03 20:42:55.494103 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:55.494081 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8af318f_da88_4811_b82a_c958cdcd739e.slice/crio-46e53e922479604489915f6e585f4d18cdf5e6dbd26af83ff9532696fc2567e3 WatchSource:0}: Error finding container 46e53e922479604489915f6e585f4d18cdf5e6dbd26af83ff9532696fc2567e3: Status 404 returned error can't find the container with id 46e53e922479604489915f6e585f4d18cdf5e6dbd26af83ff9532696fc2567e3 Jun 03 20:42:55.498991 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:42:55.498966 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51f5ccb5_b246_47b7_82cb_9524ff802fae.slice/crio-4e4d7574e749710f87f0f53157fad3182369a8fc4f2f5c12f81fa4adfa5efe07 WatchSource:0}: Error finding container 4e4d7574e749710f87f0f53157fad3182369a8fc4f2f5c12f81fa4adfa5efe07: Status 404 returned error can't find the container with id 4e4d7574e749710f87f0f53157fad3182369a8fc4f2f5c12f81fa4adfa5efe07 Jun 03 20:42:55.756375 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.756342 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/025eda00-3ac0-406d-8bcc-48ea3697528f-original-pull-secret\") pod \"global-pull-secret-syncer-m7dmv\" (UID: \"025eda00-3ac0-406d-8bcc-48ea3697528f\") " pod="kube-system/global-pull-secret-syncer-m7dmv" Jun 03 20:42:55.756574 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.756393 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a19725e1-b81e-4b3b-8cb9-173528f14f9d-metrics-certs\") pod \"network-metrics-daemon-5qxdz\" (UID: \"a19725e1-b81e-4b3b-8cb9-173528f14f9d\") " pod="openshift-multus/network-metrics-daemon-5qxdz" Jun 03 20:42:55.756574 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:55.756438 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm845\" (UniqueName: \"kubernetes.io/projected/8e4786f6-75ea-4291-87b8-9f436beae16c-kube-api-access-cm845\") pod \"network-check-target-jnfc6\" (UID: \"8e4786f6-75ea-4291-87b8-9f436beae16c\") " pod="openshift-network-diagnostics/network-check-target-jnfc6" Jun 03 20:42:55.756679 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:55.756597 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 20:42:55.756679 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:55.756618 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 20:42:55.756679 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:55.756630 2573 projected.go:196] Error preparing data for projected volume kube-api-access-cm845 for pod openshift-network-diagnostics/network-check-target-jnfc6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:42:55.756826 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:55.756684 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e4786f6-75ea-4291-87b8-9f436beae16c-kube-api-access-cm845 podName:8e4786f6-75ea-4291-87b8-9f436beae16c nodeName:}" failed. No retries permitted until 2026-06-03 20:42:56.756666526 +0000 UTC m=+3.006076999 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cm845" (UniqueName: "kubernetes.io/projected/8e4786f6-75ea-4291-87b8-9f436beae16c-kube-api-access-cm845") pod "network-check-target-jnfc6" (UID: "8e4786f6-75ea-4291-87b8-9f436beae16c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:42:55.757083 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:55.756990 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:42:55.757083 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:55.757054 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a19725e1-b81e-4b3b-8cb9-173528f14f9d-metrics-certs podName:a19725e1-b81e-4b3b-8cb9-173528f14f9d nodeName:}" failed. No retries permitted until 2026-06-03 20:42:56.757037038 +0000 UTC m=+3.006447496 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a19725e1-b81e-4b3b-8cb9-173528f14f9d-metrics-certs") pod "network-metrics-daemon-5qxdz" (UID: "a19725e1-b81e-4b3b-8cb9-173528f14f9d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:42:55.757233 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:55.757093 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 20:42:55.757233 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:55.757142 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/025eda00-3ac0-406d-8bcc-48ea3697528f-original-pull-secret podName:025eda00-3ac0-406d-8bcc-48ea3697528f nodeName:}" failed. No retries permitted until 2026-06-03 20:42:56.75712746 +0000 UTC m=+3.006537916 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/025eda00-3ac0-406d-8bcc-48ea3697528f-original-pull-secret") pod "global-pull-secret-syncer-m7dmv" (UID: "025eda00-3ac0-406d-8bcc-48ea3697528f") : object "kube-system"/"original-pull-secret" not registered Jun 03 20:42:56.120099 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:56.120014 2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 20:42:56.177752 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:56.177693 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 20:37:55 +0000 UTC" deadline="2027-12-03 18:06:00.381124414 +0000 UTC" Jun 03 20:42:56.177752 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:56.177750 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13149h23m4.203378703s" Jun 03 20:42:56.185077 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:56.184885 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 20:42:56.231510 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:56.231397 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hzpmd" event={"ID":"c8af318f-da88-4811-b82a-c958cdcd739e","Type":"ContainerStarted","Data":"46e53e922479604489915f6e585f4d18cdf5e6dbd26af83ff9532696fc2567e3"} Jun 03 20:42:56.239224 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:56.239119 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4kgfh" event={"ID":"3052984c-1fbe-473f-ac39-8c597c47c315","Type":"ContainerStarted","Data":"2e3997d5fb484cce5c36b30fed1c068b22bd97c4ca95659f264f7b35ec29b691"} Jun 03 20:42:56.249535 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:56.249450 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fgv2m" event={"ID":"aee2b45f-422e-44e2-9cc1-eca625d64f5e","Type":"ContainerStarted","Data":"77953c7f8dce2135ef1c24f14259624e62cd30559f790dcddc0fc2403c79e4a3"} Jun 03 20:42:56.262841 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:56.262816 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vf4jz" event={"ID":"8999c8ff-31e0-4203-82b6-9969dd68a29e","Type":"ContainerStarted","Data":"4823385a4e6e72cadc5da5f8e1007329deca10c7c0ae61d8597116f06637a8d7"} Jun 03 20:42:56.277234 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:56.277123 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" event={"ID":"51f5ccb5-b246-47b7-82cb-9524ff802fae","Type":"ContainerStarted","Data":"4e4d7574e749710f87f0f53157fad3182369a8fc4f2f5c12f81fa4adfa5efe07"} Jun 03 20:42:56.285545 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:56.285460 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qv9w9" event={"ID":"ee74555b-6958-4016-aeaf-7ceec6fd794f","Type":"ContainerStarted","Data":"3a5c5a1d27570019e7846a20434a5cbae44b378b6f951e74501193986dd49905"} Jun 03 20:42:56.290787 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:56.290723 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7sm44" event={"ID":"1823acc8-b08e-42f8-8f2c-419d2adeba34","Type":"ContainerStarted","Data":"49753ec2974d5062499cde9d636dcee30fe5ff09169c756a5b26c45fe710ce25"} Jun 03 20:42:56.296606 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:56.296529 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hh664" event={"ID":"c16d78e4-4fa7-4f14-9b41-3281ad9058d1","Type":"ContainerStarted","Data":"a9c460abcb6c1751ddf092308ea4db7cd1de4dc349ee0deb7288c6800712ae82"} Jun 03 20:42:56.308307 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:56.308280 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jknxv" event={"ID":"af1b38f2-1aca-4850-8da0-2a34544d3cab","Type":"ContainerStarted","Data":"7c10dbe4db7a9feedff4c0f01c8e8975c12aa2b6feec792c193c971ac0abab01"} Jun 03 20:42:56.764884 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:56.764172 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/025eda00-3ac0-406d-8bcc-48ea3697528f-original-pull-secret\") pod \"global-pull-secret-syncer-m7dmv\" (UID: \"025eda00-3ac0-406d-8bcc-48ea3697528f\") " pod="kube-system/global-pull-secret-syncer-m7dmv" Jun 03 20:42:56.764884 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:56.764231 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a19725e1-b81e-4b3b-8cb9-173528f14f9d-metrics-certs\") pod \"network-metrics-daemon-5qxdz\" (UID: \"a19725e1-b81e-4b3b-8cb9-173528f14f9d\") " pod="openshift-multus/network-metrics-daemon-5qxdz" Jun 03 20:42:56.764884 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:56.764281 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm845\" (UniqueName: \"kubernetes.io/projected/8e4786f6-75ea-4291-87b8-9f436beae16c-kube-api-access-cm845\") pod \"network-check-target-jnfc6\" (UID: \"8e4786f6-75ea-4291-87b8-9f436beae16c\") " pod="openshift-network-diagnostics/network-check-target-jnfc6" Jun 03 20:42:56.764884 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:56.764427 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 20:42:56.764884 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:56.764447 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 20:42:56.764884 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:56.764460 2573 projected.go:196] Error preparing data for projected volume kube-api-access-cm845 for pod openshift-network-diagnostics/network-check-target-jnfc6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:42:56.764884 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:56.764520 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 20:42:56.764884 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:56.764535 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e4786f6-75ea-4291-87b8-9f436beae16c-kube-api-access-cm845 podName:8e4786f6-75ea-4291-87b8-9f436beae16c nodeName:}" failed. No retries permitted until 2026-06-03 20:42:58.764516898 +0000 UTC m=+5.013927368 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cm845" (UniqueName: "kubernetes.io/projected/8e4786f6-75ea-4291-87b8-9f436beae16c-kube-api-access-cm845") pod "network-check-target-jnfc6" (UID: "8e4786f6-75ea-4291-87b8-9f436beae16c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:42:56.764884 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:56.764582 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/025eda00-3ac0-406d-8bcc-48ea3697528f-original-pull-secret podName:025eda00-3ac0-406d-8bcc-48ea3697528f nodeName:}" failed. No retries permitted until 2026-06-03 20:42:58.764565673 +0000 UTC m=+5.013976144 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/025eda00-3ac0-406d-8bcc-48ea3697528f-original-pull-secret") pod "global-pull-secret-syncer-m7dmv" (UID: "025eda00-3ac0-406d-8bcc-48ea3697528f") : object "kube-system"/"original-pull-secret" not registered Jun 03 20:42:56.764884 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:56.764591 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:42:56.764884 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:56.764636 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a19725e1-b81e-4b3b-8cb9-173528f14f9d-metrics-certs podName:a19725e1-b81e-4b3b-8cb9-173528f14f9d nodeName:}" failed. No retries permitted until 2026-06-03 20:42:58.764623099 +0000 UTC m=+5.014033569 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a19725e1-b81e-4b3b-8cb9-173528f14f9d-metrics-certs") pod "network-metrics-daemon-5qxdz" (UID: "a19725e1-b81e-4b3b-8cb9-173528f14f9d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:42:57.178514 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:57.178377 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 20:37:55 +0000 UTC" deadline="2028-01-07 02:10:56.022912792 +0000 UTC" Jun 03 20:42:57.178514 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:57.178413 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13973h27m58.844504576s" Jun 03 20:42:57.207461 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:57.206603 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qxdz" Jun 03 20:42:57.207461 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:57.206788 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qxdz" podUID="a19725e1-b81e-4b3b-8cb9-173528f14f9d" Jun 03 20:42:57.207461 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:57.207193 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m7dmv" Jun 03 20:42:57.207461 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:57.207297 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m7dmv" podUID="025eda00-3ac0-406d-8bcc-48ea3697528f" Jun 03 20:42:57.207461 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:57.207335 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnfc6" Jun 03 20:42:57.207461 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:57.207399 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnfc6" podUID="8e4786f6-75ea-4291-87b8-9f436beae16c" Jun 03 20:42:57.544246 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:57.544215 2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 20:42:58.780498 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:58.780179 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a19725e1-b81e-4b3b-8cb9-173528f14f9d-metrics-certs\") pod \"network-metrics-daemon-5qxdz\" (UID: \"a19725e1-b81e-4b3b-8cb9-173528f14f9d\") " pod="openshift-multus/network-metrics-daemon-5qxdz" Jun 03 20:42:58.780498 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:58.780254 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm845\" (UniqueName: \"kubernetes.io/projected/8e4786f6-75ea-4291-87b8-9f436beae16c-kube-api-access-cm845\") pod \"network-check-target-jnfc6\" (UID: \"8e4786f6-75ea-4291-87b8-9f436beae16c\") " pod="openshift-network-diagnostics/network-check-target-jnfc6" Jun 03 20:42:58.780498 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:58.780294 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:42:58.780498 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:58.780310 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/025eda00-3ac0-406d-8bcc-48ea3697528f-original-pull-secret\") pod \"global-pull-secret-syncer-m7dmv\" (UID: \"025eda00-3ac0-406d-8bcc-48ea3697528f\") " pod="kube-system/global-pull-secret-syncer-m7dmv" Jun 03 20:42:58.780498 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:58.780365 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a19725e1-b81e-4b3b-8cb9-173528f14f9d-metrics-certs podName:a19725e1-b81e-4b3b-8cb9-173528f14f9d nodeName:}" failed. No retries permitted until 2026-06-03 20:43:02.780345898 +0000 UTC m=+9.029756365 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a19725e1-b81e-4b3b-8cb9-173528f14f9d-metrics-certs") pod "network-metrics-daemon-5qxdz" (UID: "a19725e1-b81e-4b3b-8cb9-173528f14f9d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:42:58.780498 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:58.780455 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 20:42:58.781198 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:58.780792 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 20:42:58.781198 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:58.780809 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 20:42:58.781198 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:58.780822 2573 projected.go:196] Error preparing data for projected volume kube-api-access-cm845 for pod openshift-network-diagnostics/network-check-target-jnfc6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:42:58.781198 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:58.780867 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e4786f6-75ea-4291-87b8-9f436beae16c-kube-api-access-cm845 podName:8e4786f6-75ea-4291-87b8-9f436beae16c nodeName:}" failed. No retries permitted until 2026-06-03 20:43:02.780851887 +0000 UTC m=+9.030262342 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cm845" (UniqueName: "kubernetes.io/projected/8e4786f6-75ea-4291-87b8-9f436beae16c-kube-api-access-cm845") pod "network-check-target-jnfc6" (UID: "8e4786f6-75ea-4291-87b8-9f436beae16c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:42:58.781509 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:58.781462 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/025eda00-3ac0-406d-8bcc-48ea3697528f-original-pull-secret podName:025eda00-3ac0-406d-8bcc-48ea3697528f nodeName:}" failed. No retries permitted until 2026-06-03 20:43:02.78144288 +0000 UTC m=+9.030853352 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/025eda00-3ac0-406d-8bcc-48ea3697528f-original-pull-secret") pod "global-pull-secret-syncer-m7dmv" (UID: "025eda00-3ac0-406d-8bcc-48ea3697528f") : object "kube-system"/"original-pull-secret" not registered Jun 03 20:42:59.206528 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:59.206395 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnfc6" Jun 03 20:42:59.206528 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:59.206419 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m7dmv" Jun 03 20:42:59.206752 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:59.206540 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnfc6" podUID="8e4786f6-75ea-4291-87b8-9f436beae16c" Jun 03 20:42:59.206752 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:42:59.206586 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qxdz" Jun 03 20:42:59.206752 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:59.206690 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qxdz" podUID="a19725e1-b81e-4b3b-8cb9-173528f14f9d" Jun 03 20:42:59.206909 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:42:59.206767 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m7dmv" podUID="025eda00-3ac0-406d-8bcc-48ea3697528f" Jun 03 20:43:01.206156 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:01.205815 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qxdz" Jun 03 20:43:01.206156 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:01.205852 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnfc6" Jun 03 20:43:01.206156 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:01.205854 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m7dmv" Jun 03 20:43:01.206156 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:01.205959 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qxdz" podUID="a19725e1-b81e-4b3b-8cb9-173528f14f9d" Jun 03 20:43:01.206156 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:01.206087 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnfc6" podUID="8e4786f6-75ea-4291-87b8-9f436beae16c" Jun 03 20:43:01.206756 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:01.206182 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m7dmv" podUID="025eda00-3ac0-406d-8bcc-48ea3697528f" Jun 03 20:43:02.813411 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:02.813248 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm845\" (UniqueName: \"kubernetes.io/projected/8e4786f6-75ea-4291-87b8-9f436beae16c-kube-api-access-cm845\") pod \"network-check-target-jnfc6\" (UID: \"8e4786f6-75ea-4291-87b8-9f436beae16c\") " pod="openshift-network-diagnostics/network-check-target-jnfc6" Jun 03 20:43:02.813411 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:02.813331 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/025eda00-3ac0-406d-8bcc-48ea3697528f-original-pull-secret\") pod \"global-pull-secret-syncer-m7dmv\" (UID: \"025eda00-3ac0-406d-8bcc-48ea3697528f\") " pod="kube-system/global-pull-secret-syncer-m7dmv" Jun 03 20:43:02.813411 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:02.813366 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a19725e1-b81e-4b3b-8cb9-173528f14f9d-metrics-certs\") pod \"network-metrics-daemon-5qxdz\" (UID: \"a19725e1-b81e-4b3b-8cb9-173528f14f9d\") " pod="openshift-multus/network-metrics-daemon-5qxdz" Jun 03 20:43:02.814091 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:02.813434 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 20:43:02.814091 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:02.813460 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 20:43:02.814091 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:02.813489 2573 projected.go:196] Error preparing data for projected volume kube-api-access-cm845 for pod openshift-network-diagnostics/network-check-target-jnfc6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:02.814091 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:02.813511 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:02.814091 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:02.813551 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e4786f6-75ea-4291-87b8-9f436beae16c-kube-api-access-cm845 podName:8e4786f6-75ea-4291-87b8-9f436beae16c nodeName:}" failed. No retries permitted until 2026-06-03 20:43:10.8135314 +0000 UTC m=+17.062941869 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cm845" (UniqueName: "kubernetes.io/projected/8e4786f6-75ea-4291-87b8-9f436beae16c-kube-api-access-cm845") pod "network-check-target-jnfc6" (UID: "8e4786f6-75ea-4291-87b8-9f436beae16c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:02.814091 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:02.813573 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a19725e1-b81e-4b3b-8cb9-173528f14f9d-metrics-certs podName:a19725e1-b81e-4b3b-8cb9-173528f14f9d nodeName:}" failed. No retries permitted until 2026-06-03 20:43:10.813562543 +0000 UTC m=+17.062973000 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a19725e1-b81e-4b3b-8cb9-173528f14f9d-metrics-certs") pod "network-metrics-daemon-5qxdz" (UID: "a19725e1-b81e-4b3b-8cb9-173528f14f9d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:02.814091 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:02.813604 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:02.814091 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:02.813649 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/025eda00-3ac0-406d-8bcc-48ea3697528f-original-pull-secret podName:025eda00-3ac0-406d-8bcc-48ea3697528f nodeName:}" failed. No retries permitted until 2026-06-03 20:43:10.813624284 +0000 UTC m=+17.063034750 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/025eda00-3ac0-406d-8bcc-48ea3697528f-original-pull-secret") pod "global-pull-secret-syncer-m7dmv" (UID: "025eda00-3ac0-406d-8bcc-48ea3697528f") : object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:03.206327 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:03.205890 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qxdz" Jun 03 20:43:03.206327 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:03.206017 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnfc6" Jun 03 20:43:03.206327 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:03.206028 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qxdz" podUID="a19725e1-b81e-4b3b-8cb9-173528f14f9d" Jun 03 20:43:03.206327 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:03.206086 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnfc6" podUID="8e4786f6-75ea-4291-87b8-9f436beae16c" Jun 03 20:43:03.206327 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:03.206128 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m7dmv" Jun 03 20:43:03.206327 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:03.206194 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m7dmv" podUID="025eda00-3ac0-406d-8bcc-48ea3697528f" Jun 03 20:43:05.206727 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:05.206690 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnfc6" Jun 03 20:43:05.207155 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:05.206790 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qxdz" Jun 03 20:43:05.207155 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:05.206806 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnfc6" podUID="8e4786f6-75ea-4291-87b8-9f436beae16c" Jun 03 20:43:05.207155 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:05.206817 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m7dmv" Jun 03 20:43:05.207155 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:05.206900 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qxdz" podUID="a19725e1-b81e-4b3b-8cb9-173528f14f9d" Jun 03 20:43:05.207155 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:05.206984 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m7dmv" podUID="025eda00-3ac0-406d-8bcc-48ea3697528f" Jun 03 20:43:07.206618 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:07.206588 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qxdz" Jun 03 20:43:07.207042 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:07.206637 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnfc6" Jun 03 20:43:07.207042 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:07.206731 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qxdz" podUID="a19725e1-b81e-4b3b-8cb9-173528f14f9d" Jun 03 20:43:07.207042 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:07.206794 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnfc6" podUID="8e4786f6-75ea-4291-87b8-9f436beae16c" Jun 03 20:43:07.207042 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:07.206826 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m7dmv" Jun 03 20:43:07.207042 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:07.206932 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m7dmv" podUID="025eda00-3ac0-406d-8bcc-48ea3697528f" Jun 03 20:43:09.206217 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:09.206162 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnfc6" Jun 03 20:43:09.206217 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:09.206188 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qxdz" Jun 03 20:43:09.206769 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:09.206284 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnfc6" podUID="8e4786f6-75ea-4291-87b8-9f436beae16c" Jun 03 20:43:09.206769 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:09.206162 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m7dmv" Jun 03 20:43:09.206769 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:09.206392 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m7dmv" podUID="025eda00-3ac0-406d-8bcc-48ea3697528f" Jun 03 20:43:09.206914 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:09.206854 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qxdz" podUID="a19725e1-b81e-4b3b-8cb9-173528f14f9d" Jun 03 20:43:10.873490 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:10.873444 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/025eda00-3ac0-406d-8bcc-48ea3697528f-original-pull-secret\") pod \"global-pull-secret-syncer-m7dmv\" (UID: \"025eda00-3ac0-406d-8bcc-48ea3697528f\") " pod="kube-system/global-pull-secret-syncer-m7dmv" Jun 03 20:43:10.874031 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:10.873505 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a19725e1-b81e-4b3b-8cb9-173528f14f9d-metrics-certs\") pod \"network-metrics-daemon-5qxdz\" (UID: \"a19725e1-b81e-4b3b-8cb9-173528f14f9d\") " pod="openshift-multus/network-metrics-daemon-5qxdz" Jun 03 20:43:10.874031 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:10.873560 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm845\" (UniqueName: \"kubernetes.io/projected/8e4786f6-75ea-4291-87b8-9f436beae16c-kube-api-access-cm845\") pod \"network-check-target-jnfc6\" (UID: \"8e4786f6-75ea-4291-87b8-9f436beae16c\") " pod="openshift-network-diagnostics/network-check-target-jnfc6" Jun 03 20:43:10.874031 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:10.873587 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:10.874031 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:10.873664 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/025eda00-3ac0-406d-8bcc-48ea3697528f-original-pull-secret podName:025eda00-3ac0-406d-8bcc-48ea3697528f nodeName:}" failed. No retries permitted until 2026-06-03 20:43:26.873644268 +0000 UTC m=+33.123054734 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/025eda00-3ac0-406d-8bcc-48ea3697528f-original-pull-secret") pod "global-pull-secret-syncer-m7dmv" (UID: "025eda00-3ac0-406d-8bcc-48ea3697528f") : object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:10.874031 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:10.873665 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 20:43:10.874031 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:10.873683 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:10.874031 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:10.873688 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 20:43:10.874031 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:10.873742 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a19725e1-b81e-4b3b-8cb9-173528f14f9d-metrics-certs podName:a19725e1-b81e-4b3b-8cb9-173528f14f9d nodeName:}" failed. No retries permitted until 2026-06-03 20:43:26.873721859 +0000 UTC m=+33.123132331 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a19725e1-b81e-4b3b-8cb9-173528f14f9d-metrics-certs") pod "network-metrics-daemon-5qxdz" (UID: "a19725e1-b81e-4b3b-8cb9-173528f14f9d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:10.874031 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:10.873757 2573 projected.go:196] Error preparing data for projected volume kube-api-access-cm845 for pod openshift-network-diagnostics/network-check-target-jnfc6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:10.874031 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:10.873819 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e4786f6-75ea-4291-87b8-9f436beae16c-kube-api-access-cm845 podName:8e4786f6-75ea-4291-87b8-9f436beae16c nodeName:}" failed. No retries permitted until 2026-06-03 20:43:26.873795387 +0000 UTC m=+33.123205862 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cm845" (UniqueName: "kubernetes.io/projected/8e4786f6-75ea-4291-87b8-9f436beae16c-kube-api-access-cm845") pod "network-check-target-jnfc6" (UID: "8e4786f6-75ea-4291-87b8-9f436beae16c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:11.206778 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:11.206649 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnfc6" Jun 03 20:43:11.206778 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:11.206669 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qxdz" Jun 03 20:43:11.206778 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:11.206648 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m7dmv" Jun 03 20:43:11.207029 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:11.206776 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnfc6" podUID="8e4786f6-75ea-4291-87b8-9f436beae16c" Jun 03 20:43:11.207029 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:11.206871 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qxdz" podUID="a19725e1-b81e-4b3b-8cb9-173528f14f9d" Jun 03 20:43:11.207029 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:11.206952 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m7dmv" podUID="025eda00-3ac0-406d-8bcc-48ea3697528f" Jun 03 20:43:13.206106 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:13.206068 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qxdz" Jun 03 20:43:13.206594 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:13.206068 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnfc6" Jun 03 20:43:13.206594 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:13.206172 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qxdz" podUID="a19725e1-b81e-4b3b-8cb9-173528f14f9d" Jun 03 20:43:13.206594 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:13.206245 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnfc6" podUID="8e4786f6-75ea-4291-87b8-9f436beae16c" Jun 03 20:43:13.206594 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:13.206069 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m7dmv" Jun 03 20:43:13.206594 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:13.206333 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m7dmv" podUID="025eda00-3ac0-406d-8bcc-48ea3697528f" Jun 03 20:43:15.206259 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:15.206053 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qxdz" Jun 03 20:43:15.207071 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:15.206362 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qxdz" podUID="a19725e1-b81e-4b3b-8cb9-173528f14f9d" Jun 03 20:43:15.207071 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:15.206088 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m7dmv" Jun 03 20:43:15.207071 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:15.206465 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m7dmv" podUID="025eda00-3ac0-406d-8bcc-48ea3697528f" Jun 03 20:43:15.207071 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:15.206076 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnfc6" Jun 03 20:43:15.207071 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:15.206581 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnfc6" podUID="8e4786f6-75ea-4291-87b8-9f436beae16c" Jun 03 20:43:15.360778 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:15.360752 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8cpfl_51f5ccb5-b246-47b7-82cb-9524ff802fae/ovn-acl-logging/0.log" Jun 03 20:43:15.361593 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:15.361145 2573 generic.go:356] "Generic (PLEG): container finished" podID="51f5ccb5-b246-47b7-82cb-9524ff802fae" containerID="ac4a35f50cd7624284d00323cd7945715df60247b497ec5fb4e91cd4505a8c64" exitCode=1 Jun 03 20:43:15.361593 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:15.361224 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" event={"ID":"51f5ccb5-b246-47b7-82cb-9524ff802fae","Type":"ContainerStarted","Data":"b766dbdb5830cb3029dc6053a3710c22d550948eca22cc78d6109ee6c7ec6a64"} Jun 03 20:43:15.361593 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:15.361331 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" event={"ID":"51f5ccb5-b246-47b7-82cb-9524ff802fae","Type":"ContainerStarted","Data":"a52ca7ec061a3fde82e40930097b0c234c7ac4d8c34d3b73f90dbe03dd21f3fb"} Jun 03 20:43:15.361593 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:15.361404 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" event={"ID":"51f5ccb5-b246-47b7-82cb-9524ff802fae","Type":"ContainerStarted","Data":"904d5e3084740aef16de80ab7824ae660c534e45965f8a9c75604b940d71de8f"} Jun 03 20:43:15.361593 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:15.361454 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" event={"ID":"51f5ccb5-b246-47b7-82cb-9524ff802fae","Type":"ContainerStarted","Data":"a266a29030e0f2bd90bd79f776b247b67e65ab52bd478b998e4faf06bba7fd67"} Jun 03 20:43:15.361593 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:15.361523 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" event={"ID":"51f5ccb5-b246-47b7-82cb-9524ff802fae","Type":"ContainerDied","Data":"ac4a35f50cd7624284d00323cd7945715df60247b497ec5fb4e91cd4505a8c64"} Jun 03 20:43:15.361906 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:15.361606 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" event={"ID":"51f5ccb5-b246-47b7-82cb-9524ff802fae","Type":"ContainerStarted","Data":"b24f883b24c2d23646e2f9629575fe7d70c80322e261b1637198b487a6e3788c"} Jun 03 20:43:15.363044 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:15.363022 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qv9w9" event={"ID":"ee74555b-6958-4016-aeaf-7ceec6fd794f","Type":"ContainerStarted","Data":"71d24bf97d0f2eb8b32874b73d46536f4c37fdca73a0e9826bc74da16acc0dce"} Jun 03 20:43:15.364992 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:15.364964 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7sm44" event={"ID":"1823acc8-b08e-42f8-8f2c-419d2adeba34","Type":"ContainerStarted","Data":"c302cb534593d902bdd8f7586e32c352bdfd83195d076e65a023c8b80455be7d"} Jun 03 20:43:15.368917 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:15.368858 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jknxv" event={"ID":"af1b38f2-1aca-4850-8da0-2a34544d3cab","Type":"ContainerStarted","Data":"8a2761c8c0ac19d9c0a82e1b55cd88bbe6257ac85ed0a288c17c287944ed41fc"} Jun 03 20:43:15.370912 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:15.370886 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-159.ec2.internal" event={"ID":"2cfaf7f25e0479ec5ca04027253aa5e2","Type":"ContainerStarted","Data":"5fc305ac239977e87b3c32bd25d9238ec1aaa5dcc75da74bd022d3a0cbfbfdb2"} Jun 03 20:43:15.376166 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:15.376129 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fgv2m" event={"ID":"aee2b45f-422e-44e2-9cc1-eca625d64f5e","Type":"ContainerStarted","Data":"21b1cb31d5c7063d07a410adae3ba76442ff798754fc469ee8c656bf7c5e9a37"} Jun 03 20:43:15.385051 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:15.385002 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qv9w9" podStartSLOduration=1.834658111 podStartE2EDuration="21.384984814s" totalImagesPullingTime="19.550326703s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:42:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:15.384063121 +0000 UTC m=+21.633473597" watchObservedRunningTime="2026-06-03 20:43:15.384984814 +0000 UTC m=+21.634395289" Jun 03 20:43:15.438459 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:15.438416 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-159.ec2.internal" podStartSLOduration=20.438401526 podStartE2EDuration="20.438401526s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:42:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:15.43794844 +0000 UTC m=+21.687358915" watchObservedRunningTime="2026-06-03 20:43:15.438401526 +0000 UTC m=+21.687812000" Jun 03 20:43:15.438589 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:15.438497 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7sm44" podStartSLOduration=2.381968269 podStartE2EDuration="21.438491149s" totalImagesPullingTime="19.05652288s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:42:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:15.42507213 +0000 UTC m=+21.674482604" watchObservedRunningTime="2026-06-03 20:43:15.438491149 +0000 UTC m=+21.687901614" Jun 03 20:43:15.456514 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:15.456445 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fgv2m" podStartSLOduration=7.085558734 podStartE2EDuration="21.456428995s" totalImagesPullingTime="14.370870261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:42:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:15.455887677 +0000 UTC m=+21.705298153" watchObservedRunningTime="2026-06-03 20:43:15.456428995 +0000 UTC m=+21.705839470" Jun 03 20:43:15.471960 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:15.471919 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vf4jz" podStartSLOduration=2.389623416 podStartE2EDuration="21.471907419s" totalImagesPullingTime="19.082284003s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:42:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:15.471533149 +0000 UTC m=+21.720943624" watchObservedRunningTime="2026-06-03 20:43:15.471907419 +0000 UTC m=+21.721317893" Jun 03 20:43:15.540419 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:15.540389 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:15.616342 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:15.616318 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:16.380358 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:16.380328 2573 generic.go:356] "Generic (PLEG): container finished" podID="c16d78e4-4fa7-4f14-9b41-3281ad9058d1" containerID="5b9dbbbb696ed6bd064987fdb5b16c19b7ff9fcda69f2bfde8d1f8f265ba1eae" exitCode=0 Jun 03 20:43:16.380809 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:16.380403 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hh664" event={"ID":"c16d78e4-4fa7-4f14-9b41-3281ad9058d1","Type":"ContainerDied","Data":"5b9dbbbb696ed6bd064987fdb5b16c19b7ff9fcda69f2bfde8d1f8f265ba1eae"} Jun 03 20:43:16.381813 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:16.381793 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hzpmd" event={"ID":"c8af318f-da88-4811-b82a-c958cdcd739e","Type":"ContainerStarted","Data":"81ecd947369eeea9367cf4bac7eb83a03edf3a09b88ff64326a4251d7931d5ca"} Jun 03 20:43:16.383057 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:16.383038 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4kgfh" event={"ID":"3052984c-1fbe-473f-ac39-8c597c47c315","Type":"ContainerStarted","Data":"c5b07ed9e7a5c14ae4ff88174879277c4c561d85704daa453e34bc5703671d5e"} Jun 03 20:43:16.384319 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:16.384301 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vf4jz" event={"ID":"8999c8ff-31e0-4203-82b6-9969dd68a29e","Type":"ContainerStarted","Data":"965140676b95f440c696e161d08bf4d9e3244ec1bcf00d2267e9b7123136b5bb"} Jun 03 20:43:16.385714 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:16.385693 2573 generic.go:356] "Generic (PLEG): container finished" podID="14c7604689d2953ccbf42e9f811949bd" containerID="733309cf280382ab97ec63421e277d44ef2edcd86d8857230279094715f7e61d" exitCode=0 Jun 03 20:43:16.385794 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:16.385749 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-159.ec2.internal" event={"ID":"14c7604689d2953ccbf42e9f811949bd","Type":"ContainerDied","Data":"733309cf280382ab97ec63421e277d44ef2edcd86d8857230279094715f7e61d"} Jun 03 20:43:16.432321 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:16.432286 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hzpmd" podStartSLOduration=8.09672375 podStartE2EDuration="22.432274059s" totalImagesPullingTime="14.335550309s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:42:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:16.418103958 +0000 UTC m=+22.667514432" watchObservedRunningTime="2026-06-03 20:43:16.432274059 +0000 UTC m=+22.681684533" Jun 03 20:43:16.447556 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:16.447523 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4kgfh" podStartSLOduration=3.409621843 podStartE2EDuration="22.447515749s" totalImagesPullingTime="19.037893906s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:42:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:16.447337337 +0000 UTC m=+22.696747812" watchObservedRunningTime="2026-06-03 20:43:16.447515749 +0000 UTC m=+22.696926223" Jun 03 20:43:16.536204 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:16.536010 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:16.588826 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:16.588719 2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 20:43:16.636534 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:16.636462 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:16.739294 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:16.739271 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:16.837602 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:16.837576 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:17.205859 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:17.205831 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qxdz" Jun 03 20:43:17.206209 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:17.205949 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnfc6" Jun 03 20:43:17.206209 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:17.205964 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qxdz" podUID="a19725e1-b81e-4b3b-8cb9-173528f14f9d" Jun 03 20:43:17.206209 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:17.206066 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnfc6" podUID="8e4786f6-75ea-4291-87b8-9f436beae16c" Jun 03 20:43:17.206209 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:17.206077 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m7dmv" Jun 03 20:43:17.206209 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:17.206178 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m7dmv" podUID="025eda00-3ac0-406d-8bcc-48ea3697528f" Jun 03 20:43:17.213032 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:17.212951 2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T20:43:16.588734949Z","UUID":"8914119b-dcf6-44d3-8299-9da8d70ce024","Handler":null,"Name":"","Endpoint":""} Jun 03 20:43:17.214891 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:17.214871 2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 20:43:17.214991 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:17.214913 2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 20:43:17.390416 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:17.390385 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-159.ec2.internal" event={"ID":"14c7604689d2953ccbf42e9f811949bd","Type":"ContainerStarted","Data":"66ed88799282a699e2b172b7cfd6e08fb6b28d7ce54e19799a899833db1fb6f1"} Jun 03 20:43:17.392553 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:17.392518 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jknxv" event={"ID":"af1b38f2-1aca-4850-8da0-2a34544d3cab","Type":"ContainerStarted","Data":"7ef0132dc2d5afbb224afddd76e6cacdb5736ef4be4ee739a6e8c0d21d31ccc9"} Jun 03 20:43:17.407925 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:17.407871 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-159.ec2.internal" podStartSLOduration=22.407850111 podStartE2EDuration="22.407850111s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:42:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:17.406925497 +0000 UTC m=+23.656335971" watchObservedRunningTime="2026-06-03 20:43:17.407850111 +0000 UTC m=+23.657260590" Jun 03 20:43:17.906704 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:17.906673 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fgv2m" Jun 03 20:43:17.907158 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:17.907133 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fgv2m" Jun 03 20:43:18.397486 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:18.397442 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8cpfl_51f5ccb5-b246-47b7-82cb-9524ff802fae/ovn-acl-logging/0.log" Jun 03 20:43:18.398307 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:18.398279 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" event={"ID":"51f5ccb5-b246-47b7-82cb-9524ff802fae","Type":"ContainerStarted","Data":"4bc7dd97f83a5af3569461d4e392a88a79dfabb72349ad0593596ea2e59b94d7"} Jun 03 20:43:18.400519 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:18.400489 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jknxv" event={"ID":"af1b38f2-1aca-4850-8da0-2a34544d3cab","Type":"ContainerStarted","Data":"e41085e160bc544071134e7bbe1001840513b9574d685e4a1f3a0a10bdfaf7e5"} Jun 03 20:43:18.405158 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:18.405139 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fgv2m" Jun 03 20:43:18.405688 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:18.405674 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fgv2m" Jun 03 20:43:18.418675 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:18.418632 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jknxv" podStartSLOduration=3.19120037 podStartE2EDuration="24.418615214s" totalImagesPullingTime="21.227414844s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:42:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:18.41672748 +0000 UTC m=+24.666137956" watchObservedRunningTime="2026-06-03 20:43:18.418615214 +0000 UTC m=+24.668025692" Jun 03 20:43:18.472770 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:18.472721 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:19.206682 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:19.206649 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qxdz" Jun 03 20:43:19.206682 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:19.206673 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnfc6" Jun 03 20:43:19.206903 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:19.206674 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m7dmv" Jun 03 20:43:19.206903 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:19.206782 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qxdz" podUID="a19725e1-b81e-4b3b-8cb9-173528f14f9d" Jun 03 20:43:19.206903 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:19.206839 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnfc6" podUID="8e4786f6-75ea-4291-87b8-9f436beae16c" Jun 03 20:43:19.207022 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:19.206899 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m7dmv" podUID="025eda00-3ac0-406d-8bcc-48ea3697528f" Jun 03 20:43:21.206713 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:21.206494 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnfc6" Jun 03 20:43:21.207202 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:21.206495 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m7dmv" Jun 03 20:43:21.207202 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:21.206749 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnfc6" podUID="8e4786f6-75ea-4291-87b8-9f436beae16c" Jun 03 20:43:21.207202 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:21.206494 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qxdz" Jun 03 20:43:21.207202 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:21.206797 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m7dmv" podUID="025eda00-3ac0-406d-8bcc-48ea3697528f" Jun 03 20:43:21.207202 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:21.206872 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qxdz" podUID="a19725e1-b81e-4b3b-8cb9-173528f14f9d" Jun 03 20:43:21.412261 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:21.412230 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8cpfl_51f5ccb5-b246-47b7-82cb-9524ff802fae/ovn-acl-logging/0.log" Jun 03 20:43:21.412629 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:21.412594 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" event={"ID":"51f5ccb5-b246-47b7-82cb-9524ff802fae","Type":"ContainerStarted","Data":"d6c812372bb4c45796c351941e86a46918d01971218c647f1151257733367fb3"} Jun 03 20:43:21.412892 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:21.412863 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:43:21.412993 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:21.412935 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:43:21.412993 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:21.412982 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:43:21.413095 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:21.413060 2573 scope.go:117] "RemoveContainer" containerID="ac4a35f50cd7624284d00323cd7945715df60247b497ec5fb4e91cd4505a8c64" Jun 03 20:43:21.414734 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:21.414714 2573 generic.go:356] "Generic (PLEG): container finished" podID="c16d78e4-4fa7-4f14-9b41-3281ad9058d1" containerID="3d901273b5b45c55f62cb0af65c72a02356b04fb9c8a20e6df7db723b5355e6f" exitCode=0 Jun 03 20:43:21.414810 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:21.414755 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hh664" event={"ID":"c16d78e4-4fa7-4f14-9b41-3281ad9058d1","Type":"ContainerDied","Data":"3d901273b5b45c55f62cb0af65c72a02356b04fb9c8a20e6df7db723b5355e6f"} Jun 03 20:43:21.429128 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:21.429108 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:43:21.429306 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:21.429288 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:43:22.422227 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:22.422084 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8cpfl_51f5ccb5-b246-47b7-82cb-9524ff802fae/ovn-acl-logging/0.log" Jun 03 20:43:22.422824 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:22.422712 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" event={"ID":"51f5ccb5-b246-47b7-82cb-9524ff802fae","Type":"ContainerStarted","Data":"d0fdcc06c7324e90d50f783ade1a12a9de8732edf92d575e1f1c378f10998ecb"} Jun 03 20:43:22.451453 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:22.449668 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" podStartSLOduration=9.370316915 podStartE2EDuration="28.449648386s" totalImagesPullingTime="19.079331471s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:42:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:22.447208915 +0000 UTC m=+28.696619390" watchObservedRunningTime="2026-06-03 20:43:22.449648386 +0000 UTC m=+28.699058862" Jun 03 20:43:22.516726 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:22.516706 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5qxdz"] Jun 03 20:43:22.516885 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:22.516856 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qxdz" Jun 03 20:43:22.517004 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:22.516982 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qxdz" podUID="a19725e1-b81e-4b3b-8cb9-173528f14f9d" Jun 03 20:43:22.520316 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:22.520288 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-m7dmv"] Jun 03 20:43:22.520415 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:22.520399 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m7dmv" Jun 03 20:43:22.520538 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:22.520502 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m7dmv" podUID="025eda00-3ac0-406d-8bcc-48ea3697528f" Jun 03 20:43:22.521662 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:22.521627 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jnfc6"] Jun 03 20:43:22.521758 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:22.521728 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnfc6" Jun 03 20:43:22.521844 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:22.521822 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnfc6" podUID="8e4786f6-75ea-4291-87b8-9f436beae16c" Jun 03 20:43:23.427163 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:23.427135 2573 generic.go:356] "Generic (PLEG): container finished" podID="c16d78e4-4fa7-4f14-9b41-3281ad9058d1" containerID="701098638cd8adea59e99de2414ae1fcba8a9e074a7f2b368aa5c1ed244622e6" exitCode=0 Jun 03 20:43:23.427630 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:23.427207 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hh664" event={"ID":"c16d78e4-4fa7-4f14-9b41-3281ad9058d1","Type":"ContainerDied","Data":"701098638cd8adea59e99de2414ae1fcba8a9e074a7f2b368aa5c1ed244622e6"} Jun 03 20:43:24.207153 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:24.207129 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnfc6" Jun 03 20:43:24.207308 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:24.207211 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qxdz" Jun 03 20:43:24.207308 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:24.207232 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnfc6" podUID="8e4786f6-75ea-4291-87b8-9f436beae16c" Jun 03 20:43:24.207437 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:24.207311 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qxdz" podUID="a19725e1-b81e-4b3b-8cb9-173528f14f9d" Jun 03 20:43:24.207437 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:24.207337 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m7dmv" Jun 03 20:43:24.207553 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:24.207493 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m7dmv" podUID="025eda00-3ac0-406d-8bcc-48ea3697528f" Jun 03 20:43:24.431890 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:24.431861 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hh664" event={"ID":"c16d78e4-4fa7-4f14-9b41-3281ad9058d1","Type":"ContainerStarted","Data":"709b467bde26299c49c844c9842901fde5b197cc49d89cd528dc8c735b426565"} Jun 03 20:43:25.437241 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:25.437018 2573 generic.go:356] "Generic (PLEG): container finished" podID="c16d78e4-4fa7-4f14-9b41-3281ad9058d1" containerID="709b467bde26299c49c844c9842901fde5b197cc49d89cd528dc8c735b426565" exitCode=0 Jun 03 20:43:25.437731 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:25.437087 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hh664" event={"ID":"c16d78e4-4fa7-4f14-9b41-3281ad9058d1","Type":"ContainerDied","Data":"709b467bde26299c49c844c9842901fde5b197cc49d89cd528dc8c735b426565"} Jun 03 20:43:26.206278 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:26.206243 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnfc6" Jun 03 20:43:26.206461 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:26.206243 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qxdz" Jun 03 20:43:26.206461 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:26.206366 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnfc6" podUID="8e4786f6-75ea-4291-87b8-9f436beae16c" Jun 03 20:43:26.206608 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:26.206484 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qxdz" podUID="a19725e1-b81e-4b3b-8cb9-173528f14f9d" Jun 03 20:43:26.206608 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:26.206243 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m7dmv" Jun 03 20:43:26.206608 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:26.206593 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m7dmv" podUID="025eda00-3ac0-406d-8bcc-48ea3697528f" Jun 03 20:43:26.895275 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:26.895239 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm845\" (UniqueName: \"kubernetes.io/projected/8e4786f6-75ea-4291-87b8-9f436beae16c-kube-api-access-cm845\") pod \"network-check-target-jnfc6\" (UID: \"8e4786f6-75ea-4291-87b8-9f436beae16c\") " pod="openshift-network-diagnostics/network-check-target-jnfc6" Jun 03 20:43:26.895811 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:26.895299 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/025eda00-3ac0-406d-8bcc-48ea3697528f-original-pull-secret\") pod \"global-pull-secret-syncer-m7dmv\" (UID: \"025eda00-3ac0-406d-8bcc-48ea3697528f\") " pod="kube-system/global-pull-secret-syncer-m7dmv" Jun 03 20:43:26.895811 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:26.895391 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:26.895811 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:26.895428 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a19725e1-b81e-4b3b-8cb9-173528f14f9d-metrics-certs\") pod \"network-metrics-daemon-5qxdz\" (UID: \"a19725e1-b81e-4b3b-8cb9-173528f14f9d\") " pod="openshift-multus/network-metrics-daemon-5qxdz" Jun 03 20:43:26.895811 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:26.895444 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/025eda00-3ac0-406d-8bcc-48ea3697528f-original-pull-secret podName:025eda00-3ac0-406d-8bcc-48ea3697528f nodeName:}" failed. No retries permitted until 2026-06-03 20:43:58.895430403 +0000 UTC m=+65.144840856 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/025eda00-3ac0-406d-8bcc-48ea3697528f-original-pull-secret") pod "global-pull-secret-syncer-m7dmv" (UID: "025eda00-3ac0-406d-8bcc-48ea3697528f") : object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:26.895811 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:26.895462 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 20:43:26.895811 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:26.895502 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 20:43:26.895811 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:26.895516 2573 projected.go:196] Error preparing data for projected volume kube-api-access-cm845 for pod openshift-network-diagnostics/network-check-target-jnfc6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:26.895811 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:26.895549 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:26.895811 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:26.895581 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e4786f6-75ea-4291-87b8-9f436beae16c-kube-api-access-cm845 podName:8e4786f6-75ea-4291-87b8-9f436beae16c nodeName:}" failed. No retries permitted until 2026-06-03 20:43:58.895566324 +0000 UTC m=+65.144976777 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cm845" (UniqueName: "kubernetes.io/projected/8e4786f6-75ea-4291-87b8-9f436beae16c-kube-api-access-cm845") pod "network-check-target-jnfc6" (UID: "8e4786f6-75ea-4291-87b8-9f436beae16c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:26.895811 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:26.895602 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a19725e1-b81e-4b3b-8cb9-173528f14f9d-metrics-certs podName:a19725e1-b81e-4b3b-8cb9-173528f14f9d nodeName:}" failed. No retries permitted until 2026-06-03 20:43:58.895591253 +0000 UTC m=+65.145001712 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a19725e1-b81e-4b3b-8cb9-173528f14f9d-metrics-certs") pod "network-metrics-daemon-5qxdz" (UID: "a19725e1-b81e-4b3b-8cb9-173528f14f9d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:27.593729 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:27.593691 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeReady" Jun 03 20:43:27.593891 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:27.593842 2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 03 20:43:27.638663 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:27.638636 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xs8jn"] Jun 03 20:43:27.643060 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:27.643038 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-znprx"] Jun 03 20:43:27.643181 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:27.643170 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xs8jn" Jun 03 20:43:27.646784 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:27.646443 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gs868\"" Jun 03 20:43:27.646784 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:27.646444 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 20:43:27.646784 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:27.646748 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 20:43:27.647652 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:27.647030 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-znprx" Jun 03 20:43:27.649410 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:27.649390 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 20:43:27.649782 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:27.649669 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 20:43:27.649782 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:27.649740 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-f7zh4\"" Jun 03 20:43:27.649967 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:27.649955 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 20:43:27.651771 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:27.651748 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xs8jn"] Jun 03 20:43:27.656343 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:27.656325 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-znprx"] Jun 03 20:43:27.780927 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:27.780847 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:27.802483 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:27.802452 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a49042aa-131c-4704-b69e-b4ff4e0a1fd4-config-volume\") pod \"dns-default-xs8jn\" (UID: \"a49042aa-131c-4704-b69e-b4ff4e0a1fd4\") " pod="openshift-dns/dns-default-xs8jn" Jun 03 20:43:27.802631 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:27.802531 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1ad9037-60f7-44e2-bcb8-3d9bc56ddc15-cert\") pod \"ingress-canary-znprx\" (UID: \"c1ad9037-60f7-44e2-bcb8-3d9bc56ddc15\") " pod="openshift-ingress-canary/ingress-canary-znprx" Jun 03 20:43:27.802631 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:27.802559 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a49042aa-131c-4704-b69e-b4ff4e0a1fd4-metrics-tls\") pod \"dns-default-xs8jn\" (UID: \"a49042aa-131c-4704-b69e-b4ff4e0a1fd4\") " pod="openshift-dns/dns-default-xs8jn" Jun 03 20:43:27.802631 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:27.802580 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqrxk\" (UniqueName: \"kubernetes.io/projected/a49042aa-131c-4704-b69e-b4ff4e0a1fd4-kube-api-access-fqrxk\") pod \"dns-default-xs8jn\" (UID: \"a49042aa-131c-4704-b69e-b4ff4e0a1fd4\") " pod="openshift-dns/dns-default-xs8jn" Jun 03 20:43:27.802631 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:27.802607 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnh6v\" (UniqueName: \"kubernetes.io/projected/c1ad9037-60f7-44e2-bcb8-3d9bc56ddc15-kube-api-access-pnh6v\") pod \"ingress-canary-znprx\" (UID: \"c1ad9037-60f7-44e2-bcb8-3d9bc56ddc15\") " pod="openshift-ingress-canary/ingress-canary-znprx" Jun 03 20:43:27.802793 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:27.802698 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a49042aa-131c-4704-b69e-b4ff4e0a1fd4-tmp-dir\") pod \"dns-default-xs8jn\" (UID: \"a49042aa-131c-4704-b69e-b4ff4e0a1fd4\") " pod="openshift-dns/dns-default-xs8jn" Jun 03 20:43:27.903802 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:27.903760 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a49042aa-131c-4704-b69e-b4ff4e0a1fd4-config-volume\") pod \"dns-default-xs8jn\" (UID: \"a49042aa-131c-4704-b69e-b4ff4e0a1fd4\") " pod="openshift-dns/dns-default-xs8jn" Jun 03 20:43:27.904204 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:27.903832 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1ad9037-60f7-44e2-bcb8-3d9bc56ddc15-cert\") pod \"ingress-canary-znprx\" (UID: \"c1ad9037-60f7-44e2-bcb8-3d9bc56ddc15\") " pod="openshift-ingress-canary/ingress-canary-znprx" Jun 03 20:43:27.904204 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:27.903853 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a49042aa-131c-4704-b69e-b4ff4e0a1fd4-metrics-tls\") pod \"dns-default-xs8jn\" (UID: \"a49042aa-131c-4704-b69e-b4ff4e0a1fd4\") " pod="openshift-dns/dns-default-xs8jn" Jun 03 20:43:27.904204 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:27.903868 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqrxk\" (UniqueName: \"kubernetes.io/projected/a49042aa-131c-4704-b69e-b4ff4e0a1fd4-kube-api-access-fqrxk\") pod \"dns-default-xs8jn\" (UID: \"a49042aa-131c-4704-b69e-b4ff4e0a1fd4\") " pod="openshift-dns/dns-default-xs8jn" Jun 03 20:43:27.904204 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:27.903899 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnh6v\" (UniqueName: \"kubernetes.io/projected/c1ad9037-60f7-44e2-bcb8-3d9bc56ddc15-kube-api-access-pnh6v\") pod \"ingress-canary-znprx\" (UID: \"c1ad9037-60f7-44e2-bcb8-3d9bc56ddc15\") " pod="openshift-ingress-canary/ingress-canary-znprx" Jun 03 20:43:27.904204 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:27.903943 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a49042aa-131c-4704-b69e-b4ff4e0a1fd4-tmp-dir\") pod \"dns-default-xs8jn\" (UID: \"a49042aa-131c-4704-b69e-b4ff4e0a1fd4\") " pod="openshift-dns/dns-default-xs8jn" Jun 03 20:43:27.904460 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:27.904230 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a49042aa-131c-4704-b69e-b4ff4e0a1fd4-tmp-dir\") pod \"dns-default-xs8jn\" (UID: \"a49042aa-131c-4704-b69e-b4ff4e0a1fd4\") " pod="openshift-dns/dns-default-xs8jn" Jun 03 20:43:27.904460 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:27.904254 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:43:27.904460 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:27.904323 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a49042aa-131c-4704-b69e-b4ff4e0a1fd4-metrics-tls podName:a49042aa-131c-4704-b69e-b4ff4e0a1fd4 nodeName:}" failed. No retries permitted until 2026-06-03 20:43:28.404300379 +0000 UTC m=+34.653710846 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a49042aa-131c-4704-b69e-b4ff4e0a1fd4-metrics-tls") pod "dns-default-xs8jn" (UID: "a49042aa-131c-4704-b69e-b4ff4e0a1fd4") : secret "dns-default-metrics-tls" not found Jun 03 20:43:27.904460 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:27.904384 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a49042aa-131c-4704-b69e-b4ff4e0a1fd4-config-volume\") pod \"dns-default-xs8jn\" (UID: \"a49042aa-131c-4704-b69e-b4ff4e0a1fd4\") " pod="openshift-dns/dns-default-xs8jn" Jun 03 20:43:27.908623 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:27.908602 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1ad9037-60f7-44e2-bcb8-3d9bc56ddc15-cert\") pod \"ingress-canary-znprx\" (UID: \"c1ad9037-60f7-44e2-bcb8-3d9bc56ddc15\") " pod="openshift-ingress-canary/ingress-canary-znprx" Jun 03 20:43:27.912858 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:27.912833 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnh6v\" (UniqueName: \"kubernetes.io/projected/c1ad9037-60f7-44e2-bcb8-3d9bc56ddc15-kube-api-access-pnh6v\") pod \"ingress-canary-znprx\" (UID: \"c1ad9037-60f7-44e2-bcb8-3d9bc56ddc15\") " pod="openshift-ingress-canary/ingress-canary-znprx" Jun 03 20:43:27.913227 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:27.913206 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqrxk\" (UniqueName: \"kubernetes.io/projected/a49042aa-131c-4704-b69e-b4ff4e0a1fd4-kube-api-access-fqrxk\") pod \"dns-default-xs8jn\" (UID: \"a49042aa-131c-4704-b69e-b4ff4e0a1fd4\") " pod="openshift-dns/dns-default-xs8jn" Jun 03 20:43:27.964835 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:27.964813 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-znprx" Jun 03 20:43:28.206188 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:28.206051 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnfc6" Jun 03 20:43:28.206335 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:28.206186 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m7dmv" Jun 03 20:43:28.206335 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:28.206198 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qxdz" Jun 03 20:43:28.209217 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:28.209193 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 20:43:28.210324 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:28.210285 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ztp69\"" Jun 03 20:43:28.210324 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:28.210308 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 20:43:28.210536 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:28.210374 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 20:43:28.210536 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:28.210384 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 20:43:28.210648 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:28.210563 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cg5sv\"" Jun 03 20:43:28.365628 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:28.365591 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-znprx"] Jun 03 20:43:28.369459 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:43:28.369433 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1ad9037_60f7_44e2_bcb8_3d9bc56ddc15.slice/crio-146f090d219f505f48b6521eee04f6fc24c9ca38e967844cf8b00a1489e29d96 WatchSource:0}: Error finding container 146f090d219f505f48b6521eee04f6fc24c9ca38e967844cf8b00a1489e29d96: Status 404 returned error can't find the container with id 146f090d219f505f48b6521eee04f6fc24c9ca38e967844cf8b00a1489e29d96 Jun 03 20:43:28.407190 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:28.407052 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a49042aa-131c-4704-b69e-b4ff4e0a1fd4-metrics-tls\") pod \"dns-default-xs8jn\" (UID: \"a49042aa-131c-4704-b69e-b4ff4e0a1fd4\") " pod="openshift-dns/dns-default-xs8jn" Jun 03 20:43:28.407292 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:28.407207 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:43:28.407292 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:28.407258 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a49042aa-131c-4704-b69e-b4ff4e0a1fd4-metrics-tls podName:a49042aa-131c-4704-b69e-b4ff4e0a1fd4 nodeName:}" failed. No retries permitted until 2026-06-03 20:43:29.407242508 +0000 UTC m=+35.656652961 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a49042aa-131c-4704-b69e-b4ff4e0a1fd4-metrics-tls") pod "dns-default-xs8jn" (UID: "a49042aa-131c-4704-b69e-b4ff4e0a1fd4") : secret "dns-default-metrics-tls" not found Jun 03 20:43:28.447485 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:28.447441 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hh664" event={"ID":"c16d78e4-4fa7-4f14-9b41-3281ad9058d1","Type":"ContainerStarted","Data":"714f123c06713efb45bdfdc82cacd1546cd39d31658e8bbe767bd158df213a59"} Jun 03 20:43:28.448669 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:28.448636 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-znprx" event={"ID":"c1ad9037-60f7-44e2-bcb8-3d9bc56ddc15","Type":"ContainerStarted","Data":"146f090d219f505f48b6521eee04f6fc24c9ca38e967844cf8b00a1489e29d96"} Jun 03 20:43:29.414833 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:29.414796 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a49042aa-131c-4704-b69e-b4ff4e0a1fd4-metrics-tls\") pod \"dns-default-xs8jn\" (UID: \"a49042aa-131c-4704-b69e-b4ff4e0a1fd4\") " pod="openshift-dns/dns-default-xs8jn" Jun 03 20:43:29.415208 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:29.414949 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:43:29.415208 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:29.415010 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a49042aa-131c-4704-b69e-b4ff4e0a1fd4-metrics-tls podName:a49042aa-131c-4704-b69e-b4ff4e0a1fd4 nodeName:}" failed. No retries permitted until 2026-06-03 20:43:31.414991035 +0000 UTC m=+37.664401508 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a49042aa-131c-4704-b69e-b4ff4e0a1fd4-metrics-tls") pod "dns-default-xs8jn" (UID: "a49042aa-131c-4704-b69e-b4ff4e0a1fd4") : secret "dns-default-metrics-tls" not found Jun 03 20:43:29.454669 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:29.454634 2573 generic.go:356] "Generic (PLEG): container finished" podID="c16d78e4-4fa7-4f14-9b41-3281ad9058d1" containerID="714f123c06713efb45bdfdc82cacd1546cd39d31658e8bbe767bd158df213a59" exitCode=0 Jun 03 20:43:29.454821 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:29.454699 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hh664" event={"ID":"c16d78e4-4fa7-4f14-9b41-3281ad9058d1","Type":"ContainerDied","Data":"714f123c06713efb45bdfdc82cacd1546cd39d31658e8bbe767bd158df213a59"} Jun 03 20:43:30.459953 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:30.459921 2573 generic.go:356] "Generic (PLEG): container finished" podID="c16d78e4-4fa7-4f14-9b41-3281ad9058d1" containerID="0d4ee359a742af1b891df0bfb1a4771c743a6c1933ee02cb67b80ac911de1d2c" exitCode=0 Jun 03 20:43:30.460585 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:30.460009 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hh664" event={"ID":"c16d78e4-4fa7-4f14-9b41-3281ad9058d1","Type":"ContainerDied","Data":"0d4ee359a742af1b891df0bfb1a4771c743a6c1933ee02cb67b80ac911de1d2c"} Jun 03 20:43:30.461389 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:30.461364 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-znprx" event={"ID":"c1ad9037-60f7-44e2-bcb8-3d9bc56ddc15","Type":"ContainerStarted","Data":"ed0279da3ba3d1bc6c5a5a9433a04560d808b54face713533c198c49e8c95054"} Jun 03 20:43:30.498128 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:30.498081 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-znprx" podStartSLOduration=1.987194597 podStartE2EDuration="3.49806494s" totalImagesPullingTime="1.510870343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:43:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:30.497070023 +0000 UTC m=+36.746480497" watchObservedRunningTime="2026-06-03 20:43:30.49806494 +0000 UTC m=+36.747475414" Jun 03 20:43:31.432233 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:31.432197 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a49042aa-131c-4704-b69e-b4ff4e0a1fd4-metrics-tls\") pod \"dns-default-xs8jn\" (UID: \"a49042aa-131c-4704-b69e-b4ff4e0a1fd4\") " pod="openshift-dns/dns-default-xs8jn" Jun 03 20:43:31.432408 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:31.432321 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:43:31.432408 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:31.432385 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a49042aa-131c-4704-b69e-b4ff4e0a1fd4-metrics-tls podName:a49042aa-131c-4704-b69e-b4ff4e0a1fd4 nodeName:}" failed. No retries permitted until 2026-06-03 20:43:35.432367569 +0000 UTC m=+41.681778022 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a49042aa-131c-4704-b69e-b4ff4e0a1fd4-metrics-tls") pod "dns-default-xs8jn" (UID: "a49042aa-131c-4704-b69e-b4ff4e0a1fd4") : secret "dns-default-metrics-tls" not found Jun 03 20:43:31.466439 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:31.466394 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hh664" event={"ID":"c16d78e4-4fa7-4f14-9b41-3281ad9058d1","Type":"ContainerStarted","Data":"7eb56559b3a6dadaad0a379d068a8a858d485bf84aa9adba7d1f4c216e5c8758"} Jun 03 20:43:31.490559 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:31.490512 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hh664" podStartSLOduration=8.343705845 podStartE2EDuration="37.490497189s" totalImagesPullingTime="29.146791344s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:42:54 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:31.490267304 +0000 UTC m=+37.739677778" watchObservedRunningTime="2026-06-03 20:43:31.490497189 +0000 UTC m=+37.739907663" Jun 03 20:43:31.609723 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:31.609701 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:31.667650 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:31.667626 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:31.726508 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:31.726483 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:32.113874 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:32.113845 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:32.214557 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:32.214517 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:33.541113 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:33.541081 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:33.598862 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:33.598802 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:35.460692 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:35.460652 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a49042aa-131c-4704-b69e-b4ff4e0a1fd4-metrics-tls\") pod \"dns-default-xs8jn\" (UID: \"a49042aa-131c-4704-b69e-b4ff4e0a1fd4\") " pod="openshift-dns/dns-default-xs8jn" Jun 03 20:43:35.461080 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:35.460779 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:43:35.461080 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:35.460832 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a49042aa-131c-4704-b69e-b4ff4e0a1fd4-metrics-tls podName:a49042aa-131c-4704-b69e-b4ff4e0a1fd4 nodeName:}" failed. No retries permitted until 2026-06-03 20:43:43.460817597 +0000 UTC m=+49.710228051 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a49042aa-131c-4704-b69e-b4ff4e0a1fd4-metrics-tls") pod "dns-default-xs8jn" (UID: "a49042aa-131c-4704-b69e-b4ff4e0a1fd4") : secret "dns-default-metrics-tls" not found Jun 03 20:43:38.366642 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:38.366608 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:38.419140 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:38.419101 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:42.731533 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:42.731499 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-644444b4bd-l97xz"] Jun 03 20:43:42.774535 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:42.774507 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ffd748d6-vwvl8"] Jun 03 20:43:42.774677 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:42.774591 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-644444b4bd-l97xz" Jun 03 20:43:42.778771 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:42.778745 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 03 20:43:42.778907 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:42.778836 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-wlbqq\"" Jun 03 20:43:42.779605 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:42.779587 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 03 20:43:42.779697 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:42.779617 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 03 20:43:42.779697 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:42.779688 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 03 20:43:42.788326 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:42.788310 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-644444b4bd-l97xz"] Jun 03 20:43:42.788394 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:42.788333 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ffd748d6-vwvl8"] Jun 03 20:43:42.788433 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:42.788393 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ffd748d6-vwvl8" Jun 03 20:43:42.791161 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:42.791142 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 03 20:43:42.791242 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:42.791189 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 03 20:43:42.791282 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:42.791189 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 03 20:43:42.791282 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:42.791150 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 03 20:43:42.911704 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:42.911670 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csgk7\" (UniqueName: \"kubernetes.io/projected/9df59c83-dd6b-47b4-9b76-6aa27d3e42cd-kube-api-access-csgk7\") pod \"cluster-proxy-proxy-agent-84ffd748d6-vwvl8\" (UID: \"9df59c83-dd6b-47b4-9b76-6aa27d3e42cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ffd748d6-vwvl8" Jun 03 20:43:42.911850 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:42.911709 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2ad655f9-1757-4f92-84a1-dea9c0ead0fb-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-644444b4bd-l97xz\" (UID: \"2ad655f9-1757-4f92-84a1-dea9c0ead0fb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-644444b4bd-l97xz" Jun 03 20:43:42.911850 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:42.911746 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cr7c8\" (UniqueName: \"kubernetes.io/projected/2ad655f9-1757-4f92-84a1-dea9c0ead0fb-kube-api-access-cr7c8\") pod \"managed-serviceaccount-addon-agent-644444b4bd-l97xz\" (UID: \"2ad655f9-1757-4f92-84a1-dea9c0ead0fb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-644444b4bd-l97xz" Jun 03 20:43:42.911850 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:42.911769 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9df59c83-dd6b-47b4-9b76-6aa27d3e42cd-hub\") pod \"cluster-proxy-proxy-agent-84ffd748d6-vwvl8\" (UID: \"9df59c83-dd6b-47b4-9b76-6aa27d3e42cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ffd748d6-vwvl8" Jun 03 20:43:42.911850 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:42.911790 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9df59c83-dd6b-47b4-9b76-6aa27d3e42cd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-84ffd748d6-vwvl8\" (UID: \"9df59c83-dd6b-47b4-9b76-6aa27d3e42cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ffd748d6-vwvl8" Jun 03 20:43:42.911850 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:42.911815 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9df59c83-dd6b-47b4-9b76-6aa27d3e42cd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-84ffd748d6-vwvl8\" (UID: \"9df59c83-dd6b-47b4-9b76-6aa27d3e42cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ffd748d6-vwvl8" Jun 03 20:43:42.912040 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:42.911884 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9df59c83-dd6b-47b4-9b76-6aa27d3e42cd-ca\") pod \"cluster-proxy-proxy-agent-84ffd748d6-vwvl8\" (UID: \"9df59c83-dd6b-47b4-9b76-6aa27d3e42cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ffd748d6-vwvl8" Jun 03 20:43:42.912040 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:42.911917 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9df59c83-dd6b-47b4-9b76-6aa27d3e42cd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-84ffd748d6-vwvl8\" (UID: \"9df59c83-dd6b-47b4-9b76-6aa27d3e42cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ffd748d6-vwvl8" Jun 03 20:43:43.012596 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:43.012519 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9df59c83-dd6b-47b4-9b76-6aa27d3e42cd-ca\") pod \"cluster-proxy-proxy-agent-84ffd748d6-vwvl8\" (UID: \"9df59c83-dd6b-47b4-9b76-6aa27d3e42cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ffd748d6-vwvl8" Jun 03 20:43:43.012596 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:43.012561 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9df59c83-dd6b-47b4-9b76-6aa27d3e42cd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-84ffd748d6-vwvl8\" (UID: \"9df59c83-dd6b-47b4-9b76-6aa27d3e42cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ffd748d6-vwvl8" Jun 03 20:43:43.012780 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:43.012648 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csgk7\" (UniqueName: \"kubernetes.io/projected/9df59c83-dd6b-47b4-9b76-6aa27d3e42cd-kube-api-access-csgk7\") pod \"cluster-proxy-proxy-agent-84ffd748d6-vwvl8\" (UID: \"9df59c83-dd6b-47b4-9b76-6aa27d3e42cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ffd748d6-vwvl8" Jun 03 20:43:43.012780 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:43.012674 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2ad655f9-1757-4f92-84a1-dea9c0ead0fb-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-644444b4bd-l97xz\" (UID: \"2ad655f9-1757-4f92-84a1-dea9c0ead0fb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-644444b4bd-l97xz" Jun 03 20:43:43.012780 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:43.012697 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cr7c8\" (UniqueName: \"kubernetes.io/projected/2ad655f9-1757-4f92-84a1-dea9c0ead0fb-kube-api-access-cr7c8\") pod \"managed-serviceaccount-addon-agent-644444b4bd-l97xz\" (UID: \"2ad655f9-1757-4f92-84a1-dea9c0ead0fb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-644444b4bd-l97xz" Jun 03 20:43:43.012780 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:43.012719 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9df59c83-dd6b-47b4-9b76-6aa27d3e42cd-hub\") pod \"cluster-proxy-proxy-agent-84ffd748d6-vwvl8\" (UID: \"9df59c83-dd6b-47b4-9b76-6aa27d3e42cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ffd748d6-vwvl8" Jun 03 20:43:43.012780 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:43.012750 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9df59c83-dd6b-47b4-9b76-6aa27d3e42cd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-84ffd748d6-vwvl8\" (UID: \"9df59c83-dd6b-47b4-9b76-6aa27d3e42cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ffd748d6-vwvl8" Jun 03 20:43:43.013018 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:43.012780 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9df59c83-dd6b-47b4-9b76-6aa27d3e42cd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-84ffd748d6-vwvl8\" (UID: \"9df59c83-dd6b-47b4-9b76-6aa27d3e42cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ffd748d6-vwvl8" Jun 03 20:43:43.013623 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:43.013587 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9df59c83-dd6b-47b4-9b76-6aa27d3e42cd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-84ffd748d6-vwvl8\" (UID: \"9df59c83-dd6b-47b4-9b76-6aa27d3e42cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ffd748d6-vwvl8" Jun 03 20:43:43.016328 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:43.016297 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9df59c83-dd6b-47b4-9b76-6aa27d3e42cd-ca\") pod \"cluster-proxy-proxy-agent-84ffd748d6-vwvl8\" (UID: \"9df59c83-dd6b-47b4-9b76-6aa27d3e42cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ffd748d6-vwvl8" Jun 03 20:43:43.016416 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:43.016368 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9df59c83-dd6b-47b4-9b76-6aa27d3e42cd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-84ffd748d6-vwvl8\" (UID: \"9df59c83-dd6b-47b4-9b76-6aa27d3e42cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ffd748d6-vwvl8" Jun 03 20:43:43.016532 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:43.016516 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2ad655f9-1757-4f92-84a1-dea9c0ead0fb-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-644444b4bd-l97xz\" (UID: \"2ad655f9-1757-4f92-84a1-dea9c0ead0fb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-644444b4bd-l97xz" Jun 03 20:43:43.016572 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:43.016523 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9df59c83-dd6b-47b4-9b76-6aa27d3e42cd-hub\") pod \"cluster-proxy-proxy-agent-84ffd748d6-vwvl8\" (UID: \"9df59c83-dd6b-47b4-9b76-6aa27d3e42cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ffd748d6-vwvl8" Jun 03 20:43:43.016606 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:43.016590 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9df59c83-dd6b-47b4-9b76-6aa27d3e42cd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-84ffd748d6-vwvl8\" (UID: \"9df59c83-dd6b-47b4-9b76-6aa27d3e42cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ffd748d6-vwvl8" Jun 03 20:43:43.021342 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:43.021323 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cr7c8\" (UniqueName: \"kubernetes.io/projected/2ad655f9-1757-4f92-84a1-dea9c0ead0fb-kube-api-access-cr7c8\") pod \"managed-serviceaccount-addon-agent-644444b4bd-l97xz\" (UID: \"2ad655f9-1757-4f92-84a1-dea9c0ead0fb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-644444b4bd-l97xz" Jun 03 20:43:43.021423 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:43.021399 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csgk7\" (UniqueName: \"kubernetes.io/projected/9df59c83-dd6b-47b4-9b76-6aa27d3e42cd-kube-api-access-csgk7\") pod \"cluster-proxy-proxy-agent-84ffd748d6-vwvl8\" (UID: \"9df59c83-dd6b-47b4-9b76-6aa27d3e42cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ffd748d6-vwvl8" Jun 03 20:43:43.101275 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:43.101251 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-644444b4bd-l97xz" Jun 03 20:43:43.107907 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:43.107887 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ffd748d6-vwvl8" Jun 03 20:43:43.256515 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:43.256409 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-644444b4bd-l97xz"] Jun 03 20:43:43.260091 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:43:43.260064 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ad655f9_1757_4f92_84a1_dea9c0ead0fb.slice/crio-5c868a92c926597cb5abea1bf895bf7da7a0ccd44edf210e7819e301536ab038 WatchSource:0}: Error finding container 5c868a92c926597cb5abea1bf895bf7da7a0ccd44edf210e7819e301536ab038: Status 404 returned error can't find the container with id 5c868a92c926597cb5abea1bf895bf7da7a0ccd44edf210e7819e301536ab038 Jun 03 20:43:43.285901 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:43.285878 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ffd748d6-vwvl8"] Jun 03 20:43:43.288629 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:43:43.288603 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9df59c83_dd6b_47b4_9b76_6aa27d3e42cd.slice/crio-cb181da27c85739ffbece576519196b6da1b58544dc4ecadeeae381f9ca068ae WatchSource:0}: Error finding container cb181da27c85739ffbece576519196b6da1b58544dc4ecadeeae381f9ca068ae: Status 404 returned error can't find the container with id cb181da27c85739ffbece576519196b6da1b58544dc4ecadeeae381f9ca068ae Jun 03 20:43:43.494122 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:43.494084 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ffd748d6-vwvl8" event={"ID":"9df59c83-dd6b-47b4-9b76-6aa27d3e42cd","Type":"ContainerStarted","Data":"cb181da27c85739ffbece576519196b6da1b58544dc4ecadeeae381f9ca068ae"} Jun 03 20:43:43.495201 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:43.495167 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-644444b4bd-l97xz" event={"ID":"2ad655f9-1757-4f92-84a1-dea9c0ead0fb","Type":"ContainerStarted","Data":"5c868a92c926597cb5abea1bf895bf7da7a0ccd44edf210e7819e301536ab038"} Jun 03 20:43:43.515532 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:43.515512 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a49042aa-131c-4704-b69e-b4ff4e0a1fd4-metrics-tls\") pod \"dns-default-xs8jn\" (UID: \"a49042aa-131c-4704-b69e-b4ff4e0a1fd4\") " pod="openshift-dns/dns-default-xs8jn" Jun 03 20:43:43.515654 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:43.515640 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:43:43.515713 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:43.515705 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a49042aa-131c-4704-b69e-b4ff4e0a1fd4-metrics-tls podName:a49042aa-131c-4704-b69e-b4ff4e0a1fd4 nodeName:}" failed. No retries permitted until 2026-06-03 20:43:59.515689483 +0000 UTC m=+65.765099935 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a49042aa-131c-4704-b69e-b4ff4e0a1fd4-metrics-tls") pod "dns-default-xs8jn" (UID: "a49042aa-131c-4704-b69e-b4ff4e0a1fd4") : secret "dns-default-metrics-tls" not found Jun 03 20:43:48.508933 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:48.508889 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-644444b4bd-l97xz" event={"ID":"2ad655f9-1757-4f92-84a1-dea9c0ead0fb","Type":"ContainerStarted","Data":"f6a3f56f5f7636d0d364e74002bcaac7901281f493f79cd09ee6074ce37ddf27"} Jun 03 20:43:48.510815 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:48.510790 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ffd748d6-vwvl8" event={"ID":"9df59c83-dd6b-47b4-9b76-6aa27d3e42cd","Type":"ContainerStarted","Data":"5bae8140ac7234b17c002e7f5f6886404c64485ee3f156ba672a7646f64ad744"} Jun 03 20:43:48.510937 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:48.510821 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ffd748d6-vwvl8" event={"ID":"9df59c83-dd6b-47b4-9b76-6aa27d3e42cd","Type":"ContainerStarted","Data":"9adb46891479a51b37fe3d0cbc7f7400b30c208dae8f5b3d40db892147c58488"} Jun 03 20:43:48.510937 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:48.510832 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ffd748d6-vwvl8" event={"ID":"9df59c83-dd6b-47b4-9b76-6aa27d3e42cd","Type":"ContainerStarted","Data":"6df2a1173bc3c7a4eed0911361108e7dd50a8e988665de0634dcdcc6e664e5f0"} Jun 03 20:43:48.524661 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:48.524621 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-644444b4bd-l97xz" podStartSLOduration=1.7082472260000001 podStartE2EDuration="6.524607476s" totalImagesPullingTime="4.81636025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:43:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:48.523457707 +0000 UTC m=+54.772868182" watchObservedRunningTime="2026-06-03 20:43:48.524607476 +0000 UTC m=+54.774017987" Jun 03 20:43:48.546455 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:48.546420 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ffd748d6-vwvl8" podStartSLOduration=1.740821812 podStartE2EDuration="6.54640682s" totalImagesPullingTime="4.805585008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:43:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:48.545659786 +0000 UTC m=+54.795070261" watchObservedRunningTime="2026-06-03 20:43:48.54640682 +0000 UTC m=+54.795817295" Jun 03 20:43:53.445455 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:53.445417 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8cpfl" Jun 03 20:43:53.556043 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:53.556016 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:53.606833 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:53.606808 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:58.916555 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:58.916506 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/025eda00-3ac0-406d-8bcc-48ea3697528f-original-pull-secret\") pod \"global-pull-secret-syncer-m7dmv\" (UID: \"025eda00-3ac0-406d-8bcc-48ea3697528f\") " pod="kube-system/global-pull-secret-syncer-m7dmv" Jun 03 20:43:58.916555 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:58.916561 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a19725e1-b81e-4b3b-8cb9-173528f14f9d-metrics-certs\") pod \"network-metrics-daemon-5qxdz\" (UID: \"a19725e1-b81e-4b3b-8cb9-173528f14f9d\") " pod="openshift-multus/network-metrics-daemon-5qxdz" Jun 03 20:43:58.916963 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:58.916618 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm845\" (UniqueName: \"kubernetes.io/projected/8e4786f6-75ea-4291-87b8-9f436beae16c-kube-api-access-cm845\") pod \"network-check-target-jnfc6\" (UID: \"8e4786f6-75ea-4291-87b8-9f436beae16c\") " pod="openshift-network-diagnostics/network-check-target-jnfc6" Jun 03 20:43:58.919421 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:58.919398 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 20:43:58.919464 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:58.919431 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 20:43:58.919515 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:58.919410 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 20:43:58.927628 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:58.927605 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 20:43:58.927738 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:58.927666 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a19725e1-b81e-4b3b-8cb9-173528f14f9d-metrics-certs podName:a19725e1-b81e-4b3b-8cb9-173528f14f9d nodeName:}" failed. No retries permitted until 2026-06-03 20:45:02.927649353 +0000 UTC m=+129.177059806 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a19725e1-b81e-4b3b-8cb9-173528f14f9d-metrics-certs") pod "network-metrics-daemon-5qxdz" (UID: "a19725e1-b81e-4b3b-8cb9-173528f14f9d") : secret "metrics-daemon-secret" not found Jun 03 20:43:58.929766 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:58.929745 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/025eda00-3ac0-406d-8bcc-48ea3697528f-original-pull-secret\") pod \"global-pull-secret-syncer-m7dmv\" (UID: \"025eda00-3ac0-406d-8bcc-48ea3697528f\") " pod="kube-system/global-pull-secret-syncer-m7dmv" Jun 03 20:43:58.929925 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:58.929910 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 20:43:58.940485 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:58.940455 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm845\" (UniqueName: \"kubernetes.io/projected/8e4786f6-75ea-4291-87b8-9f436beae16c-kube-api-access-cm845\") pod \"network-check-target-jnfc6\" (UID: \"8e4786f6-75ea-4291-87b8-9f436beae16c\") " pod="openshift-network-diagnostics/network-check-target-jnfc6" Jun 03 20:43:59.121826 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:59.121801 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ztp69\"" Jun 03 20:43:59.126009 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:59.125995 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m7dmv" Jun 03 20:43:59.129810 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:59.129792 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnfc6" Jun 03 20:43:59.258896 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:59.258789 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-m7dmv"] Jun 03 20:43:59.274090 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:59.274064 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jnfc6"] Jun 03 20:43:59.276465 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:43:59.276441 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e4786f6_75ea_4291_87b8_9f436beae16c.slice/crio-ed4eb78ac96b26fd5e580ee74cc5db60e103dbf51c7aa1c1827072d7abc5ca71 WatchSource:0}: Error finding container ed4eb78ac96b26fd5e580ee74cc5db60e103dbf51c7aa1c1827072d7abc5ca71: Status 404 returned error can't find the container with id ed4eb78ac96b26fd5e580ee74cc5db60e103dbf51c7aa1c1827072d7abc5ca71 Jun 03 20:43:59.521796 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:59.521763 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a49042aa-131c-4704-b69e-b4ff4e0a1fd4-metrics-tls\") pod \"dns-default-xs8jn\" (UID: \"a49042aa-131c-4704-b69e-b4ff4e0a1fd4\") " pod="openshift-dns/dns-default-xs8jn" Jun 03 20:43:59.521970 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:59.521893 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:43:59.521970 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:43:59.521960 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a49042aa-131c-4704-b69e-b4ff4e0a1fd4-metrics-tls podName:a49042aa-131c-4704-b69e-b4ff4e0a1fd4 nodeName:}" failed. No retries permitted until 2026-06-03 20:44:31.5219409 +0000 UTC m=+97.771351353 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a49042aa-131c-4704-b69e-b4ff4e0a1fd4-metrics-tls") pod "dns-default-xs8jn" (UID: "a49042aa-131c-4704-b69e-b4ff4e0a1fd4") : secret "dns-default-metrics-tls" not found Jun 03 20:43:59.538681 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:59.538646 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-m7dmv" event={"ID":"025eda00-3ac0-406d-8bcc-48ea3697528f","Type":"ContainerStarted","Data":"b30b2b807275627bb867015f4eb4df32de3e0159ee817ae7ed60d34d481ec50b"} Jun 03 20:43:59.539671 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:43:59.539651 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jnfc6" event={"ID":"8e4786f6-75ea-4291-87b8-9f436beae16c","Type":"ContainerStarted","Data":"ed4eb78ac96b26fd5e580ee74cc5db60e103dbf51c7aa1c1827072d7abc5ca71"} Jun 03 20:44:04.555533 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:44:04.555497 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-m7dmv" event={"ID":"025eda00-3ac0-406d-8bcc-48ea3697528f","Type":"ContainerStarted","Data":"b8bc46745874e90a58e8a71afe5c76a78c6f46050023e7737eea2e03d82e9640"} Jun 03 20:44:04.556890 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:44:04.556860 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jnfc6" event={"ID":"8e4786f6-75ea-4291-87b8-9f436beae16c","Type":"ContainerStarted","Data":"ca08687d4f6984622f3d916ae925ebe2cdad1e3b19ce09d8017d5d01cefba155"} Jun 03 20:44:04.556999 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:44:04.556981 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jnfc6" Jun 03 20:44:04.569557 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:44:04.569514 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-m7dmv" podStartSLOduration=66.226696011 podStartE2EDuration="1m10.569499233s" totalImagesPullingTime="4.342803222s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:42:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:44:04.569274299 +0000 UTC m=+70.818684773" watchObservedRunningTime="2026-06-03 20:44:04.569499233 +0000 UTC m=+70.818909708" Jun 03 20:44:04.583550 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:44:04.583512 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jnfc6" podStartSLOduration=66.259177604 podStartE2EDuration="1m10.583500062s" totalImagesPullingTime="4.324322458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:42:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:44:04.583216947 +0000 UTC m=+70.832627424" watchObservedRunningTime="2026-06-03 20:44:04.583500062 +0000 UTC m=+70.832910537" Jun 03 20:44:31.536959 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:44:31.536923 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a49042aa-131c-4704-b69e-b4ff4e0a1fd4-metrics-tls\") pod \"dns-default-xs8jn\" (UID: \"a49042aa-131c-4704-b69e-b4ff4e0a1fd4\") " pod="openshift-dns/dns-default-xs8jn" Jun 03 20:44:31.537395 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:44:31.537026 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:44:31.537395 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:44:31.537083 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a49042aa-131c-4704-b69e-b4ff4e0a1fd4-metrics-tls podName:a49042aa-131c-4704-b69e-b4ff4e0a1fd4 nodeName:}" failed. No retries permitted until 2026-06-03 20:45:35.537069663 +0000 UTC m=+161.786480116 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a49042aa-131c-4704-b69e-b4ff4e0a1fd4-metrics-tls") pod "dns-default-xs8jn" (UID: "a49042aa-131c-4704-b69e-b4ff4e0a1fd4") : secret "dns-default-metrics-tls" not found Jun 03 20:44:35.562920 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:44:35.562889 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jnfc6" Jun 03 20:45:02.940991 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:45:02.940957 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a19725e1-b81e-4b3b-8cb9-173528f14f9d-metrics-certs\") pod \"network-metrics-daemon-5qxdz\" (UID: \"a19725e1-b81e-4b3b-8cb9-173528f14f9d\") " pod="openshift-multus/network-metrics-daemon-5qxdz" Jun 03 20:45:02.941430 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:45:02.941080 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 20:45:02.941430 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:45:02.941138 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a19725e1-b81e-4b3b-8cb9-173528f14f9d-metrics-certs podName:a19725e1-b81e-4b3b-8cb9-173528f14f9d nodeName:}" failed. No retries permitted until 2026-06-03 20:47:04.941124102 +0000 UTC m=+251.190534555 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a19725e1-b81e-4b3b-8cb9-173528f14f9d-metrics-certs") pod "network-metrics-daemon-5qxdz" (UID: "a19725e1-b81e-4b3b-8cb9-173528f14f9d") : secret "metrics-daemon-secret" not found Jun 03 20:45:30.658026 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:45:30.657945 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xs8jn" podUID="a49042aa-131c-4704-b69e-b4ff4e0a1fd4" Jun 03 20:45:30.791455 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:45:30.791428 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xs8jn" Jun 03 20:45:31.231060 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:45:31.231012 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-5qxdz" podUID="a19725e1-b81e-4b3b-8cb9-173528f14f9d" Jun 03 20:45:35.554313 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:45:35.554267 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a49042aa-131c-4704-b69e-b4ff4e0a1fd4-metrics-tls\") pod \"dns-default-xs8jn\" (UID: \"a49042aa-131c-4704-b69e-b4ff4e0a1fd4\") " pod="openshift-dns/dns-default-xs8jn" Jun 03 20:45:35.554804 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:45:35.554438 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:45:35.554804 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:45:35.554556 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a49042aa-131c-4704-b69e-b4ff4e0a1fd4-metrics-tls podName:a49042aa-131c-4704-b69e-b4ff4e0a1fd4 nodeName:}" failed. No retries permitted until 2026-06-03 20:47:37.554532679 +0000 UTC m=+283.803943132 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a49042aa-131c-4704-b69e-b4ff4e0a1fd4-metrics-tls") pod "dns-default-xs8jn" (UID: "a49042aa-131c-4704-b69e-b4ff4e0a1fd4") : secret "dns-default-metrics-tls" not found Jun 03 20:45:43.206487 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:45:43.206443 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qxdz" Jun 03 20:45:48.842487 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:45:48.842436 2573 generic.go:356] "Generic (PLEG): container finished" podID="2ad655f9-1757-4f92-84a1-dea9c0ead0fb" containerID="f6a3f56f5f7636d0d364e74002bcaac7901281f493f79cd09ee6074ce37ddf27" exitCode=255 Jun 03 20:45:48.842920 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:45:48.842506 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-644444b4bd-l97xz" event={"ID":"2ad655f9-1757-4f92-84a1-dea9c0ead0fb","Type":"ContainerDied","Data":"f6a3f56f5f7636d0d364e74002bcaac7901281f493f79cd09ee6074ce37ddf27"} Jun 03 20:45:48.842920 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:45:48.842778 2573 scope.go:117] "RemoveContainer" containerID="f6a3f56f5f7636d0d364e74002bcaac7901281f493f79cd09ee6074ce37ddf27" Jun 03 20:45:49.847072 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:45:49.847038 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-644444b4bd-l97xz" event={"ID":"2ad655f9-1757-4f92-84a1-dea9c0ead0fb","Type":"ContainerStarted","Data":"63e2fc6503873ec89bde6e0859f259b16ed3c9f47c83272bfa7a1d4f0215fabf"} Jun 03 20:45:58.467878 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:45:58.467841 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:40.900300 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:40.900263 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:41.002711 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:41.002676 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:42.883150 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:42.883103 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:45.744360 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:45.744315 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:45.845607 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:45.845565 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:46.150504 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:46.150412 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:46.245632 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:46.245603 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:46.350947 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:46.350917 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:46.459504 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:46.459410 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:46.554418 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:46.554375 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:48.026235 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:48.026201 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:48.095462 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:48.095430 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:49.098589 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:49.098555 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:49.269645 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:49.269618 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vf4jz_8999c8ff-31e0-4203-82b6-9969dd68a29e/dns-node-resolver/0.log" Jun 03 20:46:49.565078 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:49.565040 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:49.696293 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:49.696267 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:49.797721 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:49.797696 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:49.869208 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:49.869141 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4kgfh_3052984c-1fbe-473f-ac39-8c597c47c315/node-ca/0.log" Jun 03 20:46:49.896818 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:49.896794 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:50.859345 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:50.859315 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:51.057784 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:51.057757 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:51.069021 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:51.068996 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-znprx_c1ad9037-60f7-44e2-bcb8-3d9bc56ddc15/serve-healthcheck-canary/0.log" Jun 03 20:46:51.456342 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:51.456313 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:51.657335 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:51.657303 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:52.253408 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:52.253380 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:52.361465 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:52.361432 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:52.668160 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:52.668054 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:53.059253 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:53.059217 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:53.256791 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:53.256742 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:53.451863 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:53.451790 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:53.661106 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:53.661075 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:53.853891 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:53.853842 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:54.255196 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:54.255165 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:54.453741 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:54.453707 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:54.854247 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:54.854208 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:55.453815 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:55.453773 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:56.053133 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:56.053092 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:56.106651 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:56.106619 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:56.252092 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:56.252050 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:56.449783 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:56.449690 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:56.865767 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:56.865739 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:57.451253 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:57.451218 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:57.854519 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:57.854488 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:58.051064 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:58.051026 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:58.450718 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:58.450678 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:59.053367 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:59.053338 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:59.154363 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:59.154330 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:59.455510 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:59.455402 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:46:59.655300 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:46:59.655263 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:00.057909 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:00.057869 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:00.248249 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:00.248218 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:00.667661 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:00.667632 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:04.952581 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:04.952548 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a19725e1-b81e-4b3b-8cb9-173528f14f9d-metrics-certs\") pod \"network-metrics-daemon-5qxdz\" (UID: \"a19725e1-b81e-4b3b-8cb9-173528f14f9d\") " pod="openshift-multus/network-metrics-daemon-5qxdz" Jun 03 20:47:04.954694 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:04.954676 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a19725e1-b81e-4b3b-8cb9-173528f14f9d-metrics-certs\") pod \"network-metrics-daemon-5qxdz\" (UID: \"a19725e1-b81e-4b3b-8cb9-173528f14f9d\") " pod="openshift-multus/network-metrics-daemon-5qxdz" Jun 03 20:47:05.109466 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:05.109432 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cg5sv\"" Jun 03 20:47:05.117390 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:05.117371 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qxdz" Jun 03 20:47:05.230888 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:05.230857 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5qxdz"] Jun 03 20:47:05.233610 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:47:05.233574 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda19725e1_b81e_4b3b_8cb9_173528f14f9d.slice/crio-253fd844b2aedc8d96ccb38db5ea66527e4604448a0742a1d9f4540e0607e9c9 WatchSource:0}: Error finding container 253fd844b2aedc8d96ccb38db5ea66527e4604448a0742a1d9f4540e0607e9c9: Status 404 returned error can't find the container with id 253fd844b2aedc8d96ccb38db5ea66527e4604448a0742a1d9f4540e0607e9c9 Jun 03 20:47:05.365099 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:05.365058 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:05.415861 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:05.415835 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:06.055375 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:06.055346 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5qxdz" event={"ID":"a19725e1-b81e-4b3b-8cb9-173528f14f9d","Type":"ContainerStarted","Data":"253fd844b2aedc8d96ccb38db5ea66527e4604448a0742a1d9f4540e0607e9c9"} Jun 03 20:47:07.060222 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:07.060192 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5qxdz" event={"ID":"a19725e1-b81e-4b3b-8cb9-173528f14f9d","Type":"ContainerStarted","Data":"cda383af8fb3a2e2ed684e84b9b9ceff5f1939e6f94207e954442a6ae161cab2"} Jun 03 20:47:07.060618 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:07.060239 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5qxdz" event={"ID":"a19725e1-b81e-4b3b-8cb9-173528f14f9d","Type":"ContainerStarted","Data":"b756b3047936e5320bea5d090b2b8468c1a712639a60de7430bcc8c2eb8591e1"} Jun 03 20:47:07.075370 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:07.075330 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5qxdz" podStartSLOduration=252.282046588 podStartE2EDuration="4m13.075314715s" totalImagesPullingTime="793.268127ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:42:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:07.074139153 +0000 UTC m=+253.323549626" watchObservedRunningTime="2026-06-03 20:47:07.075314715 +0000 UTC m=+253.324725188" Jun 03 20:47:07.565644 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:07.565609 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-k6ssk"] Jun 03 20:47:07.569949 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:07.568969 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k6ssk" Jun 03 20:47:07.572631 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:07.572607 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6s5xw\"" Jun 03 20:47:07.572783 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:07.572640 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 20:47:07.573444 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:07.573423 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 20:47:07.573561 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:07.573507 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 20:47:07.573640 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:07.573584 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 20:47:07.579485 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:07.579446 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k6ssk"] Jun 03 20:47:07.647048 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:07.647018 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:07.673585 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:07.673554 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtdcb\" (UniqueName: \"kubernetes.io/projected/dce4ed17-2435-4480-899b-271e12208236-kube-api-access-rtdcb\") pod \"insights-runtime-extractor-k6ssk\" (UID: \"dce4ed17-2435-4480-899b-271e12208236\") " pod="openshift-insights/insights-runtime-extractor-k6ssk" Jun 03 20:47:07.673679 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:07.673594 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dce4ed17-2435-4480-899b-271e12208236-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k6ssk\" (UID: \"dce4ed17-2435-4480-899b-271e12208236\") " pod="openshift-insights/insights-runtime-extractor-k6ssk" Jun 03 20:47:07.673679 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:07.673633 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dce4ed17-2435-4480-899b-271e12208236-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k6ssk\" (UID: \"dce4ed17-2435-4480-899b-271e12208236\") " pod="openshift-insights/insights-runtime-extractor-k6ssk" Jun 03 20:47:07.673679 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:07.673677 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dce4ed17-2435-4480-899b-271e12208236-data-volume\") pod \"insights-runtime-extractor-k6ssk\" (UID: \"dce4ed17-2435-4480-899b-271e12208236\") " pod="openshift-insights/insights-runtime-extractor-k6ssk" Jun 03 20:47:07.673776 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:07.673698 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dce4ed17-2435-4480-899b-271e12208236-crio-socket\") pod \"insights-runtime-extractor-k6ssk\" (UID: \"dce4ed17-2435-4480-899b-271e12208236\") " pod="openshift-insights/insights-runtime-extractor-k6ssk" Jun 03 20:47:07.745347 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:07.745322 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:07.774562 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:07.774538 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dce4ed17-2435-4480-899b-271e12208236-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k6ssk\" (UID: \"dce4ed17-2435-4480-899b-271e12208236\") " pod="openshift-insights/insights-runtime-extractor-k6ssk" Jun 03 20:47:07.774650 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:07.774572 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dce4ed17-2435-4480-899b-271e12208236-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k6ssk\" (UID: \"dce4ed17-2435-4480-899b-271e12208236\") " pod="openshift-insights/insights-runtime-extractor-k6ssk" Jun 03 20:47:07.774650 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:07.774612 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dce4ed17-2435-4480-899b-271e12208236-data-volume\") pod \"insights-runtime-extractor-k6ssk\" (UID: \"dce4ed17-2435-4480-899b-271e12208236\") " pod="openshift-insights/insights-runtime-extractor-k6ssk" Jun 03 20:47:07.774650 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:07.774628 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dce4ed17-2435-4480-899b-271e12208236-crio-socket\") pod \"insights-runtime-extractor-k6ssk\" (UID: \"dce4ed17-2435-4480-899b-271e12208236\") " pod="openshift-insights/insights-runtime-extractor-k6ssk" Jun 03 20:47:07.774650 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:07.774647 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtdcb\" (UniqueName: \"kubernetes.io/projected/dce4ed17-2435-4480-899b-271e12208236-kube-api-access-rtdcb\") pod \"insights-runtime-extractor-k6ssk\" (UID: \"dce4ed17-2435-4480-899b-271e12208236\") " pod="openshift-insights/insights-runtime-extractor-k6ssk" Jun 03 20:47:07.774788 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:07.774746 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dce4ed17-2435-4480-899b-271e12208236-crio-socket\") pod \"insights-runtime-extractor-k6ssk\" (UID: \"dce4ed17-2435-4480-899b-271e12208236\") " pod="openshift-insights/insights-runtime-extractor-k6ssk" Jun 03 20:47:07.774949 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:07.774934 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dce4ed17-2435-4480-899b-271e12208236-data-volume\") pod \"insights-runtime-extractor-k6ssk\" (UID: \"dce4ed17-2435-4480-899b-271e12208236\") " pod="openshift-insights/insights-runtime-extractor-k6ssk" Jun 03 20:47:07.775077 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:07.775063 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dce4ed17-2435-4480-899b-271e12208236-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k6ssk\" (UID: \"dce4ed17-2435-4480-899b-271e12208236\") " pod="openshift-insights/insights-runtime-extractor-k6ssk" Jun 03 20:47:07.776833 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:07.776808 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dce4ed17-2435-4480-899b-271e12208236-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k6ssk\" (UID: \"dce4ed17-2435-4480-899b-271e12208236\") " pod="openshift-insights/insights-runtime-extractor-k6ssk" Jun 03 20:47:07.782744 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:07.782721 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtdcb\" (UniqueName: \"kubernetes.io/projected/dce4ed17-2435-4480-899b-271e12208236-kube-api-access-rtdcb\") pod \"insights-runtime-extractor-k6ssk\" (UID: \"dce4ed17-2435-4480-899b-271e12208236\") " pod="openshift-insights/insights-runtime-extractor-k6ssk" Jun 03 20:47:07.845723 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:07.845646 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:07.881499 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:07.881460 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k6ssk" Jun 03 20:47:07.996678 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:07.996651 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k6ssk"] Jun 03 20:47:07.999541 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:47:07.999518 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddce4ed17_2435_4480_899b_271e12208236.slice/crio-bbce80a41bbe68c61ef932dd0b09878cccc211273da82e60b72807a6d7c1667a WatchSource:0}: Error finding container bbce80a41bbe68c61ef932dd0b09878cccc211273da82e60b72807a6d7c1667a: Status 404 returned error can't find the container with id bbce80a41bbe68c61ef932dd0b09878cccc211273da82e60b72807a6d7c1667a Jun 03 20:47:08.065680 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:08.065654 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k6ssk" event={"ID":"dce4ed17-2435-4480-899b-271e12208236","Type":"ContainerStarted","Data":"c55d1246b73a023d24fe4e3b8b52ac38fc33a0bd103597babf15b33021d1d859"} Jun 03 20:47:08.065936 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:08.065714 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k6ssk" event={"ID":"dce4ed17-2435-4480-899b-271e12208236","Type":"ContainerStarted","Data":"bbce80a41bbe68c61ef932dd0b09878cccc211273da82e60b72807a6d7c1667a"} Jun 03 20:47:09.070062 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:09.069987 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k6ssk" event={"ID":"dce4ed17-2435-4480-899b-271e12208236","Type":"ContainerStarted","Data":"3266f00680acc7e017bb2fe168d2390135646047c123df464be9e183808ed001"} Jun 03 20:47:11.077933 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:11.077894 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k6ssk" event={"ID":"dce4ed17-2435-4480-899b-271e12208236","Type":"ContainerStarted","Data":"3adefaa8c189a99ab37e243c3a86fdf4f9592de071e87f895d4775e914a4a4d9"} Jun 03 20:47:11.096940 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:11.096896 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-k6ssk" podStartSLOduration=1.927661963 podStartE2EDuration="4.096883394s" totalImagesPullingTime="2.169221431s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:47:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:11.094422586 +0000 UTC m=+257.343833058" watchObservedRunningTime="2026-06-03 20:47:11.096883394 +0000 UTC m=+257.346293867" Jun 03 20:47:14.496311 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:14.496280 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:14.597996 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:14.597965 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:14.674105 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:14.674075 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:14.962444 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:14.962364 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:17.688551 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:17.688518 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:17.785771 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:17.785734 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:18.162377 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:18.162344 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:19.991234 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:19.991203 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:20.167647 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:20.167615 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:20.267776 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:20.267690 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:21.827149 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:21.827122 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:22.018259 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.018227 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:22.068788 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.068755 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-79fb7d47d4-kwq4x"] Jun 03 20:47:22.074736 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.074719 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-kwq4x" Jun 03 20:47:22.077655 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.077602 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 20:47:22.077749 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.077688 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 03 20:47:22.077810 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.077798 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 20:47:22.078654 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.078636 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 03 20:47:22.078759 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.078686 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 20:47:22.078820 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.078643 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-jqpck\"" Jun 03 20:47:22.079023 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.079008 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 03 20:47:22.085648 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.085628 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-79fb7d47d4-kwq4x"] Jun 03 20:47:22.102406 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.102382 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9nr8m"] Jun 03 20:47:22.105160 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.105143 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:22.106400 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.106386 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9nr8m" Jun 03 20:47:22.108857 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.108842 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 20:47:22.108956 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.108944 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 20:47:22.109020 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.108954 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pw9s7\"" Jun 03 20:47:22.109148 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.109135 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 20:47:22.166489 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.166451 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ab6df49-7f74-4f69-a23c-c4abaf13785e-kube-state-metrics-tls\") pod \"kube-state-metrics-79fb7d47d4-kwq4x\" (UID: \"1ab6df49-7f74-4f69-a23c-c4abaf13785e\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-kwq4x" Jun 03 20:47:22.166596 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.166503 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1ab6df49-7f74-4f69-a23c-c4abaf13785e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-79fb7d47d4-kwq4x\" (UID: \"1ab6df49-7f74-4f69-a23c-c4abaf13785e\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-kwq4x" Jun 03 20:47:22.166596 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.166534 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ab6df49-7f74-4f69-a23c-c4abaf13785e-metrics-client-ca\") pod \"kube-state-metrics-79fb7d47d4-kwq4x\" (UID: \"1ab6df49-7f74-4f69-a23c-c4abaf13785e\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-kwq4x" Jun 03 20:47:22.166596 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.166550 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5qfq\" (UniqueName: \"kubernetes.io/projected/1ab6df49-7f74-4f69-a23c-c4abaf13785e-kube-api-access-j5qfq\") pod \"kube-state-metrics-79fb7d47d4-kwq4x\" (UID: \"1ab6df49-7f74-4f69-a23c-c4abaf13785e\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-kwq4x" Jun 03 20:47:22.166596 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.166567 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1ab6df49-7f74-4f69-a23c-c4abaf13785e-volume-directive-shadow\") pod \"kube-state-metrics-79fb7d47d4-kwq4x\" (UID: \"1ab6df49-7f74-4f69-a23c-c4abaf13785e\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-kwq4x" Jun 03 20:47:22.166596 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.166588 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1ab6df49-7f74-4f69-a23c-c4abaf13785e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-79fb7d47d4-kwq4x\" (UID: \"1ab6df49-7f74-4f69-a23c-c4abaf13785e\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-kwq4x" Jun 03 20:47:22.267483 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.267453 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8bc5c4e4-950d-48f7-81eb-e288419443b7-node-exporter-tls\") pod \"node-exporter-9nr8m\" (UID: \"8bc5c4e4-950d-48f7-81eb-e288419443b7\") " pod="openshift-monitoring/node-exporter-9nr8m" Jun 03 20:47:22.267600 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.267509 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5qfq\" (UniqueName: \"kubernetes.io/projected/1ab6df49-7f74-4f69-a23c-c4abaf13785e-kube-api-access-j5qfq\") pod \"kube-state-metrics-79fb7d47d4-kwq4x\" (UID: \"1ab6df49-7f74-4f69-a23c-c4abaf13785e\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-kwq4x" Jun 03 20:47:22.267600 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.267551 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1ab6df49-7f74-4f69-a23c-c4abaf13785e-volume-directive-shadow\") pod \"kube-state-metrics-79fb7d47d4-kwq4x\" (UID: \"1ab6df49-7f74-4f69-a23c-c4abaf13785e\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-kwq4x" Jun 03 20:47:22.267707 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.267638 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1ab6df49-7f74-4f69-a23c-c4abaf13785e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-79fb7d47d4-kwq4x\" (UID: \"1ab6df49-7f74-4f69-a23c-c4abaf13785e\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-kwq4x" Jun 03 20:47:22.267707 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.267673 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ab6df49-7f74-4f69-a23c-c4abaf13785e-kube-state-metrics-tls\") pod \"kube-state-metrics-79fb7d47d4-kwq4x\" (UID: \"1ab6df49-7f74-4f69-a23c-c4abaf13785e\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-kwq4x" Jun 03 20:47:22.267812 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.267706 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1ab6df49-7f74-4f69-a23c-c4abaf13785e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-79fb7d47d4-kwq4x\" (UID: \"1ab6df49-7f74-4f69-a23c-c4abaf13785e\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-kwq4x" Jun 03 20:47:22.267812 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.267744 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8bc5c4e4-950d-48f7-81eb-e288419443b7-node-exporter-accelerators-collector-config\") pod \"node-exporter-9nr8m\" (UID: \"8bc5c4e4-950d-48f7-81eb-e288419443b7\") " pod="openshift-monitoring/node-exporter-9nr8m" Jun 03 20:47:22.267812 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.267775 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bc5c4e4-950d-48f7-81eb-e288419443b7-metrics-client-ca\") pod \"node-exporter-9nr8m\" (UID: \"8bc5c4e4-950d-48f7-81eb-e288419443b7\") " pod="openshift-monitoring/node-exporter-9nr8m" Jun 03 20:47:22.267812 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.267804 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8bc5c4e4-950d-48f7-81eb-e288419443b7-node-exporter-textfile\") pod \"node-exporter-9nr8m\" (UID: \"8bc5c4e4-950d-48f7-81eb-e288419443b7\") " pod="openshift-monitoring/node-exporter-9nr8m" Jun 03 20:47:22.268097 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.267867 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ab6df49-7f74-4f69-a23c-c4abaf13785e-metrics-client-ca\") pod \"kube-state-metrics-79fb7d47d4-kwq4x\" (UID: \"1ab6df49-7f74-4f69-a23c-c4abaf13785e\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-kwq4x" Jun 03 20:47:22.268097 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.267892 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1ab6df49-7f74-4f69-a23c-c4abaf13785e-volume-directive-shadow\") pod \"kube-state-metrics-79fb7d47d4-kwq4x\" (UID: \"1ab6df49-7f74-4f69-a23c-c4abaf13785e\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-kwq4x" Jun 03 20:47:22.268097 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.267938 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8bc5c4e4-950d-48f7-81eb-e288419443b7-root\") pod \"node-exporter-9nr8m\" (UID: \"8bc5c4e4-950d-48f7-81eb-e288419443b7\") " pod="openshift-monitoring/node-exporter-9nr8m" Jun 03 20:47:22.268097 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.267984 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bc5c4e4-950d-48f7-81eb-e288419443b7-sys\") pod \"node-exporter-9nr8m\" (UID: \"8bc5c4e4-950d-48f7-81eb-e288419443b7\") " pod="openshift-monitoring/node-exporter-9nr8m" Jun 03 20:47:22.268097 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.268009 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8bc5c4e4-950d-48f7-81eb-e288419443b7-node-exporter-wtmp\") pod \"node-exporter-9nr8m\" (UID: \"8bc5c4e4-950d-48f7-81eb-e288419443b7\") " pod="openshift-monitoring/node-exporter-9nr8m" Jun 03 20:47:22.268097 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.268057 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8bc5c4e4-950d-48f7-81eb-e288419443b7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9nr8m\" (UID: \"8bc5c4e4-950d-48f7-81eb-e288419443b7\") " pod="openshift-monitoring/node-exporter-9nr8m" Jun 03 20:47:22.268341 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.268113 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89zmz\" (UniqueName: \"kubernetes.io/projected/8bc5c4e4-950d-48f7-81eb-e288419443b7-kube-api-access-89zmz\") pod \"node-exporter-9nr8m\" (UID: \"8bc5c4e4-950d-48f7-81eb-e288419443b7\") " pod="openshift-monitoring/node-exporter-9nr8m" Jun 03 20:47:22.268419 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.268402 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ab6df49-7f74-4f69-a23c-c4abaf13785e-metrics-client-ca\") pod \"kube-state-metrics-79fb7d47d4-kwq4x\" (UID: \"1ab6df49-7f74-4f69-a23c-c4abaf13785e\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-kwq4x" Jun 03 20:47:22.268466 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.268447 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1ab6df49-7f74-4f69-a23c-c4abaf13785e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-79fb7d47d4-kwq4x\" (UID: \"1ab6df49-7f74-4f69-a23c-c4abaf13785e\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-kwq4x" Jun 03 20:47:22.270037 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.270016 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1ab6df49-7f74-4f69-a23c-c4abaf13785e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-79fb7d47d4-kwq4x\" (UID: \"1ab6df49-7f74-4f69-a23c-c4abaf13785e\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-kwq4x" Jun 03 20:47:22.270120 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.270090 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ab6df49-7f74-4f69-a23c-c4abaf13785e-kube-state-metrics-tls\") pod \"kube-state-metrics-79fb7d47d4-kwq4x\" (UID: \"1ab6df49-7f74-4f69-a23c-c4abaf13785e\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-kwq4x" Jun 03 20:47:22.275231 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.275211 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5qfq\" (UniqueName: \"kubernetes.io/projected/1ab6df49-7f74-4f69-a23c-c4abaf13785e-kube-api-access-j5qfq\") pod \"kube-state-metrics-79fb7d47d4-kwq4x\" (UID: \"1ab6df49-7f74-4f69-a23c-c4abaf13785e\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-kwq4x" Jun 03 20:47:22.283281 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.283260 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:22.368726 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.368665 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bc5c4e4-950d-48f7-81eb-e288419443b7-metrics-client-ca\") pod \"node-exporter-9nr8m\" (UID: \"8bc5c4e4-950d-48f7-81eb-e288419443b7\") " pod="openshift-monitoring/node-exporter-9nr8m" Jun 03 20:47:22.368726 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.368693 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8bc5c4e4-950d-48f7-81eb-e288419443b7-node-exporter-textfile\") pod \"node-exporter-9nr8m\" (UID: \"8bc5c4e4-950d-48f7-81eb-e288419443b7\") " pod="openshift-monitoring/node-exporter-9nr8m" Jun 03 20:47:22.368726 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.368712 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8bc5c4e4-950d-48f7-81eb-e288419443b7-root\") pod \"node-exporter-9nr8m\" (UID: \"8bc5c4e4-950d-48f7-81eb-e288419443b7\") " pod="openshift-monitoring/node-exporter-9nr8m" Jun 03 20:47:22.368959 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.368733 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bc5c4e4-950d-48f7-81eb-e288419443b7-sys\") pod \"node-exporter-9nr8m\" (UID: \"8bc5c4e4-950d-48f7-81eb-e288419443b7\") " pod="openshift-monitoring/node-exporter-9nr8m" Jun 03 20:47:22.368959 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.368748 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8bc5c4e4-950d-48f7-81eb-e288419443b7-node-exporter-wtmp\") pod \"node-exporter-9nr8m\" (UID: \"8bc5c4e4-950d-48f7-81eb-e288419443b7\") " pod="openshift-monitoring/node-exporter-9nr8m" Jun 03 20:47:22.368959 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.368762 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8bc5c4e4-950d-48f7-81eb-e288419443b7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9nr8m\" (UID: \"8bc5c4e4-950d-48f7-81eb-e288419443b7\") " pod="openshift-monitoring/node-exporter-9nr8m" Jun 03 20:47:22.368959 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.368802 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89zmz\" (UniqueName: \"kubernetes.io/projected/8bc5c4e4-950d-48f7-81eb-e288419443b7-kube-api-access-89zmz\") pod \"node-exporter-9nr8m\" (UID: \"8bc5c4e4-950d-48f7-81eb-e288419443b7\") " pod="openshift-monitoring/node-exporter-9nr8m" Jun 03 20:47:22.368959 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.368807 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8bc5c4e4-950d-48f7-81eb-e288419443b7-root\") pod \"node-exporter-9nr8m\" (UID: \"8bc5c4e4-950d-48f7-81eb-e288419443b7\") " pod="openshift-monitoring/node-exporter-9nr8m" Jun 03 20:47:22.368959 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.368826 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bc5c4e4-950d-48f7-81eb-e288419443b7-sys\") pod \"node-exporter-9nr8m\" (UID: \"8bc5c4e4-950d-48f7-81eb-e288419443b7\") " pod="openshift-monitoring/node-exporter-9nr8m" Jun 03 20:47:22.368959 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.368902 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8bc5c4e4-950d-48f7-81eb-e288419443b7-node-exporter-wtmp\") pod \"node-exporter-9nr8m\" (UID: \"8bc5c4e4-950d-48f7-81eb-e288419443b7\") " pod="openshift-monitoring/node-exporter-9nr8m" Jun 03 20:47:22.369210 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.368990 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8bc5c4e4-950d-48f7-81eb-e288419443b7-node-exporter-tls\") pod \"node-exporter-9nr8m\" (UID: \"8bc5c4e4-950d-48f7-81eb-e288419443b7\") " pod="openshift-monitoring/node-exporter-9nr8m" Jun 03 20:47:22.369210 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.369035 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8bc5c4e4-950d-48f7-81eb-e288419443b7-node-exporter-accelerators-collector-config\") pod \"node-exporter-9nr8m\" (UID: \"8bc5c4e4-950d-48f7-81eb-e288419443b7\") " pod="openshift-monitoring/node-exporter-9nr8m" Jun 03 20:47:22.369210 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.369054 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8bc5c4e4-950d-48f7-81eb-e288419443b7-node-exporter-textfile\") pod \"node-exporter-9nr8m\" (UID: \"8bc5c4e4-950d-48f7-81eb-e288419443b7\") " pod="openshift-monitoring/node-exporter-9nr8m" Jun 03 20:47:22.369319 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.369289 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bc5c4e4-950d-48f7-81eb-e288419443b7-metrics-client-ca\") pod \"node-exporter-9nr8m\" (UID: \"8bc5c4e4-950d-48f7-81eb-e288419443b7\") " pod="openshift-monitoring/node-exporter-9nr8m" Jun 03 20:47:22.369524 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.369509 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8bc5c4e4-950d-48f7-81eb-e288419443b7-node-exporter-accelerators-collector-config\") pod \"node-exporter-9nr8m\" (UID: \"8bc5c4e4-950d-48f7-81eb-e288419443b7\") " pod="openshift-monitoring/node-exporter-9nr8m" Jun 03 20:47:22.370904 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.370887 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8bc5c4e4-950d-48f7-81eb-e288419443b7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9nr8m\" (UID: \"8bc5c4e4-950d-48f7-81eb-e288419443b7\") " pod="openshift-monitoring/node-exporter-9nr8m" Jun 03 20:47:22.371021 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.371007 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8bc5c4e4-950d-48f7-81eb-e288419443b7-node-exporter-tls\") pod \"node-exporter-9nr8m\" (UID: \"8bc5c4e4-950d-48f7-81eb-e288419443b7\") " pod="openshift-monitoring/node-exporter-9nr8m" Jun 03 20:47:22.376625 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.376603 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89zmz\" (UniqueName: \"kubernetes.io/projected/8bc5c4e4-950d-48f7-81eb-e288419443b7-kube-api-access-89zmz\") pod \"node-exporter-9nr8m\" (UID: \"8bc5c4e4-950d-48f7-81eb-e288419443b7\") " pod="openshift-monitoring/node-exporter-9nr8m" Jun 03 20:47:22.383515 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.383496 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-kwq4x" Jun 03 20:47:22.385759 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.385738 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:22.414648 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.414628 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9nr8m" Jun 03 20:47:22.424888 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:47:22.424861 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bc5c4e4_950d_48f7_81eb_e288419443b7.slice/crio-ba14fe620d228ec47dc54d09e18c6a96be7287d11104308f886b7968ced3e183 WatchSource:0}: Error finding container ba14fe620d228ec47dc54d09e18c6a96be7287d11104308f886b7968ced3e183: Status 404 returned error can't find the container with id ba14fe620d228ec47dc54d09e18c6a96be7287d11104308f886b7968ced3e183 Jun 03 20:47:22.505110 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.505080 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-79fb7d47d4-kwq4x"] Jun 03 20:47:22.507829 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:47:22.507806 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ab6df49_7f74_4f69_a23c_c4abaf13785e.slice/crio-74e88f079d55707f22c48dcae5850612857df88a4ab97a31bf55eed75839e518 WatchSource:0}: Error finding container 74e88f079d55707f22c48dcae5850612857df88a4ab97a31bf55eed75839e518: Status 404 returned error can't find the container with id 74e88f079d55707f22c48dcae5850612857df88a4ab97a31bf55eed75839e518 Jun 03 20:47:22.579656 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:22.579631 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:23.087621 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:23.087586 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:23.113534 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:23.113499 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-kwq4x" event={"ID":"1ab6df49-7f74-4f69-a23c-c4abaf13785e","Type":"ContainerStarted","Data":"74e88f079d55707f22c48dcae5850612857df88a4ab97a31bf55eed75839e518"} Jun 03 20:47:23.114911 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:23.114849 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9nr8m" event={"ID":"8bc5c4e4-950d-48f7-81eb-e288419443b7","Type":"ContainerStarted","Data":"ba14fe620d228ec47dc54d09e18c6a96be7287d11104308f886b7968ced3e183"} Jun 03 20:47:23.166828 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:23.166793 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:23.235710 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:23.235676 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:24.119714 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:24.119682 2573 generic.go:356] "Generic (PLEG): container finished" podID="8bc5c4e4-950d-48f7-81eb-e288419443b7" containerID="b4c76f0421ee2d4935b407adf5b0298dca6568dc61d006f28cf1d0ddc5d862dc" exitCode=0 Jun 03 20:47:24.120177 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:24.119759 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9nr8m" event={"ID":"8bc5c4e4-950d-48f7-81eb-e288419443b7","Type":"ContainerDied","Data":"b4c76f0421ee2d4935b407adf5b0298dca6568dc61d006f28cf1d0ddc5d862dc"} Jun 03 20:47:24.121897 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:24.121867 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-kwq4x" event={"ID":"1ab6df49-7f74-4f69-a23c-c4abaf13785e","Type":"ContainerStarted","Data":"30e6ab0f61e7888bb488b398d77be66c4e83462aee73b9e72d3a565dda98b71a"} Jun 03 20:47:24.122002 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:24.121921 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-kwq4x" event={"ID":"1ab6df49-7f74-4f69-a23c-c4abaf13785e","Type":"ContainerStarted","Data":"765191feafb60a0fa7684a1eb3c8ea9940b3d639663e93f8ce00448077a03da2"} Jun 03 20:47:24.122002 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:24.121961 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-kwq4x" event={"ID":"1ab6df49-7f74-4f69-a23c-c4abaf13785e","Type":"ContainerStarted","Data":"a384960ef043632a2b410b25d2eff68892d7da4e50502557963c17e0e6522a6e"} Jun 03 20:47:24.158791 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:24.158749 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-kwq4x" podStartSLOduration=0.928096395 podStartE2EDuration="2.158733999s" totalImagesPullingTime="1.230637604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:47:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:24.157350868 +0000 UTC m=+270.406761344" watchObservedRunningTime="2026-06-03 20:47:24.158733999 +0000 UTC m=+270.408144515" Jun 03 20:47:25.019767 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:25.019734 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:25.093150 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:25.093104 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:25.126276 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:25.126253 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9nr8m" event={"ID":"8bc5c4e4-950d-48f7-81eb-e288419443b7","Type":"ContainerStarted","Data":"7a6288ff1301cc20f52a5aed8e2ee0d49b882dfcd32267b512fd6603918d5493"} Jun 03 20:47:25.126653 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:25.126303 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9nr8m" event={"ID":"8bc5c4e4-950d-48f7-81eb-e288419443b7","Type":"ContainerStarted","Data":"8cbb955519303f29d5fa520aa0805d6c5ae5bd1b97a4443fd027a876dbce8b9a"} Jun 03 20:47:25.147680 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:25.147642 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9nr8m" podStartSLOduration=2.162990019 podStartE2EDuration="3.147629142s" totalImagesPullingTime="915.753635ms" totalInitContainerRuntime="68.885488ms" isStatefulPod=true podCreationTimestamp="2026-06-03 20:47:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:25.145708089 +0000 UTC m=+271.395118586" watchObservedRunningTime="2026-06-03 20:47:25.147629142 +0000 UTC m=+271.397039657" Jun 03 20:47:25.181581 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:25.181547 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:25.315443 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:25.315371 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-56b467f5ff-nkkbr"] Jun 03 20:47:25.318535 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:25.318521 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-56b467f5ff-nkkbr" Jun 03 20:47:25.321008 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:25.320984 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 03 20:47:25.321113 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:25.321037 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-7b8gh\"" Jun 03 20:47:25.321113 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:25.321058 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 03 20:47:25.330620 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:25.330599 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-56b467f5ff-nkkbr"] Jun 03 20:47:25.336550 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:25.336517 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:25.392835 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:25.392805 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm2v8\" (UniqueName: \"kubernetes.io/projected/13ecd0fe-a9f3-4ea5-bd41-1d7a6d771adb-kube-api-access-xm2v8\") pod \"downloads-56b467f5ff-nkkbr\" (UID: \"13ecd0fe-a9f3-4ea5-bd41-1d7a6d771adb\") " pod="openshift-console/downloads-56b467f5ff-nkkbr" Jun 03 20:47:25.396208 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:25.396182 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:25.451638 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:25.451600 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:25.493755 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:25.493726 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xm2v8\" (UniqueName: \"kubernetes.io/projected/13ecd0fe-a9f3-4ea5-bd41-1d7a6d771adb-kube-api-access-xm2v8\") pod \"downloads-56b467f5ff-nkkbr\" (UID: \"13ecd0fe-a9f3-4ea5-bd41-1d7a6d771adb\") " pod="openshift-console/downloads-56b467f5ff-nkkbr" Jun 03 20:47:25.501417 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:25.501398 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm2v8\" (UniqueName: \"kubernetes.io/projected/13ecd0fe-a9f3-4ea5-bd41-1d7a6d771adb-kube-api-access-xm2v8\") pod \"downloads-56b467f5ff-nkkbr\" (UID: \"13ecd0fe-a9f3-4ea5-bd41-1d7a6d771adb\") " pod="openshift-console/downloads-56b467f5ff-nkkbr" Jun 03 20:47:25.607814 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:25.607743 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:25.627371 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:25.627352 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-56b467f5ff-nkkbr" Jun 03 20:47:25.750519 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:25.750405 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-56b467f5ff-nkkbr"] Jun 03 20:47:25.752925 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:47:25.752902 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13ecd0fe_a9f3_4ea5_bd41_1d7a6d771adb.slice/crio-4a67727a914dc74a64b5cd637acdb819c27175d37464aa72b90c695f410b5685 WatchSource:0}: Error finding container 4a67727a914dc74a64b5cd637acdb819c27175d37464aa72b90c695f410b5685: Status 404 returned error can't find the container with id 4a67727a914dc74a64b5cd637acdb819c27175d37464aa72b90c695f410b5685 Jun 03 20:47:26.012334 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:26.012302 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:26.065771 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:26.065742 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:26.130344 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:26.130320 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-56b467f5ff-nkkbr" event={"ID":"13ecd0fe-a9f3-4ea5-bd41-1d7a6d771adb","Type":"ContainerStarted","Data":"4a67727a914dc74a64b5cd637acdb819c27175d37464aa72b90c695f410b5685"} Jun 03 20:47:26.407859 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:26.407774 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:26.467780 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:26.467736 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:26.619794 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:26.619758 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:26.712544 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:26.712430 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:26.819206 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:26.819131 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:26.861997 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:26.857170 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-9b9fc658-64gv9"] Jun 03 20:47:26.861997 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:26.860968 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-9b9fc658-64gv9" Jun 03 20:47:26.864490 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:26.863971 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-gb2tv\"" Jun 03 20:47:26.864490 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:26.864115 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 03 20:47:26.872315 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:26.872292 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-9b9fc658-64gv9"] Jun 03 20:47:26.896050 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:26.896000 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:26.998997 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:26.998964 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:27.007172 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:27.007024 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/02cb4f66-27ef-4f0d-ae4d-af0918a52a7b-monitoring-plugin-cert\") pod \"monitoring-plugin-9b9fc658-64gv9\" (UID: \"02cb4f66-27ef-4f0d-ae4d-af0918a52a7b\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-64gv9" Jun 03 20:47:27.007429 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:27.007405 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rskjx\" (UniqueName: \"kubernetes.io/projected/02cb4f66-27ef-4f0d-ae4d-af0918a52a7b-kube-api-access-rskjx\") pod \"monitoring-plugin-9b9fc658-64gv9\" (UID: \"02cb4f66-27ef-4f0d-ae4d-af0918a52a7b\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-64gv9" Jun 03 20:47:27.099446 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:27.099369 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:27.108275 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:27.108248 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rskjx\" (UniqueName: \"kubernetes.io/projected/02cb4f66-27ef-4f0d-ae4d-af0918a52a7b-kube-api-access-rskjx\") pod \"monitoring-plugin-9b9fc658-64gv9\" (UID: \"02cb4f66-27ef-4f0d-ae4d-af0918a52a7b\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-64gv9" Jun 03 20:47:27.108407 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:27.108347 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/02cb4f66-27ef-4f0d-ae4d-af0918a52a7b-monitoring-plugin-cert\") pod \"monitoring-plugin-9b9fc658-64gv9\" (UID: \"02cb4f66-27ef-4f0d-ae4d-af0918a52a7b\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-64gv9" Jun 03 20:47:27.110837 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:27.110809 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/02cb4f66-27ef-4f0d-ae4d-af0918a52a7b-monitoring-plugin-cert\") pod \"monitoring-plugin-9b9fc658-64gv9\" (UID: \"02cb4f66-27ef-4f0d-ae4d-af0918a52a7b\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-64gv9" Jun 03 20:47:27.116390 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:27.116366 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rskjx\" (UniqueName: \"kubernetes.io/projected/02cb4f66-27ef-4f0d-ae4d-af0918a52a7b-kube-api-access-rskjx\") pod \"monitoring-plugin-9b9fc658-64gv9\" (UID: \"02cb4f66-27ef-4f0d-ae4d-af0918a52a7b\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-64gv9" Jun 03 20:47:27.153484 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:27.153443 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:27.174226 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:27.174205 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-9b9fc658-64gv9" Jun 03 20:47:27.314374 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:27.314335 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-9b9fc658-64gv9"] Jun 03 20:47:27.317455 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:47:27.317425 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02cb4f66_27ef_4f0d_ae4d_af0918a52a7b.slice/crio-a6373a53c3ea9432bd91ab69b2dc6eb85037d395d0bcf6225b3454ac2a3935d1 WatchSource:0}: Error finding container a6373a53c3ea9432bd91ab69b2dc6eb85037d395d0bcf6225b3454ac2a3935d1: Status 404 returned error can't find the container with id a6373a53c3ea9432bd91ab69b2dc6eb85037d395d0bcf6225b3454ac2a3935d1 Jun 03 20:47:27.322783 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:27.322756 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:28.023776 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:28.023718 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:28.121217 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:28.121184 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:28.142291 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:28.142259 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-9b9fc658-64gv9" event={"ID":"02cb4f66-27ef-4f0d-ae4d-af0918a52a7b","Type":"ContainerStarted","Data":"a6373a53c3ea9432bd91ab69b2dc6eb85037d395d0bcf6225b3454ac2a3935d1"} Jun 03 20:47:28.247616 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:28.247573 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:29.147250 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:29.147218 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-9b9fc658-64gv9" event={"ID":"02cb4f66-27ef-4f0d-ae4d-af0918a52a7b","Type":"ContainerStarted","Data":"8f56062ba8f51533c594d674baff6dfb5ae46caba45450df49af1c37544f55ac"} Jun 03 20:47:29.147440 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:29.147420 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-9b9fc658-64gv9" Jun 03 20:47:29.152451 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:29.152426 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-9b9fc658-64gv9" Jun 03 20:47:29.162510 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:29.162449 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-9b9fc658-64gv9" podStartSLOduration=1.828359851 podStartE2EDuration="3.162430682s" totalImagesPullingTime="1.334070831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:47:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:29.161856941 +0000 UTC m=+275.411267414" watchObservedRunningTime="2026-06-03 20:47:29.162430682 +0000 UTC m=+275.411841158" Jun 03 20:47:30.224232 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:30.224200 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6fdb8d9f49-66jrk"] Jun 03 20:47:30.227184 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:30.227164 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fdb8d9f49-66jrk" Jun 03 20:47:30.229866 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:30.229700 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 03 20:47:30.231016 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:30.230785 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 03 20:47:30.231016 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:30.230785 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 03 20:47:30.231016 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:30.230845 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 03 20:47:30.231016 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:30.230790 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 03 20:47:30.231016 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:30.230921 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7z6lx\"" Jun 03 20:47:30.237401 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:30.237382 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fdb8d9f49-66jrk"] Jun 03 20:47:30.335647 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:30.335616 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncmbl\" (UniqueName: \"kubernetes.io/projected/f10adc1b-edd9-430a-b1b8-92400e3b3727-kube-api-access-ncmbl\") pod \"console-6fdb8d9f49-66jrk\" (UID: \"f10adc1b-edd9-430a-b1b8-92400e3b3727\") " pod="openshift-console/console-6fdb8d9f49-66jrk" Jun 03 20:47:30.335806 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:30.335671 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f10adc1b-edd9-430a-b1b8-92400e3b3727-console-config\") pod \"console-6fdb8d9f49-66jrk\" (UID: \"f10adc1b-edd9-430a-b1b8-92400e3b3727\") " pod="openshift-console/console-6fdb8d9f49-66jrk" Jun 03 20:47:30.335806 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:30.335776 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f10adc1b-edd9-430a-b1b8-92400e3b3727-service-ca\") pod \"console-6fdb8d9f49-66jrk\" (UID: \"f10adc1b-edd9-430a-b1b8-92400e3b3727\") " pod="openshift-console/console-6fdb8d9f49-66jrk" Jun 03 20:47:30.335806 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:30.335800 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f10adc1b-edd9-430a-b1b8-92400e3b3727-console-serving-cert\") pod \"console-6fdb8d9f49-66jrk\" (UID: \"f10adc1b-edd9-430a-b1b8-92400e3b3727\") " pod="openshift-console/console-6fdb8d9f49-66jrk" Jun 03 20:47:30.335953 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:30.335834 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f10adc1b-edd9-430a-b1b8-92400e3b3727-console-oauth-config\") pod \"console-6fdb8d9f49-66jrk\" (UID: \"f10adc1b-edd9-430a-b1b8-92400e3b3727\") " pod="openshift-console/console-6fdb8d9f49-66jrk" Jun 03 20:47:30.335953 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:30.335864 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f10adc1b-edd9-430a-b1b8-92400e3b3727-oauth-serving-cert\") pod \"console-6fdb8d9f49-66jrk\" (UID: \"f10adc1b-edd9-430a-b1b8-92400e3b3727\") " pod="openshift-console/console-6fdb8d9f49-66jrk" Jun 03 20:47:30.437290 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:30.437249 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f10adc1b-edd9-430a-b1b8-92400e3b3727-console-oauth-config\") pod \"console-6fdb8d9f49-66jrk\" (UID: \"f10adc1b-edd9-430a-b1b8-92400e3b3727\") " pod="openshift-console/console-6fdb8d9f49-66jrk" Jun 03 20:47:30.437462 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:30.437383 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f10adc1b-edd9-430a-b1b8-92400e3b3727-oauth-serving-cert\") pod \"console-6fdb8d9f49-66jrk\" (UID: \"f10adc1b-edd9-430a-b1b8-92400e3b3727\") " pod="openshift-console/console-6fdb8d9f49-66jrk" Jun 03 20:47:30.437462 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:30.437442 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncmbl\" (UniqueName: \"kubernetes.io/projected/f10adc1b-edd9-430a-b1b8-92400e3b3727-kube-api-access-ncmbl\") pod \"console-6fdb8d9f49-66jrk\" (UID: \"f10adc1b-edd9-430a-b1b8-92400e3b3727\") " pod="openshift-console/console-6fdb8d9f49-66jrk" Jun 03 20:47:30.437653 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:30.437630 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f10adc1b-edd9-430a-b1b8-92400e3b3727-console-config\") pod \"console-6fdb8d9f49-66jrk\" (UID: \"f10adc1b-edd9-430a-b1b8-92400e3b3727\") " pod="openshift-console/console-6fdb8d9f49-66jrk" Jun 03 20:47:30.437770 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:30.437721 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f10adc1b-edd9-430a-b1b8-92400e3b3727-service-ca\") pod \"console-6fdb8d9f49-66jrk\" (UID: \"f10adc1b-edd9-430a-b1b8-92400e3b3727\") " pod="openshift-console/console-6fdb8d9f49-66jrk" Jun 03 20:47:30.437770 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:30.437755 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f10adc1b-edd9-430a-b1b8-92400e3b3727-console-serving-cert\") pod \"console-6fdb8d9f49-66jrk\" (UID: \"f10adc1b-edd9-430a-b1b8-92400e3b3727\") " pod="openshift-console/console-6fdb8d9f49-66jrk" Jun 03 20:47:30.438199 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:30.438156 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f10adc1b-edd9-430a-b1b8-92400e3b3727-oauth-serving-cert\") pod \"console-6fdb8d9f49-66jrk\" (UID: \"f10adc1b-edd9-430a-b1b8-92400e3b3727\") " pod="openshift-console/console-6fdb8d9f49-66jrk" Jun 03 20:47:30.438298 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:30.438284 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f10adc1b-edd9-430a-b1b8-92400e3b3727-console-config\") pod \"console-6fdb8d9f49-66jrk\" (UID: \"f10adc1b-edd9-430a-b1b8-92400e3b3727\") " pod="openshift-console/console-6fdb8d9f49-66jrk" Jun 03 20:47:30.438356 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:30.438314 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f10adc1b-edd9-430a-b1b8-92400e3b3727-service-ca\") pod \"console-6fdb8d9f49-66jrk\" (UID: \"f10adc1b-edd9-430a-b1b8-92400e3b3727\") " pod="openshift-console/console-6fdb8d9f49-66jrk" Jun 03 20:47:30.439994 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:30.439965 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f10adc1b-edd9-430a-b1b8-92400e3b3727-console-oauth-config\") pod \"console-6fdb8d9f49-66jrk\" (UID: \"f10adc1b-edd9-430a-b1b8-92400e3b3727\") " pod="openshift-console/console-6fdb8d9f49-66jrk" Jun 03 20:47:30.440347 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:30.440315 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f10adc1b-edd9-430a-b1b8-92400e3b3727-console-serving-cert\") pod \"console-6fdb8d9f49-66jrk\" (UID: \"f10adc1b-edd9-430a-b1b8-92400e3b3727\") " pod="openshift-console/console-6fdb8d9f49-66jrk" Jun 03 20:47:30.445913 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:30.445872 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncmbl\" (UniqueName: \"kubernetes.io/projected/f10adc1b-edd9-430a-b1b8-92400e3b3727-kube-api-access-ncmbl\") pod \"console-6fdb8d9f49-66jrk\" (UID: \"f10adc1b-edd9-430a-b1b8-92400e3b3727\") " pod="openshift-console/console-6fdb8d9f49-66jrk" Jun 03 20:47:30.538617 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:30.538549 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fdb8d9f49-66jrk" Jun 03 20:47:30.695264 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:30.695221 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fdb8d9f49-66jrk"] Jun 03 20:47:30.698235 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:47:30.698204 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf10adc1b_edd9_430a_b1b8_92400e3b3727.slice/crio-4cfdf920dcbd0ac6a1b69d975aacf351714bf19d5cd1d70a0055caa5d86d0492 WatchSource:0}: Error finding container 4cfdf920dcbd0ac6a1b69d975aacf351714bf19d5cd1d70a0055caa5d86d0492: Status 404 returned error can't find the container with id 4cfdf920dcbd0ac6a1b69d975aacf351714bf19d5cd1d70a0055caa5d86d0492 Jun 03 20:47:31.155827 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:31.155756 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fdb8d9f49-66jrk" event={"ID":"f10adc1b-edd9-430a-b1b8-92400e3b3727","Type":"ContainerStarted","Data":"4cfdf920dcbd0ac6a1b69d975aacf351714bf19d5cd1d70a0055caa5d86d0492"} Jun 03 20:47:33.109300 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:33.109236 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ffd748d6-vwvl8" podUID="9df59c83-dd6b-47b4-9b76-6aa27d3e42cd" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 03 20:47:33.792616 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:47:33.792529 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xs8jn" podUID="a49042aa-131c-4704-b69e-b4ff4e0a1fd4" Jun 03 20:47:34.169084 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:34.169004 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fdb8d9f49-66jrk" event={"ID":"f10adc1b-edd9-430a-b1b8-92400e3b3727","Type":"ContainerStarted","Data":"2c8edcefa25102a3680ab438c3251b14d764a977425d8dafbc1edee653756183"} Jun 03 20:47:34.169084 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:34.169053 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xs8jn" Jun 03 20:47:34.185338 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:34.185297 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6fdb8d9f49-66jrk" podStartSLOduration=1.405229751 podStartE2EDuration="4.185284241s" totalImagesPullingTime="2.78005449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:47:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:34.184551923 +0000 UTC m=+280.433962398" watchObservedRunningTime="2026-06-03 20:47:34.185284241 +0000 UTC m=+280.434694714" Jun 03 20:47:36.630592 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:36.630545 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:37.599177 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:37.599141 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a49042aa-131c-4704-b69e-b4ff4e0a1fd4-metrics-tls\") pod \"dns-default-xs8jn\" (UID: \"a49042aa-131c-4704-b69e-b4ff4e0a1fd4\") " pod="openshift-dns/dns-default-xs8jn" Jun 03 20:47:37.601698 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:37.601666 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a49042aa-131c-4704-b69e-b4ff4e0a1fd4-metrics-tls\") pod \"dns-default-xs8jn\" (UID: \"a49042aa-131c-4704-b69e-b4ff4e0a1fd4\") " pod="openshift-dns/dns-default-xs8jn" Jun 03 20:47:37.671381 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:37.671342 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:37.773180 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:37.773151 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gs868\"" Jun 03 20:47:37.781399 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:37.781373 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xs8jn" Jun 03 20:47:39.388405 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:39.388364 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:39.438836 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:39.438789 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:39.506085 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:39.506049 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:39.607342 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:39.607303 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:40.186462 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:40.186422 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:40.236954 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:40.236921 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:40.539828 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:40.539788 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6fdb8d9f49-66jrk" Jun 03 20:47:40.540255 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:40.539855 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6fdb8d9f49-66jrk" Jun 03 20:47:40.545278 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:40.545257 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6fdb8d9f49-66jrk" Jun 03 20:47:40.992977 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:40.992928 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:41.093944 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:41.093905 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:41.193682 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:41.193649 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:41.199330 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:41.199305 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6fdb8d9f49-66jrk" Jun 03 20:47:41.294520 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:41.294486 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:41.330022 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:41.329997 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xs8jn"] Jun 03 20:47:41.332282 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:47:41.332255 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda49042aa_131c_4704_b69e_b4ff4e0a1fd4.slice/crio-c5029a389c6152d260e7096856676e8648f0ee4f6030c2bad885bbdd53f09195 WatchSource:0}: Error finding container c5029a389c6152d260e7096856676e8648f0ee4f6030c2bad885bbdd53f09195: Status 404 returned error can't find the container with id c5029a389c6152d260e7096856676e8648f0ee4f6030c2bad885bbdd53f09195 Jun 03 20:47:41.495908 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:41.495869 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:41.547587 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:41.547513 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:42.201717 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:42.201681 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-56b467f5ff-nkkbr" event={"ID":"13ecd0fe-a9f3-4ea5-bd41-1d7a6d771adb","Type":"ContainerStarted","Data":"ccc62bd01496c7024d6f07305be9ffa373bb7b92ddf229570db1833ba1031b11"} Jun 03 20:47:42.202616 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:42.202591 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-56b467f5ff-nkkbr" Jun 03 20:47:42.204211 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:42.203982 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xs8jn" event={"ID":"a49042aa-131c-4704-b69e-b4ff4e0a1fd4","Type":"ContainerStarted","Data":"c5029a389c6152d260e7096856676e8648f0ee4f6030c2bad885bbdd53f09195"} Jun 03 20:47:42.220765 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:42.220702 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-56b467f5ff-nkkbr" Jun 03 20:47:42.239301 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:42.239249 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-56b467f5ff-nkkbr" podStartSLOduration=1.682784056 podStartE2EDuration="17.239230308s" totalImagesPullingTime="15.556446252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:47:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:42.220271237 +0000 UTC m=+288.469681710" watchObservedRunningTime="2026-06-03 20:47:42.239230308 +0000 UTC m=+288.488640780" Jun 03 20:47:42.623014 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:42.622939 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:42.672648 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:42.672555 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:43.110244 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:43.110206 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ffd748d6-vwvl8" podUID="9df59c83-dd6b-47b4-9b76-6aa27d3e42cd" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 03 20:47:44.214901 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:44.214866 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xs8jn" event={"ID":"a49042aa-131c-4704-b69e-b4ff4e0a1fd4","Type":"ContainerStarted","Data":"4f99a2164079d440be07b1aa0c06d7a25fd63080df46dd41bd88b4210e5dec14"} Jun 03 20:47:44.215340 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:44.214920 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xs8jn" event={"ID":"a49042aa-131c-4704-b69e-b4ff4e0a1fd4","Type":"ContainerStarted","Data":"76e6cf9883cd3276730533d5d7da78c911ebcea69fb94a2966e7d748eb7a508a"} Jun 03 20:47:44.231383 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:44.231328 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xs8jn" podStartSLOduration=255.487380712 podStartE2EDuration="4m17.231309357s" totalImagesPullingTime="1.743928645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:43:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:44.23062597 +0000 UTC m=+290.480036445" watchObservedRunningTime="2026-06-03 20:47:44.231309357 +0000 UTC m=+290.480719831" Jun 03 20:47:44.315800 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:44.315754 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:44.372321 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:44.372284 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:44.628494 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:44.628450 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:45.218790 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:45.218753 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xs8jn" Jun 03 20:47:47.105416 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:47.105381 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fdb8d9f49-66jrk"] Jun 03 20:47:48.031872 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:48.031834 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:48.133672 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:48.133626 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:49.223713 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:49.223675 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:49.272012 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:49.271976 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:50.360405 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:50.360370 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:50.411038 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:50.411009 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:50.620933 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:50.620848 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:50.720760 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:50.720734 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:47:53.109207 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:53.109167 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ffd748d6-vwvl8" podUID="9df59c83-dd6b-47b4-9b76-6aa27d3e42cd" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 03 20:47:53.109666 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:53.109234 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ffd748d6-vwvl8" Jun 03 20:47:53.109751 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:53.109713 2573 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"5bae8140ac7234b17c002e7f5f6886404c64485ee3f156ba672a7646f64ad744"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ffd748d6-vwvl8" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 03 20:47:53.109796 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:53.109771 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ffd748d6-vwvl8" podUID="9df59c83-dd6b-47b4-9b76-6aa27d3e42cd" containerName="service-proxy" containerID="cri-o://5bae8140ac7234b17c002e7f5f6886404c64485ee3f156ba672a7646f64ad744" gracePeriod=30 Jun 03 20:47:53.246959 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:53.246933 2573 generic.go:356] "Generic (PLEG): container finished" podID="9df59c83-dd6b-47b4-9b76-6aa27d3e42cd" containerID="5bae8140ac7234b17c002e7f5f6886404c64485ee3f156ba672a7646f64ad744" exitCode=2 Jun 03 20:47:53.247051 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:53.246983 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ffd748d6-vwvl8" event={"ID":"9df59c83-dd6b-47b4-9b76-6aa27d3e42cd","Type":"ContainerDied","Data":"5bae8140ac7234b17c002e7f5f6886404c64485ee3f156ba672a7646f64ad744"} Jun 03 20:47:54.157916 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:54.157880 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8cpfl_51f5ccb5-b246-47b7-82cb-9524ff802fae/ovn-acl-logging/0.log" Jun 03 20:47:54.159676 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:54.159654 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8cpfl_51f5ccb5-b246-47b7-82cb-9524ff802fae/ovn-acl-logging/0.log" Jun 03 20:47:54.164983 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:54.164965 2573 kubelet.go:1648] "Image garbage collection succeeded" Jun 03 20:47:54.252052 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:54.252025 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84ffd748d6-vwvl8" event={"ID":"9df59c83-dd6b-47b4-9b76-6aa27d3e42cd","Type":"ContainerStarted","Data":"d96d0f4a1b752235aa819546384b3ef1e74cea20de38683bbebbe37a30f1d22a"} Jun 03 20:47:55.224169 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:55.224140 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xs8jn" Jun 03 20:47:56.811132 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:47:56.811106 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-znprx_c1ad9037-60f7-44e2-bcb8-3d9bc56ddc15/serve-healthcheck-canary/0.log" Jun 03 20:48:04.359213 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:04.359175 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:04.410352 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:04.410318 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:05.363561 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:05.363527 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:05.411995 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:05.411962 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:12.129387 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:12.129330 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6fdb8d9f49-66jrk" podUID="f10adc1b-edd9-430a-b1b8-92400e3b3727" containerName="console" containerID="cri-o://2c8edcefa25102a3680ab438c3251b14d764a977425d8dafbc1edee653756183" gracePeriod=15 Jun 03 20:48:12.315759 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:12.315720 2573 generic.go:356] "Generic (PLEG): container finished" podID="f10adc1b-edd9-430a-b1b8-92400e3b3727" containerID="2c8edcefa25102a3680ab438c3251b14d764a977425d8dafbc1edee653756183" exitCode=0 Jun 03 20:48:12.315885 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:12.315790 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fdb8d9f49-66jrk" event={"ID":"f10adc1b-edd9-430a-b1b8-92400e3b3727","Type":"ContainerDied","Data":"2c8edcefa25102a3680ab438c3251b14d764a977425d8dafbc1edee653756183"} Jun 03 20:48:12.399757 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:12.399689 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fdb8d9f49-66jrk" Jun 03 20:48:12.436346 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:12.436316 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:12.458118 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:12.458096 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f10adc1b-edd9-430a-b1b8-92400e3b3727-console-config\") pod \"f10adc1b-edd9-430a-b1b8-92400e3b3727\" (UID: \"f10adc1b-edd9-430a-b1b8-92400e3b3727\") " Jun 03 20:48:12.458216 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:12.458129 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ncmbl\" (UniqueName: \"kubernetes.io/projected/f10adc1b-edd9-430a-b1b8-92400e3b3727-kube-api-access-ncmbl\") pod \"f10adc1b-edd9-430a-b1b8-92400e3b3727\" (UID: \"f10adc1b-edd9-430a-b1b8-92400e3b3727\") " Jun 03 20:48:12.458216 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:12.458187 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f10adc1b-edd9-430a-b1b8-92400e3b3727-console-oauth-config\") pod \"f10adc1b-edd9-430a-b1b8-92400e3b3727\" (UID: \"f10adc1b-edd9-430a-b1b8-92400e3b3727\") " Jun 03 20:48:12.458309 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:12.458214 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f10adc1b-edd9-430a-b1b8-92400e3b3727-service-ca\") pod \"f10adc1b-edd9-430a-b1b8-92400e3b3727\" (UID: \"f10adc1b-edd9-430a-b1b8-92400e3b3727\") " Jun 03 20:48:12.458309 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:12.458254 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f10adc1b-edd9-430a-b1b8-92400e3b3727-oauth-serving-cert\") pod \"f10adc1b-edd9-430a-b1b8-92400e3b3727\" (UID: \"f10adc1b-edd9-430a-b1b8-92400e3b3727\") " Jun 03 20:48:12.458309 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:12.458288 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f10adc1b-edd9-430a-b1b8-92400e3b3727-console-serving-cert\") pod \"f10adc1b-edd9-430a-b1b8-92400e3b3727\" (UID: \"f10adc1b-edd9-430a-b1b8-92400e3b3727\") " Jun 03 20:48:12.458642 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:12.458616 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f10adc1b-edd9-430a-b1b8-92400e3b3727-console-config" (OuterVolumeSpecName: "console-config") pod "f10adc1b-edd9-430a-b1b8-92400e3b3727" (UID: "f10adc1b-edd9-430a-b1b8-92400e3b3727"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:48:12.458713 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:12.458668 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f10adc1b-edd9-430a-b1b8-92400e3b3727-service-ca" (OuterVolumeSpecName: "service-ca") pod "f10adc1b-edd9-430a-b1b8-92400e3b3727" (UID: "f10adc1b-edd9-430a-b1b8-92400e3b3727"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:48:12.458760 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:12.458733 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f10adc1b-edd9-430a-b1b8-92400e3b3727-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f10adc1b-edd9-430a-b1b8-92400e3b3727" (UID: "f10adc1b-edd9-430a-b1b8-92400e3b3727"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:48:12.460507 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:12.460463 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f10adc1b-edd9-430a-b1b8-92400e3b3727-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f10adc1b-edd9-430a-b1b8-92400e3b3727" (UID: "f10adc1b-edd9-430a-b1b8-92400e3b3727"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:48:12.460594 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:12.460503 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f10adc1b-edd9-430a-b1b8-92400e3b3727-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f10adc1b-edd9-430a-b1b8-92400e3b3727" (UID: "f10adc1b-edd9-430a-b1b8-92400e3b3727"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:48:12.460594 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:12.460524 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f10adc1b-edd9-430a-b1b8-92400e3b3727-kube-api-access-ncmbl" (OuterVolumeSpecName: "kube-api-access-ncmbl") pod "f10adc1b-edd9-430a-b1b8-92400e3b3727" (UID: "f10adc1b-edd9-430a-b1b8-92400e3b3727"). InnerVolumeSpecName "kube-api-access-ncmbl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:48:12.535883 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:12.535851 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:12.558832 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:12.558810 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f10adc1b-edd9-430a-b1b8-92400e3b3727-console-serving-cert\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:48:12.558832 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:12.558831 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f10adc1b-edd9-430a-b1b8-92400e3b3727-console-config\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:48:12.558928 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:12.558841 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncmbl\" (UniqueName: \"kubernetes.io/projected/f10adc1b-edd9-430a-b1b8-92400e3b3727-kube-api-access-ncmbl\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:48:12.558928 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:12.558850 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f10adc1b-edd9-430a-b1b8-92400e3b3727-console-oauth-config\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:48:12.558928 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:12.558858 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f10adc1b-edd9-430a-b1b8-92400e3b3727-service-ca\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:48:12.558928 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:12.558866 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f10adc1b-edd9-430a-b1b8-92400e3b3727-oauth-serving-cert\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:48:12.636621 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:12.636588 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:13.319835 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:13.319806 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fdb8d9f49-66jrk" Jun 03 20:48:13.320283 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:13.319806 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fdb8d9f49-66jrk" event={"ID":"f10adc1b-edd9-430a-b1b8-92400e3b3727","Type":"ContainerDied","Data":"4cfdf920dcbd0ac6a1b69d975aacf351714bf19d5cd1d70a0055caa5d86d0492"} Jun 03 20:48:13.320283 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:13.319948 2573 scope.go:117] "RemoveContainer" containerID="2c8edcefa25102a3680ab438c3251b14d764a977425d8dafbc1edee653756183" Jun 03 20:48:13.340214 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:13.340191 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fdb8d9f49-66jrk"] Jun 03 20:48:13.344332 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:13.344312 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6fdb8d9f49-66jrk"] Jun 03 20:48:14.210984 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:14.210953 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f10adc1b-edd9-430a-b1b8-92400e3b3727" path="/var/lib/kubelet/pods/f10adc1b-edd9-430a-b1b8-92400e3b3727/volumes" Jun 03 20:48:41.241369 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:41.241330 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:41.335555 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:41.335514 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:49.525267 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:49.525233 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:49.579459 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:49.579424 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:50.175261 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:50.175223 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-759769848-d8wsv"] Jun 03 20:48:50.175552 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:50.175535 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f10adc1b-edd9-430a-b1b8-92400e3b3727" containerName="console" Jun 03 20:48:50.175636 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:50.175553 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f10adc1b-edd9-430a-b1b8-92400e3b3727" containerName="console" Jun 03 20:48:50.175690 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:50.175636 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f10adc1b-edd9-430a-b1b8-92400e3b3727" containerName="console" Jun 03 20:48:50.178605 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:50.178584 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-759769848-d8wsv" Jun 03 20:48:50.181159 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:50.181131 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 03 20:48:50.181250 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:50.181167 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 03 20:48:50.182130 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:50.182113 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 03 20:48:50.182319 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:50.182295 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 03 20:48:50.182425 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:50.182404 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 03 20:48:50.182510 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:50.182413 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7z6lx\"" Jun 03 20:48:50.186630 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:50.186613 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 03 20:48:50.190298 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:50.190281 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-759769848-d8wsv"] Jun 03 20:48:50.247983 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:50.247953 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:50.305492 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:50.305452 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/24fe0942-1393-49bc-9a31-fa1469e4f530-console-serving-cert\") pod \"console-759769848-d8wsv\" (UID: \"24fe0942-1393-49bc-9a31-fa1469e4f530\") " pod="openshift-console/console-759769848-d8wsv" Jun 03 20:48:50.305605 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:50.305505 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/24fe0942-1393-49bc-9a31-fa1469e4f530-console-oauth-config\") pod \"console-759769848-d8wsv\" (UID: \"24fe0942-1393-49bc-9a31-fa1469e4f530\") " pod="openshift-console/console-759769848-d8wsv" Jun 03 20:48:50.305605 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:50.305553 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/24fe0942-1393-49bc-9a31-fa1469e4f530-console-config\") pod \"console-759769848-d8wsv\" (UID: \"24fe0942-1393-49bc-9a31-fa1469e4f530\") " pod="openshift-console/console-759769848-d8wsv" Jun 03 20:48:50.305605 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:50.305578 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5bvj\" (UniqueName: \"kubernetes.io/projected/24fe0942-1393-49bc-9a31-fa1469e4f530-kube-api-access-p5bvj\") pod \"console-759769848-d8wsv\" (UID: \"24fe0942-1393-49bc-9a31-fa1469e4f530\") " pod="openshift-console/console-759769848-d8wsv" Jun 03 20:48:50.305738 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:50.305666 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/24fe0942-1393-49bc-9a31-fa1469e4f530-oauth-serving-cert\") pod \"console-759769848-d8wsv\" (UID: \"24fe0942-1393-49bc-9a31-fa1469e4f530\") " pod="openshift-console/console-759769848-d8wsv" Jun 03 20:48:50.305738 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:50.305697 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/24fe0942-1393-49bc-9a31-fa1469e4f530-service-ca\") pod \"console-759769848-d8wsv\" (UID: \"24fe0942-1393-49bc-9a31-fa1469e4f530\") " pod="openshift-console/console-759769848-d8wsv" Jun 03 20:48:50.305738 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:50.305724 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24fe0942-1393-49bc-9a31-fa1469e4f530-trusted-ca-bundle\") pod \"console-759769848-d8wsv\" (UID: \"24fe0942-1393-49bc-9a31-fa1469e4f530\") " pod="openshift-console/console-759769848-d8wsv" Jun 03 20:48:50.376606 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:50.376569 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:50.406497 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:50.406460 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/24fe0942-1393-49bc-9a31-fa1469e4f530-oauth-serving-cert\") pod \"console-759769848-d8wsv\" (UID: \"24fe0942-1393-49bc-9a31-fa1469e4f530\") " pod="openshift-console/console-759769848-d8wsv" Jun 03 20:48:50.406557 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:50.406506 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/24fe0942-1393-49bc-9a31-fa1469e4f530-service-ca\") pod \"console-759769848-d8wsv\" (UID: \"24fe0942-1393-49bc-9a31-fa1469e4f530\") " pod="openshift-console/console-759769848-d8wsv" Jun 03 20:48:50.406557 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:50.406539 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24fe0942-1393-49bc-9a31-fa1469e4f530-trusted-ca-bundle\") pod \"console-759769848-d8wsv\" (UID: \"24fe0942-1393-49bc-9a31-fa1469e4f530\") " pod="openshift-console/console-759769848-d8wsv" Jun 03 20:48:50.406645 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:50.406573 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/24fe0942-1393-49bc-9a31-fa1469e4f530-console-serving-cert\") pod \"console-759769848-d8wsv\" (UID: \"24fe0942-1393-49bc-9a31-fa1469e4f530\") " pod="openshift-console/console-759769848-d8wsv" Jun 03 20:48:50.406645 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:50.406599 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/24fe0942-1393-49bc-9a31-fa1469e4f530-console-oauth-config\") pod \"console-759769848-d8wsv\" (UID: \"24fe0942-1393-49bc-9a31-fa1469e4f530\") " pod="openshift-console/console-759769848-d8wsv" Jun 03 20:48:50.406645 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:50.406629 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/24fe0942-1393-49bc-9a31-fa1469e4f530-console-config\") pod \"console-759769848-d8wsv\" (UID: \"24fe0942-1393-49bc-9a31-fa1469e4f530\") " pod="openshift-console/console-759769848-d8wsv" Jun 03 20:48:50.406791 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:50.406649 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5bvj\" (UniqueName: \"kubernetes.io/projected/24fe0942-1393-49bc-9a31-fa1469e4f530-kube-api-access-p5bvj\") pod \"console-759769848-d8wsv\" (UID: \"24fe0942-1393-49bc-9a31-fa1469e4f530\") " pod="openshift-console/console-759769848-d8wsv" Jun 03 20:48:50.407204 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:50.407180 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/24fe0942-1393-49bc-9a31-fa1469e4f530-oauth-serving-cert\") pod \"console-759769848-d8wsv\" (UID: \"24fe0942-1393-49bc-9a31-fa1469e4f530\") " pod="openshift-console/console-759769848-d8wsv" Jun 03 20:48:50.407302 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:50.407248 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/24fe0942-1393-49bc-9a31-fa1469e4f530-service-ca\") pod \"console-759769848-d8wsv\" (UID: \"24fe0942-1393-49bc-9a31-fa1469e4f530\") " pod="openshift-console/console-759769848-d8wsv" Jun 03 20:48:50.407356 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:50.407323 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/24fe0942-1393-49bc-9a31-fa1469e4f530-console-config\") pod \"console-759769848-d8wsv\" (UID: \"24fe0942-1393-49bc-9a31-fa1469e4f530\") " pod="openshift-console/console-759769848-d8wsv" Jun 03 20:48:50.407511 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:50.407492 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24fe0942-1393-49bc-9a31-fa1469e4f530-trusted-ca-bundle\") pod \"console-759769848-d8wsv\" (UID: \"24fe0942-1393-49bc-9a31-fa1469e4f530\") " pod="openshift-console/console-759769848-d8wsv" Jun 03 20:48:50.409096 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:50.409071 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/24fe0942-1393-49bc-9a31-fa1469e4f530-console-oauth-config\") pod \"console-759769848-d8wsv\" (UID: \"24fe0942-1393-49bc-9a31-fa1469e4f530\") " pod="openshift-console/console-759769848-d8wsv" Jun 03 20:48:50.409169 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:50.409101 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/24fe0942-1393-49bc-9a31-fa1469e4f530-console-serving-cert\") pod \"console-759769848-d8wsv\" (UID: \"24fe0942-1393-49bc-9a31-fa1469e4f530\") " pod="openshift-console/console-759769848-d8wsv" Jun 03 20:48:50.414733 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:50.414710 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5bvj\" (UniqueName: \"kubernetes.io/projected/24fe0942-1393-49bc-9a31-fa1469e4f530-kube-api-access-p5bvj\") pod \"console-759769848-d8wsv\" (UID: \"24fe0942-1393-49bc-9a31-fa1469e4f530\") " pod="openshift-console/console-759769848-d8wsv" Jun 03 20:48:50.476650 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:50.476617 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:50.488576 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:50.488550 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-759769848-d8wsv" Jun 03 20:48:50.607760 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:50.607736 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-759769848-d8wsv"] Jun 03 20:48:50.609943 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:48:50.609920 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24fe0942_1393_49bc_9a31_fa1469e4f530.slice/crio-850bb11c04b51dc62086d87465fd35f7720aa23b13cc74c70b02c77b74f72bcb WatchSource:0}: Error finding container 850bb11c04b51dc62086d87465fd35f7720aa23b13cc74c70b02c77b74f72bcb: Status 404 returned error can't find the container with id 850bb11c04b51dc62086d87465fd35f7720aa23b13cc74c70b02c77b74f72bcb Jun 03 20:48:50.974188 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:50.974158 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:51.024172 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:51.024142 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:51.452301 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:51.452227 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-759769848-d8wsv" event={"ID":"24fe0942-1393-49bc-9a31-fa1469e4f530","Type":"ContainerStarted","Data":"808dbf2bed56a4864f6f82d5d158c6ed435f0dad68be9cd2198877deda549538"} Jun 03 20:48:51.452301 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:51.452270 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-759769848-d8wsv" event={"ID":"24fe0942-1393-49bc-9a31-fa1469e4f530","Type":"ContainerStarted","Data":"850bb11c04b51dc62086d87465fd35f7720aa23b13cc74c70b02c77b74f72bcb"} Jun 03 20:48:51.468745 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:51.468699 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-759769848-d8wsv" podStartSLOduration=1.4686838469999999 podStartE2EDuration="1.468683847s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:48:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:48:51.467514325 +0000 UTC m=+357.716924799" watchObservedRunningTime="2026-06-03 20:48:51.468683847 +0000 UTC m=+357.718094320" Jun 03 20:48:53.438439 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:53.438400 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:48:53.493507 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:48:53.493458 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:49:00.489548 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:49:00.489514 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-759769848-d8wsv" Jun 03 20:49:00.490007 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:49:00.489568 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-759769848-d8wsv" Jun 03 20:49:00.494034 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:49:00.494011 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-759769848-d8wsv" Jun 03 20:49:01.486245 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:49:01.486219 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-759769848-d8wsv" Jun 03 20:49:01.645615 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:49:01.645576 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:49:01.747218 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:49:01.747141 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:49:01.848064 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:49:01.848026 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:49:27.003529 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:49:27.003463 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:49:27.061949 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:49:27.061919 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:49:56.462812 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:49:56.462772 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:49:56.516658 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:49:56.516625 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:50:06.210041 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:06.209960 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:50:06.266351 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:06.266321 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:50:08.313287 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:08.313253 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:50:08.361164 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:08.361131 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:50:16.728162 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:16.728129 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-759769848-d8wsv"] Jun 03 20:50:16.829890 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:16.829853 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:50:16.881764 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:16.881736 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:50:16.933454 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:16.933425 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:50:20.377758 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:20.377720 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:50:20.477440 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:20.477399 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:50:20.679571 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:20.679504 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:50:25.626364 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:25.626329 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:50:41.747138 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:41.747093 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-759769848-d8wsv" podUID="24fe0942-1393-49bc-9a31-fa1469e4f530" containerName="console" containerID="cri-o://808dbf2bed56a4864f6f82d5d158c6ed435f0dad68be9cd2198877deda549538" gracePeriod=15 Jun 03 20:50:41.977410 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:41.977386 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-759769848-d8wsv" Jun 03 20:50:42.131180 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:42.131114 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/24fe0942-1393-49bc-9a31-fa1469e4f530-oauth-serving-cert\") pod \"24fe0942-1393-49bc-9a31-fa1469e4f530\" (UID: \"24fe0942-1393-49bc-9a31-fa1469e4f530\") " Jun 03 20:50:42.131180 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:42.131161 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/24fe0942-1393-49bc-9a31-fa1469e4f530-console-serving-cert\") pod \"24fe0942-1393-49bc-9a31-fa1469e4f530\" (UID: \"24fe0942-1393-49bc-9a31-fa1469e4f530\") " Jun 03 20:50:42.131369 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:42.131208 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/24fe0942-1393-49bc-9a31-fa1469e4f530-console-oauth-config\") pod \"24fe0942-1393-49bc-9a31-fa1469e4f530\" (UID: \"24fe0942-1393-49bc-9a31-fa1469e4f530\") " Jun 03 20:50:42.131369 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:42.131230 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5bvj\" (UniqueName: \"kubernetes.io/projected/24fe0942-1393-49bc-9a31-fa1469e4f530-kube-api-access-p5bvj\") pod \"24fe0942-1393-49bc-9a31-fa1469e4f530\" (UID: \"24fe0942-1393-49bc-9a31-fa1469e4f530\") " Jun 03 20:50:42.131369 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:42.131251 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24fe0942-1393-49bc-9a31-fa1469e4f530-trusted-ca-bundle\") pod \"24fe0942-1393-49bc-9a31-fa1469e4f530\" (UID: \"24fe0942-1393-49bc-9a31-fa1469e4f530\") " Jun 03 20:50:42.131369 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:42.131342 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/24fe0942-1393-49bc-9a31-fa1469e4f530-console-config\") pod \"24fe0942-1393-49bc-9a31-fa1469e4f530\" (UID: \"24fe0942-1393-49bc-9a31-fa1469e4f530\") " Jun 03 20:50:42.131580 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:42.131385 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/24fe0942-1393-49bc-9a31-fa1469e4f530-service-ca\") pod \"24fe0942-1393-49bc-9a31-fa1469e4f530\" (UID: \"24fe0942-1393-49bc-9a31-fa1469e4f530\") " Jun 03 20:50:42.131637 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:42.131587 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24fe0942-1393-49bc-9a31-fa1469e4f530-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "24fe0942-1393-49bc-9a31-fa1469e4f530" (UID: "24fe0942-1393-49bc-9a31-fa1469e4f530"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:50:42.131711 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:42.131685 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24fe0942-1393-49bc-9a31-fa1469e4f530-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "24fe0942-1393-49bc-9a31-fa1469e4f530" (UID: "24fe0942-1393-49bc-9a31-fa1469e4f530"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:50:42.131766 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:42.131707 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24fe0942-1393-49bc-9a31-fa1469e4f530-console-config" (OuterVolumeSpecName: "console-config") pod "24fe0942-1393-49bc-9a31-fa1469e4f530" (UID: "24fe0942-1393-49bc-9a31-fa1469e4f530"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:50:42.131914 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:42.131894 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24fe0942-1393-49bc-9a31-fa1469e4f530-service-ca" (OuterVolumeSpecName: "service-ca") pod "24fe0942-1393-49bc-9a31-fa1469e4f530" (UID: "24fe0942-1393-49bc-9a31-fa1469e4f530"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:50:42.133360 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:42.133324 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24fe0942-1393-49bc-9a31-fa1469e4f530-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "24fe0942-1393-49bc-9a31-fa1469e4f530" (UID: "24fe0942-1393-49bc-9a31-fa1469e4f530"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:50:42.133360 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:42.133350 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24fe0942-1393-49bc-9a31-fa1469e4f530-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "24fe0942-1393-49bc-9a31-fa1469e4f530" (UID: "24fe0942-1393-49bc-9a31-fa1469e4f530"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:50:42.133504 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:42.133387 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24fe0942-1393-49bc-9a31-fa1469e4f530-kube-api-access-p5bvj" (OuterVolumeSpecName: "kube-api-access-p5bvj") pod "24fe0942-1393-49bc-9a31-fa1469e4f530" (UID: "24fe0942-1393-49bc-9a31-fa1469e4f530"). InnerVolumeSpecName "kube-api-access-p5bvj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:50:42.232853 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:42.232835 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/24fe0942-1393-49bc-9a31-fa1469e4f530-console-oauth-config\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:50:42.232853 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:42.232854 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5bvj\" (UniqueName: \"kubernetes.io/projected/24fe0942-1393-49bc-9a31-fa1469e4f530-kube-api-access-p5bvj\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:50:42.232981 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:42.232863 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24fe0942-1393-49bc-9a31-fa1469e4f530-trusted-ca-bundle\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:50:42.232981 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:42.232872 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/24fe0942-1393-49bc-9a31-fa1469e4f530-console-config\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:50:42.232981 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:42.232881 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/24fe0942-1393-49bc-9a31-fa1469e4f530-service-ca\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:50:42.232981 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:42.232889 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/24fe0942-1393-49bc-9a31-fa1469e4f530-oauth-serving-cert\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:50:42.232981 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:42.232896 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/24fe0942-1393-49bc-9a31-fa1469e4f530-console-serving-cert\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:50:42.816065 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:42.816030 2573 generic.go:356] "Generic (PLEG): container finished" podID="24fe0942-1393-49bc-9a31-fa1469e4f530" containerID="808dbf2bed56a4864f6f82d5d158c6ed435f0dad68be9cd2198877deda549538" exitCode=0 Jun 03 20:50:42.816455 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:42.816079 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-759769848-d8wsv" Jun 03 20:50:42.816455 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:42.816094 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-759769848-d8wsv" event={"ID":"24fe0942-1393-49bc-9a31-fa1469e4f530","Type":"ContainerDied","Data":"808dbf2bed56a4864f6f82d5d158c6ed435f0dad68be9cd2198877deda549538"} Jun 03 20:50:42.816455 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:42.816133 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-759769848-d8wsv" event={"ID":"24fe0942-1393-49bc-9a31-fa1469e4f530","Type":"ContainerDied","Data":"850bb11c04b51dc62086d87465fd35f7720aa23b13cc74c70b02c77b74f72bcb"} Jun 03 20:50:42.816455 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:42.816151 2573 scope.go:117] "RemoveContainer" containerID="808dbf2bed56a4864f6f82d5d158c6ed435f0dad68be9cd2198877deda549538" Jun 03 20:50:42.823945 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:42.823927 2573 scope.go:117] "RemoveContainer" containerID="808dbf2bed56a4864f6f82d5d158c6ed435f0dad68be9cd2198877deda549538" Jun 03 20:50:42.824203 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:50:42.824182 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"808dbf2bed56a4864f6f82d5d158c6ed435f0dad68be9cd2198877deda549538\": container with ID starting with 808dbf2bed56a4864f6f82d5d158c6ed435f0dad68be9cd2198877deda549538 not found: ID does not exist" containerID="808dbf2bed56a4864f6f82d5d158c6ed435f0dad68be9cd2198877deda549538" Jun 03 20:50:42.824269 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:42.824209 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"808dbf2bed56a4864f6f82d5d158c6ed435f0dad68be9cd2198877deda549538"} err="failed to get container status \"808dbf2bed56a4864f6f82d5d158c6ed435f0dad68be9cd2198877deda549538\": rpc error: code = NotFound desc = could not find container \"808dbf2bed56a4864f6f82d5d158c6ed435f0dad68be9cd2198877deda549538\": container with ID starting with 808dbf2bed56a4864f6f82d5d158c6ed435f0dad68be9cd2198877deda549538 not found: ID does not exist" Jun 03 20:50:42.831582 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:42.831562 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-759769848-d8wsv"] Jun 03 20:50:42.835373 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:42.835353 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-759769848-d8wsv"] Jun 03 20:50:44.210452 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:44.210421 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24fe0942-1393-49bc-9a31-fa1469e4f530" path="/var/lib/kubelet/pods/24fe0942-1393-49bc-9a31-fa1469e4f530/volumes" Jun 03 20:50:49.069118 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:49.069090 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:50:49.160177 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:49.160143 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:50:49.641004 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:49.640976 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqwxgw"] Jun 03 20:50:49.641209 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:49.641198 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24fe0942-1393-49bc-9a31-fa1469e4f530" containerName="console" Jun 03 20:50:49.641250 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:49.641211 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="24fe0942-1393-49bc-9a31-fa1469e4f530" containerName="console" Jun 03 20:50:49.641250 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:49.641247 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="24fe0942-1393-49bc-9a31-fa1469e4f530" containerName="console" Jun 03 20:50:49.645413 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:49.645397 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqwxgw" Jun 03 20:50:49.648188 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:49.648163 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 20:50:49.649240 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:49.649221 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jq9ms\"" Jun 03 20:50:49.649339 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:49.649239 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 20:50:49.652363 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:49.652311 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqwxgw"] Jun 03 20:50:49.780775 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:49.780739 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb14a6bc-750f-44fd-bee0-5887a6f0e9a4-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqwxgw\" (UID: \"cb14a6bc-750f-44fd-bee0-5887a6f0e9a4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqwxgw" Jun 03 20:50:49.780931 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:49.780779 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kpdm\" (UniqueName: \"kubernetes.io/projected/cb14a6bc-750f-44fd-bee0-5887a6f0e9a4-kube-api-access-6kpdm\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqwxgw\" (UID: \"cb14a6bc-750f-44fd-bee0-5887a6f0e9a4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqwxgw" Jun 03 20:50:49.780931 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:49.780862 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb14a6bc-750f-44fd-bee0-5887a6f0e9a4-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqwxgw\" (UID: \"cb14a6bc-750f-44fd-bee0-5887a6f0e9a4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqwxgw" Jun 03 20:50:49.881760 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:49.881729 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb14a6bc-750f-44fd-bee0-5887a6f0e9a4-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqwxgw\" (UID: \"cb14a6bc-750f-44fd-bee0-5887a6f0e9a4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqwxgw" Jun 03 20:50:49.881891 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:49.881778 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb14a6bc-750f-44fd-bee0-5887a6f0e9a4-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqwxgw\" (UID: \"cb14a6bc-750f-44fd-bee0-5887a6f0e9a4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqwxgw" Jun 03 20:50:49.881936 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:49.881890 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kpdm\" (UniqueName: \"kubernetes.io/projected/cb14a6bc-750f-44fd-bee0-5887a6f0e9a4-kube-api-access-6kpdm\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqwxgw\" (UID: \"cb14a6bc-750f-44fd-bee0-5887a6f0e9a4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqwxgw" Jun 03 20:50:49.882067 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:49.882053 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb14a6bc-750f-44fd-bee0-5887a6f0e9a4-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqwxgw\" (UID: \"cb14a6bc-750f-44fd-bee0-5887a6f0e9a4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqwxgw" Jun 03 20:50:49.882107 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:49.882088 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb14a6bc-750f-44fd-bee0-5887a6f0e9a4-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqwxgw\" (UID: \"cb14a6bc-750f-44fd-bee0-5887a6f0e9a4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqwxgw" Jun 03 20:50:49.890304 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:49.890284 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kpdm\" (UniqueName: \"kubernetes.io/projected/cb14a6bc-750f-44fd-bee0-5887a6f0e9a4-kube-api-access-6kpdm\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqwxgw\" (UID: \"cb14a6bc-750f-44fd-bee0-5887a6f0e9a4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqwxgw" Jun 03 20:50:49.954322 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:49.954260 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqwxgw" Jun 03 20:50:50.073347 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:50.073324 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqwxgw"] Jun 03 20:50:50.075649 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:50:50.075621 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb14a6bc_750f_44fd_bee0_5887a6f0e9a4.slice/crio-88de31f331b678cb432e5f2e2ffe2fd43c1b0f3afa56ab9a4313435fc4eafe42 WatchSource:0}: Error finding container 88de31f331b678cb432e5f2e2ffe2fd43c1b0f3afa56ab9a4313435fc4eafe42: Status 404 returned error can't find the container with id 88de31f331b678cb432e5f2e2ffe2fd43c1b0f3afa56ab9a4313435fc4eafe42 Jun 03 20:50:50.077557 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:50.077537 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 20:50:50.846303 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:50.846261 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqwxgw" event={"ID":"cb14a6bc-750f-44fd-bee0-5887a6f0e9a4","Type":"ContainerStarted","Data":"88de31f331b678cb432e5f2e2ffe2fd43c1b0f3afa56ab9a4313435fc4eafe42"} Jun 03 20:50:51.650018 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:51.649978 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:50:55.866262 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:55.866229 2573 generic.go:356] "Generic (PLEG): container finished" podID="cb14a6bc-750f-44fd-bee0-5887a6f0e9a4" containerID="e7f0ae842cf5a8ff1e6ad970a088aeb7fc772680dabc57b47870ed3782c7641b" exitCode=0 Jun 03 20:50:55.866643 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:55.866274 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqwxgw" event={"ID":"cb14a6bc-750f-44fd-bee0-5887a6f0e9a4","Type":"ContainerDied","Data":"e7f0ae842cf5a8ff1e6ad970a088aeb7fc772680dabc57b47870ed3782c7641b"} Jun 03 20:50:56.352493 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:56.352448 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:50:56.405023 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:56.404989 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:50:56.871401 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:56.871333 2573 generic.go:356] "Generic (PLEG): container finished" podID="cb14a6bc-750f-44fd-bee0-5887a6f0e9a4" containerID="2deca962fcffeaa9b3d0da1959b08ae9de705cea0c5bda5d9a5341ecc68d502f" exitCode=0 Jun 03 20:50:56.871401 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:50:56.871386 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqwxgw" event={"ID":"cb14a6bc-750f-44fd-bee0-5887a6f0e9a4","Type":"ContainerDied","Data":"2deca962fcffeaa9b3d0da1959b08ae9de705cea0c5bda5d9a5341ecc68d502f"} Jun 03 20:51:03.899092 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:03.899057 2573 generic.go:356] "Generic (PLEG): container finished" podID="cb14a6bc-750f-44fd-bee0-5887a6f0e9a4" containerID="79a15b0f62d3e917c941d817510de7ea32d43da3aa660f3fc0feb0dc53c7e84c" exitCode=0 Jun 03 20:51:03.899092 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:03.899098 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqwxgw" event={"ID":"cb14a6bc-750f-44fd-bee0-5887a6f0e9a4","Type":"ContainerDied","Data":"79a15b0f62d3e917c941d817510de7ea32d43da3aa660f3fc0feb0dc53c7e84c"} Jun 03 20:51:05.020001 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:05.019974 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqwxgw" Jun 03 20:51:05.197908 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:05.197832 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb14a6bc-750f-44fd-bee0-5887a6f0e9a4-bundle\") pod \"cb14a6bc-750f-44fd-bee0-5887a6f0e9a4\" (UID: \"cb14a6bc-750f-44fd-bee0-5887a6f0e9a4\") " Jun 03 20:51:05.197908 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:05.197891 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb14a6bc-750f-44fd-bee0-5887a6f0e9a4-util\") pod \"cb14a6bc-750f-44fd-bee0-5887a6f0e9a4\" (UID: \"cb14a6bc-750f-44fd-bee0-5887a6f0e9a4\") " Jun 03 20:51:05.198123 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:05.197917 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kpdm\" (UniqueName: \"kubernetes.io/projected/cb14a6bc-750f-44fd-bee0-5887a6f0e9a4-kube-api-access-6kpdm\") pod \"cb14a6bc-750f-44fd-bee0-5887a6f0e9a4\" (UID: \"cb14a6bc-750f-44fd-bee0-5887a6f0e9a4\") " Jun 03 20:51:05.198524 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:05.198499 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb14a6bc-750f-44fd-bee0-5887a6f0e9a4-bundle" (OuterVolumeSpecName: "bundle") pod "cb14a6bc-750f-44fd-bee0-5887a6f0e9a4" (UID: "cb14a6bc-750f-44fd-bee0-5887a6f0e9a4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:51:05.200425 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:05.200393 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb14a6bc-750f-44fd-bee0-5887a6f0e9a4-kube-api-access-6kpdm" (OuterVolumeSpecName: "kube-api-access-6kpdm") pod "cb14a6bc-750f-44fd-bee0-5887a6f0e9a4" (UID: "cb14a6bc-750f-44fd-bee0-5887a6f0e9a4"). InnerVolumeSpecName "kube-api-access-6kpdm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:51:05.203069 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:05.203041 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb14a6bc-750f-44fd-bee0-5887a6f0e9a4-util" (OuterVolumeSpecName: "util") pod "cb14a6bc-750f-44fd-bee0-5887a6f0e9a4" (UID: "cb14a6bc-750f-44fd-bee0-5887a6f0e9a4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:51:05.299173 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:05.299149 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb14a6bc-750f-44fd-bee0-5887a6f0e9a4-util\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:51:05.299173 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:05.299169 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kpdm\" (UniqueName: \"kubernetes.io/projected/cb14a6bc-750f-44fd-bee0-5887a6f0e9a4-kube-api-access-6kpdm\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:51:05.299307 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:05.299179 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb14a6bc-750f-44fd-bee0-5887a6f0e9a4-bundle\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:51:05.907431 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:05.907400 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqwxgw" Jun 03 20:51:05.907431 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:05.907411 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqwxgw" event={"ID":"cb14a6bc-750f-44fd-bee0-5887a6f0e9a4","Type":"ContainerDied","Data":"88de31f331b678cb432e5f2e2ffe2fd43c1b0f3afa56ab9a4313435fc4eafe42"} Jun 03 20:51:05.907648 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:05.907508 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="88de31f331b678cb432e5f2e2ffe2fd43c1b0f3afa56ab9a4313435fc4eafe42" Jun 03 20:51:10.641252 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:10.641210 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:11.420990 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:11.420949 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:12.672723 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:12.672693 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-jffbt"] Jun 03 20:51:12.673088 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:12.672917 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb14a6bc-750f-44fd-bee0-5887a6f0e9a4" containerName="pull" Jun 03 20:51:12.673088 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:12.672927 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb14a6bc-750f-44fd-bee0-5887a6f0e9a4" containerName="pull" Jun 03 20:51:12.673088 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:12.672936 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb14a6bc-750f-44fd-bee0-5887a6f0e9a4" containerName="util" Jun 03 20:51:12.673088 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:12.672942 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb14a6bc-750f-44fd-bee0-5887a6f0e9a4" containerName="util" Jun 03 20:51:12.673088 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:12.672951 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb14a6bc-750f-44fd-bee0-5887a6f0e9a4" containerName="extract" Jun 03 20:51:12.673088 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:12.672957 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb14a6bc-750f-44fd-bee0-5887a6f0e9a4" containerName="extract" Jun 03 20:51:12.673088 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:12.672993 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb14a6bc-750f-44fd-bee0-5887a6f0e9a4" containerName="extract" Jun 03 20:51:12.689192 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:12.689161 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-jffbt"] Jun 03 20:51:12.689309 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:12.689271 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-jffbt" Jun 03 20:51:12.692023 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:12.692003 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 03 20:51:12.692136 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:12.692004 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-ghf5w\"" Jun 03 20:51:12.693020 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:12.693004 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 03 20:51:12.851964 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:12.851929 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a04194b-42f8-4920-98e6-64ae4d5ab2e1-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-jffbt\" (UID: \"9a04194b-42f8-4920-98e6-64ae4d5ab2e1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-jffbt" Jun 03 20:51:12.852138 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:12.851969 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w766\" (UniqueName: \"kubernetes.io/projected/9a04194b-42f8-4920-98e6-64ae4d5ab2e1-kube-api-access-2w766\") pod \"cert-manager-operator-controller-manager-57757f7cfc-jffbt\" (UID: \"9a04194b-42f8-4920-98e6-64ae4d5ab2e1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-jffbt" Jun 03 20:51:12.952306 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:12.952247 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a04194b-42f8-4920-98e6-64ae4d5ab2e1-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-jffbt\" (UID: \"9a04194b-42f8-4920-98e6-64ae4d5ab2e1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-jffbt" Jun 03 20:51:12.952306 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:12.952282 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2w766\" (UniqueName: \"kubernetes.io/projected/9a04194b-42f8-4920-98e6-64ae4d5ab2e1-kube-api-access-2w766\") pod \"cert-manager-operator-controller-manager-57757f7cfc-jffbt\" (UID: \"9a04194b-42f8-4920-98e6-64ae4d5ab2e1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-jffbt" Jun 03 20:51:12.952631 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:12.952612 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a04194b-42f8-4920-98e6-64ae4d5ab2e1-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-jffbt\" (UID: \"9a04194b-42f8-4920-98e6-64ae4d5ab2e1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-jffbt" Jun 03 20:51:12.965227 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:12.965200 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w766\" (UniqueName: \"kubernetes.io/projected/9a04194b-42f8-4920-98e6-64ae4d5ab2e1-kube-api-access-2w766\") pod \"cert-manager-operator-controller-manager-57757f7cfc-jffbt\" (UID: \"9a04194b-42f8-4920-98e6-64ae4d5ab2e1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-jffbt" Jun 03 20:51:12.998084 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:12.998062 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-jffbt" Jun 03 20:51:13.144118 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:13.144089 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-jffbt"] Jun 03 20:51:13.147453 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:51:13.147427 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a04194b_42f8_4920_98e6_64ae4d5ab2e1.slice/crio-1fabe95735e00ed5c5ac571770d5cf1947ae0bccd89e405943d010484d8b980a WatchSource:0}: Error finding container 1fabe95735e00ed5c5ac571770d5cf1947ae0bccd89e405943d010484d8b980a: Status 404 returned error can't find the container with id 1fabe95735e00ed5c5ac571770d5cf1947ae0bccd89e405943d010484d8b980a Jun 03 20:51:13.937020 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:13.936989 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-jffbt" event={"ID":"9a04194b-42f8-4920-98e6-64ae4d5ab2e1","Type":"ContainerStarted","Data":"1fabe95735e00ed5c5ac571770d5cf1947ae0bccd89e405943d010484d8b980a"} Jun 03 20:51:14.439178 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:14.439134 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:14.538310 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:14.538272 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:15.945398 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:15.945342 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-jffbt" event={"ID":"9a04194b-42f8-4920-98e6-64ae4d5ab2e1","Type":"ContainerStarted","Data":"4aa64225b127432c4683f4ef6843d7ff6518dcdadeffb1b602ac17e180953793"} Jun 03 20:51:15.978135 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:15.978081 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-jffbt" podStartSLOduration=1.8005207460000001 podStartE2EDuration="3.978065597s" totalImagesPullingTime="2.177544851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:51:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:51:15.975466632 +0000 UTC m=+502.224877104" watchObservedRunningTime="2026-06-03 20:51:15.978065597 +0000 UTC m=+502.227476071" Jun 03 20:51:16.042239 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:16.042200 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:16.147294 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:16.147261 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:16.434216 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:16.434184 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:16.545080 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:16.545050 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:17.045037 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:17.045006 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxp47p"] Jun 03 20:51:17.046868 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:17.046852 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxp47p" Jun 03 20:51:17.049649 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:17.049623 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 20:51:17.049753 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:17.049649 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 20:51:17.050568 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:17.050547 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jq9ms\"" Jun 03 20:51:17.058252 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:17.058234 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxp47p"] Jun 03 20:51:17.185791 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:17.185749 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09010f63-e112-4411-a5a3-cbcc904df4d4-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxp47p\" (UID: \"09010f63-e112-4411-a5a3-cbcc904df4d4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxp47p" Jun 03 20:51:17.185938 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:17.185814 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09010f63-e112-4411-a5a3-cbcc904df4d4-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxp47p\" (UID: \"09010f63-e112-4411-a5a3-cbcc904df4d4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxp47p" Jun 03 20:51:17.185938 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:17.185844 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9844r\" (UniqueName: \"kubernetes.io/projected/09010f63-e112-4411-a5a3-cbcc904df4d4-kube-api-access-9844r\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxp47p\" (UID: \"09010f63-e112-4411-a5a3-cbcc904df4d4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxp47p" Jun 03 20:51:17.286337 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:17.286300 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09010f63-e112-4411-a5a3-cbcc904df4d4-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxp47p\" (UID: \"09010f63-e112-4411-a5a3-cbcc904df4d4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxp47p" Jun 03 20:51:17.286462 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:17.286349 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09010f63-e112-4411-a5a3-cbcc904df4d4-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxp47p\" (UID: \"09010f63-e112-4411-a5a3-cbcc904df4d4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxp47p" Jun 03 20:51:17.286462 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:17.286372 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9844r\" (UniqueName: \"kubernetes.io/projected/09010f63-e112-4411-a5a3-cbcc904df4d4-kube-api-access-9844r\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxp47p\" (UID: \"09010f63-e112-4411-a5a3-cbcc904df4d4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxp47p" Jun 03 20:51:17.286727 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:17.286709 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09010f63-e112-4411-a5a3-cbcc904df4d4-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxp47p\" (UID: \"09010f63-e112-4411-a5a3-cbcc904df4d4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxp47p" Jun 03 20:51:17.286765 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:17.286732 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09010f63-e112-4411-a5a3-cbcc904df4d4-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxp47p\" (UID: \"09010f63-e112-4411-a5a3-cbcc904df4d4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxp47p" Jun 03 20:51:17.294058 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:17.294038 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9844r\" (UniqueName: \"kubernetes.io/projected/09010f63-e112-4411-a5a3-cbcc904df4d4-kube-api-access-9844r\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxp47p\" (UID: \"09010f63-e112-4411-a5a3-cbcc904df4d4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxp47p" Jun 03 20:51:17.355954 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:17.355887 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxp47p" Jun 03 20:51:17.471874 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:17.471845 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxp47p"] Jun 03 20:51:17.474257 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:51:17.474231 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09010f63_e112_4411_a5a3_cbcc904df4d4.slice/crio-8b6c385a5294efb23358fe99a17f98356946d059c8955056c92a9964f95b385b WatchSource:0}: Error finding container 8b6c385a5294efb23358fe99a17f98356946d059c8955056c92a9964f95b385b: Status 404 returned error can't find the container with id 8b6c385a5294efb23358fe99a17f98356946d059c8955056c92a9964f95b385b Jun 03 20:51:17.622935 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:17.622865 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:17.712679 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:17.712640 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:17.953630 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:17.953545 2573 generic.go:356] "Generic (PLEG): container finished" podID="09010f63-e112-4411-a5a3-cbcc904df4d4" containerID="f93818a87c2d531346905efbced63d92d5ff48b68bfb0de8ccc639807772533f" exitCode=0 Jun 03 20:51:17.953775 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:17.953644 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxp47p" event={"ID":"09010f63-e112-4411-a5a3-cbcc904df4d4","Type":"ContainerDied","Data":"f93818a87c2d531346905efbced63d92d5ff48b68bfb0de8ccc639807772533f"} Jun 03 20:51:17.953775 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:17.953707 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxp47p" event={"ID":"09010f63-e112-4411-a5a3-cbcc904df4d4","Type":"ContainerStarted","Data":"8b6c385a5294efb23358fe99a17f98356946d059c8955056c92a9964f95b385b"} Jun 03 20:51:19.334751 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:19.334699 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:19.920512 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:19.920456 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:20.967285 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:20.967256 2573 generic.go:356] "Generic (PLEG): container finished" podID="09010f63-e112-4411-a5a3-cbcc904df4d4" containerID="66259d75f09b98d57ab60e5528c0a1bbb8adad672c771cba37229fb0146a5bbc" exitCode=0 Jun 03 20:51:20.967656 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:20.967294 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxp47p" event={"ID":"09010f63-e112-4411-a5a3-cbcc904df4d4","Type":"ContainerDied","Data":"66259d75f09b98d57ab60e5528c0a1bbb8adad672c771cba37229fb0146a5bbc"} Jun 03 20:51:21.207954 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:21.207921 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:21.253340 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:21.253314 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-bl4jp"] Jun 03 20:51:21.255927 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:21.255911 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-bl4jp" Jun 03 20:51:21.258442 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:21.258425 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 03 20:51:21.258546 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:21.258481 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-6ch6s\"" Jun 03 20:51:21.258546 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:21.258506 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 03 20:51:21.266335 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:21.266313 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-bl4jp"] Jun 03 20:51:21.272548 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:21.272526 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:21.416313 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:21.416286 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e7c2c4a-0535-4232-af7b-80273d96b9cb-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-bl4jp\" (UID: \"4e7c2c4a-0535-4232-af7b-80273d96b9cb\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-bl4jp" Jun 03 20:51:21.416313 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:21.416315 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftf6m\" (UniqueName: \"kubernetes.io/projected/4e7c2c4a-0535-4232-af7b-80273d96b9cb-kube-api-access-ftf6m\") pod \"cert-manager-cainjector-5d99449ffd-bl4jp\" (UID: \"4e7c2c4a-0535-4232-af7b-80273d96b9cb\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-bl4jp" Jun 03 20:51:21.517577 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:21.517499 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e7c2c4a-0535-4232-af7b-80273d96b9cb-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-bl4jp\" (UID: \"4e7c2c4a-0535-4232-af7b-80273d96b9cb\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-bl4jp" Jun 03 20:51:21.517577 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:21.517536 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftf6m\" (UniqueName: \"kubernetes.io/projected/4e7c2c4a-0535-4232-af7b-80273d96b9cb-kube-api-access-ftf6m\") pod \"cert-manager-cainjector-5d99449ffd-bl4jp\" (UID: \"4e7c2c4a-0535-4232-af7b-80273d96b9cb\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-bl4jp" Jun 03 20:51:21.525777 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:21.525754 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e7c2c4a-0535-4232-af7b-80273d96b9cb-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-bl4jp\" (UID: \"4e7c2c4a-0535-4232-af7b-80273d96b9cb\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-bl4jp" Jun 03 20:51:21.525911 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:21.525895 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftf6m\" (UniqueName: \"kubernetes.io/projected/4e7c2c4a-0535-4232-af7b-80273d96b9cb-kube-api-access-ftf6m\") pod \"cert-manager-cainjector-5d99449ffd-bl4jp\" (UID: \"4e7c2c4a-0535-4232-af7b-80273d96b9cb\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-bl4jp" Jun 03 20:51:21.564654 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:21.564633 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-bl4jp" Jun 03 20:51:21.684400 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:21.684376 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-bl4jp"] Jun 03 20:51:21.686730 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:51:21.686705 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4e7c2c4a_0535_4232_af7b_80273d96b9cb.slice/crio-3b9136651538a9c4d8523000e19085cb560f849e91fb25ce701c1ba37fc82e01 WatchSource:0}: Error finding container 3b9136651538a9c4d8523000e19085cb560f849e91fb25ce701c1ba37fc82e01: Status 404 returned error can't find the container with id 3b9136651538a9c4d8523000e19085cb560f849e91fb25ce701c1ba37fc82e01 Jun 03 20:51:21.974035 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:21.974009 2573 generic.go:356] "Generic (PLEG): container finished" podID="09010f63-e112-4411-a5a3-cbcc904df4d4" containerID="22d5fa119d6b1cfba55ab537c944a1642a2781ec69ca37bbc10dc67cacc2f8bc" exitCode=0 Jun 03 20:51:21.974414 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:21.974095 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxp47p" event={"ID":"09010f63-e112-4411-a5a3-cbcc904df4d4","Type":"ContainerDied","Data":"22d5fa119d6b1cfba55ab537c944a1642a2781ec69ca37bbc10dc67cacc2f8bc"} Jun 03 20:51:21.975115 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:21.975096 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-bl4jp" event={"ID":"4e7c2c4a-0535-4232-af7b-80273d96b9cb","Type":"ContainerStarted","Data":"3b9136651538a9c4d8523000e19085cb560f849e91fb25ce701c1ba37fc82e01"} Jun 03 20:51:23.099703 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:23.099677 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxp47p" Jun 03 20:51:23.231912 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:23.231835 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09010f63-e112-4411-a5a3-cbcc904df4d4-util\") pod \"09010f63-e112-4411-a5a3-cbcc904df4d4\" (UID: \"09010f63-e112-4411-a5a3-cbcc904df4d4\") " Jun 03 20:51:23.232063 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:23.231945 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09010f63-e112-4411-a5a3-cbcc904df4d4-bundle\") pod \"09010f63-e112-4411-a5a3-cbcc904df4d4\" (UID: \"09010f63-e112-4411-a5a3-cbcc904df4d4\") " Jun 03 20:51:23.232063 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:23.231977 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9844r\" (UniqueName: \"kubernetes.io/projected/09010f63-e112-4411-a5a3-cbcc904df4d4-kube-api-access-9844r\") pod \"09010f63-e112-4411-a5a3-cbcc904df4d4\" (UID: \"09010f63-e112-4411-a5a3-cbcc904df4d4\") " Jun 03 20:51:23.232387 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:23.232349 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09010f63-e112-4411-a5a3-cbcc904df4d4-bundle" (OuterVolumeSpecName: "bundle") pod "09010f63-e112-4411-a5a3-cbcc904df4d4" (UID: "09010f63-e112-4411-a5a3-cbcc904df4d4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:51:23.234715 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:23.234681 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09010f63-e112-4411-a5a3-cbcc904df4d4-kube-api-access-9844r" (OuterVolumeSpecName: "kube-api-access-9844r") pod "09010f63-e112-4411-a5a3-cbcc904df4d4" (UID: "09010f63-e112-4411-a5a3-cbcc904df4d4"). InnerVolumeSpecName "kube-api-access-9844r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:51:23.237543 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:23.237513 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09010f63-e112-4411-a5a3-cbcc904df4d4-util" (OuterVolumeSpecName: "util") pod "09010f63-e112-4411-a5a3-cbcc904df4d4" (UID: "09010f63-e112-4411-a5a3-cbcc904df4d4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:51:23.333160 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:23.333129 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09010f63-e112-4411-a5a3-cbcc904df4d4-util\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:51:23.333160 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:23.333162 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09010f63-e112-4411-a5a3-cbcc904df4d4-bundle\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:51:23.333332 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:23.333176 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9844r\" (UniqueName: \"kubernetes.io/projected/09010f63-e112-4411-a5a3-cbcc904df4d4-kube-api-access-9844r\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:51:23.985314 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:23.985278 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxp47p" event={"ID":"09010f63-e112-4411-a5a3-cbcc904df4d4","Type":"ContainerDied","Data":"8b6c385a5294efb23358fe99a17f98356946d059c8955056c92a9964f95b385b"} Jun 03 20:51:23.985314 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:23.985301 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxp47p" Jun 03 20:51:23.985562 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:23.985335 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b6c385a5294efb23358fe99a17f98356946d059c8955056c92a9964f95b385b" Jun 03 20:51:24.990596 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:24.990563 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-bl4jp" event={"ID":"4e7c2c4a-0535-4232-af7b-80273d96b9cb","Type":"ContainerStarted","Data":"a9bdb5240939c5083b50cdefc1fbf660bf2cdc0b9098122a0d96ba982e197b86"} Jun 03 20:51:25.008391 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:25.008338 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-bl4jp" podStartSLOduration=0.825691168 podStartE2EDuration="4.008318455s" totalImagesPullingTime="3.182627287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:51:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:51:25.005973825 +0000 UTC m=+511.255384300" watchObservedRunningTime="2026-06-03 20:51:25.008318455 +0000 UTC m=+511.257728929" Jun 03 20:51:25.437514 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:25.437447 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:25.554902 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:25.554866 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:27.813169 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:27.813127 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:27.913287 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:27.913248 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:27.969561 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:27.969527 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:33.681799 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:33.681714 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:33.779605 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:33.779571 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:35.947057 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:35.947018 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:37.674171 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:37.674138 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4gwhh"] Jun 03 20:51:37.674530 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:37.674367 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09010f63-e112-4411-a5a3-cbcc904df4d4" containerName="pull" Jun 03 20:51:37.674530 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:37.674377 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="09010f63-e112-4411-a5a3-cbcc904df4d4" containerName="pull" Jun 03 20:51:37.674530 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:37.674388 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09010f63-e112-4411-a5a3-cbcc904df4d4" containerName="extract" Jun 03 20:51:37.674530 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:37.674393 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="09010f63-e112-4411-a5a3-cbcc904df4d4" containerName="extract" Jun 03 20:51:37.674530 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:37.674405 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09010f63-e112-4411-a5a3-cbcc904df4d4" containerName="util" Jun 03 20:51:37.674530 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:37.674410 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="09010f63-e112-4411-a5a3-cbcc904df4d4" containerName="util" Jun 03 20:51:37.674530 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:37.674452 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="09010f63-e112-4411-a5a3-cbcc904df4d4" containerName="extract" Jun 03 20:51:37.677324 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:37.677308 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4gwhh" Jun 03 20:51:37.679899 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:37.679879 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 20:51:37.680845 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:37.680827 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 20:51:37.680915 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:37.680868 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jq9ms\"" Jun 03 20:51:37.685609 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:37.685582 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4gwhh"] Jun 03 20:51:37.731908 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:37.731883 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhjf4\" (UniqueName: \"kubernetes.io/projected/79277704-eb03-498f-b561-8064073afb3f-kube-api-access-bhjf4\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4gwhh\" (UID: \"79277704-eb03-498f-b561-8064073afb3f\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4gwhh" Jun 03 20:51:37.732042 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:37.731925 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79277704-eb03-498f-b561-8064073afb3f-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4gwhh\" (UID: \"79277704-eb03-498f-b561-8064073afb3f\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4gwhh" Jun 03 20:51:37.732042 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:37.731948 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79277704-eb03-498f-b561-8064073afb3f-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4gwhh\" (UID: \"79277704-eb03-498f-b561-8064073afb3f\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4gwhh" Jun 03 20:51:37.832674 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:37.832642 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhjf4\" (UniqueName: \"kubernetes.io/projected/79277704-eb03-498f-b561-8064073afb3f-kube-api-access-bhjf4\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4gwhh\" (UID: \"79277704-eb03-498f-b561-8064073afb3f\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4gwhh" Jun 03 20:51:37.832803 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:37.832694 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79277704-eb03-498f-b561-8064073afb3f-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4gwhh\" (UID: \"79277704-eb03-498f-b561-8064073afb3f\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4gwhh" Jun 03 20:51:37.832878 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:37.832806 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79277704-eb03-498f-b561-8064073afb3f-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4gwhh\" (UID: \"79277704-eb03-498f-b561-8064073afb3f\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4gwhh" Jun 03 20:51:37.833003 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:37.832985 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79277704-eb03-498f-b561-8064073afb3f-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4gwhh\" (UID: \"79277704-eb03-498f-b561-8064073afb3f\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4gwhh" Jun 03 20:51:37.833050 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:37.833041 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79277704-eb03-498f-b561-8064073afb3f-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4gwhh\" (UID: \"79277704-eb03-498f-b561-8064073afb3f\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4gwhh" Jun 03 20:51:37.840635 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:37.840609 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhjf4\" (UniqueName: \"kubernetes.io/projected/79277704-eb03-498f-b561-8064073afb3f-kube-api-access-bhjf4\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4gwhh\" (UID: \"79277704-eb03-498f-b561-8064073afb3f\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4gwhh" Jun 03 20:51:37.987141 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:37.987103 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4gwhh" Jun 03 20:51:38.112162 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:38.112125 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4gwhh"] Jun 03 20:51:38.118156 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:51:38.118127 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79277704_eb03_498f_b561_8064073afb3f.slice/crio-4184ae13367c4267031fdcbf9b955c7af81a75be9bfc2c1284d90d08ca0d4f59 WatchSource:0}: Error finding container 4184ae13367c4267031fdcbf9b955c7af81a75be9bfc2c1284d90d08ca0d4f59: Status 404 returned error can't find the container with id 4184ae13367c4267031fdcbf9b955c7af81a75be9bfc2c1284d90d08ca0d4f59 Jun 03 20:51:39.045304 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:39.045272 2573 generic.go:356] "Generic (PLEG): container finished" podID="79277704-eb03-498f-b561-8064073afb3f" containerID="e5ecd538164b637a34a0c7437e14627cb59f1df1aebe01935b506d330701bb9e" exitCode=0 Jun 03 20:51:39.045681 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:39.045310 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4gwhh" event={"ID":"79277704-eb03-498f-b561-8064073afb3f","Type":"ContainerDied","Data":"e5ecd538164b637a34a0c7437e14627cb59f1df1aebe01935b506d330701bb9e"} Jun 03 20:51:39.045681 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:39.045345 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4gwhh" event={"ID":"79277704-eb03-498f-b561-8064073afb3f","Type":"ContainerStarted","Data":"4184ae13367c4267031fdcbf9b955c7af81a75be9bfc2c1284d90d08ca0d4f59"} Jun 03 20:51:40.050839 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:40.050809 2573 generic.go:356] "Generic (PLEG): container finished" podID="79277704-eb03-498f-b561-8064073afb3f" containerID="46df42886be58ce0fa1558e488cb9c9707f1f188888050ced1d439c2285a892d" exitCode=0 Jun 03 20:51:40.051190 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:40.050893 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4gwhh" event={"ID":"79277704-eb03-498f-b561-8064073afb3f","Type":"ContainerDied","Data":"46df42886be58ce0fa1558e488cb9c9707f1f188888050ced1d439c2285a892d"} Jun 03 20:51:41.056797 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:41.056752 2573 generic.go:356] "Generic (PLEG): container finished" podID="79277704-eb03-498f-b561-8064073afb3f" containerID="35351af81598f7cefcba0c28b5d8123729e7fb1cfb8e76c237fb24211ccf1ee5" exitCode=0 Jun 03 20:51:41.057253 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:41.056840 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4gwhh" event={"ID":"79277704-eb03-498f-b561-8064073afb3f","Type":"ContainerDied","Data":"35351af81598f7cefcba0c28b5d8123729e7fb1cfb8e76c237fb24211ccf1ee5"} Jun 03 20:51:42.182998 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:42.182974 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4gwhh" Jun 03 20:51:42.263795 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:42.263766 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhjf4\" (UniqueName: \"kubernetes.io/projected/79277704-eb03-498f-b561-8064073afb3f-kube-api-access-bhjf4\") pod \"79277704-eb03-498f-b561-8064073afb3f\" (UID: \"79277704-eb03-498f-b561-8064073afb3f\") " Jun 03 20:51:42.263908 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:42.263810 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79277704-eb03-498f-b561-8064073afb3f-bundle\") pod \"79277704-eb03-498f-b561-8064073afb3f\" (UID: \"79277704-eb03-498f-b561-8064073afb3f\") " Jun 03 20:51:42.263908 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:42.263876 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79277704-eb03-498f-b561-8064073afb3f-util\") pod \"79277704-eb03-498f-b561-8064073afb3f\" (UID: \"79277704-eb03-498f-b561-8064073afb3f\") " Jun 03 20:51:42.264658 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:42.264628 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79277704-eb03-498f-b561-8064073afb3f-bundle" (OuterVolumeSpecName: "bundle") pod "79277704-eb03-498f-b561-8064073afb3f" (UID: "79277704-eb03-498f-b561-8064073afb3f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:51:42.265711 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:42.265690 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79277704-eb03-498f-b561-8064073afb3f-kube-api-access-bhjf4" (OuterVolumeSpecName: "kube-api-access-bhjf4") pod "79277704-eb03-498f-b561-8064073afb3f" (UID: "79277704-eb03-498f-b561-8064073afb3f"). InnerVolumeSpecName "kube-api-access-bhjf4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:51:42.272340 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:42.272319 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79277704-eb03-498f-b561-8064073afb3f-util" (OuterVolumeSpecName: "util") pod "79277704-eb03-498f-b561-8064073afb3f" (UID: "79277704-eb03-498f-b561-8064073afb3f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:51:42.365186 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:42.365139 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79277704-eb03-498f-b561-8064073afb3f-bundle\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:51:42.365186 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:42.365157 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79277704-eb03-498f-b561-8064073afb3f-util\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:51:42.365186 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:42.365166 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhjf4\" (UniqueName: \"kubernetes.io/projected/79277704-eb03-498f-b561-8064073afb3f-kube-api-access-bhjf4\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:51:43.065612 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:43.065585 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4gwhh" Jun 03 20:51:43.065845 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:43.065587 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4gwhh" event={"ID":"79277704-eb03-498f-b561-8064073afb3f","Type":"ContainerDied","Data":"4184ae13367c4267031fdcbf9b955c7af81a75be9bfc2c1284d90d08ca0d4f59"} Jun 03 20:51:43.065845 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:43.065705 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4184ae13367c4267031fdcbf9b955c7af81a75be9bfc2c1284d90d08ca0d4f59" Jun 03 20:51:49.804312 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:49.804276 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:49.900836 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:49.900804 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:50.374432 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:50.374402 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:50.613468 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:50.613435 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:50.702284 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:50.702206 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:50.744585 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:50.744559 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-w2cb4"] Jun 03 20:51:50.744804 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:50.744793 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79277704-eb03-498f-b561-8064073afb3f" containerName="pull" Jun 03 20:51:50.744846 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:50.744806 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="79277704-eb03-498f-b561-8064073afb3f" containerName="pull" Jun 03 20:51:50.744846 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:50.744818 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79277704-eb03-498f-b561-8064073afb3f" containerName="util" Jun 03 20:51:50.744846 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:50.744824 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="79277704-eb03-498f-b561-8064073afb3f" containerName="util" Jun 03 20:51:50.744846 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:50.744836 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79277704-eb03-498f-b561-8064073afb3f" containerName="extract" Jun 03 20:51:50.744846 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:50.744842 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="79277704-eb03-498f-b561-8064073afb3f" containerName="extract" Jun 03 20:51:50.744989 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:50.744884 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="79277704-eb03-498f-b561-8064073afb3f" containerName="extract" Jun 03 20:51:50.750529 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:50.750512 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-w2cb4" Jun 03 20:51:50.755009 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:50.754983 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 20:51:50.755119 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:50.755047 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-vhlf2\"" Jun 03 20:51:50.755119 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:50.755108 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 20:51:50.755234 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:50.755162 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 20:51:50.758273 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:50.758255 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 20:51:50.774001 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:50.773977 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-w2cb4"] Jun 03 20:51:50.825630 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:50.825593 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aeba6bcf-a599-478e-afb3-2ac71f39a2c7-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fdd65c64b-w2cb4\" (UID: \"aeba6bcf-a599-478e-afb3-2ac71f39a2c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-w2cb4" Jun 03 20:51:50.825630 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:50.825633 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkkq7\" (UniqueName: \"kubernetes.io/projected/aeba6bcf-a599-478e-afb3-2ac71f39a2c7-kube-api-access-vkkq7\") pod \"opendatahub-operator-controller-manager-6fdd65c64b-w2cb4\" (UID: \"aeba6bcf-a599-478e-afb3-2ac71f39a2c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-w2cb4" Jun 03 20:51:50.826055 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:50.825666 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/aeba6bcf-a599-478e-afb3-2ac71f39a2c7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fdd65c64b-w2cb4\" (UID: \"aeba6bcf-a599-478e-afb3-2ac71f39a2c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-w2cb4" Jun 03 20:51:50.826055 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:50.825752 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/aeba6bcf-a599-478e-afb3-2ac71f39a2c7-manifests\") pod \"opendatahub-operator-controller-manager-6fdd65c64b-w2cb4\" (UID: \"aeba6bcf-a599-478e-afb3-2ac71f39a2c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-w2cb4" Jun 03 20:51:50.826055 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:50.825807 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aeba6bcf-a599-478e-afb3-2ac71f39a2c7-tmp\") pod \"opendatahub-operator-controller-manager-6fdd65c64b-w2cb4\" (UID: \"aeba6bcf-a599-478e-afb3-2ac71f39a2c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-w2cb4" Jun 03 20:51:50.903086 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:50.903048 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:50.927011 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:50.926946 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aeba6bcf-a599-478e-afb3-2ac71f39a2c7-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fdd65c64b-w2cb4\" (UID: \"aeba6bcf-a599-478e-afb3-2ac71f39a2c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-w2cb4" Jun 03 20:51:50.927011 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:50.926978 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkkq7\" (UniqueName: \"kubernetes.io/projected/aeba6bcf-a599-478e-afb3-2ac71f39a2c7-kube-api-access-vkkq7\") pod \"opendatahub-operator-controller-manager-6fdd65c64b-w2cb4\" (UID: \"aeba6bcf-a599-478e-afb3-2ac71f39a2c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-w2cb4" Jun 03 20:51:50.927011 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:50.927003 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/aeba6bcf-a599-478e-afb3-2ac71f39a2c7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fdd65c64b-w2cb4\" (UID: \"aeba6bcf-a599-478e-afb3-2ac71f39a2c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-w2cb4" Jun 03 20:51:50.927011 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:50.927037 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/aeba6bcf-a599-478e-afb3-2ac71f39a2c7-manifests\") pod \"opendatahub-operator-controller-manager-6fdd65c64b-w2cb4\" (UID: \"aeba6bcf-a599-478e-afb3-2ac71f39a2c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-w2cb4" Jun 03 20:51:50.927451 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:50.927074 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aeba6bcf-a599-478e-afb3-2ac71f39a2c7-tmp\") pod \"opendatahub-operator-controller-manager-6fdd65c64b-w2cb4\" (UID: \"aeba6bcf-a599-478e-afb3-2ac71f39a2c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-w2cb4" Jun 03 20:51:50.927602 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:50.927570 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/aeba6bcf-a599-478e-afb3-2ac71f39a2c7-manifests\") pod \"opendatahub-operator-controller-manager-6fdd65c64b-w2cb4\" (UID: \"aeba6bcf-a599-478e-afb3-2ac71f39a2c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-w2cb4" Jun 03 20:51:50.929450 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:50.929424 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aeba6bcf-a599-478e-afb3-2ac71f39a2c7-tmp\") pod \"opendatahub-operator-controller-manager-6fdd65c64b-w2cb4\" (UID: \"aeba6bcf-a599-478e-afb3-2ac71f39a2c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-w2cb4" Jun 03 20:51:50.929951 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:50.929926 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aeba6bcf-a599-478e-afb3-2ac71f39a2c7-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fdd65c64b-w2cb4\" (UID: \"aeba6bcf-a599-478e-afb3-2ac71f39a2c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-w2cb4" Jun 03 20:51:50.930042 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:50.929960 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/aeba6bcf-a599-478e-afb3-2ac71f39a2c7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fdd65c64b-w2cb4\" (UID: \"aeba6bcf-a599-478e-afb3-2ac71f39a2c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-w2cb4" Jun 03 20:51:50.935764 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:50.935727 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkkq7\" (UniqueName: \"kubernetes.io/projected/aeba6bcf-a599-478e-afb3-2ac71f39a2c7-kube-api-access-vkkq7\") pod \"opendatahub-operator-controller-manager-6fdd65c64b-w2cb4\" (UID: \"aeba6bcf-a599-478e-afb3-2ac71f39a2c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-w2cb4" Jun 03 20:51:51.000717 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:51.000676 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:51.060887 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:51.060857 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-w2cb4" Jun 03 20:51:51.109833 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:51.109780 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:51.197847 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:51.197822 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-w2cb4"] Jun 03 20:51:51.200598 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:51:51.200564 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeba6bcf_a599_478e_afb3_2ac71f39a2c7.slice/crio-91baf4981affa91bd08ad50aa22e9a9d810ba7d4607cadae4bb7163dd54f8c84 WatchSource:0}: Error finding container 91baf4981affa91bd08ad50aa22e9a9d810ba7d4607cadae4bb7163dd54f8c84: Status 404 returned error can't find the container with id 91baf4981affa91bd08ad50aa22e9a9d810ba7d4607cadae4bb7163dd54f8c84 Jun 03 20:51:51.201404 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:51.201375 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:51.284086 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:51.284001 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:51.399565 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:51.399532 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:51:52.101629 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:52.101556 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-w2cb4" event={"ID":"aeba6bcf-a599-478e-afb3-2ac71f39a2c7","Type":"ContainerStarted","Data":"91baf4981affa91bd08ad50aa22e9a9d810ba7d4607cadae4bb7163dd54f8c84"} Jun 03 20:51:54.111508 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:54.111413 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-w2cb4" event={"ID":"aeba6bcf-a599-478e-afb3-2ac71f39a2c7","Type":"ContainerStarted","Data":"9112ef6ee617df5f582a961e8879708c1736c550732a5132e9092c8257bc4919"} Jun 03 20:51:55.116961 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:55.116884 2573 generic.go:356] "Generic (PLEG): container finished" podID="aeba6bcf-a599-478e-afb3-2ac71f39a2c7" containerID="9112ef6ee617df5f582a961e8879708c1736c550732a5132e9092c8257bc4919" exitCode=0 Jun 03 20:51:55.117344 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:55.116964 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-w2cb4" event={"ID":"aeba6bcf-a599-478e-afb3-2ac71f39a2c7","Type":"ContainerDied","Data":"9112ef6ee617df5f582a961e8879708c1736c550732a5132e9092c8257bc4919"} Jun 03 20:51:56.122623 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:56.122581 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-w2cb4" event={"ID":"aeba6bcf-a599-478e-afb3-2ac71f39a2c7","Type":"ContainerStarted","Data":"9b5c2900f73b3a3b306b007613eb18173468804d346d9b2894c6307351d25488"} Jun 03 20:51:56.123007 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:56.122688 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-w2cb4" Jun 03 20:51:56.147152 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:51:56.147102 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-w2cb4" podStartSLOduration=2.287847362 podStartE2EDuration="6.147086537s" totalImagesPullingTime="2.953892867s" totalInitContainerRuntime="905.346308ms" isStatefulPod=false podCreationTimestamp="2026-06-03 20:51:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:51:56.146031429 +0000 UTC m=+542.395441895" watchObservedRunningTime="2026-06-03 20:51:56.147086537 +0000 UTC m=+542.396497008" Jun 03 20:52:02.167381 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:02.167348 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:02.269817 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:02.269779 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:07.129266 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:07.129233 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-w2cb4" Jun 03 20:52:08.796598 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:08.796567 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:09.016720 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:09.016683 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:09.197859 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:09.197777 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:09.325970 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:09.325935 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:09.344340 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:09.344313 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-79b6b976dd-2j6k2"] Jun 03 20:52:09.347800 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:09.347776 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-79b6b976dd-2j6k2" Jun 03 20:52:09.352748 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:09.352723 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 20:52:09.352887 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:09.352787 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 03 20:52:09.353622 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:09.353605 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 03 20:52:09.355808 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:09.355787 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 20:52:09.371455 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:09.371424 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-79b6b976dd-2j6k2"] Jun 03 20:52:09.455848 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:09.455772 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdf1f347-6cef-4716-8ffd-5bc818c3fbf7-tls-certs\") pod \"kube-auth-proxy-79b6b976dd-2j6k2\" (UID: \"bdf1f347-6cef-4716-8ffd-5bc818c3fbf7\") " pod="openshift-ingress/kube-auth-proxy-79b6b976dd-2j6k2" Jun 03 20:52:09.455848 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:09.455819 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl6zk\" (UniqueName: \"kubernetes.io/projected/bdf1f347-6cef-4716-8ffd-5bc818c3fbf7-kube-api-access-xl6zk\") pod \"kube-auth-proxy-79b6b976dd-2j6k2\" (UID: \"bdf1f347-6cef-4716-8ffd-5bc818c3fbf7\") " pod="openshift-ingress/kube-auth-proxy-79b6b976dd-2j6k2" Jun 03 20:52:09.455848 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:09.455847 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bdf1f347-6cef-4716-8ffd-5bc818c3fbf7-tmp\") pod \"kube-auth-proxy-79b6b976dd-2j6k2\" (UID: \"bdf1f347-6cef-4716-8ffd-5bc818c3fbf7\") " pod="openshift-ingress/kube-auth-proxy-79b6b976dd-2j6k2" Jun 03 20:52:09.457534 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:09.457503 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:09.544378 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:09.544349 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-45mf7"] Jun 03 20:52:09.547609 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:09.547592 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-45mf7" Jun 03 20:52:09.550699 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:09.550677 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 03 20:52:09.551695 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:09.551678 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-hkw4j\"" Jun 03 20:52:09.556267 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:09.556242 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdf1f347-6cef-4716-8ffd-5bc818c3fbf7-tls-certs\") pod \"kube-auth-proxy-79b6b976dd-2j6k2\" (UID: \"bdf1f347-6cef-4716-8ffd-5bc818c3fbf7\") " pod="openshift-ingress/kube-auth-proxy-79b6b976dd-2j6k2" Jun 03 20:52:09.556349 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:09.556273 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xl6zk\" (UniqueName: \"kubernetes.io/projected/bdf1f347-6cef-4716-8ffd-5bc818c3fbf7-kube-api-access-xl6zk\") pod \"kube-auth-proxy-79b6b976dd-2j6k2\" (UID: \"bdf1f347-6cef-4716-8ffd-5bc818c3fbf7\") " pod="openshift-ingress/kube-auth-proxy-79b6b976dd-2j6k2" Jun 03 20:52:09.556349 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:09.556296 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bdf1f347-6cef-4716-8ffd-5bc818c3fbf7-tmp\") pod \"kube-auth-proxy-79b6b976dd-2j6k2\" (UID: \"bdf1f347-6cef-4716-8ffd-5bc818c3fbf7\") " pod="openshift-ingress/kube-auth-proxy-79b6b976dd-2j6k2" Jun 03 20:52:09.558725 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:09.558701 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bdf1f347-6cef-4716-8ffd-5bc818c3fbf7-tmp\") pod \"kube-auth-proxy-79b6b976dd-2j6k2\" (UID: \"bdf1f347-6cef-4716-8ffd-5bc818c3fbf7\") " pod="openshift-ingress/kube-auth-proxy-79b6b976dd-2j6k2" Jun 03 20:52:09.559008 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:09.558979 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdf1f347-6cef-4716-8ffd-5bc818c3fbf7-tls-certs\") pod \"kube-auth-proxy-79b6b976dd-2j6k2\" (UID: \"bdf1f347-6cef-4716-8ffd-5bc818c3fbf7\") " pod="openshift-ingress/kube-auth-proxy-79b6b976dd-2j6k2" Jun 03 20:52:09.568069 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:09.568041 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-45mf7"] Jun 03 20:52:09.580193 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:09.580164 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl6zk\" (UniqueName: \"kubernetes.io/projected/bdf1f347-6cef-4716-8ffd-5bc818c3fbf7-kube-api-access-xl6zk\") pod \"kube-auth-proxy-79b6b976dd-2j6k2\" (UID: \"bdf1f347-6cef-4716-8ffd-5bc818c3fbf7\") " pod="openshift-ingress/kube-auth-proxy-79b6b976dd-2j6k2" Jun 03 20:52:09.604847 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:09.604814 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:09.656679 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:09.656646 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgt2b\" (UniqueName: \"kubernetes.io/projected/ad210e1a-bd68-4eec-84b0-ff8ba1246fb4-kube-api-access-mgt2b\") pod \"odh-model-controller-6dc94f689f-45mf7\" (UID: \"ad210e1a-bd68-4eec-84b0-ff8ba1246fb4\") " pod="opendatahub/odh-model-controller-6dc94f689f-45mf7" Jun 03 20:52:09.656826 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:09.656761 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad210e1a-bd68-4eec-84b0-ff8ba1246fb4-cert\") pod \"odh-model-controller-6dc94f689f-45mf7\" (UID: \"ad210e1a-bd68-4eec-84b0-ff8ba1246fb4\") " pod="opendatahub/odh-model-controller-6dc94f689f-45mf7" Jun 03 20:52:09.658574 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:09.658555 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-79b6b976dd-2j6k2" Jun 03 20:52:09.736465 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:09.736433 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:09.757734 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:09.757697 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad210e1a-bd68-4eec-84b0-ff8ba1246fb4-cert\") pod \"odh-model-controller-6dc94f689f-45mf7\" (UID: \"ad210e1a-bd68-4eec-84b0-ff8ba1246fb4\") " pod="opendatahub/odh-model-controller-6dc94f689f-45mf7" Jun 03 20:52:09.757734 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:09.757745 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgt2b\" (UniqueName: \"kubernetes.io/projected/ad210e1a-bd68-4eec-84b0-ff8ba1246fb4-kube-api-access-mgt2b\") pod \"odh-model-controller-6dc94f689f-45mf7\" (UID: \"ad210e1a-bd68-4eec-84b0-ff8ba1246fb4\") " pod="opendatahub/odh-model-controller-6dc94f689f-45mf7" Jun 03 20:52:09.757967 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:52:09.757877 2573 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 03 20:52:09.757967 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:52:09.757955 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad210e1a-bd68-4eec-84b0-ff8ba1246fb4-cert podName:ad210e1a-bd68-4eec-84b0-ff8ba1246fb4 nodeName:}" failed. No retries permitted until 2026-06-03 20:52:10.257934197 +0000 UTC m=+556.507344655 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ad210e1a-bd68-4eec-84b0-ff8ba1246fb4-cert") pod "odh-model-controller-6dc94f689f-45mf7" (UID: "ad210e1a-bd68-4eec-84b0-ff8ba1246fb4") : secret "odh-model-controller-webhook-cert" not found Jun 03 20:52:09.786637 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:09.786605 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgt2b\" (UniqueName: \"kubernetes.io/projected/ad210e1a-bd68-4eec-84b0-ff8ba1246fb4-kube-api-access-mgt2b\") pod \"odh-model-controller-6dc94f689f-45mf7\" (UID: \"ad210e1a-bd68-4eec-84b0-ff8ba1246fb4\") " pod="opendatahub/odh-model-controller-6dc94f689f-45mf7" Jun 03 20:52:09.803107 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:09.803082 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-79b6b976dd-2j6k2"] Jun 03 20:52:09.804866 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:52:09.804839 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdf1f347_6cef_4716_8ffd_5bc818c3fbf7.slice/crio-d55ac027a96347dd9645bfc4cc8388cb1b8a2114c84e62e23640e72970cff33f WatchSource:0}: Error finding container d55ac027a96347dd9645bfc4cc8388cb1b8a2114c84e62e23640e72970cff33f: Status 404 returned error can't find the container with id d55ac027a96347dd9645bfc4cc8388cb1b8a2114c84e62e23640e72970cff33f Jun 03 20:52:09.838181 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:09.838144 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:10.182503 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:10.182435 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-79b6b976dd-2j6k2" event={"ID":"bdf1f347-6cef-4716-8ffd-5bc818c3fbf7","Type":"ContainerStarted","Data":"d55ac027a96347dd9645bfc4cc8388cb1b8a2114c84e62e23640e72970cff33f"} Jun 03 20:52:10.262521 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:10.262458 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad210e1a-bd68-4eec-84b0-ff8ba1246fb4-cert\") pod \"odh-model-controller-6dc94f689f-45mf7\" (UID: \"ad210e1a-bd68-4eec-84b0-ff8ba1246fb4\") " pod="opendatahub/odh-model-controller-6dc94f689f-45mf7" Jun 03 20:52:10.262697 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:52:10.262588 2573 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 03 20:52:10.262697 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:52:10.262663 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad210e1a-bd68-4eec-84b0-ff8ba1246fb4-cert podName:ad210e1a-bd68-4eec-84b0-ff8ba1246fb4 nodeName:}" failed. No retries permitted until 2026-06-03 20:52:11.262642878 +0000 UTC m=+557.512053343 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ad210e1a-bd68-4eec-84b0-ff8ba1246fb4-cert") pod "odh-model-controller-6dc94f689f-45mf7" (UID: "ad210e1a-bd68-4eec-84b0-ff8ba1246fb4") : secret "odh-model-controller-webhook-cert" not found Jun 03 20:52:10.383257 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:10.382278 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-cvzlp"] Jun 03 20:52:10.386905 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:10.386747 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:10.400827 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:10.400801 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-cvzlp"] Jun 03 20:52:10.400941 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:10.400910 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-cvzlp" Jun 03 20:52:10.403691 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:10.403497 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 03 20:52:10.464250 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:10.464161 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b5bdcae-8bfe-4228-9a2b-13c944d71483-tls-certs\") pod \"model-serving-api-5dd488fc48-cvzlp\" (UID: \"8b5bdcae-8bfe-4228-9a2b-13c944d71483\") " pod="opendatahub/model-serving-api-5dd488fc48-cvzlp" Jun 03 20:52:10.464415 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:10.464286 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f97vn\" (UniqueName: \"kubernetes.io/projected/8b5bdcae-8bfe-4228-9a2b-13c944d71483-kube-api-access-f97vn\") pod \"model-serving-api-5dd488fc48-cvzlp\" (UID: \"8b5bdcae-8bfe-4228-9a2b-13c944d71483\") " pod="opendatahub/model-serving-api-5dd488fc48-cvzlp" Jun 03 20:52:10.511532 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:10.511448 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:10.565535 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:10.565500 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b5bdcae-8bfe-4228-9a2b-13c944d71483-tls-certs\") pod \"model-serving-api-5dd488fc48-cvzlp\" (UID: \"8b5bdcae-8bfe-4228-9a2b-13c944d71483\") " pod="opendatahub/model-serving-api-5dd488fc48-cvzlp" Jun 03 20:52:10.565712 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:10.565578 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f97vn\" (UniqueName: \"kubernetes.io/projected/8b5bdcae-8bfe-4228-9a2b-13c944d71483-kube-api-access-f97vn\") pod \"model-serving-api-5dd488fc48-cvzlp\" (UID: \"8b5bdcae-8bfe-4228-9a2b-13c944d71483\") " pod="opendatahub/model-serving-api-5dd488fc48-cvzlp" Jun 03 20:52:10.572062 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:10.572038 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b5bdcae-8bfe-4228-9a2b-13c944d71483-tls-certs\") pod \"model-serving-api-5dd488fc48-cvzlp\" (UID: \"8b5bdcae-8bfe-4228-9a2b-13c944d71483\") " pod="opendatahub/model-serving-api-5dd488fc48-cvzlp" Jun 03 20:52:10.576539 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:10.576506 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f97vn\" (UniqueName: \"kubernetes.io/projected/8b5bdcae-8bfe-4228-9a2b-13c944d71483-kube-api-access-f97vn\") pod \"model-serving-api-5dd488fc48-cvzlp\" (UID: \"8b5bdcae-8bfe-4228-9a2b-13c944d71483\") " pod="opendatahub/model-serving-api-5dd488fc48-cvzlp" Jun 03 20:52:10.612434 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:10.612404 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:10.716009 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:10.715926 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-cvzlp" Jun 03 20:52:10.886383 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:10.886356 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-cvzlp"] Jun 03 20:52:10.888135 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:52:10.888104 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b5bdcae_8bfe_4228_9a2b_13c944d71483.slice/crio-f2027b592b2243ea80960cfec6d34eefde5f922a54cbdf342754a9fc81ae5e60 WatchSource:0}: Error finding container f2027b592b2243ea80960cfec6d34eefde5f922a54cbdf342754a9fc81ae5e60: Status 404 returned error can't find the container with id f2027b592b2243ea80960cfec6d34eefde5f922a54cbdf342754a9fc81ae5e60 Jun 03 20:52:11.166563 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:11.166523 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068hm77"] Jun 03 20:52:11.176156 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:11.176127 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068hm77" Jun 03 20:52:11.179096 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:11.179037 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068hm77"] Jun 03 20:52:11.180210 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:11.179979 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 20:52:11.180210 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:11.180053 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jq9ms\"" Jun 03 20:52:11.181926 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:11.181166 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 20:52:11.190312 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:11.190282 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-cvzlp" event={"ID":"8b5bdcae-8bfe-4228-9a2b-13c944d71483","Type":"ContainerStarted","Data":"f2027b592b2243ea80960cfec6d34eefde5f922a54cbdf342754a9fc81ae5e60"} Jun 03 20:52:11.272323 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:11.272284 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4267085b-86df-4c45-a833-4eeff49378f8-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068hm77\" (UID: \"4267085b-86df-4c45-a833-4eeff49378f8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068hm77" Jun 03 20:52:11.272518 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:11.272361 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds9zt\" (UniqueName: \"kubernetes.io/projected/4267085b-86df-4c45-a833-4eeff49378f8-kube-api-access-ds9zt\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068hm77\" (UID: \"4267085b-86df-4c45-a833-4eeff49378f8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068hm77" Jun 03 20:52:11.272518 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:11.272434 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad210e1a-bd68-4eec-84b0-ff8ba1246fb4-cert\") pod \"odh-model-controller-6dc94f689f-45mf7\" (UID: \"ad210e1a-bd68-4eec-84b0-ff8ba1246fb4\") " pod="opendatahub/odh-model-controller-6dc94f689f-45mf7" Jun 03 20:52:11.272518 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:11.272467 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4267085b-86df-4c45-a833-4eeff49378f8-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068hm77\" (UID: \"4267085b-86df-4c45-a833-4eeff49378f8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068hm77" Jun 03 20:52:11.275235 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:11.275210 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad210e1a-bd68-4eec-84b0-ff8ba1246fb4-cert\") pod \"odh-model-controller-6dc94f689f-45mf7\" (UID: \"ad210e1a-bd68-4eec-84b0-ff8ba1246fb4\") " pod="opendatahub/odh-model-controller-6dc94f689f-45mf7" Jun 03 20:52:11.360214 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:11.360176 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-45mf7" Jun 03 20:52:11.373535 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:11.373509 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4267085b-86df-4c45-a833-4eeff49378f8-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068hm77\" (UID: \"4267085b-86df-4c45-a833-4eeff49378f8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068hm77" Jun 03 20:52:11.373684 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:11.373573 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds9zt\" (UniqueName: \"kubernetes.io/projected/4267085b-86df-4c45-a833-4eeff49378f8-kube-api-access-ds9zt\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068hm77\" (UID: \"4267085b-86df-4c45-a833-4eeff49378f8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068hm77" Jun 03 20:52:11.373684 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:11.373631 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4267085b-86df-4c45-a833-4eeff49378f8-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068hm77\" (UID: \"4267085b-86df-4c45-a833-4eeff49378f8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068hm77" Jun 03 20:52:11.373938 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:11.373913 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4267085b-86df-4c45-a833-4eeff49378f8-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068hm77\" (UID: \"4267085b-86df-4c45-a833-4eeff49378f8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068hm77" Jun 03 20:52:11.374000 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:11.373925 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4267085b-86df-4c45-a833-4eeff49378f8-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068hm77\" (UID: \"4267085b-86df-4c45-a833-4eeff49378f8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068hm77" Jun 03 20:52:11.382439 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:11.382417 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds9zt\" (UniqueName: \"kubernetes.io/projected/4267085b-86df-4c45-a833-4eeff49378f8-kube-api-access-ds9zt\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068hm77\" (UID: \"4267085b-86df-4c45-a833-4eeff49378f8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068hm77" Jun 03 20:52:11.491042 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:11.491007 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068hm77" Jun 03 20:52:12.494397 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:12.494360 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-45mf7"] Jun 03 20:52:12.496645 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:52:12.496616 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad210e1a_bd68_4eec_84b0_ff8ba1246fb4.slice/crio-c214cb9ef92ca51958bb6922c3dc19566d87021436222f7aa77503b9707e93a1 WatchSource:0}: Error finding container c214cb9ef92ca51958bb6922c3dc19566d87021436222f7aa77503b9707e93a1: Status 404 returned error can't find the container with id c214cb9ef92ca51958bb6922c3dc19566d87021436222f7aa77503b9707e93a1 Jun 03 20:52:12.514825 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:12.514794 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068hm77"] Jun 03 20:52:12.517078 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:52:12.517055 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4267085b_86df_4c45_a833_4eeff49378f8.slice/crio-49019adf7edef56c830bab82af4038bf1fcf5a2a940b111dc04b4da3ca8633ae WatchSource:0}: Error finding container 49019adf7edef56c830bab82af4038bf1fcf5a2a940b111dc04b4da3ca8633ae: Status 404 returned error can't find the container with id 49019adf7edef56c830bab82af4038bf1fcf5a2a940b111dc04b4da3ca8633ae Jun 03 20:52:13.202895 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:13.202811 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-45mf7" event={"ID":"ad210e1a-bd68-4eec-84b0-ff8ba1246fb4","Type":"ContainerStarted","Data":"c214cb9ef92ca51958bb6922c3dc19566d87021436222f7aa77503b9707e93a1"} Jun 03 20:52:13.205496 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:13.204887 2573 generic.go:356] "Generic (PLEG): container finished" podID="4267085b-86df-4c45-a833-4eeff49378f8" containerID="a0f999b3b1204309fb4364c80d278b9348507aabc87fcc5b613a4e25e7343adc" exitCode=0 Jun 03 20:52:13.205496 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:13.204967 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068hm77" event={"ID":"4267085b-86df-4c45-a833-4eeff49378f8","Type":"ContainerDied","Data":"a0f999b3b1204309fb4364c80d278b9348507aabc87fcc5b613a4e25e7343adc"} Jun 03 20:52:13.205496 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:13.205006 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068hm77" event={"ID":"4267085b-86df-4c45-a833-4eeff49378f8","Type":"ContainerStarted","Data":"49019adf7edef56c830bab82af4038bf1fcf5a2a940b111dc04b4da3ca8633ae"} Jun 03 20:52:13.207844 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:13.207720 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-79b6b976dd-2j6k2" event={"ID":"bdf1f347-6cef-4716-8ffd-5bc818c3fbf7","Type":"ContainerStarted","Data":"75dfc3879d923c6d2df35dfbcd2fa386f2f30cfc1f40019fb8b28730d9d26543"} Jun 03 20:52:14.214063 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:14.213982 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-cvzlp" event={"ID":"8b5bdcae-8bfe-4228-9a2b-13c944d71483","Type":"ContainerStarted","Data":"815c09f12bdf2925db01d80faf1f1195e48c810f548b2260c871a15f4fa5e31e"} Jun 03 20:52:14.214487 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:14.214059 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-cvzlp" Jun 03 20:52:14.215926 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:14.215900 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068hm77" event={"ID":"4267085b-86df-4c45-a833-4eeff49378f8","Type":"ContainerStarted","Data":"62aca35a2805ae8af72890d554038f0cbf1e0b9c6f9ca6a762c54787195f7377"} Jun 03 20:52:14.237149 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:14.237101 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-cvzlp" podStartSLOduration=1.70914578 podStartE2EDuration="4.237086386s" totalImagesPullingTime="2.527940606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:52:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:52:14.235194967 +0000 UTC m=+560.484605445" watchObservedRunningTime="2026-06-03 20:52:14.237086386 +0000 UTC m=+560.486496860" Jun 03 20:52:14.237467 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:14.237433 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-79b6b976dd-2j6k2" podStartSLOduration=2.652054774 podStartE2EDuration="5.23741779s" totalImagesPullingTime="2.585363016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:52:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:52:13.27771537 +0000 UTC m=+559.527125846" watchObservedRunningTime="2026-06-03 20:52:14.23741779 +0000 UTC m=+560.486828267" Jun 03 20:52:15.225894 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:15.225862 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-45mf7" event={"ID":"ad210e1a-bd68-4eec-84b0-ff8ba1246fb4","Type":"ContainerStarted","Data":"0f685b85ffe3a59862fc0be814f0ecfbdb3d2f628816982ce36e86b6576727b0"} Jun 03 20:52:15.226336 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:15.226038 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-45mf7" Jun 03 20:52:15.227797 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:15.227769 2573 generic.go:356] "Generic (PLEG): container finished" podID="4267085b-86df-4c45-a833-4eeff49378f8" containerID="62aca35a2805ae8af72890d554038f0cbf1e0b9c6f9ca6a762c54787195f7377" exitCode=0 Jun 03 20:52:15.227957 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:15.227796 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068hm77" event={"ID":"4267085b-86df-4c45-a833-4eeff49378f8","Type":"ContainerDied","Data":"62aca35a2805ae8af72890d554038f0cbf1e0b9c6f9ca6a762c54787195f7377"} Jun 03 20:52:15.242620 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:15.242568 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-45mf7" podStartSLOduration=3.666171474 podStartE2EDuration="6.242549932s" totalImagesPullingTime="2.576378458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:52:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:52:15.241663261 +0000 UTC m=+561.491073728" watchObservedRunningTime="2026-06-03 20:52:15.242549932 +0000 UTC m=+561.491960407" Jun 03 20:52:16.235412 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:16.235377 2573 generic.go:356] "Generic (PLEG): container finished" podID="4267085b-86df-4c45-a833-4eeff49378f8" containerID="c4678dfb4f61258030e179bce6ea260baa4a966b2d17cecc1055d3c19254f8cb" exitCode=0 Jun 03 20:52:16.235893 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:16.235463 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068hm77" event={"ID":"4267085b-86df-4c45-a833-4eeff49378f8","Type":"ContainerDied","Data":"c4678dfb4f61258030e179bce6ea260baa4a966b2d17cecc1055d3c19254f8cb"} Jun 03 20:52:17.354293 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:17.354269 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068hm77" Jun 03 20:52:17.427148 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:17.427120 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4267085b-86df-4c45-a833-4eeff49378f8-bundle\") pod \"4267085b-86df-4c45-a833-4eeff49378f8\" (UID: \"4267085b-86df-4c45-a833-4eeff49378f8\") " Jun 03 20:52:17.427269 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:17.427160 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4267085b-86df-4c45-a833-4eeff49378f8-util\") pod \"4267085b-86df-4c45-a833-4eeff49378f8\" (UID: \"4267085b-86df-4c45-a833-4eeff49378f8\") " Jun 03 20:52:17.427269 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:17.427215 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ds9zt\" (UniqueName: \"kubernetes.io/projected/4267085b-86df-4c45-a833-4eeff49378f8-kube-api-access-ds9zt\") pod \"4267085b-86df-4c45-a833-4eeff49378f8\" (UID: \"4267085b-86df-4c45-a833-4eeff49378f8\") " Jun 03 20:52:17.428004 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:17.427981 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4267085b-86df-4c45-a833-4eeff49378f8-bundle" (OuterVolumeSpecName: "bundle") pod "4267085b-86df-4c45-a833-4eeff49378f8" (UID: "4267085b-86df-4c45-a833-4eeff49378f8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:52:17.429199 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:17.429175 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4267085b-86df-4c45-a833-4eeff49378f8-kube-api-access-ds9zt" (OuterVolumeSpecName: "kube-api-access-ds9zt") pod "4267085b-86df-4c45-a833-4eeff49378f8" (UID: "4267085b-86df-4c45-a833-4eeff49378f8"). InnerVolumeSpecName "kube-api-access-ds9zt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:52:17.431938 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:17.431918 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4267085b-86df-4c45-a833-4eeff49378f8-util" (OuterVolumeSpecName: "util") pod "4267085b-86df-4c45-a833-4eeff49378f8" (UID: "4267085b-86df-4c45-a833-4eeff49378f8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:52:17.528153 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:17.528082 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ds9zt\" (UniqueName: \"kubernetes.io/projected/4267085b-86df-4c45-a833-4eeff49378f8-kube-api-access-ds9zt\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:52:17.528153 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:17.528109 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4267085b-86df-4c45-a833-4eeff49378f8-bundle\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:52:17.528153 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:17.528118 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4267085b-86df-4c45-a833-4eeff49378f8-util\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:52:18.246749 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:18.246726 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068hm77" Jun 03 20:52:18.246749 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:18.246738 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068hm77" event={"ID":"4267085b-86df-4c45-a833-4eeff49378f8","Type":"ContainerDied","Data":"49019adf7edef56c830bab82af4038bf1fcf5a2a940b111dc04b4da3ca8633ae"} Jun 03 20:52:18.246927 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:18.246777 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="49019adf7edef56c830bab82af4038bf1fcf5a2a940b111dc04b4da3ca8633ae" Jun 03 20:52:20.352432 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:20.352385 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:20.521588 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:20.521557 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-qmxfs"] Jun 03 20:52:20.521837 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:20.521826 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4267085b-86df-4c45-a833-4eeff49378f8" containerName="util" Jun 03 20:52:20.521891 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:20.521839 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4267085b-86df-4c45-a833-4eeff49378f8" containerName="util" Jun 03 20:52:20.521891 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:20.521856 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4267085b-86df-4c45-a833-4eeff49378f8" containerName="pull" Jun 03 20:52:20.521891 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:20.521861 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4267085b-86df-4c45-a833-4eeff49378f8" containerName="pull" Jun 03 20:52:20.521891 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:20.521867 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4267085b-86df-4c45-a833-4eeff49378f8" containerName="extract" Jun 03 20:52:20.521891 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:20.521873 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4267085b-86df-4c45-a833-4eeff49378f8" containerName="extract" Jun 03 20:52:20.522056 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:20.521919 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4267085b-86df-4c45-a833-4eeff49378f8" containerName="extract" Jun 03 20:52:20.524944 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:20.524925 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-qmxfs" Jun 03 20:52:20.528605 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:20.528562 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-w6j57\"" Jun 03 20:52:20.528726 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:20.528702 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 03 20:52:20.536855 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:20.536834 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:20.552134 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:20.552108 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-qmxfs"] Jun 03 20:52:20.553456 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:20.553436 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-kk4kl"] Jun 03 20:52:20.556449 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:20.556434 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kk4kl" Jun 03 20:52:20.561181 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:20.561162 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 03 20:52:20.561270 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:20.561169 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-cx79q\"" Jun 03 20:52:20.583494 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:20.583459 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-kk4kl"] Jun 03 20:52:20.652942 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:20.652874 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzrzg\" (UniqueName: \"kubernetes.io/projected/6eeafdc3-2a7b-4451-bc02-8ffcaff6a2db-kube-api-access-dzrzg\") pod \"kserve-controller-manager-69fc866d76-qmxfs\" (UID: \"6eeafdc3-2a7b-4451-bc02-8ffcaff6a2db\") " pod="opendatahub/kserve-controller-manager-69fc866d76-qmxfs" Jun 03 20:52:20.652942 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:20.652909 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9fe7509d-793f-4fea-8098-7ddfe212c1f2-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-kk4kl\" (UID: \"9fe7509d-793f-4fea-8098-7ddfe212c1f2\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kk4kl" Jun 03 20:52:20.653116 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:20.652961 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmzcr\" (UniqueName: \"kubernetes.io/projected/9fe7509d-793f-4fea-8098-7ddfe212c1f2-kube-api-access-pmzcr\") pod \"llmisvc-controller-manager-864bfd7bc9-kk4kl\" (UID: \"9fe7509d-793f-4fea-8098-7ddfe212c1f2\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kk4kl" Jun 03 20:52:20.653116 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:20.652993 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6eeafdc3-2a7b-4451-bc02-8ffcaff6a2db-cert\") pod \"kserve-controller-manager-69fc866d76-qmxfs\" (UID: \"6eeafdc3-2a7b-4451-bc02-8ffcaff6a2db\") " pod="opendatahub/kserve-controller-manager-69fc866d76-qmxfs" Jun 03 20:52:20.679941 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:20.679913 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:20.753358 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:20.753331 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9fe7509d-793f-4fea-8098-7ddfe212c1f2-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-kk4kl\" (UID: \"9fe7509d-793f-4fea-8098-7ddfe212c1f2\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kk4kl" Jun 03 20:52:20.753506 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:20.753369 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmzcr\" (UniqueName: \"kubernetes.io/projected/9fe7509d-793f-4fea-8098-7ddfe212c1f2-kube-api-access-pmzcr\") pod \"llmisvc-controller-manager-864bfd7bc9-kk4kl\" (UID: \"9fe7509d-793f-4fea-8098-7ddfe212c1f2\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kk4kl" Jun 03 20:52:20.753506 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:20.753398 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6eeafdc3-2a7b-4451-bc02-8ffcaff6a2db-cert\") pod \"kserve-controller-manager-69fc866d76-qmxfs\" (UID: \"6eeafdc3-2a7b-4451-bc02-8ffcaff6a2db\") " pod="opendatahub/kserve-controller-manager-69fc866d76-qmxfs" Jun 03 20:52:20.753506 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:20.753451 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzrzg\" (UniqueName: \"kubernetes.io/projected/6eeafdc3-2a7b-4451-bc02-8ffcaff6a2db-kube-api-access-dzrzg\") pod \"kserve-controller-manager-69fc866d76-qmxfs\" (UID: \"6eeafdc3-2a7b-4451-bc02-8ffcaff6a2db\") " pod="opendatahub/kserve-controller-manager-69fc866d76-qmxfs" Jun 03 20:52:20.755776 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:20.755756 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9fe7509d-793f-4fea-8098-7ddfe212c1f2-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-kk4kl\" (UID: \"9fe7509d-793f-4fea-8098-7ddfe212c1f2\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kk4kl" Jun 03 20:52:20.755861 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:20.755788 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6eeafdc3-2a7b-4451-bc02-8ffcaff6a2db-cert\") pod \"kserve-controller-manager-69fc866d76-qmxfs\" (UID: \"6eeafdc3-2a7b-4451-bc02-8ffcaff6a2db\") " pod="opendatahub/kserve-controller-manager-69fc866d76-qmxfs" Jun 03 20:52:20.762720 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:20.762680 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:20.763565 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:20.763543 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmzcr\" (UniqueName: \"kubernetes.io/projected/9fe7509d-793f-4fea-8098-7ddfe212c1f2-kube-api-access-pmzcr\") pod \"llmisvc-controller-manager-864bfd7bc9-kk4kl\" (UID: \"9fe7509d-793f-4fea-8098-7ddfe212c1f2\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kk4kl" Jun 03 20:52:20.764103 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:20.764084 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzrzg\" (UniqueName: \"kubernetes.io/projected/6eeafdc3-2a7b-4451-bc02-8ffcaff6a2db-kube-api-access-dzrzg\") pod \"kserve-controller-manager-69fc866d76-qmxfs\" (UID: \"6eeafdc3-2a7b-4451-bc02-8ffcaff6a2db\") " pod="opendatahub/kserve-controller-manager-69fc866d76-qmxfs" Jun 03 20:52:20.835593 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:20.835561 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-qmxfs" Jun 03 20:52:20.867848 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:20.867614 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kk4kl" Jun 03 20:52:21.054543 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:21.054515 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-qmxfs"] Jun 03 20:52:21.057147 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:52:21.057119 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eeafdc3_2a7b_4451_bc02_8ffcaff6a2db.slice/crio-d990896aac74112aff17093c3703d63a25c9e5a019bf2c3a3eb798fc4a0aa6d8 WatchSource:0}: Error finding container d990896aac74112aff17093c3703d63a25c9e5a019bf2c3a3eb798fc4a0aa6d8: Status 404 returned error can't find the container with id d990896aac74112aff17093c3703d63a25c9e5a019bf2c3a3eb798fc4a0aa6d8 Jun 03 20:52:21.064522 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:52:21.064491 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9fe7509d_793f_4fea_8098_7ddfe212c1f2.slice/crio-8ca3896dcc4342696c3de1d32c7d518867c22955ed3ba4188d5f983a1125ccfb WatchSource:0}: Error finding container 8ca3896dcc4342696c3de1d32c7d518867c22955ed3ba4188d5f983a1125ccfb: Status 404 returned error can't find the container with id 8ca3896dcc4342696c3de1d32c7d518867c22955ed3ba4188d5f983a1125ccfb Jun 03 20:52:21.066235 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:21.066154 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-kk4kl"] Jun 03 20:52:21.262546 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:21.262511 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-qmxfs" event={"ID":"6eeafdc3-2a7b-4451-bc02-8ffcaff6a2db","Type":"ContainerStarted","Data":"d990896aac74112aff17093c3703d63a25c9e5a019bf2c3a3eb798fc4a0aa6d8"} Jun 03 20:52:21.263604 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:21.263583 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kk4kl" event={"ID":"9fe7509d-793f-4fea-8098-7ddfe212c1f2","Type":"ContainerStarted","Data":"8ca3896dcc4342696c3de1d32c7d518867c22955ed3ba4188d5f983a1125ccfb"} Jun 03 20:52:21.802115 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:21.802062 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:21.990269 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:21.990220 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:24.279613 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:24.279580 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kk4kl" event={"ID":"9fe7509d-793f-4fea-8098-7ddfe212c1f2","Type":"ContainerStarted","Data":"f3b17052d9ab0bdfaf0e40b2c2b13e27bd65d79b9fc956e99ff339f46d1f81b2"} Jun 03 20:52:24.280029 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:24.279689 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kk4kl" Jun 03 20:52:24.281085 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:24.281066 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-qmxfs" event={"ID":"6eeafdc3-2a7b-4451-bc02-8ffcaff6a2db","Type":"ContainerStarted","Data":"be38734f23e7b6147422f230874c10c168fa32d4b2fa63403dd1e1986e797562"} Jun 03 20:52:24.281203 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:24.281185 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-qmxfs" Jun 03 20:52:24.337141 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:24.337095 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kk4kl" podStartSLOduration=1.7480046630000001 podStartE2EDuration="4.337080617s" totalImagesPullingTime="2.589075954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:52:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:52:24.336425185 +0000 UTC m=+570.585835659" watchObservedRunningTime="2026-06-03 20:52:24.337080617 +0000 UTC m=+570.586491089" Jun 03 20:52:24.369359 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:24.369305 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-qmxfs" podStartSLOduration=1.777891275 podStartE2EDuration="4.369287201s" totalImagesPullingTime="2.591395926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:52:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:52:24.367851507 +0000 UTC m=+570.617261981" watchObservedRunningTime="2026-06-03 20:52:24.369287201 +0000 UTC m=+570.618697676" Jun 03 20:52:25.233000 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:25.232970 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-cvzlp" Jun 03 20:52:26.032760 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:26.032716 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:26.238246 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:26.238219 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-45mf7" Jun 03 20:52:26.247431 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:26.247401 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:27.586384 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:27.586346 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adbft4"] Jun 03 20:52:27.591190 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:27.591169 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adbft4" Jun 03 20:52:27.624044 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:27.624019 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 20:52:27.624173 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:27.624048 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 20:52:27.624241 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:27.624211 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jq9ms\"" Jun 03 20:52:27.656719 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:27.656687 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adbft4"] Jun 03 20:52:27.724860 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:27.724815 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bntb4\" (UniqueName: \"kubernetes.io/projected/606bb6f2-a9df-4329-9260-1c61da0cb761-kube-api-access-bntb4\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adbft4\" (UID: \"606bb6f2-a9df-4329-9260-1c61da0cb761\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adbft4" Jun 03 20:52:27.725025 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:27.724919 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/606bb6f2-a9df-4329-9260-1c61da0cb761-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adbft4\" (UID: \"606bb6f2-a9df-4329-9260-1c61da0cb761\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adbft4" Jun 03 20:52:27.725025 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:27.724968 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/606bb6f2-a9df-4329-9260-1c61da0cb761-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adbft4\" (UID: \"606bb6f2-a9df-4329-9260-1c61da0cb761\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adbft4" Jun 03 20:52:27.825366 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:27.825331 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/606bb6f2-a9df-4329-9260-1c61da0cb761-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adbft4\" (UID: \"606bb6f2-a9df-4329-9260-1c61da0cb761\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adbft4" Jun 03 20:52:27.825600 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:27.825379 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bntb4\" (UniqueName: \"kubernetes.io/projected/606bb6f2-a9df-4329-9260-1c61da0cb761-kube-api-access-bntb4\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adbft4\" (UID: \"606bb6f2-a9df-4329-9260-1c61da0cb761\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adbft4" Jun 03 20:52:27.825600 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:27.825426 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/606bb6f2-a9df-4329-9260-1c61da0cb761-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adbft4\" (UID: \"606bb6f2-a9df-4329-9260-1c61da0cb761\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adbft4" Jun 03 20:52:27.825749 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:27.825729 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/606bb6f2-a9df-4329-9260-1c61da0cb761-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adbft4\" (UID: \"606bb6f2-a9df-4329-9260-1c61da0cb761\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adbft4" Jun 03 20:52:27.825785 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:27.825756 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/606bb6f2-a9df-4329-9260-1c61da0cb761-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adbft4\" (UID: \"606bb6f2-a9df-4329-9260-1c61da0cb761\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adbft4" Jun 03 20:52:27.838028 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:27.837973 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bntb4\" (UniqueName: \"kubernetes.io/projected/606bb6f2-a9df-4329-9260-1c61da0cb761-kube-api-access-bntb4\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adbft4\" (UID: \"606bb6f2-a9df-4329-9260-1c61da0cb761\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adbft4" Jun 03 20:52:27.899561 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:27.899522 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adbft4" Jun 03 20:52:28.058215 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:28.058174 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adbft4"] Jun 03 20:52:28.060838 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:52:28.060812 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod606bb6f2_a9df_4329_9260_1c61da0cb761.slice/crio-382f97b5af6d522075ba93f30910c5e2b473303e7957dff6399bff7086ee3404 WatchSource:0}: Error finding container 382f97b5af6d522075ba93f30910c5e2b473303e7957dff6399bff7086ee3404: Status 404 returned error can't find the container with id 382f97b5af6d522075ba93f30910c5e2b473303e7957dff6399bff7086ee3404 Jun 03 20:52:28.299616 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:28.299583 2573 generic.go:356] "Generic (PLEG): container finished" podID="606bb6f2-a9df-4329-9260-1c61da0cb761" containerID="c6248850dd4a4c4564140704ce273a5c67c2c47c1bfff049d45fec795aab69d3" exitCode=0 Jun 03 20:52:28.299783 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:28.299642 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adbft4" event={"ID":"606bb6f2-a9df-4329-9260-1c61da0cb761","Type":"ContainerDied","Data":"c6248850dd4a4c4564140704ce273a5c67c2c47c1bfff049d45fec795aab69d3"} Jun 03 20:52:28.299783 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:28.299676 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adbft4" event={"ID":"606bb6f2-a9df-4329-9260-1c61da0cb761","Type":"ContainerStarted","Data":"382f97b5af6d522075ba93f30910c5e2b473303e7957dff6399bff7086ee3404"} Jun 03 20:52:29.200947 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:29.200917 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:29.305850 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:29.305818 2573 generic.go:356] "Generic (PLEG): container finished" podID="606bb6f2-a9df-4329-9260-1c61da0cb761" containerID="010f01c8bf77cb0f372c7a670cec9fce3814ebb2d84866d109ab1049d32322b2" exitCode=0 Jun 03 20:52:29.305995 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:29.305899 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adbft4" event={"ID":"606bb6f2-a9df-4329-9260-1c61da0cb761","Type":"ContainerDied","Data":"010f01c8bf77cb0f372c7a670cec9fce3814ebb2d84866d109ab1049d32322b2"} Jun 03 20:52:29.393870 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:29.393835 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:29.637866 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:29.637800 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:29.925908 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:29.925817 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:30.312637 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:30.312602 2573 generic.go:356] "Generic (PLEG): container finished" podID="606bb6f2-a9df-4329-9260-1c61da0cb761" containerID="8784cdd332a4ab9c9347a8e0ba8e761d10ebeb6bb8f40caa140d6ca5307bd5e2" exitCode=0 Jun 03 20:52:30.313013 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:30.312632 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adbft4" event={"ID":"606bb6f2-a9df-4329-9260-1c61da0cb761","Type":"ContainerDied","Data":"8784cdd332a4ab9c9347a8e0ba8e761d10ebeb6bb8f40caa140d6ca5307bd5e2"} Jun 03 20:52:30.604583 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:30.604498 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:31.439718 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:31.439695 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adbft4" Jun 03 20:52:31.558713 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:31.558682 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/606bb6f2-a9df-4329-9260-1c61da0cb761-bundle\") pod \"606bb6f2-a9df-4329-9260-1c61da0cb761\" (UID: \"606bb6f2-a9df-4329-9260-1c61da0cb761\") " Jun 03 20:52:31.558882 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:31.558724 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/606bb6f2-a9df-4329-9260-1c61da0cb761-util\") pod \"606bb6f2-a9df-4329-9260-1c61da0cb761\" (UID: \"606bb6f2-a9df-4329-9260-1c61da0cb761\") " Jun 03 20:52:31.558882 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:31.558773 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bntb4\" (UniqueName: \"kubernetes.io/projected/606bb6f2-a9df-4329-9260-1c61da0cb761-kube-api-access-bntb4\") pod \"606bb6f2-a9df-4329-9260-1c61da0cb761\" (UID: \"606bb6f2-a9df-4329-9260-1c61da0cb761\") " Jun 03 20:52:31.559607 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:31.559579 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/606bb6f2-a9df-4329-9260-1c61da0cb761-bundle" (OuterVolumeSpecName: "bundle") pod "606bb6f2-a9df-4329-9260-1c61da0cb761" (UID: "606bb6f2-a9df-4329-9260-1c61da0cb761"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:52:31.560867 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:31.560838 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/606bb6f2-a9df-4329-9260-1c61da0cb761-kube-api-access-bntb4" (OuterVolumeSpecName: "kube-api-access-bntb4") pod "606bb6f2-a9df-4329-9260-1c61da0cb761" (UID: "606bb6f2-a9df-4329-9260-1c61da0cb761"). InnerVolumeSpecName "kube-api-access-bntb4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:52:31.564689 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:31.564658 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/606bb6f2-a9df-4329-9260-1c61da0cb761-util" (OuterVolumeSpecName: "util") pod "606bb6f2-a9df-4329-9260-1c61da0cb761" (UID: "606bb6f2-a9df-4329-9260-1c61da0cb761"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:52:31.659718 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:31.659634 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bntb4\" (UniqueName: \"kubernetes.io/projected/606bb6f2-a9df-4329-9260-1c61da0cb761-kube-api-access-bntb4\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:52:31.659718 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:31.659663 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/606bb6f2-a9df-4329-9260-1c61da0cb761-bundle\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:52:31.659718 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:31.659672 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/606bb6f2-a9df-4329-9260-1c61da0cb761-util\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:52:31.719556 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:31.719497 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-ccg7q"] Jun 03 20:52:31.719798 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:31.719787 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="606bb6f2-a9df-4329-9260-1c61da0cb761" containerName="pull" Jun 03 20:52:31.719887 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:31.719800 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="606bb6f2-a9df-4329-9260-1c61da0cb761" containerName="pull" Jun 03 20:52:31.719887 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:31.719809 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="606bb6f2-a9df-4329-9260-1c61da0cb761" containerName="extract" Jun 03 20:52:31.719887 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:31.719815 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="606bb6f2-a9df-4329-9260-1c61da0cb761" containerName="extract" Jun 03 20:52:31.719887 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:31.719823 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="606bb6f2-a9df-4329-9260-1c61da0cb761" containerName="util" Jun 03 20:52:31.719887 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:31.719828 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="606bb6f2-a9df-4329-9260-1c61da0cb761" containerName="util" Jun 03 20:52:31.719887 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:31.719876 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="606bb6f2-a9df-4329-9260-1c61da0cb761" containerName="extract" Jun 03 20:52:31.723065 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:31.723049 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-ccg7q" Jun 03 20:52:31.726859 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:31.726840 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 03 20:52:31.726992 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:31.726974 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 03 20:52:31.727206 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:31.727188 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-755lf\"" Jun 03 20:52:31.775630 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:31.775597 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-ccg7q"] Jun 03 20:52:31.861789 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:31.861752 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmz95\" (UniqueName: \"kubernetes.io/projected/6518a83b-aff6-4523-b2e5-3acf84b9e818-kube-api-access-mmz95\") pod \"servicemesh-operator3-57f65f65fb-ccg7q\" (UID: \"6518a83b-aff6-4523-b2e5-3acf84b9e818\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-ccg7q" Jun 03 20:52:31.861969 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:31.861796 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/6518a83b-aff6-4523-b2e5-3acf84b9e818-operator-config\") pod \"servicemesh-operator3-57f65f65fb-ccg7q\" (UID: \"6518a83b-aff6-4523-b2e5-3acf84b9e818\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-ccg7q" Jun 03 20:52:31.963132 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:31.963036 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmz95\" (UniqueName: \"kubernetes.io/projected/6518a83b-aff6-4523-b2e5-3acf84b9e818-kube-api-access-mmz95\") pod \"servicemesh-operator3-57f65f65fb-ccg7q\" (UID: \"6518a83b-aff6-4523-b2e5-3acf84b9e818\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-ccg7q" Jun 03 20:52:31.963132 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:31.963076 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/6518a83b-aff6-4523-b2e5-3acf84b9e818-operator-config\") pod \"servicemesh-operator3-57f65f65fb-ccg7q\" (UID: \"6518a83b-aff6-4523-b2e5-3acf84b9e818\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-ccg7q" Jun 03 20:52:31.965733 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:31.965709 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/6518a83b-aff6-4523-b2e5-3acf84b9e818-operator-config\") pod \"servicemesh-operator3-57f65f65fb-ccg7q\" (UID: \"6518a83b-aff6-4523-b2e5-3acf84b9e818\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-ccg7q" Jun 03 20:52:31.979350 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:31.979315 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmz95\" (UniqueName: \"kubernetes.io/projected/6518a83b-aff6-4523-b2e5-3acf84b9e818-kube-api-access-mmz95\") pod \"servicemesh-operator3-57f65f65fb-ccg7q\" (UID: \"6518a83b-aff6-4523-b2e5-3acf84b9e818\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-ccg7q" Jun 03 20:52:32.033049 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:32.033019 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-ccg7q" Jun 03 20:52:32.235616 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:32.235594 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-ccg7q"] Jun 03 20:52:32.237420 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:52:32.237391 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6518a83b_aff6_4523_b2e5_3acf84b9e818.slice/crio-92a154baa98cadc534de7e3c092f4330a9bd565d37a78cc14428d7eb1de55eec WatchSource:0}: Error finding container 92a154baa98cadc534de7e3c092f4330a9bd565d37a78cc14428d7eb1de55eec: Status 404 returned error can't find the container with id 92a154baa98cadc534de7e3c092f4330a9bd565d37a78cc14428d7eb1de55eec Jun 03 20:52:32.323045 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:32.323007 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-ccg7q" event={"ID":"6518a83b-aff6-4523-b2e5-3acf84b9e818","Type":"ContainerStarted","Data":"92a154baa98cadc534de7e3c092f4330a9bd565d37a78cc14428d7eb1de55eec"} Jun 03 20:52:32.324889 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:32.324866 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adbft4" Jun 03 20:52:32.324999 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:32.324866 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adbft4" event={"ID":"606bb6f2-a9df-4329-9260-1c61da0cb761","Type":"ContainerDied","Data":"382f97b5af6d522075ba93f30910c5e2b473303e7957dff6399bff7086ee3404"} Jun 03 20:52:32.324999 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:32.324983 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="382f97b5af6d522075ba93f30910c5e2b473303e7957dff6399bff7086ee3404" Jun 03 20:52:35.346407 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:35.346305 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-ccg7q" event={"ID":"6518a83b-aff6-4523-b2e5-3acf84b9e818","Type":"ContainerStarted","Data":"ac0ed46b96addf1a20be9157797e53544f6c02f7c2976fe9d067c6be52bce67f"} Jun 03 20:52:35.346874 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:35.346509 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-ccg7q" Jun 03 20:52:35.382053 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:35.382001 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-ccg7q" podStartSLOduration=1.602891713 podStartE2EDuration="4.381984918s" totalImagesPullingTime="2.779093205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:52:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:52:35.380812894 +0000 UTC m=+581.630223370" watchObservedRunningTime="2026-06-03 20:52:35.381984918 +0000 UTC m=+581.631395393" Jun 03 20:52:36.522086 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:36.522055 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:39.805443 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:39.805408 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-b685d69dc-2v74v"] Jun 03 20:52:39.809019 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:39.809000 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-b685d69dc-2v74v" Jun 03 20:52:39.812724 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:39.812698 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-jqgjn\"" Jun 03 20:52:39.812850 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:39.812698 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 03 20:52:39.821588 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:39.821562 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-b685d69dc-2v74v"] Jun 03 20:52:39.824002 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:39.823974 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwtc9\" (UniqueName: \"kubernetes.io/projected/13571a47-6031-47ee-a67d-2e261f504d5f-kube-api-access-kwtc9\") pod \"dashboard-redirect-b685d69dc-2v74v\" (UID: \"13571a47-6031-47ee-a67d-2e261f504d5f\") " pod="opendatahub/dashboard-redirect-b685d69dc-2v74v" Jun 03 20:52:39.824124 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:39.824036 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/13571a47-6031-47ee-a67d-2e261f504d5f-redirect-config\") pod \"dashboard-redirect-b685d69dc-2v74v\" (UID: \"13571a47-6031-47ee-a67d-2e261f504d5f\") " pod="opendatahub/dashboard-redirect-b685d69dc-2v74v" Jun 03 20:52:39.837128 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:39.837096 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:52:39.925208 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:39.925167 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwtc9\" (UniqueName: \"kubernetes.io/projected/13571a47-6031-47ee-a67d-2e261f504d5f-kube-api-access-kwtc9\") pod \"dashboard-redirect-b685d69dc-2v74v\" (UID: \"13571a47-6031-47ee-a67d-2e261f504d5f\") " pod="opendatahub/dashboard-redirect-b685d69dc-2v74v" Jun 03 20:52:39.925411 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:39.925221 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/13571a47-6031-47ee-a67d-2e261f504d5f-redirect-config\") pod \"dashboard-redirect-b685d69dc-2v74v\" (UID: \"13571a47-6031-47ee-a67d-2e261f504d5f\") " pod="opendatahub/dashboard-redirect-b685d69dc-2v74v" Jun 03 20:52:39.925926 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:39.925906 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/13571a47-6031-47ee-a67d-2e261f504d5f-redirect-config\") pod \"dashboard-redirect-b685d69dc-2v74v\" (UID: \"13571a47-6031-47ee-a67d-2e261f504d5f\") " pod="opendatahub/dashboard-redirect-b685d69dc-2v74v" Jun 03 20:52:39.934556 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:39.934526 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwtc9\" (UniqueName: \"kubernetes.io/projected/13571a47-6031-47ee-a67d-2e261f504d5f-kube-api-access-kwtc9\") pod \"dashboard-redirect-b685d69dc-2v74v\" (UID: \"13571a47-6031-47ee-a67d-2e261f504d5f\") " pod="opendatahub/dashboard-redirect-b685d69dc-2v74v" Jun 03 20:52:40.118883 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:40.118797 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-b685d69dc-2v74v" Jun 03 20:52:40.249327 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:40.249297 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-b685d69dc-2v74v"] Jun 03 20:52:40.251937 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:52:40.251908 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13571a47_6031_47ee_a67d_2e261f504d5f.slice/crio-5295aa951d1f1c87527dd6fccb4d8f67cef255cab4ef7b93445ac0e495f2228d WatchSource:0}: Error finding container 5295aa951d1f1c87527dd6fccb4d8f67cef255cab4ef7b93445ac0e495f2228d: Status 404 returned error can't find the container with id 5295aa951d1f1c87527dd6fccb4d8f67cef255cab4ef7b93445ac0e495f2228d Jun 03 20:52:40.370641 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:40.370557 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-b685d69dc-2v74v" event={"ID":"13571a47-6031-47ee-a67d-2e261f504d5f","Type":"ContainerStarted","Data":"5295aa951d1f1c87527dd6fccb4d8f67cef255cab4ef7b93445ac0e495f2228d"} Jun 03 20:52:45.396507 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:45.396451 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-b685d69dc-2v74v" event={"ID":"13571a47-6031-47ee-a67d-2e261f504d5f","Type":"ContainerStarted","Data":"3e9c8fbf48f4a25366a1207e060fdae9b8cc4c29e437e5a3b9476e441c895b15"} Jun 03 20:52:45.416200 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:45.416153 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-b685d69dc-2v74v" podStartSLOduration=2.268197625 podStartE2EDuration="6.416139246s" totalImagesPullingTime="4.147941621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:52:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:52:45.412783362 +0000 UTC m=+591.662193862" watchObservedRunningTime="2026-06-03 20:52:45.416139246 +0000 UTC m=+591.665549724" Jun 03 20:52:46.352321 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:46.352286 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-ccg7q" Jun 03 20:52:54.189713 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:54.189686 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8cpfl_51f5ccb5-b246-47b7-82cb-9524ff802fae/ovn-acl-logging/0.log" Jun 03 20:52:54.190666 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:54.190644 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8cpfl_51f5ccb5-b246-47b7-82cb-9524ff802fae/ovn-acl-logging/0.log" Jun 03 20:52:55.287952 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:55.287923 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kk4kl" Jun 03 20:52:55.290880 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:52:55.290863 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-qmxfs" Jun 03 20:53:10.436582 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:10.436489 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:10.526139 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:10.526102 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:10.543058 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:10.543028 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9mt6w"] Jun 03 20:53:10.550174 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:10.550149 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9mt6w" Jun 03 20:53:10.553248 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:10.553228 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 20:53:10.553372 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:10.553229 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 20:53:10.554570 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:10.554543 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-hs5mn\"" Jun 03 20:53:10.557325 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:10.557301 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9mt6w"] Jun 03 20:53:10.602346 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:10.602315 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:10.669770 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:10.669742 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vsz4\" (UniqueName: \"kubernetes.io/projected/0cd01e57-ac43-4098-b8ce-0484cda34009-kube-api-access-9vsz4\") pod \"kuadrant-operator-catalog-9mt6w\" (UID: \"0cd01e57-ac43-4098-b8ce-0484cda34009\") " pod="kuadrant-system/kuadrant-operator-catalog-9mt6w" Jun 03 20:53:10.771110 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:10.771079 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vsz4\" (UniqueName: \"kubernetes.io/projected/0cd01e57-ac43-4098-b8ce-0484cda34009-kube-api-access-9vsz4\") pod \"kuadrant-operator-catalog-9mt6w\" (UID: \"0cd01e57-ac43-4098-b8ce-0484cda34009\") " pod="kuadrant-system/kuadrant-operator-catalog-9mt6w" Jun 03 20:53:10.779167 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:10.779137 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vsz4\" (UniqueName: \"kubernetes.io/projected/0cd01e57-ac43-4098-b8ce-0484cda34009-kube-api-access-9vsz4\") pod \"kuadrant-operator-catalog-9mt6w\" (UID: \"0cd01e57-ac43-4098-b8ce-0484cda34009\") " pod="kuadrant-system/kuadrant-operator-catalog-9mt6w" Jun 03 20:53:10.862231 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:10.862202 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9mt6w" Jun 03 20:53:10.904609 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:10.904577 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9mt6w"] Jun 03 20:53:10.989080 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:10.989039 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9mt6w"] Jun 03 20:53:10.991304 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:53:10.991271 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cd01e57_ac43_4098_b8ce_0484cda34009.slice/crio-c79e0b465f068367e4855f618d31b819242e652c0a5d01b1dda2dd579a828bb3 WatchSource:0}: Error finding container c79e0b465f068367e4855f618d31b819242e652c0a5d01b1dda2dd579a828bb3: Status 404 returned error can't find the container with id c79e0b465f068367e4855f618d31b819242e652c0a5d01b1dda2dd579a828bb3 Jun 03 20:53:11.113820 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:11.113752 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mh5kf"] Jun 03 20:53:11.120832 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:11.120803 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mh5kf" Jun 03 20:53:11.126212 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:11.126186 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mh5kf"] Jun 03 20:53:11.174602 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:11.174574 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28xcp\" (UniqueName: \"kubernetes.io/projected/6b488700-62b6-4e5c-8e84-a067c6731be5-kube-api-access-28xcp\") pod \"kuadrant-operator-catalog-mh5kf\" (UID: \"6b488700-62b6-4e5c-8e84-a067c6731be5\") " pod="kuadrant-system/kuadrant-operator-catalog-mh5kf" Jun 03 20:53:11.275120 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:11.275088 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28xcp\" (UniqueName: \"kubernetes.io/projected/6b488700-62b6-4e5c-8e84-a067c6731be5-kube-api-access-28xcp\") pod \"kuadrant-operator-catalog-mh5kf\" (UID: \"6b488700-62b6-4e5c-8e84-a067c6731be5\") " pod="kuadrant-system/kuadrant-operator-catalog-mh5kf" Jun 03 20:53:11.284777 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:11.284752 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28xcp\" (UniqueName: \"kubernetes.io/projected/6b488700-62b6-4e5c-8e84-a067c6731be5-kube-api-access-28xcp\") pod \"kuadrant-operator-catalog-mh5kf\" (UID: \"6b488700-62b6-4e5c-8e84-a067c6731be5\") " pod="kuadrant-system/kuadrant-operator-catalog-mh5kf" Jun 03 20:53:11.431622 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:11.431542 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mh5kf" Jun 03 20:53:11.516567 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:11.516527 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9mt6w" event={"ID":"0cd01e57-ac43-4098-b8ce-0484cda34009","Type":"ContainerStarted","Data":"c79e0b465f068367e4855f618d31b819242e652c0a5d01b1dda2dd579a828bb3"} Jun 03 20:53:11.608837 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:11.608811 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mh5kf"] Jun 03 20:53:11.688776 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:53:11.688689 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b488700_62b6_4e5c_8e84_a067c6731be5.slice/crio-57fe110416ecc667edce570e9b6430c1d34701aef560348591e442baf19c8d16 WatchSource:0}: Error finding container 57fe110416ecc667edce570e9b6430c1d34701aef560348591e442baf19c8d16: Status 404 returned error can't find the container with id 57fe110416ecc667edce570e9b6430c1d34701aef560348591e442baf19c8d16 Jun 03 20:53:12.523241 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:12.523202 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mh5kf" event={"ID":"6b488700-62b6-4e5c-8e84-a067c6731be5","Type":"ContainerStarted","Data":"57fe110416ecc667edce570e9b6430c1d34701aef560348591e442baf19c8d16"} Jun 03 20:53:13.529445 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:13.529410 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mh5kf" event={"ID":"6b488700-62b6-4e5c-8e84-a067c6731be5","Type":"ContainerStarted","Data":"a9453bffd21a4d2596c143e75763498099d47b32fadf2fe5583ed28a252d7429"} Jun 03 20:53:13.530920 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:13.530896 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9mt6w" event={"ID":"0cd01e57-ac43-4098-b8ce-0484cda34009","Type":"ContainerStarted","Data":"a9fd275cbfec91b09f2e93936e6f5275a23777c7b65abe6e2169f5560fc83b03"} Jun 03 20:53:13.531046 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:13.530917 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-9mt6w" podUID="0cd01e57-ac43-4098-b8ce-0484cda34009" containerName="registry-server" containerID="cri-o://a9fd275cbfec91b09f2e93936e6f5275a23777c7b65abe6e2169f5560fc83b03" gracePeriod=2 Jun 03 20:53:13.551227 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:13.551184 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-mh5kf" podStartSLOduration=1.472007587 podStartE2EDuration="2.551170488s" totalImagesPullingTime="1.079162901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:53:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:53:13.549003559 +0000 UTC m=+619.798414035" watchObservedRunningTime="2026-06-03 20:53:13.551170488 +0000 UTC m=+619.800580979" Jun 03 20:53:13.573184 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:13.573145 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-9mt6w" podStartSLOduration=1.796984116 podStartE2EDuration="3.573131825s" totalImagesPullingTime="1.776147709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:53:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:53:13.571640508 +0000 UTC m=+619.821050982" watchObservedRunningTime="2026-06-03 20:53:13.573131825 +0000 UTC m=+619.822542303" Jun 03 20:53:13.792183 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:13.792130 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9mt6w" Jun 03 20:53:13.895175 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:13.895150 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vsz4\" (UniqueName: \"kubernetes.io/projected/0cd01e57-ac43-4098-b8ce-0484cda34009-kube-api-access-9vsz4\") pod \"0cd01e57-ac43-4098-b8ce-0484cda34009\" (UID: \"0cd01e57-ac43-4098-b8ce-0484cda34009\") " Jun 03 20:53:13.897199 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:13.897167 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cd01e57-ac43-4098-b8ce-0484cda34009-kube-api-access-9vsz4" (OuterVolumeSpecName: "kube-api-access-9vsz4") pod "0cd01e57-ac43-4098-b8ce-0484cda34009" (UID: "0cd01e57-ac43-4098-b8ce-0484cda34009"). InnerVolumeSpecName "kube-api-access-9vsz4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:53:13.995589 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:13.995565 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vsz4\" (UniqueName: \"kubernetes.io/projected/0cd01e57-ac43-4098-b8ce-0484cda34009-kube-api-access-9vsz4\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:53:14.536723 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:14.536693 2573 generic.go:356] "Generic (PLEG): container finished" podID="0cd01e57-ac43-4098-b8ce-0484cda34009" containerID="a9fd275cbfec91b09f2e93936e6f5275a23777c7b65abe6e2169f5560fc83b03" exitCode=0 Jun 03 20:53:14.537213 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:14.536730 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9mt6w" Jun 03 20:53:14.537213 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:14.536776 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9mt6w" event={"ID":"0cd01e57-ac43-4098-b8ce-0484cda34009","Type":"ContainerDied","Data":"a9fd275cbfec91b09f2e93936e6f5275a23777c7b65abe6e2169f5560fc83b03"} Jun 03 20:53:14.537213 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:14.536831 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9mt6w" event={"ID":"0cd01e57-ac43-4098-b8ce-0484cda34009","Type":"ContainerDied","Data":"c79e0b465f068367e4855f618d31b819242e652c0a5d01b1dda2dd579a828bb3"} Jun 03 20:53:14.537213 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:14.536863 2573 scope.go:117] "RemoveContainer" containerID="a9fd275cbfec91b09f2e93936e6f5275a23777c7b65abe6e2169f5560fc83b03" Jun 03 20:53:14.545540 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:14.545523 2573 scope.go:117] "RemoveContainer" containerID="a9fd275cbfec91b09f2e93936e6f5275a23777c7b65abe6e2169f5560fc83b03" Jun 03 20:53:14.545783 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:53:14.545764 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9fd275cbfec91b09f2e93936e6f5275a23777c7b65abe6e2169f5560fc83b03\": container with ID starting with a9fd275cbfec91b09f2e93936e6f5275a23777c7b65abe6e2169f5560fc83b03 not found: ID does not exist" containerID="a9fd275cbfec91b09f2e93936e6f5275a23777c7b65abe6e2169f5560fc83b03" Jun 03 20:53:14.545846 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:14.545790 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9fd275cbfec91b09f2e93936e6f5275a23777c7b65abe6e2169f5560fc83b03"} err="failed to get container status \"a9fd275cbfec91b09f2e93936e6f5275a23777c7b65abe6e2169f5560fc83b03\": rpc error: code = NotFound desc = could not find container \"a9fd275cbfec91b09f2e93936e6f5275a23777c7b65abe6e2169f5560fc83b03\": container with ID starting with a9fd275cbfec91b09f2e93936e6f5275a23777c7b65abe6e2169f5560fc83b03 not found: ID does not exist" Jun 03 20:53:14.558369 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:14.558343 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9mt6w"] Jun 03 20:53:14.564922 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:14.564900 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9mt6w"] Jun 03 20:53:16.210987 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:16.210957 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cd01e57-ac43-4098-b8ce-0484cda34009" path="/var/lib/kubelet/pods/0cd01e57-ac43-4098-b8ce-0484cda34009/volumes" Jun 03 20:53:16.874756 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:16.874722 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-cbms5"] Jun 03 20:53:16.875031 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:16.875019 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cd01e57-ac43-4098-b8ce-0484cda34009" containerName="registry-server" Jun 03 20:53:16.875086 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:16.875032 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cd01e57-ac43-4098-b8ce-0484cda34009" containerName="registry-server" Jun 03 20:53:16.875123 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:16.875091 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cd01e57-ac43-4098-b8ce-0484cda34009" containerName="registry-server" Jun 03 20:53:16.881798 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:16.881741 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:16.953058 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:16.953014 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:16.996254 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:16.996228 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-cbms5"] Jun 03 20:53:16.996343 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:16.996313 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cbms5" Jun 03 20:53:16.999234 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:16.999213 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 03 20:53:16.999344 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:16.999243 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 03 20:53:16.999344 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:16.999216 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 03 20:53:16.999344 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:16.999298 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 03 20:53:16.999527 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:16.999390 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-gzv2x\"" Jun 03 20:53:17.120735 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:17.120703 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c9p9\" (UniqueName: \"kubernetes.io/projected/1e80f295-7279-48b5-85ff-319655acd05b-kube-api-access-5c9p9\") pod \"istiod-openshift-gateway-75c67f8887-cbms5\" (UID: \"1e80f295-7279-48b5-85ff-319655acd05b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cbms5" Jun 03 20:53:17.120896 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:17.120745 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e80f295-7279-48b5-85ff-319655acd05b-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-cbms5\" (UID: \"1e80f295-7279-48b5-85ff-319655acd05b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cbms5" Jun 03 20:53:17.120896 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:17.120769 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1e80f295-7279-48b5-85ff-319655acd05b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-cbms5\" (UID: \"1e80f295-7279-48b5-85ff-319655acd05b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cbms5" Jun 03 20:53:17.120896 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:17.120791 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1e80f295-7279-48b5-85ff-319655acd05b-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-cbms5\" (UID: \"1e80f295-7279-48b5-85ff-319655acd05b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cbms5" Jun 03 20:53:17.120896 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:17.120827 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e80f295-7279-48b5-85ff-319655acd05b-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-cbms5\" (UID: \"1e80f295-7279-48b5-85ff-319655acd05b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cbms5" Jun 03 20:53:17.120896 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:17.120849 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1e80f295-7279-48b5-85ff-319655acd05b-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-cbms5\" (UID: \"1e80f295-7279-48b5-85ff-319655acd05b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cbms5" Jun 03 20:53:17.120896 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:17.120882 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1e80f295-7279-48b5-85ff-319655acd05b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-cbms5\" (UID: \"1e80f295-7279-48b5-85ff-319655acd05b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cbms5" Jun 03 20:53:17.221453 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:17.221420 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1e80f295-7279-48b5-85ff-319655acd05b-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-cbms5\" (UID: \"1e80f295-7279-48b5-85ff-319655acd05b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cbms5" Jun 03 20:53:17.221932 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:17.221488 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1e80f295-7279-48b5-85ff-319655acd05b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-cbms5\" (UID: \"1e80f295-7279-48b5-85ff-319655acd05b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cbms5" Jun 03 20:53:17.221932 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:17.221541 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c9p9\" (UniqueName: \"kubernetes.io/projected/1e80f295-7279-48b5-85ff-319655acd05b-kube-api-access-5c9p9\") pod \"istiod-openshift-gateway-75c67f8887-cbms5\" (UID: \"1e80f295-7279-48b5-85ff-319655acd05b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cbms5" Jun 03 20:53:17.221932 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:17.221570 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e80f295-7279-48b5-85ff-319655acd05b-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-cbms5\" (UID: \"1e80f295-7279-48b5-85ff-319655acd05b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cbms5" Jun 03 20:53:17.221932 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:17.221603 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1e80f295-7279-48b5-85ff-319655acd05b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-cbms5\" (UID: \"1e80f295-7279-48b5-85ff-319655acd05b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cbms5" Jun 03 20:53:17.221932 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:17.221629 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1e80f295-7279-48b5-85ff-319655acd05b-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-cbms5\" (UID: \"1e80f295-7279-48b5-85ff-319655acd05b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cbms5" Jun 03 20:53:17.221932 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:17.221653 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e80f295-7279-48b5-85ff-319655acd05b-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-cbms5\" (UID: \"1e80f295-7279-48b5-85ff-319655acd05b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cbms5" Jun 03 20:53:17.222278 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:17.222249 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1e80f295-7279-48b5-85ff-319655acd05b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-cbms5\" (UID: \"1e80f295-7279-48b5-85ff-319655acd05b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cbms5" Jun 03 20:53:17.223935 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:17.223913 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1e80f295-7279-48b5-85ff-319655acd05b-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-cbms5\" (UID: \"1e80f295-7279-48b5-85ff-319655acd05b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cbms5" Jun 03 20:53:17.224025 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:17.223972 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1e80f295-7279-48b5-85ff-319655acd05b-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-cbms5\" (UID: \"1e80f295-7279-48b5-85ff-319655acd05b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cbms5" Jun 03 20:53:17.224148 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:17.224132 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e80f295-7279-48b5-85ff-319655acd05b-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-cbms5\" (UID: \"1e80f295-7279-48b5-85ff-319655acd05b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cbms5" Jun 03 20:53:17.224335 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:17.224317 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1e80f295-7279-48b5-85ff-319655acd05b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-cbms5\" (UID: \"1e80f295-7279-48b5-85ff-319655acd05b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cbms5" Jun 03 20:53:17.230707 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:17.230685 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e80f295-7279-48b5-85ff-319655acd05b-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-cbms5\" (UID: \"1e80f295-7279-48b5-85ff-319655acd05b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cbms5" Jun 03 20:53:17.231219 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:17.231201 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c9p9\" (UniqueName: \"kubernetes.io/projected/1e80f295-7279-48b5-85ff-319655acd05b-kube-api-access-5c9p9\") pod \"istiod-openshift-gateway-75c67f8887-cbms5\" (UID: \"1e80f295-7279-48b5-85ff-319655acd05b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cbms5" Jun 03 20:53:17.306209 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:17.306183 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cbms5" Jun 03 20:53:17.379729 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:17.379697 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:17.489842 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:17.489816 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-cbms5"] Jun 03 20:53:17.491203 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:53:17.491173 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e80f295_7279_48b5_85ff_319655acd05b.slice/crio-59f04e213427dcaade32d32802ee13030d6398cd5b718c0b7c1b3548f868b9e1 WatchSource:0}: Error finding container 59f04e213427dcaade32d32802ee13030d6398cd5b718c0b7c1b3548f868b9e1: Status 404 returned error can't find the container with id 59f04e213427dcaade32d32802ee13030d6398cd5b718c0b7c1b3548f868b9e1 Jun 03 20:53:17.551743 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:17.551714 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cbms5" event={"ID":"1e80f295-7279-48b5-85ff-319655acd05b","Type":"ContainerStarted","Data":"59f04e213427dcaade32d32802ee13030d6398cd5b718c0b7c1b3548f868b9e1"} Jun 03 20:53:20.028373 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:20.028334 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 20:53:20.028683 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:20.028403 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 20:53:20.568487 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:20.568435 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cbms5" event={"ID":"1e80f295-7279-48b5-85ff-319655acd05b","Type":"ContainerStarted","Data":"205bfc5a3df0653ff7891d6f3fd28cfb71aaea11cac56e12a7a1be10bc670591"} Jun 03 20:53:20.568652 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:20.568588 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cbms5" Jun 03 20:53:20.597969 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:20.597922 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cbms5" podStartSLOduration=2.0629395 podStartE2EDuration="4.597909799s" totalImagesPullingTime="2.534970299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:53:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:53:20.594010755 +0000 UTC m=+626.843421231" watchObservedRunningTime="2026-06-03 20:53:20.597909799 +0000 UTC m=+626.847320274" Jun 03 20:53:20.744760 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:20.744726 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:20.903202 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:20.903113 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:21.193153 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:21.193074 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:21.341508 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:21.341458 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:21.432485 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:21.432447 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-mh5kf" Jun 03 20:53:21.432636 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:21.432509 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-mh5kf" Jun 03 20:53:21.453960 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:21.453889 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-mh5kf" Jun 03 20:53:21.459815 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:21.459788 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:21.575308 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:21.575284 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cbms5" Jun 03 20:53:21.595944 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:21.595918 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-mh5kf" Jun 03 20:53:21.895636 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:21.895606 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:26.149883 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:26.149849 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dpjhc"] Jun 03 20:53:26.153331 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:26.153313 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dpjhc" Jun 03 20:53:26.156409 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:26.156390 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qkqzb\"" Jun 03 20:53:26.162632 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:26.162610 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dpjhc"] Jun 03 20:53:26.305314 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:26.305280 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31d9d1ba-cdcc-4002-b333-cbf77268ca1c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dpjhc\" (UID: \"31d9d1ba-cdcc-4002-b333-cbf77268ca1c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dpjhc" Jun 03 20:53:26.305523 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:26.305322 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31d9d1ba-cdcc-4002-b333-cbf77268ca1c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dpjhc\" (UID: \"31d9d1ba-cdcc-4002-b333-cbf77268ca1c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dpjhc" Jun 03 20:53:26.305523 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:26.305340 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gfv8\" (UniqueName: \"kubernetes.io/projected/31d9d1ba-cdcc-4002-b333-cbf77268ca1c-kube-api-access-4gfv8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dpjhc\" (UID: \"31d9d1ba-cdcc-4002-b333-cbf77268ca1c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dpjhc" Jun 03 20:53:26.406807 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:26.406721 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31d9d1ba-cdcc-4002-b333-cbf77268ca1c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dpjhc\" (UID: \"31d9d1ba-cdcc-4002-b333-cbf77268ca1c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dpjhc" Jun 03 20:53:26.406807 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:26.406762 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gfv8\" (UniqueName: \"kubernetes.io/projected/31d9d1ba-cdcc-4002-b333-cbf77268ca1c-kube-api-access-4gfv8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dpjhc\" (UID: \"31d9d1ba-cdcc-4002-b333-cbf77268ca1c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dpjhc" Jun 03 20:53:26.407038 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:26.406822 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31d9d1ba-cdcc-4002-b333-cbf77268ca1c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dpjhc\" (UID: \"31d9d1ba-cdcc-4002-b333-cbf77268ca1c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dpjhc" Jun 03 20:53:26.407126 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:26.407107 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31d9d1ba-cdcc-4002-b333-cbf77268ca1c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dpjhc\" (UID: \"31d9d1ba-cdcc-4002-b333-cbf77268ca1c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dpjhc" Jun 03 20:53:26.407185 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:26.407137 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31d9d1ba-cdcc-4002-b333-cbf77268ca1c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dpjhc\" (UID: \"31d9d1ba-cdcc-4002-b333-cbf77268ca1c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dpjhc" Jun 03 20:53:26.416319 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:26.416293 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gfv8\" (UniqueName: \"kubernetes.io/projected/31d9d1ba-cdcc-4002-b333-cbf77268ca1c-kube-api-access-4gfv8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dpjhc\" (UID: \"31d9d1ba-cdcc-4002-b333-cbf77268ca1c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dpjhc" Jun 03 20:53:26.463266 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:26.463234 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dpjhc" Jun 03 20:53:26.608257 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:26.608228 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dpjhc"] Jun 03 20:53:26.611116 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:53:26.611091 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31d9d1ba_cdcc_4002_b333_cbf77268ca1c.slice/crio-dd80f3d028738b53d0e01c6d2d0b7c0f48e758eb7160f7726fab2ce46537acd0 WatchSource:0}: Error finding container dd80f3d028738b53d0e01c6d2d0b7c0f48e758eb7160f7726fab2ce46537acd0: Status 404 returned error can't find the container with id dd80f3d028738b53d0e01c6d2d0b7c0f48e758eb7160f7726fab2ce46537acd0 Jun 03 20:53:26.758785 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:26.758747 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jj6rm"] Jun 03 20:53:26.762208 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:26.762188 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jj6rm" Jun 03 20:53:26.777663 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:26.777628 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jj6rm"] Jun 03 20:53:26.911389 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:26.911350 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wl5z\" (UniqueName: \"kubernetes.io/projected/0f42b2d3-9411-4391-b2b4-a964d0bc931f-kube-api-access-7wl5z\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jj6rm\" (UID: \"0f42b2d3-9411-4391-b2b4-a964d0bc931f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jj6rm" Jun 03 20:53:26.911579 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:26.911403 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f42b2d3-9411-4391-b2b4-a964d0bc931f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jj6rm\" (UID: \"0f42b2d3-9411-4391-b2b4-a964d0bc931f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jj6rm" Jun 03 20:53:26.911579 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:26.911512 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f42b2d3-9411-4391-b2b4-a964d0bc931f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jj6rm\" (UID: \"0f42b2d3-9411-4391-b2b4-a964d0bc931f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jj6rm" Jun 03 20:53:27.012674 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:27.012636 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f42b2d3-9411-4391-b2b4-a964d0bc931f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jj6rm\" (UID: \"0f42b2d3-9411-4391-b2b4-a964d0bc931f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jj6rm" Jun 03 20:53:27.012840 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:27.012688 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wl5z\" (UniqueName: \"kubernetes.io/projected/0f42b2d3-9411-4391-b2b4-a964d0bc931f-kube-api-access-7wl5z\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jj6rm\" (UID: \"0f42b2d3-9411-4391-b2b4-a964d0bc931f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jj6rm" Jun 03 20:53:27.012840 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:27.012722 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f42b2d3-9411-4391-b2b4-a964d0bc931f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jj6rm\" (UID: \"0f42b2d3-9411-4391-b2b4-a964d0bc931f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jj6rm" Jun 03 20:53:27.013031 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:27.013013 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f42b2d3-9411-4391-b2b4-a964d0bc931f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jj6rm\" (UID: \"0f42b2d3-9411-4391-b2b4-a964d0bc931f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jj6rm" Jun 03 20:53:27.013068 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:27.013039 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f42b2d3-9411-4391-b2b4-a964d0bc931f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jj6rm\" (UID: \"0f42b2d3-9411-4391-b2b4-a964d0bc931f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jj6rm" Jun 03 20:53:27.022215 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:27.022183 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wl5z\" (UniqueName: \"kubernetes.io/projected/0f42b2d3-9411-4391-b2b4-a964d0bc931f-kube-api-access-7wl5z\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jj6rm\" (UID: \"0f42b2d3-9411-4391-b2b4-a964d0bc931f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jj6rm" Jun 03 20:53:27.090371 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:27.090337 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jj6rm" Jun 03 20:53:27.177884 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:27.177843 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ggln8"] Jun 03 20:53:27.182485 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:27.182449 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ggln8" Jun 03 20:53:27.194487 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:27.194408 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ggln8"] Jun 03 20:53:27.235545 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:27.235520 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jj6rm"] Jun 03 20:53:27.237427 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:53:27.237402 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f42b2d3_9411_4391_b2b4_a964d0bc931f.slice/crio-4b552e03537cc811d14939734d749f76302cbd67fe1df7c4b2aa44a70c7b25c4 WatchSource:0}: Error finding container 4b552e03537cc811d14939734d749f76302cbd67fe1df7c4b2aa44a70c7b25c4: Status 404 returned error can't find the container with id 4b552e03537cc811d14939734d749f76302cbd67fe1df7c4b2aa44a70c7b25c4 Jun 03 20:53:27.315587 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:27.315564 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0dd242a-c271-4154-b50a-078632f1e110-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ggln8\" (UID: \"c0dd242a-c271-4154-b50a-078632f1e110\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ggln8" Jun 03 20:53:27.315718 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:27.315610 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xksqz\" (UniqueName: \"kubernetes.io/projected/c0dd242a-c271-4154-b50a-078632f1e110-kube-api-access-xksqz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ggln8\" (UID: \"c0dd242a-c271-4154-b50a-078632f1e110\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ggln8" Jun 03 20:53:27.315782 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:27.315732 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0dd242a-c271-4154-b50a-078632f1e110-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ggln8\" (UID: \"c0dd242a-c271-4154-b50a-078632f1e110\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ggln8" Jun 03 20:53:27.416971 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:27.416933 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0dd242a-c271-4154-b50a-078632f1e110-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ggln8\" (UID: \"c0dd242a-c271-4154-b50a-078632f1e110\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ggln8" Jun 03 20:53:27.417140 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:27.416988 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0dd242a-c271-4154-b50a-078632f1e110-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ggln8\" (UID: \"c0dd242a-c271-4154-b50a-078632f1e110\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ggln8" Jun 03 20:53:27.417140 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:27.417016 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xksqz\" (UniqueName: \"kubernetes.io/projected/c0dd242a-c271-4154-b50a-078632f1e110-kube-api-access-xksqz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ggln8\" (UID: \"c0dd242a-c271-4154-b50a-078632f1e110\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ggln8" Jun 03 20:53:27.417362 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:27.417337 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0dd242a-c271-4154-b50a-078632f1e110-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ggln8\" (UID: \"c0dd242a-c271-4154-b50a-078632f1e110\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ggln8" Jun 03 20:53:27.417420 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:27.417363 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0dd242a-c271-4154-b50a-078632f1e110-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ggln8\" (UID: \"c0dd242a-c271-4154-b50a-078632f1e110\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ggln8" Jun 03 20:53:27.427739 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:27.427715 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xksqz\" (UniqueName: \"kubernetes.io/projected/c0dd242a-c271-4154-b50a-078632f1e110-kube-api-access-xksqz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ggln8\" (UID: \"c0dd242a-c271-4154-b50a-078632f1e110\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ggln8" Jun 03 20:53:27.495690 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:27.495657 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ggln8" Jun 03 20:53:27.605038 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:27.605004 2573 generic.go:356] "Generic (PLEG): container finished" podID="31d9d1ba-cdcc-4002-b333-cbf77268ca1c" containerID="3e163a66214ee630e5914e4df47005e9e5bdc9416855c457368421302ce7ed8d" exitCode=0 Jun 03 20:53:27.605211 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:27.605101 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dpjhc" event={"ID":"31d9d1ba-cdcc-4002-b333-cbf77268ca1c","Type":"ContainerDied","Data":"3e163a66214ee630e5914e4df47005e9e5bdc9416855c457368421302ce7ed8d"} Jun 03 20:53:27.605211 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:27.605167 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dpjhc" event={"ID":"31d9d1ba-cdcc-4002-b333-cbf77268ca1c","Type":"ContainerStarted","Data":"dd80f3d028738b53d0e01c6d2d0b7c0f48e758eb7160f7726fab2ce46537acd0"} Jun 03 20:53:27.607065 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:27.607042 2573 generic.go:356] "Generic (PLEG): container finished" podID="0f42b2d3-9411-4391-b2b4-a964d0bc931f" containerID="e8f4be1f6b5c187a696186a56c2f7431464ad19ce98675e5d8da05030f4e8ad6" exitCode=0 Jun 03 20:53:27.607168 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:27.607096 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jj6rm" event={"ID":"0f42b2d3-9411-4391-b2b4-a964d0bc931f","Type":"ContainerDied","Data":"e8f4be1f6b5c187a696186a56c2f7431464ad19ce98675e5d8da05030f4e8ad6"} Jun 03 20:53:27.607168 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:27.607122 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jj6rm" event={"ID":"0f42b2d3-9411-4391-b2b4-a964d0bc931f","Type":"ContainerStarted","Data":"4b552e03537cc811d14939734d749f76302cbd67fe1df7c4b2aa44a70c7b25c4"} Jun 03 20:53:27.636486 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:27.635666 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ggln8"] Jun 03 20:53:27.764921 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:27.764891 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qk8d6"] Jun 03 20:53:27.768277 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:27.768257 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qk8d6" Jun 03 20:53:27.786290 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:27.786264 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qk8d6"] Jun 03 20:53:27.921776 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:27.921685 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1cc82b2-5f14-4f31-a4b1-fc400bd103bd-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qk8d6\" (UID: \"b1cc82b2-5f14-4f31-a4b1-fc400bd103bd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qk8d6" Jun 03 20:53:27.921776 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:27.921740 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1cc82b2-5f14-4f31-a4b1-fc400bd103bd-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qk8d6\" (UID: \"b1cc82b2-5f14-4f31-a4b1-fc400bd103bd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qk8d6" Jun 03 20:53:27.921968 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:27.921830 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vksk9\" (UniqueName: \"kubernetes.io/projected/b1cc82b2-5f14-4f31-a4b1-fc400bd103bd-kube-api-access-vksk9\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qk8d6\" (UID: \"b1cc82b2-5f14-4f31-a4b1-fc400bd103bd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qk8d6" Jun 03 20:53:28.023252 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:28.023222 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1cc82b2-5f14-4f31-a4b1-fc400bd103bd-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qk8d6\" (UID: \"b1cc82b2-5f14-4f31-a4b1-fc400bd103bd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qk8d6" Jun 03 20:53:28.023425 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:28.023266 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1cc82b2-5f14-4f31-a4b1-fc400bd103bd-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qk8d6\" (UID: \"b1cc82b2-5f14-4f31-a4b1-fc400bd103bd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qk8d6" Jun 03 20:53:28.023425 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:28.023293 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vksk9\" (UniqueName: \"kubernetes.io/projected/b1cc82b2-5f14-4f31-a4b1-fc400bd103bd-kube-api-access-vksk9\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qk8d6\" (UID: \"b1cc82b2-5f14-4f31-a4b1-fc400bd103bd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qk8d6" Jun 03 20:53:28.023688 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:28.023668 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1cc82b2-5f14-4f31-a4b1-fc400bd103bd-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qk8d6\" (UID: \"b1cc82b2-5f14-4f31-a4b1-fc400bd103bd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qk8d6" Jun 03 20:53:28.023756 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:28.023706 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1cc82b2-5f14-4f31-a4b1-fc400bd103bd-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qk8d6\" (UID: \"b1cc82b2-5f14-4f31-a4b1-fc400bd103bd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qk8d6" Jun 03 20:53:28.033796 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:28.033767 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vksk9\" (UniqueName: \"kubernetes.io/projected/b1cc82b2-5f14-4f31-a4b1-fc400bd103bd-kube-api-access-vksk9\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qk8d6\" (UID: \"b1cc82b2-5f14-4f31-a4b1-fc400bd103bd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qk8d6" Jun 03 20:53:28.097687 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:28.097639 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qk8d6" Jun 03 20:53:28.388400 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:28.388371 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qk8d6"] Jun 03 20:53:28.390169 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:53:28.390133 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1cc82b2_5f14_4f31_a4b1_fc400bd103bd.slice/crio-97a85f7bd915cc812342b4ba89c8a5a203a29742c428ae0e23ca931246e6a78b WatchSource:0}: Error finding container 97a85f7bd915cc812342b4ba89c8a5a203a29742c428ae0e23ca931246e6a78b: Status 404 returned error can't find the container with id 97a85f7bd915cc812342b4ba89c8a5a203a29742c428ae0e23ca931246e6a78b Jun 03 20:53:28.613127 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:28.613096 2573 generic.go:356] "Generic (PLEG): container finished" podID="31d9d1ba-cdcc-4002-b333-cbf77268ca1c" containerID="d4d6ccc08a236be1005b36c6cc87bb16b1964b4c95eba0f45d68c076b20c5b2f" exitCode=0 Jun 03 20:53:28.613221 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:28.613175 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dpjhc" event={"ID":"31d9d1ba-cdcc-4002-b333-cbf77268ca1c","Type":"ContainerDied","Data":"d4d6ccc08a236be1005b36c6cc87bb16b1964b4c95eba0f45d68c076b20c5b2f"} Jun 03 20:53:28.615103 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:28.615081 2573 generic.go:356] "Generic (PLEG): container finished" podID="0f42b2d3-9411-4391-b2b4-a964d0bc931f" containerID="204fa474ecbe47e2c4ad5c9fd6562d1fd2beb32850a1481f45e386f9a40abde3" exitCode=0 Jun 03 20:53:28.615201 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:28.615146 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jj6rm" event={"ID":"0f42b2d3-9411-4391-b2b4-a964d0bc931f","Type":"ContainerDied","Data":"204fa474ecbe47e2c4ad5c9fd6562d1fd2beb32850a1481f45e386f9a40abde3"} Jun 03 20:53:28.616649 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:28.616631 2573 generic.go:356] "Generic (PLEG): container finished" podID="c0dd242a-c271-4154-b50a-078632f1e110" containerID="3d8ae97e73c615380c3f293002704d9c52a54840b65347084d09729836446cbc" exitCode=0 Jun 03 20:53:28.616731 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:28.616691 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ggln8" event={"ID":"c0dd242a-c271-4154-b50a-078632f1e110","Type":"ContainerDied","Data":"3d8ae97e73c615380c3f293002704d9c52a54840b65347084d09729836446cbc"} Jun 03 20:53:28.616776 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:28.616731 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ggln8" event={"ID":"c0dd242a-c271-4154-b50a-078632f1e110","Type":"ContainerStarted","Data":"0b0582d86f0782e3afe2d23072b84458087f2ecc8d10f28044cb0f6972e32df4"} Jun 03 20:53:28.618383 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:28.618363 2573 generic.go:356] "Generic (PLEG): container finished" podID="b1cc82b2-5f14-4f31-a4b1-fc400bd103bd" containerID="bb50616ed413202dbc912b1bd834815e1bd5eb11cacc7c640b308be4bfc883cc" exitCode=0 Jun 03 20:53:28.618434 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:28.618402 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qk8d6" event={"ID":"b1cc82b2-5f14-4f31-a4b1-fc400bd103bd","Type":"ContainerDied","Data":"bb50616ed413202dbc912b1bd834815e1bd5eb11cacc7c640b308be4bfc883cc"} Jun 03 20:53:28.618521 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:28.618506 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qk8d6" event={"ID":"b1cc82b2-5f14-4f31-a4b1-fc400bd103bd","Type":"ContainerStarted","Data":"97a85f7bd915cc812342b4ba89c8a5a203a29742c428ae0e23ca931246e6a78b"} Jun 03 20:53:29.625720 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:29.625611 2573 generic.go:356] "Generic (PLEG): container finished" podID="31d9d1ba-cdcc-4002-b333-cbf77268ca1c" containerID="d2c43ee35fd0374d51c9913dd0fcb5e52776dbb4a371f7858998ad7bf1aa74d7" exitCode=0 Jun 03 20:53:29.626179 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:29.625711 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dpjhc" event={"ID":"31d9d1ba-cdcc-4002-b333-cbf77268ca1c","Type":"ContainerDied","Data":"d2c43ee35fd0374d51c9913dd0fcb5e52776dbb4a371f7858998ad7bf1aa74d7"} Jun 03 20:53:29.627832 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:29.627808 2573 generic.go:356] "Generic (PLEG): container finished" podID="0f42b2d3-9411-4391-b2b4-a964d0bc931f" containerID="95ba32ec7518c1b36c89655686c16be5b5a24068f08c411913511ea591734229" exitCode=0 Jun 03 20:53:29.627935 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:29.627880 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jj6rm" event={"ID":"0f42b2d3-9411-4391-b2b4-a964d0bc931f","Type":"ContainerDied","Data":"95ba32ec7518c1b36c89655686c16be5b5a24068f08c411913511ea591734229"} Jun 03 20:53:29.629531 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:29.629508 2573 generic.go:356] "Generic (PLEG): container finished" podID="c0dd242a-c271-4154-b50a-078632f1e110" containerID="e15f09bb0f34babf1ff7a73b7d36cd9e8b40e34c3d6c32fd03ba8703ba5be5cb" exitCode=0 Jun 03 20:53:29.629614 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:29.629585 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ggln8" event={"ID":"c0dd242a-c271-4154-b50a-078632f1e110","Type":"ContainerDied","Data":"e15f09bb0f34babf1ff7a73b7d36cd9e8b40e34c3d6c32fd03ba8703ba5be5cb"} Jun 03 20:53:29.631519 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:29.631498 2573 generic.go:356] "Generic (PLEG): container finished" podID="b1cc82b2-5f14-4f31-a4b1-fc400bd103bd" containerID="078ab68c4a923341884e752d51fc8d6cc58e56b851dfee462f0e09fe230432be" exitCode=0 Jun 03 20:53:29.631626 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:29.631546 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qk8d6" event={"ID":"b1cc82b2-5f14-4f31-a4b1-fc400bd103bd","Type":"ContainerDied","Data":"078ab68c4a923341884e752d51fc8d6cc58e56b851dfee462f0e09fe230432be"} Jun 03 20:53:30.638582 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:30.638545 2573 generic.go:356] "Generic (PLEG): container finished" podID="b1cc82b2-5f14-4f31-a4b1-fc400bd103bd" containerID="d5d0e43054a6ec7fd1f06216843be2c10b73bbc544e258774cb7cb9ed3a653cc" exitCode=0 Jun 03 20:53:30.638956 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:30.638630 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qk8d6" event={"ID":"b1cc82b2-5f14-4f31-a4b1-fc400bd103bd","Type":"ContainerDied","Data":"d5d0e43054a6ec7fd1f06216843be2c10b73bbc544e258774cb7cb9ed3a653cc"} Jun 03 20:53:30.640484 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:30.640449 2573 generic.go:356] "Generic (PLEG): container finished" podID="c0dd242a-c271-4154-b50a-078632f1e110" containerID="c9910b6ef0c11dadec9f6ccb7e9ef6d5b71a3190dbe5b9030bd7056b8ebad80f" exitCode=0 Jun 03 20:53:30.640596 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:30.640509 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ggln8" event={"ID":"c0dd242a-c271-4154-b50a-078632f1e110","Type":"ContainerDied","Data":"c9910b6ef0c11dadec9f6ccb7e9ef6d5b71a3190dbe5b9030bd7056b8ebad80f"} Jun 03 20:53:30.779986 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:30.779961 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dpjhc" Jun 03 20:53:30.796164 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:30.796145 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jj6rm" Jun 03 20:53:30.946540 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:30.946432 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31d9d1ba-cdcc-4002-b333-cbf77268ca1c-util\") pod \"31d9d1ba-cdcc-4002-b333-cbf77268ca1c\" (UID: \"31d9d1ba-cdcc-4002-b333-cbf77268ca1c\") " Jun 03 20:53:30.946540 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:30.946468 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f42b2d3-9411-4391-b2b4-a964d0bc931f-bundle\") pod \"0f42b2d3-9411-4391-b2b4-a964d0bc931f\" (UID: \"0f42b2d3-9411-4391-b2b4-a964d0bc931f\") " Jun 03 20:53:30.946540 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:30.946523 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f42b2d3-9411-4391-b2b4-a964d0bc931f-util\") pod \"0f42b2d3-9411-4391-b2b4-a964d0bc931f\" (UID: \"0f42b2d3-9411-4391-b2b4-a964d0bc931f\") " Jun 03 20:53:30.946813 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:30.946553 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wl5z\" (UniqueName: \"kubernetes.io/projected/0f42b2d3-9411-4391-b2b4-a964d0bc931f-kube-api-access-7wl5z\") pod \"0f42b2d3-9411-4391-b2b4-a964d0bc931f\" (UID: \"0f42b2d3-9411-4391-b2b4-a964d0bc931f\") " Jun 03 20:53:30.946813 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:30.946609 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4gfv8\" (UniqueName: \"kubernetes.io/projected/31d9d1ba-cdcc-4002-b333-cbf77268ca1c-kube-api-access-4gfv8\") pod \"31d9d1ba-cdcc-4002-b333-cbf77268ca1c\" (UID: \"31d9d1ba-cdcc-4002-b333-cbf77268ca1c\") " Jun 03 20:53:30.946813 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:30.946659 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31d9d1ba-cdcc-4002-b333-cbf77268ca1c-bundle\") pod \"31d9d1ba-cdcc-4002-b333-cbf77268ca1c\" (UID: \"31d9d1ba-cdcc-4002-b333-cbf77268ca1c\") " Jun 03 20:53:30.947240 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:30.947208 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f42b2d3-9411-4391-b2b4-a964d0bc931f-bundle" (OuterVolumeSpecName: "bundle") pod "0f42b2d3-9411-4391-b2b4-a964d0bc931f" (UID: "0f42b2d3-9411-4391-b2b4-a964d0bc931f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:53:30.947436 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:30.947412 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31d9d1ba-cdcc-4002-b333-cbf77268ca1c-bundle" (OuterVolumeSpecName: "bundle") pod "31d9d1ba-cdcc-4002-b333-cbf77268ca1c" (UID: "31d9d1ba-cdcc-4002-b333-cbf77268ca1c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:53:30.948765 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:30.948737 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31d9d1ba-cdcc-4002-b333-cbf77268ca1c-kube-api-access-4gfv8" (OuterVolumeSpecName: "kube-api-access-4gfv8") pod "31d9d1ba-cdcc-4002-b333-cbf77268ca1c" (UID: "31d9d1ba-cdcc-4002-b333-cbf77268ca1c"). InnerVolumeSpecName "kube-api-access-4gfv8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:53:30.949040 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:30.949021 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f42b2d3-9411-4391-b2b4-a964d0bc931f-kube-api-access-7wl5z" (OuterVolumeSpecName: "kube-api-access-7wl5z") pod "0f42b2d3-9411-4391-b2b4-a964d0bc931f" (UID: "0f42b2d3-9411-4391-b2b4-a964d0bc931f"). InnerVolumeSpecName "kube-api-access-7wl5z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:53:30.952244 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:30.952220 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31d9d1ba-cdcc-4002-b333-cbf77268ca1c-util" (OuterVolumeSpecName: "util") pod "31d9d1ba-cdcc-4002-b333-cbf77268ca1c" (UID: "31d9d1ba-cdcc-4002-b333-cbf77268ca1c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:53:30.952810 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:30.952791 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f42b2d3-9411-4391-b2b4-a964d0bc931f-util" (OuterVolumeSpecName: "util") pod "0f42b2d3-9411-4391-b2b4-a964d0bc931f" (UID: "0f42b2d3-9411-4391-b2b4-a964d0bc931f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:53:31.047480 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:31.047437 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31d9d1ba-cdcc-4002-b333-cbf77268ca1c-bundle\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:53:31.047480 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:31.047488 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31d9d1ba-cdcc-4002-b333-cbf77268ca1c-util\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:53:31.047643 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:31.047500 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f42b2d3-9411-4391-b2b4-a964d0bc931f-bundle\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:53:31.047643 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:31.047508 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f42b2d3-9411-4391-b2b4-a964d0bc931f-util\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:53:31.047643 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:31.047518 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wl5z\" (UniqueName: \"kubernetes.io/projected/0f42b2d3-9411-4391-b2b4-a964d0bc931f-kube-api-access-7wl5z\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:53:31.047643 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:31.047528 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4gfv8\" (UniqueName: \"kubernetes.io/projected/31d9d1ba-cdcc-4002-b333-cbf77268ca1c-kube-api-access-4gfv8\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:53:31.647002 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:31.646973 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dpjhc" Jun 03 20:53:31.647454 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:31.647000 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dpjhc" event={"ID":"31d9d1ba-cdcc-4002-b333-cbf77268ca1c","Type":"ContainerDied","Data":"dd80f3d028738b53d0e01c6d2d0b7c0f48e758eb7160f7726fab2ce46537acd0"} Jun 03 20:53:31.647454 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:31.647048 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd80f3d028738b53d0e01c6d2d0b7c0f48e758eb7160f7726fab2ce46537acd0" Jun 03 20:53:31.648852 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:31.648826 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jj6rm" event={"ID":"0f42b2d3-9411-4391-b2b4-a964d0bc931f","Type":"ContainerDied","Data":"4b552e03537cc811d14939734d749f76302cbd67fe1df7c4b2aa44a70c7b25c4"} Jun 03 20:53:31.648956 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:31.648873 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b552e03537cc811d14939734d749f76302cbd67fe1df7c4b2aa44a70c7b25c4" Jun 03 20:53:31.648956 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:31.648840 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jj6rm" Jun 03 20:53:31.805723 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:31.805703 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qk8d6" Jun 03 20:53:31.807679 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:31.807659 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ggln8" Jun 03 20:53:31.954832 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:31.954749 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vksk9\" (UniqueName: \"kubernetes.io/projected/b1cc82b2-5f14-4f31-a4b1-fc400bd103bd-kube-api-access-vksk9\") pod \"b1cc82b2-5f14-4f31-a4b1-fc400bd103bd\" (UID: \"b1cc82b2-5f14-4f31-a4b1-fc400bd103bd\") " Jun 03 20:53:31.954832 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:31.954790 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xksqz\" (UniqueName: \"kubernetes.io/projected/c0dd242a-c271-4154-b50a-078632f1e110-kube-api-access-xksqz\") pod \"c0dd242a-c271-4154-b50a-078632f1e110\" (UID: \"c0dd242a-c271-4154-b50a-078632f1e110\") " Jun 03 20:53:31.954832 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:31.954824 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0dd242a-c271-4154-b50a-078632f1e110-util\") pod \"c0dd242a-c271-4154-b50a-078632f1e110\" (UID: \"c0dd242a-c271-4154-b50a-078632f1e110\") " Jun 03 20:53:31.955107 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:31.954865 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1cc82b2-5f14-4f31-a4b1-fc400bd103bd-util\") pod \"b1cc82b2-5f14-4f31-a4b1-fc400bd103bd\" (UID: \"b1cc82b2-5f14-4f31-a4b1-fc400bd103bd\") " Jun 03 20:53:31.955107 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:31.954898 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1cc82b2-5f14-4f31-a4b1-fc400bd103bd-bundle\") pod \"b1cc82b2-5f14-4f31-a4b1-fc400bd103bd\" (UID: \"b1cc82b2-5f14-4f31-a4b1-fc400bd103bd\") " Jun 03 20:53:31.955107 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:31.954973 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0dd242a-c271-4154-b50a-078632f1e110-bundle\") pod \"c0dd242a-c271-4154-b50a-078632f1e110\" (UID: \"c0dd242a-c271-4154-b50a-078632f1e110\") " Jun 03 20:53:31.955513 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:31.955431 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0dd242a-c271-4154-b50a-078632f1e110-bundle" (OuterVolumeSpecName: "bundle") pod "c0dd242a-c271-4154-b50a-078632f1e110" (UID: "c0dd242a-c271-4154-b50a-078632f1e110"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:53:31.955513 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:31.955435 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1cc82b2-5f14-4f31-a4b1-fc400bd103bd-bundle" (OuterVolumeSpecName: "bundle") pod "b1cc82b2-5f14-4f31-a4b1-fc400bd103bd" (UID: "b1cc82b2-5f14-4f31-a4b1-fc400bd103bd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:53:31.957023 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:31.956994 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1cc82b2-5f14-4f31-a4b1-fc400bd103bd-kube-api-access-vksk9" (OuterVolumeSpecName: "kube-api-access-vksk9") pod "b1cc82b2-5f14-4f31-a4b1-fc400bd103bd" (UID: "b1cc82b2-5f14-4f31-a4b1-fc400bd103bd"). InnerVolumeSpecName "kube-api-access-vksk9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:53:31.957153 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:31.957077 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0dd242a-c271-4154-b50a-078632f1e110-kube-api-access-xksqz" (OuterVolumeSpecName: "kube-api-access-xksqz") pod "c0dd242a-c271-4154-b50a-078632f1e110" (UID: "c0dd242a-c271-4154-b50a-078632f1e110"). InnerVolumeSpecName "kube-api-access-xksqz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:53:31.960981 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:31.960950 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0dd242a-c271-4154-b50a-078632f1e110-util" (OuterVolumeSpecName: "util") pod "c0dd242a-c271-4154-b50a-078632f1e110" (UID: "c0dd242a-c271-4154-b50a-078632f1e110"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:53:31.961168 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:31.961149 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1cc82b2-5f14-4f31-a4b1-fc400bd103bd-util" (OuterVolumeSpecName: "util") pod "b1cc82b2-5f14-4f31-a4b1-fc400bd103bd" (UID: "b1cc82b2-5f14-4f31-a4b1-fc400bd103bd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:53:32.055757 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:32.055731 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0dd242a-c271-4154-b50a-078632f1e110-bundle\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:53:32.055757 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:32.055754 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vksk9\" (UniqueName: \"kubernetes.io/projected/b1cc82b2-5f14-4f31-a4b1-fc400bd103bd-kube-api-access-vksk9\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:53:32.055906 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:32.055765 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xksqz\" (UniqueName: \"kubernetes.io/projected/c0dd242a-c271-4154-b50a-078632f1e110-kube-api-access-xksqz\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:53:32.055906 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:32.055773 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0dd242a-c271-4154-b50a-078632f1e110-util\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:53:32.055906 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:32.055782 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1cc82b2-5f14-4f31-a4b1-fc400bd103bd-util\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:53:32.055906 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:32.055789 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1cc82b2-5f14-4f31-a4b1-fc400bd103bd-bundle\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:53:32.655630 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:32.655592 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ggln8" Jun 03 20:53:32.656055 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:32.655602 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ggln8" event={"ID":"c0dd242a-c271-4154-b50a-078632f1e110","Type":"ContainerDied","Data":"0b0582d86f0782e3afe2d23072b84458087f2ecc8d10f28044cb0f6972e32df4"} Jun 03 20:53:32.656055 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:32.655715 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0b0582d86f0782e3afe2d23072b84458087f2ecc8d10f28044cb0f6972e32df4" Jun 03 20:53:32.657363 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:32.657317 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qk8d6" event={"ID":"b1cc82b2-5f14-4f31-a4b1-fc400bd103bd","Type":"ContainerDied","Data":"97a85f7bd915cc812342b4ba89c8a5a203a29742c428ae0e23ca931246e6a78b"} Jun 03 20:53:32.657363 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:32.657356 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qk8d6" Jun 03 20:53:32.657569 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:32.657364 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="97a85f7bd915cc812342b4ba89c8a5a203a29742c428ae0e23ca931246e6a78b" Jun 03 20:53:34.345050 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:34.345005 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:35.090514 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:35.090464 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:35.494866 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:35.494823 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:35.642921 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:35.642881 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:39.367953 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:39.367917 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:41.499239 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:41.499197 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:42.158568 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:42.158501 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:43.394527 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:43.394498 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:44.992675 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:44.992632 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkq8m"] Jun 03 20:53:44.993160 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:44.993107 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f42b2d3-9411-4391-b2b4-a964d0bc931f" containerName="extract" Jun 03 20:53:44.993160 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:44.993124 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f42b2d3-9411-4391-b2b4-a964d0bc931f" containerName="extract" Jun 03 20:53:44.993160 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:44.993138 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f42b2d3-9411-4391-b2b4-a964d0bc931f" containerName="util" Jun 03 20:53:44.993160 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:44.993146 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f42b2d3-9411-4391-b2b4-a964d0bc931f" containerName="util" Jun 03 20:53:44.993160 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:44.993156 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31d9d1ba-cdcc-4002-b333-cbf77268ca1c" containerName="util" Jun 03 20:53:44.993426 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:44.993166 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="31d9d1ba-cdcc-4002-b333-cbf77268ca1c" containerName="util" Jun 03 20:53:44.993426 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:44.993175 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31d9d1ba-cdcc-4002-b333-cbf77268ca1c" containerName="extract" Jun 03 20:53:44.993426 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:44.993183 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="31d9d1ba-cdcc-4002-b333-cbf77268ca1c" containerName="extract" Jun 03 20:53:44.993426 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:44.993202 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1cc82b2-5f14-4f31-a4b1-fc400bd103bd" containerName="util" Jun 03 20:53:44.993426 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:44.993209 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1cc82b2-5f14-4f31-a4b1-fc400bd103bd" containerName="util" Jun 03 20:53:44.993426 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:44.993224 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0dd242a-c271-4154-b50a-078632f1e110" containerName="util" Jun 03 20:53:44.993426 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:44.993232 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0dd242a-c271-4154-b50a-078632f1e110" containerName="util" Jun 03 20:53:44.993426 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:44.993240 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31d9d1ba-cdcc-4002-b333-cbf77268ca1c" containerName="pull" Jun 03 20:53:44.993426 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:44.993247 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="31d9d1ba-cdcc-4002-b333-cbf77268ca1c" containerName="pull" Jun 03 20:53:44.993426 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:44.993261 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f42b2d3-9411-4391-b2b4-a964d0bc931f" containerName="pull" Jun 03 20:53:44.993426 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:44.993268 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f42b2d3-9411-4391-b2b4-a964d0bc931f" containerName="pull" Jun 03 20:53:44.993426 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:44.993277 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1cc82b2-5f14-4f31-a4b1-fc400bd103bd" containerName="pull" Jun 03 20:53:44.993426 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:44.993286 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1cc82b2-5f14-4f31-a4b1-fc400bd103bd" containerName="pull" Jun 03 20:53:44.993426 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:44.993296 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1cc82b2-5f14-4f31-a4b1-fc400bd103bd" containerName="extract" Jun 03 20:53:44.993426 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:44.993303 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1cc82b2-5f14-4f31-a4b1-fc400bd103bd" containerName="extract" Jun 03 20:53:44.993426 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:44.993316 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0dd242a-c271-4154-b50a-078632f1e110" containerName="pull" Jun 03 20:53:44.993426 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:44.993324 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0dd242a-c271-4154-b50a-078632f1e110" containerName="pull" Jun 03 20:53:44.993426 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:44.993342 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0dd242a-c271-4154-b50a-078632f1e110" containerName="extract" Jun 03 20:53:44.993426 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:44.993350 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0dd242a-c271-4154-b50a-078632f1e110" containerName="extract" Jun 03 20:53:44.993426 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:44.993428 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0dd242a-c271-4154-b50a-078632f1e110" containerName="extract" Jun 03 20:53:44.994335 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:44.993440 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="31d9d1ba-cdcc-4002-b333-cbf77268ca1c" containerName="extract" Jun 03 20:53:44.994335 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:44.993448 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f42b2d3-9411-4391-b2b4-a964d0bc931f" containerName="extract" Jun 03 20:53:44.994335 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:44.993458 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1cc82b2-5f14-4f31-a4b1-fc400bd103bd" containerName="extract" Jun 03 20:53:45.001426 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:45.001403 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkq8m" Jun 03 20:53:45.008503 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:45.008464 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nd7pt\"" Jun 03 20:53:45.019281 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:45.019254 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkq8m"] Jun 03 20:53:45.065004 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:45.064973 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/253d2645-7e04-4ed2-83c2-c0c1ff1c6a28-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zkq8m\" (UID: \"253d2645-7e04-4ed2-83c2-c0c1ff1c6a28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkq8m" Jun 03 20:53:45.065118 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:45.065015 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6rvd\" (UniqueName: \"kubernetes.io/projected/253d2645-7e04-4ed2-83c2-c0c1ff1c6a28-kube-api-access-t6rvd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zkq8m\" (UID: \"253d2645-7e04-4ed2-83c2-c0c1ff1c6a28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkq8m" Jun 03 20:53:45.165574 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:45.165538 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/253d2645-7e04-4ed2-83c2-c0c1ff1c6a28-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zkq8m\" (UID: \"253d2645-7e04-4ed2-83c2-c0c1ff1c6a28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkq8m" Jun 03 20:53:45.165768 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:45.165585 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6rvd\" (UniqueName: \"kubernetes.io/projected/253d2645-7e04-4ed2-83c2-c0c1ff1c6a28-kube-api-access-t6rvd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zkq8m\" (UID: \"253d2645-7e04-4ed2-83c2-c0c1ff1c6a28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkq8m" Jun 03 20:53:45.165996 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:45.165971 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/253d2645-7e04-4ed2-83c2-c0c1ff1c6a28-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zkq8m\" (UID: \"253d2645-7e04-4ed2-83c2-c0c1ff1c6a28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkq8m" Jun 03 20:53:45.178726 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:45.178697 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6rvd\" (UniqueName: \"kubernetes.io/projected/253d2645-7e04-4ed2-83c2-c0c1ff1c6a28-kube-api-access-t6rvd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zkq8m\" (UID: \"253d2645-7e04-4ed2-83c2-c0c1ff1c6a28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkq8m" Jun 03 20:53:45.310763 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:45.310676 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkq8m" Jun 03 20:53:45.349274 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:45.349236 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:45.476735 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:45.476701 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkq8m"] Jun 03 20:53:45.484608 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:53:45.484573 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod253d2645_7e04_4ed2_83c2_c0c1ff1c6a28.slice/crio-159329b4c48a87c651b2264943f5d9d3108610781bd7bd05c4a22f861bd8df2d WatchSource:0}: Error finding container 159329b4c48a87c651b2264943f5d9d3108610781bd7bd05c4a22f861bd8df2d: Status 404 returned error can't find the container with id 159329b4c48a87c651b2264943f5d9d3108610781bd7bd05c4a22f861bd8df2d Jun 03 20:53:45.727391 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:45.727358 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkq8m" event={"ID":"253d2645-7e04-4ed2-83c2-c0c1ff1c6a28","Type":"ContainerStarted","Data":"159329b4c48a87c651b2264943f5d9d3108610781bd7bd05c4a22f861bd8df2d"} Jun 03 20:53:45.994325 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:45.994232 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:48.567151 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:48.567119 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:48.746664 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:48.746633 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkq8m" event={"ID":"253d2645-7e04-4ed2-83c2-c0c1ff1c6a28","Type":"ContainerStarted","Data":"b243fc04e00a6f5360453774588ec48291e9d70ad0a5251577f142666ae055b3"} Jun 03 20:53:48.746840 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:48.746763 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkq8m" Jun 03 20:53:48.832048 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:48.831962 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:48.903436 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:48.903386 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkq8m" podStartSLOduration=1.814555574 podStartE2EDuration="4.903370805s" totalImagesPullingTime="3.088815231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:53:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:53:48.899591087 +0000 UTC m=+655.149001562" watchObservedRunningTime="2026-06-03 20:53:48.903370805 +0000 UTC m=+655.152781279" Jun 03 20:53:49.083232 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:49.083145 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:49.328988 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:49.328958 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:51.631913 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:51.631882 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:51.844277 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:51.844242 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:52.198359 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:52.198325 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55f45b7c4b-rp8sm"] Jun 03 20:53:52.203069 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:52.203047 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55f45b7c4b-rp8sm" Jun 03 20:53:52.209504 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:52.209450 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 03 20:53:52.210660 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:52.210276 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 03 20:53:52.210660 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:52.210282 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 03 20:53:52.210660 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:52.210614 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 03 20:53:52.211890 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:52.211870 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 03 20:53:52.213500 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:52.213464 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7z6lx\"" Jun 03 20:53:52.217131 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:52.217114 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 03 20:53:52.222846 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:52.222824 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55f45b7c4b-rp8sm"] Jun 03 20:53:52.267698 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:52.267672 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:52.326146 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:52.326122 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff7774cd-5884-4434-8756-5a9483add0aa-service-ca\") pod \"console-55f45b7c4b-rp8sm\" (UID: \"ff7774cd-5884-4434-8756-5a9483add0aa\") " pod="openshift-console/console-55f45b7c4b-rp8sm" Jun 03 20:53:52.326261 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:52.326183 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff7774cd-5884-4434-8756-5a9483add0aa-console-oauth-config\") pod \"console-55f45b7c4b-rp8sm\" (UID: \"ff7774cd-5884-4434-8756-5a9483add0aa\") " pod="openshift-console/console-55f45b7c4b-rp8sm" Jun 03 20:53:52.326261 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:52.326219 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff7774cd-5884-4434-8756-5a9483add0aa-console-serving-cert\") pod \"console-55f45b7c4b-rp8sm\" (UID: \"ff7774cd-5884-4434-8756-5a9483add0aa\") " pod="openshift-console/console-55f45b7c4b-rp8sm" Jun 03 20:53:52.326261 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:52.326241 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff7774cd-5884-4434-8756-5a9483add0aa-trusted-ca-bundle\") pod \"console-55f45b7c4b-rp8sm\" (UID: \"ff7774cd-5884-4434-8756-5a9483add0aa\") " pod="openshift-console/console-55f45b7c4b-rp8sm" Jun 03 20:53:52.326410 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:52.326329 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff7774cd-5884-4434-8756-5a9483add0aa-oauth-serving-cert\") pod \"console-55f45b7c4b-rp8sm\" (UID: \"ff7774cd-5884-4434-8756-5a9483add0aa\") " pod="openshift-console/console-55f45b7c4b-rp8sm" Jun 03 20:53:52.326410 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:52.326354 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w494z\" (UniqueName: \"kubernetes.io/projected/ff7774cd-5884-4434-8756-5a9483add0aa-kube-api-access-w494z\") pod \"console-55f45b7c4b-rp8sm\" (UID: \"ff7774cd-5884-4434-8756-5a9483add0aa\") " pod="openshift-console/console-55f45b7c4b-rp8sm" Jun 03 20:53:52.326410 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:52.326384 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff7774cd-5884-4434-8756-5a9483add0aa-console-config\") pod \"console-55f45b7c4b-rp8sm\" (UID: \"ff7774cd-5884-4434-8756-5a9483add0aa\") " pod="openshift-console/console-55f45b7c4b-rp8sm" Jun 03 20:53:52.387097 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:52.387069 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:52.427292 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:52.427270 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff7774cd-5884-4434-8756-5a9483add0aa-console-serving-cert\") pod \"console-55f45b7c4b-rp8sm\" (UID: \"ff7774cd-5884-4434-8756-5a9483add0aa\") " pod="openshift-console/console-55f45b7c4b-rp8sm" Jun 03 20:53:52.427393 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:52.427298 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff7774cd-5884-4434-8756-5a9483add0aa-trusted-ca-bundle\") pod \"console-55f45b7c4b-rp8sm\" (UID: \"ff7774cd-5884-4434-8756-5a9483add0aa\") " pod="openshift-console/console-55f45b7c4b-rp8sm" Jun 03 20:53:52.427393 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:52.427321 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff7774cd-5884-4434-8756-5a9483add0aa-oauth-serving-cert\") pod \"console-55f45b7c4b-rp8sm\" (UID: \"ff7774cd-5884-4434-8756-5a9483add0aa\") " pod="openshift-console/console-55f45b7c4b-rp8sm" Jun 03 20:53:52.427393 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:52.427336 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w494z\" (UniqueName: \"kubernetes.io/projected/ff7774cd-5884-4434-8756-5a9483add0aa-kube-api-access-w494z\") pod \"console-55f45b7c4b-rp8sm\" (UID: \"ff7774cd-5884-4434-8756-5a9483add0aa\") " pod="openshift-console/console-55f45b7c4b-rp8sm" Jun 03 20:53:52.427393 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:52.427355 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff7774cd-5884-4434-8756-5a9483add0aa-console-config\") pod \"console-55f45b7c4b-rp8sm\" (UID: \"ff7774cd-5884-4434-8756-5a9483add0aa\") " pod="openshift-console/console-55f45b7c4b-rp8sm" Jun 03 20:53:52.427593 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:52.427403 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff7774cd-5884-4434-8756-5a9483add0aa-service-ca\") pod \"console-55f45b7c4b-rp8sm\" (UID: \"ff7774cd-5884-4434-8756-5a9483add0aa\") " pod="openshift-console/console-55f45b7c4b-rp8sm" Jun 03 20:53:52.427593 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:52.427438 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff7774cd-5884-4434-8756-5a9483add0aa-console-oauth-config\") pod \"console-55f45b7c4b-rp8sm\" (UID: \"ff7774cd-5884-4434-8756-5a9483add0aa\") " pod="openshift-console/console-55f45b7c4b-rp8sm" Jun 03 20:53:52.428122 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:52.428098 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff7774cd-5884-4434-8756-5a9483add0aa-service-ca\") pod \"console-55f45b7c4b-rp8sm\" (UID: \"ff7774cd-5884-4434-8756-5a9483add0aa\") " pod="openshift-console/console-55f45b7c4b-rp8sm" Jun 03 20:53:52.428207 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:52.428117 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff7774cd-5884-4434-8756-5a9483add0aa-console-config\") pod \"console-55f45b7c4b-rp8sm\" (UID: \"ff7774cd-5884-4434-8756-5a9483add0aa\") " pod="openshift-console/console-55f45b7c4b-rp8sm" Jun 03 20:53:52.428207 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:52.428146 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff7774cd-5884-4434-8756-5a9483add0aa-oauth-serving-cert\") pod \"console-55f45b7c4b-rp8sm\" (UID: \"ff7774cd-5884-4434-8756-5a9483add0aa\") " pod="openshift-console/console-55f45b7c4b-rp8sm" Jun 03 20:53:52.428346 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:52.428323 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff7774cd-5884-4434-8756-5a9483add0aa-trusted-ca-bundle\") pod \"console-55f45b7c4b-rp8sm\" (UID: \"ff7774cd-5884-4434-8756-5a9483add0aa\") " pod="openshift-console/console-55f45b7c4b-rp8sm" Jun 03 20:53:52.429897 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:52.429876 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff7774cd-5884-4434-8756-5a9483add0aa-console-oauth-config\") pod \"console-55f45b7c4b-rp8sm\" (UID: \"ff7774cd-5884-4434-8756-5a9483add0aa\") " pod="openshift-console/console-55f45b7c4b-rp8sm" Jun 03 20:53:52.430036 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:52.430018 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff7774cd-5884-4434-8756-5a9483add0aa-console-serving-cert\") pod \"console-55f45b7c4b-rp8sm\" (UID: \"ff7774cd-5884-4434-8756-5a9483add0aa\") " pod="openshift-console/console-55f45b7c4b-rp8sm" Jun 03 20:53:52.439576 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:52.439552 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w494z\" (UniqueName: \"kubernetes.io/projected/ff7774cd-5884-4434-8756-5a9483add0aa-kube-api-access-w494z\") pod \"console-55f45b7c4b-rp8sm\" (UID: \"ff7774cd-5884-4434-8756-5a9483add0aa\") " pod="openshift-console/console-55f45b7c4b-rp8sm" Jun 03 20:53:52.513586 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:52.513561 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55f45b7c4b-rp8sm" Jun 03 20:53:52.670990 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:52.670960 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55f45b7c4b-rp8sm"] Jun 03 20:53:52.676531 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:53:52.676404 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff7774cd_5884_4434_8756_5a9483add0aa.slice/crio-9170c777d8c732b993d1a7ef31408f793396fefc21621a9a597eaa24ad178fba WatchSource:0}: Error finding container 9170c777d8c732b993d1a7ef31408f793396fefc21621a9a597eaa24ad178fba: Status 404 returned error can't find the container with id 9170c777d8c732b993d1a7ef31408f793396fefc21621a9a597eaa24ad178fba Jun 03 20:53:52.719341 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:52.719314 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:52.769315 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:52.769235 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55f45b7c4b-rp8sm" event={"ID":"ff7774cd-5884-4434-8756-5a9483add0aa","Type":"ContainerStarted","Data":"816963d7d68afe2d08ec655cc74e3956157069c4ffbf213ead872e3668bfd8a9"} Jun 03 20:53:52.769315 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:52.769287 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55f45b7c4b-rp8sm" event={"ID":"ff7774cd-5884-4434-8756-5a9483add0aa","Type":"ContainerStarted","Data":"9170c777d8c732b993d1a7ef31408f793396fefc21621a9a597eaa24ad178fba"} Jun 03 20:53:52.800602 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:52.798619 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55f45b7c4b-rp8sm" podStartSLOduration=0.798599709 podStartE2EDuration="798.599709ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:53:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:53:52.793889397 +0000 UTC m=+659.043299872" watchObservedRunningTime="2026-06-03 20:53:52.798599709 +0000 UTC m=+659.048010184" Jun 03 20:53:52.844822 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:52.844788 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:55.981405 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:55.981373 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:56.088759 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:56.088717 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:53:59.754456 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:53:59.754423 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkq8m" Jun 03 20:54:01.941919 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:01.941884 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkq8m"] Jun 03 20:54:01.942287 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:01.942050 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkq8m" podUID="253d2645-7e04-4ed2-83c2-c0c1ff1c6a28" containerName="manager" containerID="cri-o://b243fc04e00a6f5360453774588ec48291e9d70ad0a5251577f142666ae055b3" gracePeriod=2 Jun 03 20:54:01.963091 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:01.963056 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkq8m"] Jun 03 20:54:01.973996 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:54:01.973951 2573 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"253d2645-7e04-4ed2-83c2-c0c1ff1c6a28\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-zkq8m\": pods \"kuadrant-operator-controller-manager-8684c9ff49-zkq8m\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkq8m" Jun 03 20:54:02.024585 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:02.024554 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-snb5g"] Jun 03 20:54:02.024873 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:02.024860 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="253d2645-7e04-4ed2-83c2-c0c1ff1c6a28" containerName="manager" Jun 03 20:54:02.024873 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:02.024873 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="253d2645-7e04-4ed2-83c2-c0c1ff1c6a28" containerName="manager" Jun 03 20:54:02.024996 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:02.024941 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="253d2645-7e04-4ed2-83c2-c0c1ff1c6a28" containerName="manager" Jun 03 20:54:02.027908 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:02.027887 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-snb5g" Jun 03 20:54:02.056639 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:02.056613 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-snb5g"] Jun 03 20:54:02.108320 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:02.108278 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmhkc\" (UniqueName: \"kubernetes.io/projected/a62bde8d-147a-4ae3-8d0c-05432c4d004b-kube-api-access-nmhkc\") pod \"kuadrant-operator-controller-manager-8684c9ff49-snb5g\" (UID: \"a62bde8d-147a-4ae3-8d0c-05432c4d004b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-snb5g" Jun 03 20:54:02.108320 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:02.108324 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a62bde8d-147a-4ae3-8d0c-05432c4d004b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-snb5g\" (UID: \"a62bde8d-147a-4ae3-8d0c-05432c4d004b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-snb5g" Jun 03 20:54:02.112995 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:54:02.112957 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zkq8m\" is forbidden: User \"system:node:ip-10-0-141-159.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-159.ec2.internal' and this object" podUID="253d2645-7e04-4ed2-83c2-c0c1ff1c6a28" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkq8m" Jun 03 20:54:02.209104 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:02.209076 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmhkc\" (UniqueName: \"kubernetes.io/projected/a62bde8d-147a-4ae3-8d0c-05432c4d004b-kube-api-access-nmhkc\") pod \"kuadrant-operator-controller-manager-8684c9ff49-snb5g\" (UID: \"a62bde8d-147a-4ae3-8d0c-05432c4d004b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-snb5g" Jun 03 20:54:02.209246 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:02.209117 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a62bde8d-147a-4ae3-8d0c-05432c4d004b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-snb5g\" (UID: \"a62bde8d-147a-4ae3-8d0c-05432c4d004b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-snb5g" Jun 03 20:54:02.209528 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:02.209505 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkq8m" Jun 03 20:54:02.209653 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:02.209512 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a62bde8d-147a-4ae3-8d0c-05432c4d004b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-snb5g\" (UID: \"a62bde8d-147a-4ae3-8d0c-05432c4d004b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-snb5g" Jun 03 20:54:02.219270 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:54:02.219247 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zkq8m\" is forbidden: User \"system:node:ip-10-0-141-159.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-159.ec2.internal' and this object" podUID="253d2645-7e04-4ed2-83c2-c0c1ff1c6a28" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkq8m" Jun 03 20:54:02.230225 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:02.230206 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmhkc\" (UniqueName: \"kubernetes.io/projected/a62bde8d-147a-4ae3-8d0c-05432c4d004b-kube-api-access-nmhkc\") pod \"kuadrant-operator-controller-manager-8684c9ff49-snb5g\" (UID: \"a62bde8d-147a-4ae3-8d0c-05432c4d004b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-snb5g" Jun 03 20:54:02.310043 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:02.310016 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6rvd\" (UniqueName: \"kubernetes.io/projected/253d2645-7e04-4ed2-83c2-c0c1ff1c6a28-kube-api-access-t6rvd\") pod \"253d2645-7e04-4ed2-83c2-c0c1ff1c6a28\" (UID: \"253d2645-7e04-4ed2-83c2-c0c1ff1c6a28\") " Jun 03 20:54:02.310148 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:02.310088 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/253d2645-7e04-4ed2-83c2-c0c1ff1c6a28-extensions-socket-volume\") pod \"253d2645-7e04-4ed2-83c2-c0c1ff1c6a28\" (UID: \"253d2645-7e04-4ed2-83c2-c0c1ff1c6a28\") " Jun 03 20:54:02.310460 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:02.310430 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/253d2645-7e04-4ed2-83c2-c0c1ff1c6a28-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "253d2645-7e04-4ed2-83c2-c0c1ff1c6a28" (UID: "253d2645-7e04-4ed2-83c2-c0c1ff1c6a28"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:54:02.311931 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:02.311910 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/253d2645-7e04-4ed2-83c2-c0c1ff1c6a28-kube-api-access-t6rvd" (OuterVolumeSpecName: "kube-api-access-t6rvd") pod "253d2645-7e04-4ed2-83c2-c0c1ff1c6a28" (UID: "253d2645-7e04-4ed2-83c2-c0c1ff1c6a28"). InnerVolumeSpecName "kube-api-access-t6rvd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:54:02.338100 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:02.338078 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-snb5g" Jun 03 20:54:02.410981 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:02.410954 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/253d2645-7e04-4ed2-83c2-c0c1ff1c6a28-extensions-socket-volume\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:54:02.410981 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:02.410979 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6rvd\" (UniqueName: \"kubernetes.io/projected/253d2645-7e04-4ed2-83c2-c0c1ff1c6a28-kube-api-access-t6rvd\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:54:02.513989 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:02.513955 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55f45b7c4b-rp8sm" Jun 03 20:54:02.514140 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:02.514013 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55f45b7c4b-rp8sm" Jun 03 20:54:02.518564 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:02.518541 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55f45b7c4b-rp8sm" Jun 03 20:54:02.616563 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:02.616537 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-snb5g"] Jun 03 20:54:02.617858 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:54:02.617837 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda62bde8d_147a_4ae3_8d0c_05432c4d004b.slice/crio-080adbbd278584fb2f3c2d6f012e97610dcf133d5edf73daeb86cf28b670bfde WatchSource:0}: Error finding container 080adbbd278584fb2f3c2d6f012e97610dcf133d5edf73daeb86cf28b670bfde: Status 404 returned error can't find the container with id 080adbbd278584fb2f3c2d6f012e97610dcf133d5edf73daeb86cf28b670bfde Jun 03 20:54:02.821510 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:02.821386 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-snb5g" event={"ID":"a62bde8d-147a-4ae3-8d0c-05432c4d004b","Type":"ContainerStarted","Data":"558d385f9a8cacddd6d9a93e7b1a6dc28a89ad36d4333f414f5270f8949b7de4"} Jun 03 20:54:02.821692 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:02.821558 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-snb5g" Jun 03 20:54:02.821692 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:02.821600 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-snb5g" event={"ID":"a62bde8d-147a-4ae3-8d0c-05432c4d004b","Type":"ContainerStarted","Data":"080adbbd278584fb2f3c2d6f012e97610dcf133d5edf73daeb86cf28b670bfde"} Jun 03 20:54:02.822790 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:02.822766 2573 generic.go:356] "Generic (PLEG): container finished" podID="253d2645-7e04-4ed2-83c2-c0c1ff1c6a28" containerID="b243fc04e00a6f5360453774588ec48291e9d70ad0a5251577f142666ae055b3" exitCode=0 Jun 03 20:54:02.822909 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:02.822827 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkq8m" Jun 03 20:54:02.822909 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:02.822810 2573 scope.go:117] "RemoveContainer" containerID="b243fc04e00a6f5360453774588ec48291e9d70ad0a5251577f142666ae055b3" Jun 03 20:54:02.827156 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:02.827114 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55f45b7c4b-rp8sm" Jun 03 20:54:02.833025 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:02.833005 2573 scope.go:117] "RemoveContainer" containerID="b243fc04e00a6f5360453774588ec48291e9d70ad0a5251577f142666ae055b3" Jun 03 20:54:02.833304 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:54:02.833280 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b243fc04e00a6f5360453774588ec48291e9d70ad0a5251577f142666ae055b3\": container with ID starting with b243fc04e00a6f5360453774588ec48291e9d70ad0a5251577f142666ae055b3 not found: ID does not exist" containerID="b243fc04e00a6f5360453774588ec48291e9d70ad0a5251577f142666ae055b3" Jun 03 20:54:02.833420 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:02.833313 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b243fc04e00a6f5360453774588ec48291e9d70ad0a5251577f142666ae055b3"} err="failed to get container status \"b243fc04e00a6f5360453774588ec48291e9d70ad0a5251577f142666ae055b3\": rpc error: code = NotFound desc = could not find container \"b243fc04e00a6f5360453774588ec48291e9d70ad0a5251577f142666ae055b3\": container with ID starting with b243fc04e00a6f5360453774588ec48291e9d70ad0a5251577f142666ae055b3 not found: ID does not exist" Jun 03 20:54:02.923694 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:02.923643 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-snb5g" podStartSLOduration=1.923631611 podStartE2EDuration="1.923631611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:54:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:54:02.922826319 +0000 UTC m=+669.172236793" watchObservedRunningTime="2026-06-03 20:54:02.923631611 +0000 UTC m=+669.173042086" Jun 03 20:54:03.048608 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:03.048572 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:03.428097 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:03.428063 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:03.630945 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:03.630910 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:03.887379 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:03.887344 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:04.213705 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:04.213622 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="253d2645-7e04-4ed2-83c2-c0c1ff1c6a28" path="/var/lib/kubelet/pods/253d2645-7e04-4ed2-83c2-c0c1ff1c6a28/volumes" Jun 03 20:54:06.669817 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:06.669781 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xmkff"] Jun 03 20:54:06.674587 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:06.674570 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xmkff" Jun 03 20:54:06.712542 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:06.712513 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xmkff"] Jun 03 20:54:06.750314 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:06.750285 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spt9f\" (UniqueName: \"kubernetes.io/projected/ed68e3d3-d33e-4ae9-a405-506ca65530f5-kube-api-access-spt9f\") pod \"kuadrant-operator-controller-manager-86878c769f-xmkff\" (UID: \"ed68e3d3-d33e-4ae9-a405-506ca65530f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xmkff" Jun 03 20:54:06.750449 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:06.750334 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed68e3d3-d33e-4ae9-a405-506ca65530f5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xmkff\" (UID: \"ed68e3d3-d33e-4ae9-a405-506ca65530f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xmkff" Jun 03 20:54:06.851748 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:06.851719 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spt9f\" (UniqueName: \"kubernetes.io/projected/ed68e3d3-d33e-4ae9-a405-506ca65530f5-kube-api-access-spt9f\") pod \"kuadrant-operator-controller-manager-86878c769f-xmkff\" (UID: \"ed68e3d3-d33e-4ae9-a405-506ca65530f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xmkff" Jun 03 20:54:06.851910 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:06.851767 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed68e3d3-d33e-4ae9-a405-506ca65530f5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xmkff\" (UID: \"ed68e3d3-d33e-4ae9-a405-506ca65530f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xmkff" Jun 03 20:54:06.852111 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:06.852096 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed68e3d3-d33e-4ae9-a405-506ca65530f5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xmkff\" (UID: \"ed68e3d3-d33e-4ae9-a405-506ca65530f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xmkff" Jun 03 20:54:06.870539 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:06.870510 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spt9f\" (UniqueName: \"kubernetes.io/projected/ed68e3d3-d33e-4ae9-a405-506ca65530f5-kube-api-access-spt9f\") pod \"kuadrant-operator-controller-manager-86878c769f-xmkff\" (UID: \"ed68e3d3-d33e-4ae9-a405-506ca65530f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xmkff" Jun 03 20:54:06.984390 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:06.984362 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xmkff" Jun 03 20:54:07.154281 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:54:07.154252 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded68e3d3_d33e_4ae9_a405_506ca65530f5.slice/crio-4ebcb0b54189f0bef7061b0f84cc7e48aecc0f1538120b189d6cd328452dac19 WatchSource:0}: Error finding container 4ebcb0b54189f0bef7061b0f84cc7e48aecc0f1538120b189d6cd328452dac19: Status 404 returned error can't find the container with id 4ebcb0b54189f0bef7061b0f84cc7e48aecc0f1538120b189d6cd328452dac19 Jun 03 20:54:07.154536 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:07.154514 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xmkff"] Jun 03 20:54:07.856371 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:07.856343 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xmkff" event={"ID":"ed68e3d3-d33e-4ae9-a405-506ca65530f5","Type":"ContainerStarted","Data":"b626a2089044f7257189e273e030afa466217b6e6d797ef831e58f3d35a72666"} Jun 03 20:54:07.856778 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:07.856389 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xmkff" event={"ID":"ed68e3d3-d33e-4ae9-a405-506ca65530f5","Type":"ContainerStarted","Data":"4ebcb0b54189f0bef7061b0f84cc7e48aecc0f1538120b189d6cd328452dac19"} Jun 03 20:54:07.856778 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:07.856436 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xmkff" Jun 03 20:54:07.898254 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:07.898209 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xmkff" podStartSLOduration=1.8981922839999998 podStartE2EDuration="1.898192284s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:54:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:54:07.894531735 +0000 UTC m=+674.143942210" watchObservedRunningTime="2026-06-03 20:54:07.898192284 +0000 UTC m=+674.147602759" Jun 03 20:54:12.756241 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:12.756204 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:13.002197 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:13.002166 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:13.831736 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:13.831707 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-snb5g" Jun 03 20:54:18.864138 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:18.864107 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xmkff" Jun 03 20:54:19.093195 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:19.093163 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-snb5g"] Jun 03 20:54:19.093390 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:19.093353 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-snb5g" podUID="a62bde8d-147a-4ae3-8d0c-05432c4d004b" containerName="manager" containerID="cri-o://558d385f9a8cacddd6d9a93e7b1a6dc28a89ad36d4333f414f5270f8949b7de4" gracePeriod=10 Jun 03 20:54:20.237845 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:20.237822 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-snb5g" Jun 03 20:54:20.371424 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:20.371354 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a62bde8d-147a-4ae3-8d0c-05432c4d004b-extensions-socket-volume\") pod \"a62bde8d-147a-4ae3-8d0c-05432c4d004b\" (UID: \"a62bde8d-147a-4ae3-8d0c-05432c4d004b\") " Jun 03 20:54:20.371424 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:20.371390 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmhkc\" (UniqueName: \"kubernetes.io/projected/a62bde8d-147a-4ae3-8d0c-05432c4d004b-kube-api-access-nmhkc\") pod \"a62bde8d-147a-4ae3-8d0c-05432c4d004b\" (UID: \"a62bde8d-147a-4ae3-8d0c-05432c4d004b\") " Jun 03 20:54:20.371744 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:20.371721 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a62bde8d-147a-4ae3-8d0c-05432c4d004b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a62bde8d-147a-4ae3-8d0c-05432c4d004b" (UID: "a62bde8d-147a-4ae3-8d0c-05432c4d004b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:54:20.373416 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:20.373388 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a62bde8d-147a-4ae3-8d0c-05432c4d004b-kube-api-access-nmhkc" (OuterVolumeSpecName: "kube-api-access-nmhkc") pod "a62bde8d-147a-4ae3-8d0c-05432c4d004b" (UID: "a62bde8d-147a-4ae3-8d0c-05432c4d004b"). InnerVolumeSpecName "kube-api-access-nmhkc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:54:20.472769 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:20.472735 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a62bde8d-147a-4ae3-8d0c-05432c4d004b-extensions-socket-volume\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:54:20.472769 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:20.472762 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmhkc\" (UniqueName: \"kubernetes.io/projected/a62bde8d-147a-4ae3-8d0c-05432c4d004b-kube-api-access-nmhkc\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:54:20.925343 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:20.925309 2573 generic.go:356] "Generic (PLEG): container finished" podID="a62bde8d-147a-4ae3-8d0c-05432c4d004b" containerID="558d385f9a8cacddd6d9a93e7b1a6dc28a89ad36d4333f414f5270f8949b7de4" exitCode=0 Jun 03 20:54:20.925541 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:20.925353 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-snb5g" Jun 03 20:54:20.925541 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:20.925378 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-snb5g" event={"ID":"a62bde8d-147a-4ae3-8d0c-05432c4d004b","Type":"ContainerDied","Data":"558d385f9a8cacddd6d9a93e7b1a6dc28a89ad36d4333f414f5270f8949b7de4"} Jun 03 20:54:20.925541 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:20.925418 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-snb5g" event={"ID":"a62bde8d-147a-4ae3-8d0c-05432c4d004b","Type":"ContainerDied","Data":"080adbbd278584fb2f3c2d6f012e97610dcf133d5edf73daeb86cf28b670bfde"} Jun 03 20:54:20.925541 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:20.925442 2573 scope.go:117] "RemoveContainer" containerID="558d385f9a8cacddd6d9a93e7b1a6dc28a89ad36d4333f414f5270f8949b7de4" Jun 03 20:54:20.936733 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:20.936716 2573 scope.go:117] "RemoveContainer" containerID="558d385f9a8cacddd6d9a93e7b1a6dc28a89ad36d4333f414f5270f8949b7de4" Jun 03 20:54:20.936996 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:54:20.936977 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"558d385f9a8cacddd6d9a93e7b1a6dc28a89ad36d4333f414f5270f8949b7de4\": container with ID starting with 558d385f9a8cacddd6d9a93e7b1a6dc28a89ad36d4333f414f5270f8949b7de4 not found: ID does not exist" containerID="558d385f9a8cacddd6d9a93e7b1a6dc28a89ad36d4333f414f5270f8949b7de4" Jun 03 20:54:20.937047 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:20.937006 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"558d385f9a8cacddd6d9a93e7b1a6dc28a89ad36d4333f414f5270f8949b7de4"} err="failed to get container status \"558d385f9a8cacddd6d9a93e7b1a6dc28a89ad36d4333f414f5270f8949b7de4\": rpc error: code = NotFound desc = could not find container \"558d385f9a8cacddd6d9a93e7b1a6dc28a89ad36d4333f414f5270f8949b7de4\": container with ID starting with 558d385f9a8cacddd6d9a93e7b1a6dc28a89ad36d4333f414f5270f8949b7de4 not found: ID does not exist" Jun 03 20:54:20.982684 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:20.982657 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-snb5g"] Jun 03 20:54:20.996320 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:20.996298 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-snb5g"] Jun 03 20:54:22.211764 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:22.211733 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a62bde8d-147a-4ae3-8d0c-05432c4d004b" path="/var/lib/kubelet/pods/a62bde8d-147a-4ae3-8d0c-05432c4d004b/volumes" Jun 03 20:54:36.089044 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:36.089007 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:36.254202 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:36.254159 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:40.465191 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:40.465149 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:41.930593 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:41.930548 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:42.173412 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:42.173365 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:42.300321 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:42.300290 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:42.762326 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:42.762294 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 20:54:42.762674 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:42.762659 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a62bde8d-147a-4ae3-8d0c-05432c4d004b" containerName="manager" Jun 03 20:54:42.762725 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:42.762676 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a62bde8d-147a-4ae3-8d0c-05432c4d004b" containerName="manager" Jun 03 20:54:42.762760 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:42.762745 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a62bde8d-147a-4ae3-8d0c-05432c4d004b" containerName="manager" Jun 03 20:54:42.765903 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:42.765886 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-5hwxg" Jun 03 20:54:42.777107 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:42.777089 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 03 20:54:42.779128 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:42.779112 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qkqzb\"" Jun 03 20:54:42.802811 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:42.802790 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 20:54:42.867058 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:42.867015 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1d7426dd-bf90-4538-9c00-cd0ad925651e-config-file\") pod \"limitador-limitador-54d6d988d5-5hwxg\" (UID: \"1d7426dd-bf90-4538-9c00-cd0ad925651e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5hwxg" Jun 03 20:54:42.867235 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:42.867141 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnxn9\" (UniqueName: \"kubernetes.io/projected/1d7426dd-bf90-4538-9c00-cd0ad925651e-kube-api-access-dnxn9\") pod \"limitador-limitador-54d6d988d5-5hwxg\" (UID: \"1d7426dd-bf90-4538-9c00-cd0ad925651e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5hwxg" Jun 03 20:54:42.869145 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:42.869116 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 20:54:42.968169 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:42.968136 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnxn9\" (UniqueName: \"kubernetes.io/projected/1d7426dd-bf90-4538-9c00-cd0ad925651e-kube-api-access-dnxn9\") pod \"limitador-limitador-54d6d988d5-5hwxg\" (UID: \"1d7426dd-bf90-4538-9c00-cd0ad925651e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5hwxg" Jun 03 20:54:42.968582 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:42.968215 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1d7426dd-bf90-4538-9c00-cd0ad925651e-config-file\") pod \"limitador-limitador-54d6d988d5-5hwxg\" (UID: \"1d7426dd-bf90-4538-9c00-cd0ad925651e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5hwxg" Jun 03 20:54:42.968909 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:42.968885 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1d7426dd-bf90-4538-9c00-cd0ad925651e-config-file\") pod \"limitador-limitador-54d6d988d5-5hwxg\" (UID: \"1d7426dd-bf90-4538-9c00-cd0ad925651e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5hwxg" Jun 03 20:54:42.979908 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:42.979877 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnxn9\" (UniqueName: \"kubernetes.io/projected/1d7426dd-bf90-4538-9c00-cd0ad925651e-kube-api-access-dnxn9\") pod \"limitador-limitador-54d6d988d5-5hwxg\" (UID: \"1d7426dd-bf90-4538-9c00-cd0ad925651e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5hwxg" Jun 03 20:54:43.076201 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:43.076118 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-5hwxg" Jun 03 20:54:43.226333 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:43.226300 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:43.233352 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:43.233330 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 20:54:43.234911 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:54:43.234888 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d7426dd_bf90_4538_9c00_cd0ad925651e.slice/crio-8404a096f0be481f4a3fab604c0c17cc5550e9051b2c2219ce445203659eb615 WatchSource:0}: Error finding container 8404a096f0be481f4a3fab604c0c17cc5550e9051b2c2219ce445203659eb615: Status 404 returned error can't find the container with id 8404a096f0be481f4a3fab604c0c17cc5550e9051b2c2219ce445203659eb615 Jun 03 20:54:43.404063 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:43.403973 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:44.050143 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:44.050106 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-5hwxg" event={"ID":"1d7426dd-bf90-4538-9c00-cd0ad925651e","Type":"ContainerStarted","Data":"8404a096f0be481f4a3fab604c0c17cc5550e9051b2c2219ce445203659eb615"} Jun 03 20:54:46.062831 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:46.062791 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-5hwxg" event={"ID":"1d7426dd-bf90-4538-9c00-cd0ad925651e","Type":"ContainerStarted","Data":"faf6a485878ff3f3c845ba52a5257d45a0ed407574873abd927222b677ed74ea"} Jun 03 20:54:46.063209 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:46.062949 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-5hwxg" Jun 03 20:54:46.098924 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:46.098854 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-5hwxg" podStartSLOduration=1.7152249739999998 podStartE2EDuration="4.098839574s" totalImagesPullingTime="2.3836146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:54:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:54:46.095144944 +0000 UTC m=+712.344555419" watchObservedRunningTime="2026-06-03 20:54:46.098839574 +0000 UTC m=+712.348250043" Jun 03 20:54:48.255607 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:48.255573 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:48.481539 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:48.481500 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:54:57.069818 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:54:57.069788 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-5hwxg" Jun 03 20:55:02.241388 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:02.241354 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:55:14.411051 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:14.411017 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:55:14.523567 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:14.523533 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:55:14.745024 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:14.744994 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:55:15.975276 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:15.975231 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cjjtd"] Jun 03 20:55:15.983283 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:15.983260 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cjjtd" Jun 03 20:55:15.990492 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:15.990460 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 20:55:15.990579 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:15.990562 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jq9ms\"" Jun 03 20:55:15.991809 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:15.991795 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 20:55:16.007952 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:16.007924 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cjjtd"] Jun 03 20:55:16.054233 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:16.054206 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jck2\" (UniqueName: \"kubernetes.io/projected/62d2d0e2-ea24-4a49-b37d-204f3c0d5631-kube-api-access-2jck2\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cjjtd\" (UID: \"62d2d0e2-ea24-4a49-b37d-204f3c0d5631\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cjjtd" Jun 03 20:55:16.054353 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:16.054243 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62d2d0e2-ea24-4a49-b37d-204f3c0d5631-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cjjtd\" (UID: \"62d2d0e2-ea24-4a49-b37d-204f3c0d5631\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cjjtd" Jun 03 20:55:16.054436 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:16.054359 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62d2d0e2-ea24-4a49-b37d-204f3c0d5631-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cjjtd\" (UID: \"62d2d0e2-ea24-4a49-b37d-204f3c0d5631\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cjjtd" Jun 03 20:55:16.155456 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:16.155427 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62d2d0e2-ea24-4a49-b37d-204f3c0d5631-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cjjtd\" (UID: \"62d2d0e2-ea24-4a49-b37d-204f3c0d5631\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cjjtd" Jun 03 20:55:16.155597 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:16.155507 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62d2d0e2-ea24-4a49-b37d-204f3c0d5631-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cjjtd\" (UID: \"62d2d0e2-ea24-4a49-b37d-204f3c0d5631\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cjjtd" Jun 03 20:55:16.155597 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:16.155544 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jck2\" (UniqueName: \"kubernetes.io/projected/62d2d0e2-ea24-4a49-b37d-204f3c0d5631-kube-api-access-2jck2\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cjjtd\" (UID: \"62d2d0e2-ea24-4a49-b37d-204f3c0d5631\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cjjtd" Jun 03 20:55:16.155803 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:16.155785 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62d2d0e2-ea24-4a49-b37d-204f3c0d5631-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cjjtd\" (UID: \"62d2d0e2-ea24-4a49-b37d-204f3c0d5631\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cjjtd" Jun 03 20:55:16.155866 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:16.155847 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62d2d0e2-ea24-4a49-b37d-204f3c0d5631-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cjjtd\" (UID: \"62d2d0e2-ea24-4a49-b37d-204f3c0d5631\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cjjtd" Jun 03 20:55:16.167363 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:16.167334 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jck2\" (UniqueName: \"kubernetes.io/projected/62d2d0e2-ea24-4a49-b37d-204f3c0d5631-kube-api-access-2jck2\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cjjtd\" (UID: \"62d2d0e2-ea24-4a49-b37d-204f3c0d5631\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cjjtd" Jun 03 20:55:16.292410 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:16.292322 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cjjtd" Jun 03 20:55:16.446879 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:16.445187 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cjjtd"] Jun 03 20:55:17.228787 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:17.228753 2573 generic.go:356] "Generic (PLEG): container finished" podID="62d2d0e2-ea24-4a49-b37d-204f3c0d5631" containerID="95867957e8a0fdf71b6553fd0d856cb32ca1cd8032dd269792a5b513ee36c13b" exitCode=0 Jun 03 20:55:17.229117 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:17.228829 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cjjtd" event={"ID":"62d2d0e2-ea24-4a49-b37d-204f3c0d5631","Type":"ContainerDied","Data":"95867957e8a0fdf71b6553fd0d856cb32ca1cd8032dd269792a5b513ee36c13b"} Jun 03 20:55:17.229117 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:17.228888 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cjjtd" event={"ID":"62d2d0e2-ea24-4a49-b37d-204f3c0d5631","Type":"ContainerStarted","Data":"8c1965fe442ce85d972873080d0783b1312c7bca094607f21d4b8b851653994f"} Jun 03 20:55:18.235946 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:18.235862 2573 generic.go:356] "Generic (PLEG): container finished" podID="62d2d0e2-ea24-4a49-b37d-204f3c0d5631" containerID="030aecb62d7993a2fb6738124225641c182d8150fdf5f0c3b3aa30d454cd6859" exitCode=0 Jun 03 20:55:18.235946 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:18.235925 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cjjtd" event={"ID":"62d2d0e2-ea24-4a49-b37d-204f3c0d5631","Type":"ContainerDied","Data":"030aecb62d7993a2fb6738124225641c182d8150fdf5f0c3b3aa30d454cd6859"} Jun 03 20:55:19.246395 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:19.246362 2573 generic.go:356] "Generic (PLEG): container finished" podID="62d2d0e2-ea24-4a49-b37d-204f3c0d5631" containerID="a8f330e7ed78adba5ad1f5cca9c8d11f7d973be3089556dd080c9e3f74ef75e5" exitCode=0 Jun 03 20:55:19.246801 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:19.246442 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cjjtd" event={"ID":"62d2d0e2-ea24-4a49-b37d-204f3c0d5631","Type":"ContainerDied","Data":"a8f330e7ed78adba5ad1f5cca9c8d11f7d973be3089556dd080c9e3f74ef75e5"} Jun 03 20:55:20.390952 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:20.390929 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cjjtd" Jun 03 20:55:20.495218 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:20.495182 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62d2d0e2-ea24-4a49-b37d-204f3c0d5631-bundle\") pod \"62d2d0e2-ea24-4a49-b37d-204f3c0d5631\" (UID: \"62d2d0e2-ea24-4a49-b37d-204f3c0d5631\") " Jun 03 20:55:20.495388 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:20.495232 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jck2\" (UniqueName: \"kubernetes.io/projected/62d2d0e2-ea24-4a49-b37d-204f3c0d5631-kube-api-access-2jck2\") pod \"62d2d0e2-ea24-4a49-b37d-204f3c0d5631\" (UID: \"62d2d0e2-ea24-4a49-b37d-204f3c0d5631\") " Jun 03 20:55:20.495388 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:20.495270 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62d2d0e2-ea24-4a49-b37d-204f3c0d5631-util\") pod \"62d2d0e2-ea24-4a49-b37d-204f3c0d5631\" (UID: \"62d2d0e2-ea24-4a49-b37d-204f3c0d5631\") " Jun 03 20:55:20.495797 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:20.495770 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62d2d0e2-ea24-4a49-b37d-204f3c0d5631-bundle" (OuterVolumeSpecName: "bundle") pod "62d2d0e2-ea24-4a49-b37d-204f3c0d5631" (UID: "62d2d0e2-ea24-4a49-b37d-204f3c0d5631"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:55:20.497398 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:20.497368 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62d2d0e2-ea24-4a49-b37d-204f3c0d5631-kube-api-access-2jck2" (OuterVolumeSpecName: "kube-api-access-2jck2") pod "62d2d0e2-ea24-4a49-b37d-204f3c0d5631" (UID: "62d2d0e2-ea24-4a49-b37d-204f3c0d5631"). InnerVolumeSpecName "kube-api-access-2jck2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:55:20.501093 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:20.501069 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62d2d0e2-ea24-4a49-b37d-204f3c0d5631-util" (OuterVolumeSpecName: "util") pod "62d2d0e2-ea24-4a49-b37d-204f3c0d5631" (UID: "62d2d0e2-ea24-4a49-b37d-204f3c0d5631"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:55:20.596054 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:20.596031 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62d2d0e2-ea24-4a49-b37d-204f3c0d5631-bundle\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:55:20.596054 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:20.596052 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jck2\" (UniqueName: \"kubernetes.io/projected/62d2d0e2-ea24-4a49-b37d-204f3c0d5631-kube-api-access-2jck2\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:55:20.596182 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:20.596063 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62d2d0e2-ea24-4a49-b37d-204f3c0d5631-util\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:55:21.258418 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:21.258389 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cjjtd" Jun 03 20:55:21.258626 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:21.258421 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cjjtd" event={"ID":"62d2d0e2-ea24-4a49-b37d-204f3c0d5631","Type":"ContainerDied","Data":"8c1965fe442ce85d972873080d0783b1312c7bca094607f21d4b8b851653994f"} Jun 03 20:55:21.258626 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:21.258466 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8c1965fe442ce85d972873080d0783b1312c7bca094607f21d4b8b851653994f" Jun 03 20:55:26.541589 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:26.541554 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:55:38.758311 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:38.758270 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:55:38.859719 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:55:38.859682 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:56:08.395081 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:08.394986 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:56:08.890103 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:08.890071 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:56:14.229345 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:14.229309 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7d69cbc5b7-7vww4"] Jun 03 20:56:14.229739 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:14.229653 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62d2d0e2-ea24-4a49-b37d-204f3c0d5631" containerName="extract" Jun 03 20:56:14.229739 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:14.229675 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="62d2d0e2-ea24-4a49-b37d-204f3c0d5631" containerName="extract" Jun 03 20:56:14.229739 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:14.229684 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62d2d0e2-ea24-4a49-b37d-204f3c0d5631" containerName="pull" Jun 03 20:56:14.229739 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:14.229690 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="62d2d0e2-ea24-4a49-b37d-204f3c0d5631" containerName="pull" Jun 03 20:56:14.229739 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:14.229698 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62d2d0e2-ea24-4a49-b37d-204f3c0d5631" containerName="util" Jun 03 20:56:14.229739 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:14.229704 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="62d2d0e2-ea24-4a49-b37d-204f3c0d5631" containerName="util" Jun 03 20:56:14.229931 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:14.229770 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="62d2d0e2-ea24-4a49-b37d-204f3c0d5631" containerName="extract" Jun 03 20:56:14.232609 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:14.232592 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d69cbc5b7-7vww4" Jun 03 20:56:14.235517 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:14.235492 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 03 20:56:14.235624 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:14.235566 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nxpff\"" Jun 03 20:56:14.244751 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:14.244727 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d69cbc5b7-7vww4"] Jun 03 20:56:14.324550 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:14.324509 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bknrp\" (UniqueName: \"kubernetes.io/projected/94c3ce96-89df-4935-9468-b664f82f38b6-kube-api-access-bknrp\") pod \"maas-controller-7d69cbc5b7-7vww4\" (UID: \"94c3ce96-89df-4935-9468-b664f82f38b6\") " pod="opendatahub/maas-controller-7d69cbc5b7-7vww4" Jun 03 20:56:14.425735 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:14.425705 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bknrp\" (UniqueName: \"kubernetes.io/projected/94c3ce96-89df-4935-9468-b664f82f38b6-kube-api-access-bknrp\") pod \"maas-controller-7d69cbc5b7-7vww4\" (UID: \"94c3ce96-89df-4935-9468-b664f82f38b6\") " pod="opendatahub/maas-controller-7d69cbc5b7-7vww4" Jun 03 20:56:14.432091 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:14.432064 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-65794dbd75-c2ghp"] Jun 03 20:56:14.435195 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:14.435180 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65794dbd75-c2ghp" Jun 03 20:56:14.437856 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:14.437832 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bknrp\" (UniqueName: \"kubernetes.io/projected/94c3ce96-89df-4935-9468-b664f82f38b6-kube-api-access-bknrp\") pod \"maas-controller-7d69cbc5b7-7vww4\" (UID: \"94c3ce96-89df-4935-9468-b664f82f38b6\") " pod="opendatahub/maas-controller-7d69cbc5b7-7vww4" Jun 03 20:56:14.444405 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:14.444382 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65794dbd75-c2ghp"] Jun 03 20:56:14.526612 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:14.526538 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f7qh\" (UniqueName: \"kubernetes.io/projected/8286d7e5-30c7-4dc1-9f82-1e8bb35f2eb8-kube-api-access-9f7qh\") pod \"maas-controller-65794dbd75-c2ghp\" (UID: \"8286d7e5-30c7-4dc1-9f82-1e8bb35f2eb8\") " pod="opendatahub/maas-controller-65794dbd75-c2ghp" Jun 03 20:56:14.542498 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:14.542466 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d69cbc5b7-7vww4" Jun 03 20:56:14.627046 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:14.627014 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f7qh\" (UniqueName: \"kubernetes.io/projected/8286d7e5-30c7-4dc1-9f82-1e8bb35f2eb8-kube-api-access-9f7qh\") pod \"maas-controller-65794dbd75-c2ghp\" (UID: \"8286d7e5-30c7-4dc1-9f82-1e8bb35f2eb8\") " pod="opendatahub/maas-controller-65794dbd75-c2ghp" Jun 03 20:56:14.636910 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:14.636883 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f7qh\" (UniqueName: \"kubernetes.io/projected/8286d7e5-30c7-4dc1-9f82-1e8bb35f2eb8-kube-api-access-9f7qh\") pod \"maas-controller-65794dbd75-c2ghp\" (UID: \"8286d7e5-30c7-4dc1-9f82-1e8bb35f2eb8\") " pod="opendatahub/maas-controller-65794dbd75-c2ghp" Jun 03 20:56:14.673587 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:14.673564 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d69cbc5b7-7vww4"] Jun 03 20:56:14.675355 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:56:14.675327 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94c3ce96_89df_4935_9468_b664f82f38b6.slice/crio-39b6b796daaa68bb85b5bb71e229b0b4ccbec674c68d3d50bea0808b667de4e0 WatchSource:0}: Error finding container 39b6b796daaa68bb85b5bb71e229b0b4ccbec674c68d3d50bea0808b667de4e0: Status 404 returned error can't find the container with id 39b6b796daaa68bb85b5bb71e229b0b4ccbec674c68d3d50bea0808b667de4e0 Jun 03 20:56:14.676703 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:14.676677 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 20:56:14.754626 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:14.754602 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65794dbd75-c2ghp" Jun 03 20:56:14.883604 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:14.883581 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65794dbd75-c2ghp"] Jun 03 20:56:14.885316 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:56:14.885288 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8286d7e5_30c7_4dc1_9f82_1e8bb35f2eb8.slice/crio-d884c91b311be9d15882efa2d0024e04ee74e5d31338a7e29267f67db5151290 WatchSource:0}: Error finding container d884c91b311be9d15882efa2d0024e04ee74e5d31338a7e29267f67db5151290: Status 404 returned error can't find the container with id d884c91b311be9d15882efa2d0024e04ee74e5d31338a7e29267f67db5151290 Jun 03 20:56:15.560241 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:15.560204 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65794dbd75-c2ghp" event={"ID":"8286d7e5-30c7-4dc1-9f82-1e8bb35f2eb8","Type":"ContainerStarted","Data":"d884c91b311be9d15882efa2d0024e04ee74e5d31338a7e29267f67db5151290"} Jun 03 20:56:15.562962 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:15.562932 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d69cbc5b7-7vww4" event={"ID":"94c3ce96-89df-4935-9468-b664f82f38b6","Type":"ContainerStarted","Data":"39b6b796daaa68bb85b5bb71e229b0b4ccbec674c68d3d50bea0808b667de4e0"} Jun 03 20:56:17.567250 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:17.567212 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:56:17.577336 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:17.577306 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65794dbd75-c2ghp" event={"ID":"8286d7e5-30c7-4dc1-9f82-1e8bb35f2eb8","Type":"ContainerStarted","Data":"08aa7d14541520a046e93411f6dc116a7f6d2735c5453fe9ffbf4aa443942ffc"} Jun 03 20:56:17.577507 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:17.577437 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-65794dbd75-c2ghp" Jun 03 20:56:17.579088 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:17.579064 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d69cbc5b7-7vww4" event={"ID":"94c3ce96-89df-4935-9468-b664f82f38b6","Type":"ContainerStarted","Data":"90dd94c23b6cce3978b6d120d16e7a1afff89601599bbaf57df83e409b9d0998"} Jun 03 20:56:17.579253 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:17.579145 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7d69cbc5b7-7vww4" Jun 03 20:56:17.601382 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:17.601306 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-65794dbd75-c2ghp" podStartSLOduration=1.1243979610000001 podStartE2EDuration="3.601295014s" totalImagesPullingTime="2.476897053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:56:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:56:17.598970855 +0000 UTC m=+803.848381330" watchObservedRunningTime="2026-06-03 20:56:17.601295014 +0000 UTC m=+803.850705488" Jun 03 20:56:17.624225 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:17.624165 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7d69cbc5b7-7vww4" podStartSLOduration=0.947307112 podStartE2EDuration="3.624151683s" totalImagesPullingTime="2.676844571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:56:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:56:17.621863208 +0000 UTC m=+803.871273684" watchObservedRunningTime="2026-06-03 20:56:17.624151683 +0000 UTC m=+803.873562496" Jun 03 20:56:17.679233 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:17.679200 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:56:28.590070 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:28.590039 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7d69cbc5b7-7vww4" Jun 03 20:56:28.590541 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:28.590111 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-65794dbd75-c2ghp" Jun 03 20:56:28.634955 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:28.634920 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7d69cbc5b7-7vww4"] Jun 03 20:56:28.639628 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:28.639591 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7d69cbc5b7-7vww4" podUID="94c3ce96-89df-4935-9468-b664f82f38b6" containerName="manager" containerID="cri-o://90dd94c23b6cce3978b6d120d16e7a1afff89601599bbaf57df83e409b9d0998" gracePeriod=30 Jun 03 20:56:28.884148 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:28.884124 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d69cbc5b7-7vww4" Jun 03 20:56:28.953769 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:28.953741 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bknrp\" (UniqueName: \"kubernetes.io/projected/94c3ce96-89df-4935-9468-b664f82f38b6-kube-api-access-bknrp\") pod \"94c3ce96-89df-4935-9468-b664f82f38b6\" (UID: \"94c3ce96-89df-4935-9468-b664f82f38b6\") " Jun 03 20:56:28.955833 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:28.955812 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94c3ce96-89df-4935-9468-b664f82f38b6-kube-api-access-bknrp" (OuterVolumeSpecName: "kube-api-access-bknrp") pod "94c3ce96-89df-4935-9468-b664f82f38b6" (UID: "94c3ce96-89df-4935-9468-b664f82f38b6"). InnerVolumeSpecName "kube-api-access-bknrp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:56:29.054957 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:29.054931 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bknrp\" (UniqueName: \"kubernetes.io/projected/94c3ce96-89df-4935-9468-b664f82f38b6-kube-api-access-bknrp\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 20:56:29.645888 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:29.645852 2573 generic.go:356] "Generic (PLEG): container finished" podID="94c3ce96-89df-4935-9468-b664f82f38b6" containerID="90dd94c23b6cce3978b6d120d16e7a1afff89601599bbaf57df83e409b9d0998" exitCode=0 Jun 03 20:56:29.646300 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:29.645912 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d69cbc5b7-7vww4" Jun 03 20:56:29.646300 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:29.645938 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d69cbc5b7-7vww4" event={"ID":"94c3ce96-89df-4935-9468-b664f82f38b6","Type":"ContainerDied","Data":"90dd94c23b6cce3978b6d120d16e7a1afff89601599bbaf57df83e409b9d0998"} Jun 03 20:56:29.646300 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:29.645995 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d69cbc5b7-7vww4" event={"ID":"94c3ce96-89df-4935-9468-b664f82f38b6","Type":"ContainerDied","Data":"39b6b796daaa68bb85b5bb71e229b0b4ccbec674c68d3d50bea0808b667de4e0"} Jun 03 20:56:29.646300 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:29.646024 2573 scope.go:117] "RemoveContainer" containerID="90dd94c23b6cce3978b6d120d16e7a1afff89601599bbaf57df83e409b9d0998" Jun 03 20:56:29.655458 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:29.655443 2573 scope.go:117] "RemoveContainer" containerID="90dd94c23b6cce3978b6d120d16e7a1afff89601599bbaf57df83e409b9d0998" Jun 03 20:56:29.655726 ip-10-0-141-159 kubenswrapper[2573]: E0603 20:56:29.655709 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90dd94c23b6cce3978b6d120d16e7a1afff89601599bbaf57df83e409b9d0998\": container with ID starting with 90dd94c23b6cce3978b6d120d16e7a1afff89601599bbaf57df83e409b9d0998 not found: ID does not exist" containerID="90dd94c23b6cce3978b6d120d16e7a1afff89601599bbaf57df83e409b9d0998" Jun 03 20:56:29.655777 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:29.655734 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90dd94c23b6cce3978b6d120d16e7a1afff89601599bbaf57df83e409b9d0998"} err="failed to get container status \"90dd94c23b6cce3978b6d120d16e7a1afff89601599bbaf57df83e409b9d0998\": rpc error: code = NotFound desc = could not find container \"90dd94c23b6cce3978b6d120d16e7a1afff89601599bbaf57df83e409b9d0998\": container with ID starting with 90dd94c23b6cce3978b6d120d16e7a1afff89601599bbaf57df83e409b9d0998 not found: ID does not exist" Jun 03 20:56:29.671654 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:29.671629 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7d69cbc5b7-7vww4"] Jun 03 20:56:29.674023 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:29.674005 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7d69cbc5b7-7vww4"] Jun 03 20:56:30.211876 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:30.211846 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94c3ce96-89df-4935-9468-b664f82f38b6" path="/var/lib/kubelet/pods/94c3ce96-89df-4935-9468-b664f82f38b6/volumes" Jun 03 20:56:48.572840 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:48.572810 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:56:48.630340 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:48.630299 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-8965c4cfb-k7ghf"] Jun 03 20:56:48.630781 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:48.630758 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94c3ce96-89df-4935-9468-b664f82f38b6" containerName="manager" Jun 03 20:56:48.630847 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:48.630784 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="94c3ce96-89df-4935-9468-b664f82f38b6" containerName="manager" Jun 03 20:56:48.630884 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:48.630853 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="94c3ce96-89df-4935-9468-b664f82f38b6" containerName="manager" Jun 03 20:56:48.634042 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:48.634021 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-8965c4cfb-k7ghf" Jun 03 20:56:48.637147 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:48.637124 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-lkdt6\"" Jun 03 20:56:48.637405 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:48.637392 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 03 20:56:48.650289 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:48.650257 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-8965c4cfb-k7ghf"] Jun 03 20:56:48.767468 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:48.767423 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:56:48.819001 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:48.818966 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52nxx\" (UniqueName: \"kubernetes.io/projected/09ad1159-e366-450a-82e5-72c6a9b7894e-kube-api-access-52nxx\") pod \"maas-api-8965c4cfb-k7ghf\" (UID: \"09ad1159-e366-450a-82e5-72c6a9b7894e\") " pod="opendatahub/maas-api-8965c4cfb-k7ghf" Jun 03 20:56:48.819176 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:48.819012 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09ad1159-e366-450a-82e5-72c6a9b7894e-maas-api-tls\") pod \"maas-api-8965c4cfb-k7ghf\" (UID: \"09ad1159-e366-450a-82e5-72c6a9b7894e\") " pod="opendatahub/maas-api-8965c4cfb-k7ghf" Jun 03 20:56:48.920558 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:48.920483 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52nxx\" (UniqueName: \"kubernetes.io/projected/09ad1159-e366-450a-82e5-72c6a9b7894e-kube-api-access-52nxx\") pod \"maas-api-8965c4cfb-k7ghf\" (UID: \"09ad1159-e366-450a-82e5-72c6a9b7894e\") " pod="opendatahub/maas-api-8965c4cfb-k7ghf" Jun 03 20:56:48.920558 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:48.920538 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09ad1159-e366-450a-82e5-72c6a9b7894e-maas-api-tls\") pod \"maas-api-8965c4cfb-k7ghf\" (UID: \"09ad1159-e366-450a-82e5-72c6a9b7894e\") " pod="opendatahub/maas-api-8965c4cfb-k7ghf" Jun 03 20:56:48.922986 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:48.922965 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09ad1159-e366-450a-82e5-72c6a9b7894e-maas-api-tls\") pod \"maas-api-8965c4cfb-k7ghf\" (UID: \"09ad1159-e366-450a-82e5-72c6a9b7894e\") " pod="opendatahub/maas-api-8965c4cfb-k7ghf" Jun 03 20:56:48.928970 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:48.928949 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52nxx\" (UniqueName: \"kubernetes.io/projected/09ad1159-e366-450a-82e5-72c6a9b7894e-kube-api-access-52nxx\") pod \"maas-api-8965c4cfb-k7ghf\" (UID: \"09ad1159-e366-450a-82e5-72c6a9b7894e\") " pod="opendatahub/maas-api-8965c4cfb-k7ghf" Jun 03 20:56:48.944632 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:48.944611 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-8965c4cfb-k7ghf" Jun 03 20:56:49.066489 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:49.066430 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:56:49.095947 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:49.095920 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-8965c4cfb-k7ghf"] Jun 03 20:56:49.097227 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:56:49.097201 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09ad1159_e366_450a_82e5_72c6a9b7894e.slice/crio-d7365942d2d4b061b1f6e7b4481cdf244650e10b1d40f4e9b0045242bc4002a9 WatchSource:0}: Error finding container d7365942d2d4b061b1f6e7b4481cdf244650e10b1d40f4e9b0045242bc4002a9: Status 404 returned error can't find the container with id d7365942d2d4b061b1f6e7b4481cdf244650e10b1d40f4e9b0045242bc4002a9 Jun 03 20:56:49.750444 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:49.750409 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-8965c4cfb-k7ghf" event={"ID":"09ad1159-e366-450a-82e5-72c6a9b7894e","Type":"ContainerStarted","Data":"d7365942d2d4b061b1f6e7b4481cdf244650e10b1d40f4e9b0045242bc4002a9"} Jun 03 20:56:49.792415 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:49.792375 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 20:56:51.762199 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:51.762161 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-8965c4cfb-k7ghf" event={"ID":"09ad1159-e366-450a-82e5-72c6a9b7894e","Type":"ContainerStarted","Data":"a6abf71e582fe72b5fb0af720b12388999900c3e68fe5b6a8ef8687dcdaa9b72"} Jun 03 20:56:51.762627 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:51.762296 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-8965c4cfb-k7ghf" Jun 03 20:56:51.781321 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:51.781266 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-8965c4cfb-k7ghf" podStartSLOduration=2.057391258 podStartE2EDuration="3.781250534s" totalImagesPullingTime="1.723859276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:56:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:56:51.780642843 +0000 UTC m=+838.030053320" watchObservedRunningTime="2026-06-03 20:56:51.781250534 +0000 UTC m=+838.030661009" Jun 03 20:56:57.773044 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:57.773017 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-8965c4cfb-k7ghf" Jun 03 20:56:58.253028 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:56:58.252992 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:57:40.153716 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:57:40.153674 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:57:40.251844 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:57:40.251803 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:57:46.593747 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:57:46.593711 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:57:46.905404 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:57:46.905324 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 20:57:54.226914 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:57:54.226882 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8cpfl_51f5ccb5-b246-47b7-82cb-9524ff802fae/ovn-acl-logging/0.log" Jun 03 20:57:54.228012 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:57:54.227992 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8cpfl_51f5ccb5-b246-47b7-82cb-9524ff802fae/ovn-acl-logging/0.log" Jun 03 20:57:54.675727 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:57:54.675648 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-l824q"] Jun 03 20:57:54.678718 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:57:54.678696 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l824q" Jun 03 20:57:54.681397 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:57:54.681372 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-sg6g7\"" Jun 03 20:57:54.682540 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:57:54.682523 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 03 20:57:54.682670 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:57:54.682531 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 03 20:57:54.682670 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:57:54.682598 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 03 20:57:54.691550 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:57:54.691524 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-l824q"] Jun 03 20:57:54.704448 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:57:54.704420 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:57:54.754487 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:57:54.754443 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb85b993-295e-4a0d-b479-0f62ffc1eda3-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-l824q\" (UID: \"eb85b993-295e-4a0d-b479-0f62ffc1eda3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l824q" Jun 03 20:57:54.754687 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:57:54.754560 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb85b993-295e-4a0d-b479-0f62ffc1eda3-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-l824q\" (UID: \"eb85b993-295e-4a0d-b479-0f62ffc1eda3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l824q" Jun 03 20:57:54.754687 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:57:54.754629 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb85b993-295e-4a0d-b479-0f62ffc1eda3-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-l824q\" (UID: \"eb85b993-295e-4a0d-b479-0f62ffc1eda3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l824q" Jun 03 20:57:54.754687 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:57:54.754650 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/eb85b993-295e-4a0d-b479-0f62ffc1eda3-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-l824q\" (UID: \"eb85b993-295e-4a0d-b479-0f62ffc1eda3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l824q" Jun 03 20:57:54.754849 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:57:54.754708 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v5s8\" (UniqueName: \"kubernetes.io/projected/eb85b993-295e-4a0d-b479-0f62ffc1eda3-kube-api-access-6v5s8\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-l824q\" (UID: \"eb85b993-295e-4a0d-b479-0f62ffc1eda3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l824q" Jun 03 20:57:54.754849 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:57:54.754744 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb85b993-295e-4a0d-b479-0f62ffc1eda3-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-l824q\" (UID: \"eb85b993-295e-4a0d-b479-0f62ffc1eda3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l824q" Jun 03 20:57:54.855705 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:57:54.855665 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb85b993-295e-4a0d-b479-0f62ffc1eda3-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-l824q\" (UID: \"eb85b993-295e-4a0d-b479-0f62ffc1eda3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l824q" Jun 03 20:57:54.855705 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:57:54.855710 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb85b993-295e-4a0d-b479-0f62ffc1eda3-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-l824q\" (UID: \"eb85b993-295e-4a0d-b479-0f62ffc1eda3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l824q" Jun 03 20:57:54.855935 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:57:54.855758 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb85b993-295e-4a0d-b479-0f62ffc1eda3-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-l824q\" (UID: \"eb85b993-295e-4a0d-b479-0f62ffc1eda3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l824q" Jun 03 20:57:54.855935 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:57:54.855774 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/eb85b993-295e-4a0d-b479-0f62ffc1eda3-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-l824q\" (UID: \"eb85b993-295e-4a0d-b479-0f62ffc1eda3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l824q" Jun 03 20:57:54.855935 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:57:54.855796 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v5s8\" (UniqueName: \"kubernetes.io/projected/eb85b993-295e-4a0d-b479-0f62ffc1eda3-kube-api-access-6v5s8\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-l824q\" (UID: \"eb85b993-295e-4a0d-b479-0f62ffc1eda3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l824q" Jun 03 20:57:54.855935 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:57:54.855827 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb85b993-295e-4a0d-b479-0f62ffc1eda3-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-l824q\" (UID: \"eb85b993-295e-4a0d-b479-0f62ffc1eda3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l824q" Jun 03 20:57:54.856131 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:57:54.856071 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb85b993-295e-4a0d-b479-0f62ffc1eda3-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-l824q\" (UID: \"eb85b993-295e-4a0d-b479-0f62ffc1eda3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l824q" Jun 03 20:57:54.856192 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:57:54.856175 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/eb85b993-295e-4a0d-b479-0f62ffc1eda3-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-l824q\" (UID: \"eb85b993-295e-4a0d-b479-0f62ffc1eda3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l824q" Jun 03 20:57:54.856250 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:57:54.856232 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb85b993-295e-4a0d-b479-0f62ffc1eda3-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-l824q\" (UID: \"eb85b993-295e-4a0d-b479-0f62ffc1eda3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l824q" Jun 03 20:57:54.858196 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:57:54.858172 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb85b993-295e-4a0d-b479-0f62ffc1eda3-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-l824q\" (UID: \"eb85b993-295e-4a0d-b479-0f62ffc1eda3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l824q" Jun 03 20:57:54.858350 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:57:54.858331 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb85b993-295e-4a0d-b479-0f62ffc1eda3-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-l824q\" (UID: \"eb85b993-295e-4a0d-b479-0f62ffc1eda3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l824q" Jun 03 20:57:54.864637 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:57:54.864610 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v5s8\" (UniqueName: \"kubernetes.io/projected/eb85b993-295e-4a0d-b479-0f62ffc1eda3-kube-api-access-6v5s8\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-l824q\" (UID: \"eb85b993-295e-4a0d-b479-0f62ffc1eda3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l824q" Jun 03 20:57:54.989704 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:57:54.989653 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 20:57:54.994293 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:57:54.994259 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l824q" Jun 03 20:57:55.147540 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:57:55.147110 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-l824q"] Jun 03 20:57:55.149740 ip-10-0-141-159 kubenswrapper[2573]: W0603 20:57:55.149708 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb85b993_295e_4a0d_b479_0f62ffc1eda3.slice/crio-d6c143dc968837506e5f9c21914b3ed11ffad3978f340e922fda26bb6e34a02d WatchSource:0}: Error finding container d6c143dc968837506e5f9c21914b3ed11ffad3978f340e922fda26bb6e34a02d: Status 404 returned error can't find the container with id d6c143dc968837506e5f9c21914b3ed11ffad3978f340e922fda26bb6e34a02d Jun 03 20:57:56.116801 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:57:56.116760 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l824q" event={"ID":"eb85b993-295e-4a0d-b479-0f62ffc1eda3","Type":"ContainerStarted","Data":"d6c143dc968837506e5f9c21914b3ed11ffad3978f340e922fda26bb6e34a02d"} Jun 03 20:57:59.140337 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:57:59.140298 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l824q" event={"ID":"eb85b993-295e-4a0d-b479-0f62ffc1eda3","Type":"ContainerStarted","Data":"eab406df1f9d1cc89a1de64703fbacba1d804c44a4cccd9ee8a065c8ec40cc30"} Jun 03 20:58:00.148049 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:58:00.148014 2573 generic.go:356] "Generic (PLEG): container finished" podID="eb85b993-295e-4a0d-b479-0f62ffc1eda3" containerID="eab406df1f9d1cc89a1de64703fbacba1d804c44a4cccd9ee8a065c8ec40cc30" exitCode=0 Jun 03 20:58:00.148437 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:58:00.148094 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l824q" event={"ID":"eb85b993-295e-4a0d-b479-0f62ffc1eda3","Type":"ContainerDied","Data":"eab406df1f9d1cc89a1de64703fbacba1d804c44a4cccd9ee8a065c8ec40cc30"} Jun 03 20:58:02.163018 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:58:02.162983 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l824q" event={"ID":"eb85b993-295e-4a0d-b479-0f62ffc1eda3","Type":"ContainerStarted","Data":"b01fc35bdb3228f7d4f67fee7553fb01424a2657744a008dcf1a84c3407c43e8"} Jun 03 20:58:02.185347 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:58:02.185283 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l824q" podStartSLOduration=2.242514985 podStartE2EDuration="8.185264508s" totalImagesPullingTime="4.570712348s" totalInitContainerRuntime="1.372037175s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:57:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:58:02.184153037 +0000 UTC m=+908.433563511" watchObservedRunningTime="2026-06-03 20:58:02.185264508 +0000 UTC m=+908.434674982" Jun 03 20:58:04.995002 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:58:04.994959 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l824q" Jun 03 20:58:04.995421 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:58:04.995031 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l824q" Jun 03 20:58:05.007562 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:58:05.007536 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l824q" Jun 03 20:58:05.197898 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:58:05.197867 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l824q" Jun 03 20:58:07.042702 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:58:07.042666 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:58:07.685793 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:58:07.685742 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 20:58:16.527698 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:58:16.527656 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:58:31.897774 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:58:31.897732 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:58:32.794249 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:58:32.794217 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 20:58:38.239678 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:58:38.239640 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:58:39.400441 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:58:39.400398 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 20:58:54.924016 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:58:54.923935 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:58:57.219773 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:58:57.219739 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 20:59:22.107742 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:59:22.107642 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 20:59:22.207941 ip-10-0-141-159 kubenswrapper[2573]: I0603 20:59:22.207904 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:00:05.088123 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:00:05.088088 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:00:05.187647 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:00:05.187611 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:00:06.283261 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:00:06.283225 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:00:06.380516 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:00:06.380453 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:00:27.690024 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:00:27.689988 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:00:34.085242 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:00:34.085158 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:00:39.803135 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:00:39.803095 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:00:49.290499 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:00:49.290449 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:00:58.093131 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:00:58.093092 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:01:08.888104 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:01:08.888067 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:01:17.409118 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:01:17.409081 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:01:28.395803 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:01:28.395766 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:01:34.386044 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:01:34.386000 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-65794dbd75-c2ghp"] Jun 03 21:01:34.386499 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:01:34.386338 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-65794dbd75-c2ghp" podUID="8286d7e5-30c7-4dc1-9f82-1e8bb35f2eb8" containerName="manager" containerID="cri-o://08aa7d14541520a046e93411f6dc116a7f6d2735c5453fe9ffbf4aa443942ffc" gracePeriod=30 Jun 03 21:01:34.639872 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:01:34.639788 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65794dbd75-c2ghp" Jun 03 21:01:34.710077 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:01:34.710035 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9f7qh\" (UniqueName: \"kubernetes.io/projected/8286d7e5-30c7-4dc1-9f82-1e8bb35f2eb8-kube-api-access-9f7qh\") pod \"8286d7e5-30c7-4dc1-9f82-1e8bb35f2eb8\" (UID: \"8286d7e5-30c7-4dc1-9f82-1e8bb35f2eb8\") " Jun 03 21:01:34.712132 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:01:34.712097 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8286d7e5-30c7-4dc1-9f82-1e8bb35f2eb8-kube-api-access-9f7qh" (OuterVolumeSpecName: "kube-api-access-9f7qh") pod "8286d7e5-30c7-4dc1-9f82-1e8bb35f2eb8" (UID: "8286d7e5-30c7-4dc1-9f82-1e8bb35f2eb8"). InnerVolumeSpecName "kube-api-access-9f7qh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:01:34.811449 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:01:34.811408 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9f7qh\" (UniqueName: \"kubernetes.io/projected/8286d7e5-30c7-4dc1-9f82-1e8bb35f2eb8-kube-api-access-9f7qh\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 21:01:35.360603 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:01:35.360567 2573 generic.go:356] "Generic (PLEG): container finished" podID="8286d7e5-30c7-4dc1-9f82-1e8bb35f2eb8" containerID="08aa7d14541520a046e93411f6dc116a7f6d2735c5453fe9ffbf4aa443942ffc" exitCode=0 Jun 03 21:01:35.360798 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:01:35.360614 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65794dbd75-c2ghp" Jun 03 21:01:35.360798 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:01:35.360650 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65794dbd75-c2ghp" event={"ID":"8286d7e5-30c7-4dc1-9f82-1e8bb35f2eb8","Type":"ContainerDied","Data":"08aa7d14541520a046e93411f6dc116a7f6d2735c5453fe9ffbf4aa443942ffc"} Jun 03 21:01:35.360798 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:01:35.360704 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65794dbd75-c2ghp" event={"ID":"8286d7e5-30c7-4dc1-9f82-1e8bb35f2eb8","Type":"ContainerDied","Data":"d884c91b311be9d15882efa2d0024e04ee74e5d31338a7e29267f67db5151290"} Jun 03 21:01:35.360798 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:01:35.360726 2573 scope.go:117] "RemoveContainer" containerID="08aa7d14541520a046e93411f6dc116a7f6d2735c5453fe9ffbf4aa443942ffc" Jun 03 21:01:35.369953 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:01:35.369934 2573 scope.go:117] "RemoveContainer" containerID="08aa7d14541520a046e93411f6dc116a7f6d2735c5453fe9ffbf4aa443942ffc" Jun 03 21:01:35.370202 ip-10-0-141-159 kubenswrapper[2573]: E0603 21:01:35.370186 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08aa7d14541520a046e93411f6dc116a7f6d2735c5453fe9ffbf4aa443942ffc\": container with ID starting with 08aa7d14541520a046e93411f6dc116a7f6d2735c5453fe9ffbf4aa443942ffc not found: ID does not exist" containerID="08aa7d14541520a046e93411f6dc116a7f6d2735c5453fe9ffbf4aa443942ffc" Jun 03 21:01:35.370252 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:01:35.370209 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08aa7d14541520a046e93411f6dc116a7f6d2735c5453fe9ffbf4aa443942ffc"} err="failed to get container status \"08aa7d14541520a046e93411f6dc116a7f6d2735c5453fe9ffbf4aa443942ffc\": rpc error: code = NotFound desc = could not find container \"08aa7d14541520a046e93411f6dc116a7f6d2735c5453fe9ffbf4aa443942ffc\": container with ID starting with 08aa7d14541520a046e93411f6dc116a7f6d2735c5453fe9ffbf4aa443942ffc not found: ID does not exist" Jun 03 21:01:35.390719 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:01:35.390689 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-65794dbd75-c2ghp"] Jun 03 21:01:35.394954 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:01:35.394929 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-65794dbd75-c2ghp"] Jun 03 21:01:36.153628 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:01:36.153580 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-65794dbd75-q2ckj"] Jun 03 21:01:36.154036 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:01:36.154017 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8286d7e5-30c7-4dc1-9f82-1e8bb35f2eb8" containerName="manager" Jun 03 21:01:36.154130 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:01:36.154039 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8286d7e5-30c7-4dc1-9f82-1e8bb35f2eb8" containerName="manager" Jun 03 21:01:36.154183 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:01:36.154147 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8286d7e5-30c7-4dc1-9f82-1e8bb35f2eb8" containerName="manager" Jun 03 21:01:36.157058 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:01:36.157034 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65794dbd75-q2ckj" Jun 03 21:01:36.160207 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:01:36.160181 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 03 21:01:36.160338 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:01:36.160239 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nxpff\"" Jun 03 21:01:36.166250 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:01:36.166226 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65794dbd75-q2ckj"] Jun 03 21:01:36.211976 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:01:36.211942 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8286d7e5-30c7-4dc1-9f82-1e8bb35f2eb8" path="/var/lib/kubelet/pods/8286d7e5-30c7-4dc1-9f82-1e8bb35f2eb8/volumes" Jun 03 21:01:36.221351 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:01:36.221314 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhn74\" (UniqueName: \"kubernetes.io/projected/1de089d5-5db8-46a7-9672-af72f4e56c02-kube-api-access-zhn74\") pod \"maas-controller-65794dbd75-q2ckj\" (UID: \"1de089d5-5db8-46a7-9672-af72f4e56c02\") " pod="opendatahub/maas-controller-65794dbd75-q2ckj" Jun 03 21:01:36.322144 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:01:36.322103 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhn74\" (UniqueName: \"kubernetes.io/projected/1de089d5-5db8-46a7-9672-af72f4e56c02-kube-api-access-zhn74\") pod \"maas-controller-65794dbd75-q2ckj\" (UID: \"1de089d5-5db8-46a7-9672-af72f4e56c02\") " pod="opendatahub/maas-controller-65794dbd75-q2ckj" Jun 03 21:01:36.331636 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:01:36.331608 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhn74\" (UniqueName: \"kubernetes.io/projected/1de089d5-5db8-46a7-9672-af72f4e56c02-kube-api-access-zhn74\") pod \"maas-controller-65794dbd75-q2ckj\" (UID: \"1de089d5-5db8-46a7-9672-af72f4e56c02\") " pod="opendatahub/maas-controller-65794dbd75-q2ckj" Jun 03 21:01:36.469588 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:01:36.469493 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65794dbd75-q2ckj" Jun 03 21:01:36.610313 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:01:36.610288 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65794dbd75-q2ckj"] Jun 03 21:01:36.611980 ip-10-0-141-159 kubenswrapper[2573]: W0603 21:01:36.611954 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1de089d5_5db8_46a7_9672_af72f4e56c02.slice/crio-d6a902416a8602e83ad40ae3fe40b3ce3e2d2f6c79a5f9bf5ea07f67eff130af WatchSource:0}: Error finding container d6a902416a8602e83ad40ae3fe40b3ce3e2d2f6c79a5f9bf5ea07f67eff130af: Status 404 returned error can't find the container with id d6a902416a8602e83ad40ae3fe40b3ce3e2d2f6c79a5f9bf5ea07f67eff130af Jun 03 21:01:36.613242 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:01:36.613222 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 21:01:37.374497 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:01:37.374385 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65794dbd75-q2ckj" event={"ID":"1de089d5-5db8-46a7-9672-af72f4e56c02","Type":"ContainerStarted","Data":"f4344a0c07ad219689e812a8f81a40f973f5abd96d1471add786cbcee4a00b3a"} Jun 03 21:01:37.374497 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:01:37.374441 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65794dbd75-q2ckj" event={"ID":"1de089d5-5db8-46a7-9672-af72f4e56c02","Type":"ContainerStarted","Data":"d6a902416a8602e83ad40ae3fe40b3ce3e2d2f6c79a5f9bf5ea07f67eff130af"} Jun 03 21:01:37.374733 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:01:37.374515 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-65794dbd75-q2ckj" Jun 03 21:01:37.398941 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:01:37.398888 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-65794dbd75-q2ckj" podStartSLOduration=0.962064245 podStartE2EDuration="1.398870886s" totalImagesPullingTime="436.806641ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:01:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:01:37.398428856 +0000 UTC m=+1123.647839332" watchObservedRunningTime="2026-06-03 21:01:37.398870886 +0000 UTC m=+1123.648281360" Jun 03 21:01:48.385944 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:01:48.385909 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-65794dbd75-q2ckj" Jun 03 21:02:01.560760 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:02:01.560688 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:02:01.616934 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:02:01.616907 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:02:15.911082 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:02:15.911041 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:02:16.005106 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:02:16.005074 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:02:24.261155 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:02:24.261103 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:02:30.635918 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:02:30.635885 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:02:30.744966 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:02:30.744925 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:02:40.492634 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:02:40.492596 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:02:54.264334 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:02:54.264294 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8cpfl_51f5ccb5-b246-47b7-82cb-9524ff802fae/ovn-acl-logging/0.log" Jun 03 21:02:54.269854 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:02:54.269830 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8cpfl_51f5ccb5-b246-47b7-82cb-9524ff802fae/ovn-acl-logging/0.log" Jun 03 21:02:56.585101 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:02:56.585069 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:03:02.781964 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:03:02.781934 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:03:03.871872 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:03:03.871837 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:03:26.642714 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:03:26.642678 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:03:32.790387 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:03:32.790306 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:03:32.903712 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:03:32.903678 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:03:32.990205 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:03:32.990170 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:03:33.170822 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:03:33.170667 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:03:33.270391 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:03:33.270355 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:03:35.487658 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:03:35.487623 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:03:49.731165 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:03:49.731122 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:03:49.845379 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:03:49.845349 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:03:49.963543 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:03:49.963509 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:03:51.692411 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:03:51.692379 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:03:55.731967 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:03:55.731929 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:03:55.829988 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:03:55.829929 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:04:03.878103 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:04:03.878066 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:04:03.982173 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:04:03.982141 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:04:04.080918 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:04:04.080886 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:04:04.206440 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:04:04.206339 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:04:06.283419 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:04:06.283378 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:04:20.709529 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:04:20.709467 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:04:20.834370 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:04:20.834333 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:04:20.934046 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:04:20.934015 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:04:22.189065 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:04:22.189027 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:04:26.759177 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:04:26.759131 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:04:26.828285 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:04:26.828252 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:05:21.604842 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:05:21.604766 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:05:31.095810 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:05:31.095766 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:05:32.594137 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:05:32.594097 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:05:40.027129 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:05:40.027090 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:05:40.127602 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:05:40.127560 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:05:48.699948 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:05:48.699903 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:05:57.591964 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:05:57.591925 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:06:14.293678 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:06:14.293629 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:06:22.896834 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:06:22.896801 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:06:55.695264 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:06:55.695214 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:07:03.686254 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:07:03.686219 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:07:11.690874 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:07:11.690839 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:07:21.688274 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:07:21.688231 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:07:29.489197 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:07:29.489165 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:07:46.992691 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:07:46.992659 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:07:52.259697 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:07:52.259666 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:07:52.340514 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:07:52.340485 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:07:54.300655 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:07:54.300625 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8cpfl_51f5ccb5-b246-47b7-82cb-9524ff802fae/ovn-acl-logging/0.log" Jun 03 21:07:54.308899 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:07:54.308879 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8cpfl_51f5ccb5-b246-47b7-82cb-9524ff802fae/ovn-acl-logging/0.log" Jun 03 21:07:58.588033 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:07:58.588002 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:08:49.293894 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:08:49.293853 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:08:56.890603 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:08:56.890572 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:09:02.492862 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:09:02.492821 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:09:11.265748 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:09:11.265711 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:09:20.485898 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:09:20.485856 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:09:27.096239 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:09:27.096207 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:09:37.298273 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:09:37.298238 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:09:46.488751 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:09:46.488715 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:09:55.588599 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:09:55.588565 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:10:02.398141 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:10:02.398105 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:10:12.592520 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:10:12.592482 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:10:19.593832 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:10:19.593796 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:10:30.498917 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:10:30.498886 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:10:35.616764 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:10:35.616733 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:10:39.197691 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:10:39.197656 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:10:48.011540 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:10:48.011505 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:10:54.791707 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:10:54.791662 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:11:04.794941 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:11:04.794862 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:11:13.890852 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:11:13.890816 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:12:04.047353 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:12:04.047309 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xmkff"] Jun 03 21:12:04.047992 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:12:04.047604 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xmkff" podUID="ed68e3d3-d33e-4ae9-a405-506ca65530f5" containerName="manager" containerID="cri-o://b626a2089044f7257189e273e030afa466217b6e6d797ef831e58f3d35a72666" gracePeriod=10 Jun 03 21:12:04.715068 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:12:04.715041 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xmkff" Jun 03 21:12:04.830745 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:12:04.830632 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed68e3d3-d33e-4ae9-a405-506ca65530f5-extensions-socket-volume\") pod \"ed68e3d3-d33e-4ae9-a405-506ca65530f5\" (UID: \"ed68e3d3-d33e-4ae9-a405-506ca65530f5\") " Jun 03 21:12:04.830745 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:12:04.830741 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spt9f\" (UniqueName: \"kubernetes.io/projected/ed68e3d3-d33e-4ae9-a405-506ca65530f5-kube-api-access-spt9f\") pod \"ed68e3d3-d33e-4ae9-a405-506ca65530f5\" (UID: \"ed68e3d3-d33e-4ae9-a405-506ca65530f5\") " Jun 03 21:12:04.831061 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:12:04.831032 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed68e3d3-d33e-4ae9-a405-506ca65530f5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ed68e3d3-d33e-4ae9-a405-506ca65530f5" (UID: "ed68e3d3-d33e-4ae9-a405-506ca65530f5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:12:04.832854 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:12:04.832813 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed68e3d3-d33e-4ae9-a405-506ca65530f5-kube-api-access-spt9f" (OuterVolumeSpecName: "kube-api-access-spt9f") pod "ed68e3d3-d33e-4ae9-a405-506ca65530f5" (UID: "ed68e3d3-d33e-4ae9-a405-506ca65530f5"). InnerVolumeSpecName "kube-api-access-spt9f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:12:04.883358 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:12:04.883323 2573 generic.go:356] "Generic (PLEG): container finished" podID="ed68e3d3-d33e-4ae9-a405-506ca65530f5" containerID="b626a2089044f7257189e273e030afa466217b6e6d797ef831e58f3d35a72666" exitCode=0 Jun 03 21:12:04.883561 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:12:04.883379 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xmkff" event={"ID":"ed68e3d3-d33e-4ae9-a405-506ca65530f5","Type":"ContainerDied","Data":"b626a2089044f7257189e273e030afa466217b6e6d797ef831e58f3d35a72666"} Jun 03 21:12:04.883561 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:12:04.883393 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xmkff" Jun 03 21:12:04.883561 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:12:04.883464 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xmkff" event={"ID":"ed68e3d3-d33e-4ae9-a405-506ca65530f5","Type":"ContainerDied","Data":"4ebcb0b54189f0bef7061b0f84cc7e48aecc0f1538120b189d6cd328452dac19"} Jun 03 21:12:04.883561 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:12:04.883493 2573 scope.go:117] "RemoveContainer" containerID="b626a2089044f7257189e273e030afa466217b6e6d797ef831e58f3d35a72666" Jun 03 21:12:04.893170 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:12:04.893146 2573 scope.go:117] "RemoveContainer" containerID="b626a2089044f7257189e273e030afa466217b6e6d797ef831e58f3d35a72666" Jun 03 21:12:04.893423 ip-10-0-141-159 kubenswrapper[2573]: E0603 21:12:04.893404 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b626a2089044f7257189e273e030afa466217b6e6d797ef831e58f3d35a72666\": container with ID starting with b626a2089044f7257189e273e030afa466217b6e6d797ef831e58f3d35a72666 not found: ID does not exist" containerID="b626a2089044f7257189e273e030afa466217b6e6d797ef831e58f3d35a72666" Jun 03 21:12:04.893519 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:12:04.893430 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b626a2089044f7257189e273e030afa466217b6e6d797ef831e58f3d35a72666"} err="failed to get container status \"b626a2089044f7257189e273e030afa466217b6e6d797ef831e58f3d35a72666\": rpc error: code = NotFound desc = could not find container \"b626a2089044f7257189e273e030afa466217b6e6d797ef831e58f3d35a72666\": container with ID starting with b626a2089044f7257189e273e030afa466217b6e6d797ef831e58f3d35a72666 not found: ID does not exist" Jun 03 21:12:04.906908 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:12:04.906873 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xmkff"] Jun 03 21:12:04.912566 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:12:04.912541 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xmkff"] Jun 03 21:12:04.931728 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:12:04.931695 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed68e3d3-d33e-4ae9-a405-506ca65530f5-extensions-socket-volume\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 21:12:04.931728 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:12:04.931725 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spt9f\" (UniqueName: \"kubernetes.io/projected/ed68e3d3-d33e-4ae9-a405-506ca65530f5-kube-api-access-spt9f\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 21:12:06.212388 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:12:06.212355 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed68e3d3-d33e-4ae9-a405-506ca65530f5" path="/var/lib/kubelet/pods/ed68e3d3-d33e-4ae9-a405-506ca65530f5/volumes" Jun 03 21:12:54.339712 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:12:54.339688 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8cpfl_51f5ccb5-b246-47b7-82cb-9524ff802fae/ovn-acl-logging/0.log" Jun 03 21:12:54.348363 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:12:54.348339 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8cpfl_51f5ccb5-b246-47b7-82cb-9524ff802fae/ovn-acl-logging/0.log" Jun 03 21:13:10.213575 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:13:10.213545 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gq6r4"] Jun 03 21:13:10.216037 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:13:10.213857 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed68e3d3-d33e-4ae9-a405-506ca65530f5" containerName="manager" Jun 03 21:13:10.216037 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:13:10.213869 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed68e3d3-d33e-4ae9-a405-506ca65530f5" containerName="manager" Jun 03 21:13:10.216037 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:13:10.213938 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed68e3d3-d33e-4ae9-a405-506ca65530f5" containerName="manager" Jun 03 21:13:10.216872 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:13:10.216857 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gq6r4" Jun 03 21:13:10.219800 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:13:10.219777 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nd7pt\"" Jun 03 21:13:10.228534 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:13:10.228509 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gq6r4"] Jun 03 21:13:10.307455 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:13:10.307424 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4tp4\" (UniqueName: \"kubernetes.io/projected/25b0f41f-46bf-4f72-b0b4-99a3c726c95e-kube-api-access-p4tp4\") pod \"kuadrant-operator-controller-manager-86878c769f-gq6r4\" (UID: \"25b0f41f-46bf-4f72-b0b4-99a3c726c95e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gq6r4" Jun 03 21:13:10.307635 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:13:10.307497 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/25b0f41f-46bf-4f72-b0b4-99a3c726c95e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-gq6r4\" (UID: \"25b0f41f-46bf-4f72-b0b4-99a3c726c95e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gq6r4" Jun 03 21:13:10.408613 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:13:10.408582 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/25b0f41f-46bf-4f72-b0b4-99a3c726c95e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-gq6r4\" (UID: \"25b0f41f-46bf-4f72-b0b4-99a3c726c95e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gq6r4" Jun 03 21:13:10.408763 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:13:10.408641 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4tp4\" (UniqueName: \"kubernetes.io/projected/25b0f41f-46bf-4f72-b0b4-99a3c726c95e-kube-api-access-p4tp4\") pod \"kuadrant-operator-controller-manager-86878c769f-gq6r4\" (UID: \"25b0f41f-46bf-4f72-b0b4-99a3c726c95e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gq6r4" Jun 03 21:13:10.409029 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:13:10.409011 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/25b0f41f-46bf-4f72-b0b4-99a3c726c95e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-gq6r4\" (UID: \"25b0f41f-46bf-4f72-b0b4-99a3c726c95e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gq6r4" Jun 03 21:13:10.419623 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:13:10.419594 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4tp4\" (UniqueName: \"kubernetes.io/projected/25b0f41f-46bf-4f72-b0b4-99a3c726c95e-kube-api-access-p4tp4\") pod \"kuadrant-operator-controller-manager-86878c769f-gq6r4\" (UID: \"25b0f41f-46bf-4f72-b0b4-99a3c726c95e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gq6r4" Jun 03 21:13:10.528007 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:13:10.527963 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gq6r4" Jun 03 21:13:10.664575 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:13:10.664551 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gq6r4"] Jun 03 21:13:10.666265 ip-10-0-141-159 kubenswrapper[2573]: W0603 21:13:10.666239 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25b0f41f_46bf_4f72_b0b4_99a3c726c95e.slice/crio-b36a32b86299db3f09d680b99db2d3d207215fa4c094cc7a837baf10177ffbe0 WatchSource:0}: Error finding container b36a32b86299db3f09d680b99db2d3d207215fa4c094cc7a837baf10177ffbe0: Status 404 returned error can't find the container with id b36a32b86299db3f09d680b99db2d3d207215fa4c094cc7a837baf10177ffbe0 Jun 03 21:13:11.262197 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:13:11.262159 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gq6r4" event={"ID":"25b0f41f-46bf-4f72-b0b4-99a3c726c95e","Type":"ContainerStarted","Data":"7b81f12fb654eb4432fc041e0b5cb731bc148f7bce85f8b1f0d681e4da7715a6"} Jun 03 21:13:11.262575 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:13:11.262224 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gq6r4" Jun 03 21:13:11.262575 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:13:11.262251 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gq6r4" event={"ID":"25b0f41f-46bf-4f72-b0b4-99a3c726c95e","Type":"ContainerStarted","Data":"b36a32b86299db3f09d680b99db2d3d207215fa4c094cc7a837baf10177ffbe0"} Jun 03 21:13:11.285631 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:13:11.285576 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gq6r4" podStartSLOduration=1.285562191 podStartE2EDuration="1.285562191s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:13:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:13:11.282395751 +0000 UTC m=+1817.531806226" watchObservedRunningTime="2026-06-03 21:13:11.285562191 +0000 UTC m=+1817.534972667" Jun 03 21:13:22.270013 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:13:22.269985 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gq6r4" Jun 03 21:13:29.312240 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:13:29.312200 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:13:36.283519 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:13:36.283486 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:14:01.584418 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:14:01.584330 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:14:07.788034 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:14:07.787998 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:14:17.889540 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:14:17.889508 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:14:25.368585 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:14:25.368553 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:14:28.392637 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:14:28.392602 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:14:37.687933 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:14:37.687897 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:14:47.589952 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:14:47.589915 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:14:57.211127 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:14:57.211092 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:15:04.650840 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:15:04.650807 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:15:04.708322 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:15:04.708296 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:15:07.584046 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:15:07.584009 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:15:15.691816 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:15:15.691782 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:15:26.180916 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:15:26.180873 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:15:36.182991 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:15:36.182957 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:16:10.596984 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:16:10.596945 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:16:54.093622 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:16:54.093585 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:17:02.991301 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:17:02.991222 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:17:11.088340 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:17:11.088302 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:17:20.189577 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:17:20.189539 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:17:28.990018 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:17:28.989984 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:17:41.822681 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:17:41.822647 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:17:50.192692 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:17:50.192656 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:17:54.375749 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:17:54.375721 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8cpfl_51f5ccb5-b246-47b7-82cb-9524ff802fae/ovn-acl-logging/0.log" Jun 03 21:17:54.385654 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:17:54.385633 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8cpfl_51f5ccb5-b246-47b7-82cb-9524ff802fae/ovn-acl-logging/0.log" Jun 03 21:17:59.787581 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:17:59.787544 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:18:09.801930 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:18:09.801891 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:18:18.388144 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:18:18.388104 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:18:26.894269 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:18:26.894228 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:18:38.710105 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:18:38.710066 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:18:50.804044 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:18:50.804011 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:18:56.706402 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:18:56.706359 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:19:04.698850 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:19:04.698815 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:19:12.801282 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:19:12.801243 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:19:21.389605 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:19:21.389575 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:19:39.691758 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:19:39.691726 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:19:48.287785 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:19:48.287746 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:19:57.048387 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:19:57.048348 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:20:03.393286 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:20:03.393193 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:20:13.292886 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:20:13.292841 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:20:22.293811 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:20:22.293776 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:20:31.385934 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:20:31.385895 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:20:45.193155 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:20:45.193116 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:20:53.593857 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:20:53.593822 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:21:06.594569 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:21:06.594531 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:21:15.086908 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:21:15.086868 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:21:24.289741 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:21:24.289699 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:21:34.897717 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:21:34.897629 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:21:43.001156 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:21:43.001115 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:22:01.695069 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:22:01.695032 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:22:10.793242 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:22:10.793205 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:22:15.882722 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:22:15.882689 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:22:19.190585 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:22:19.190550 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:22:25.445443 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:22:25.445396 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:22:30.093408 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:22:30.093373 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:22:49.712531 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:22:49.712468 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:22:52.478387 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:22:52.478352 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:22:54.416446 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:22:54.416419 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8cpfl_51f5ccb5-b246-47b7-82cb-9524ff802fae/ovn-acl-logging/0.log" Jun 03 21:22:54.424444 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:22:54.424422 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8cpfl_51f5ccb5-b246-47b7-82cb-9524ff802fae/ovn-acl-logging/0.log" Jun 03 21:23:02.772431 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:02.772356 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:23:04.511925 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:04.511888 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:23:04.592167 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:04.592134 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7"] Jun 03 21:23:04.595705 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:04.595682 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7" Jun 03 21:23:04.598229 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:04.598207 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-3bc3a4ce-openshift-default-dockercfg-kgk8s\"" Jun 03 21:23:04.612525 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:04.612499 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:23:04.615063 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:04.615040 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7"] Jun 03 21:23:04.696717 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:04.696687 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f57c386-6e44-4167-b1b5-255ec9e1cf03-credential-socket\") pod \"e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7\" (UID: \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\") " pod="openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7" Jun 03 21:23:04.696892 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:04.696737 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f57c386-6e44-4167-b1b5-255ec9e1cf03-istio-token\") pod \"e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7\" (UID: \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\") " pod="openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7" Jun 03 21:23:04.696892 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:04.696766 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f57c386-6e44-4167-b1b5-255ec9e1cf03-istio-data\") pod \"e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7\" (UID: \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\") " pod="openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7" Jun 03 21:23:04.696892 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:04.696784 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f57c386-6e44-4167-b1b5-255ec9e1cf03-workload-socket\") pod \"e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7\" (UID: \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\") " pod="openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7" Jun 03 21:23:04.696892 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:04.696821 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f57c386-6e44-4167-b1b5-255ec9e1cf03-istio-podinfo\") pod \"e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7\" (UID: \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\") " pod="openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7" Jun 03 21:23:04.696892 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:04.696861 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f57c386-6e44-4167-b1b5-255ec9e1cf03-workload-certs\") pod \"e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7\" (UID: \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\") " pod="openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7" Jun 03 21:23:04.696892 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:04.696875 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f57c386-6e44-4167-b1b5-255ec9e1cf03-istio-envoy\") pod \"e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7\" (UID: \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\") " pod="openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7" Jun 03 21:23:04.697127 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:04.696951 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4dpx\" (UniqueName: \"kubernetes.io/projected/3f57c386-6e44-4167-b1b5-255ec9e1cf03-kube-api-access-v4dpx\") pod \"e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7\" (UID: \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\") " pod="openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7" Jun 03 21:23:04.697127 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:04.696992 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f57c386-6e44-4167-b1b5-255ec9e1cf03-istiod-ca-cert\") pod \"e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7\" (UID: \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\") " pod="openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7" Jun 03 21:23:04.719265 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:04.719232 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:23:04.797733 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:04.797631 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f57c386-6e44-4167-b1b5-255ec9e1cf03-istiod-ca-cert\") pod \"e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7\" (UID: \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\") " pod="openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7" Jun 03 21:23:04.797733 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:04.797677 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f57c386-6e44-4167-b1b5-255ec9e1cf03-credential-socket\") pod \"e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7\" (UID: \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\") " pod="openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7" Jun 03 21:23:04.797733 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:04.797715 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f57c386-6e44-4167-b1b5-255ec9e1cf03-istio-token\") pod \"e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7\" (UID: \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\") " pod="openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7" Jun 03 21:23:04.798019 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:04.797740 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f57c386-6e44-4167-b1b5-255ec9e1cf03-istio-data\") pod \"e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7\" (UID: \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\") " pod="openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7" Jun 03 21:23:04.798019 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:04.797762 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f57c386-6e44-4167-b1b5-255ec9e1cf03-workload-socket\") pod \"e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7\" (UID: \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\") " pod="openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7" Jun 03 21:23:04.798019 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:04.797788 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f57c386-6e44-4167-b1b5-255ec9e1cf03-istio-podinfo\") pod \"e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7\" (UID: \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\") " pod="openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7" Jun 03 21:23:04.798019 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:04.797846 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f57c386-6e44-4167-b1b5-255ec9e1cf03-workload-certs\") pod \"e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7\" (UID: \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\") " pod="openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7" Jun 03 21:23:04.798019 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:04.797868 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f57c386-6e44-4167-b1b5-255ec9e1cf03-istio-envoy\") pod \"e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7\" (UID: \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\") " pod="openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7" Jun 03 21:23:04.798019 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:04.797911 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4dpx\" (UniqueName: \"kubernetes.io/projected/3f57c386-6e44-4167-b1b5-255ec9e1cf03-kube-api-access-v4dpx\") pod \"e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7\" (UID: \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\") " pod="openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7" Jun 03 21:23:04.798330 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:04.798152 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f57c386-6e44-4167-b1b5-255ec9e1cf03-workload-socket\") pod \"e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7\" (UID: \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\") " pod="openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7" Jun 03 21:23:04.798330 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:04.798205 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f57c386-6e44-4167-b1b5-255ec9e1cf03-credential-socket\") pod \"e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7\" (UID: \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\") " pod="openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7" Jun 03 21:23:04.798330 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:04.798250 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f57c386-6e44-4167-b1b5-255ec9e1cf03-istio-data\") pod \"e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7\" (UID: \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\") " pod="openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7" Jun 03 21:23:04.798502 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:04.798386 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f57c386-6e44-4167-b1b5-255ec9e1cf03-workload-certs\") pod \"e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7\" (UID: \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\") " pod="openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7" Jun 03 21:23:04.798502 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:04.798447 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f57c386-6e44-4167-b1b5-255ec9e1cf03-istiod-ca-cert\") pod \"e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7\" (UID: \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\") " pod="openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7" Jun 03 21:23:04.800325 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:04.800306 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f57c386-6e44-4167-b1b5-255ec9e1cf03-istio-envoy\") pod \"e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7\" (UID: \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\") " pod="openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7" Jun 03 21:23:04.800557 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:04.800539 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f57c386-6e44-4167-b1b5-255ec9e1cf03-istio-podinfo\") pod \"e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7\" (UID: \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\") " pod="openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7" Jun 03 21:23:04.823487 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:04.823447 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f57c386-6e44-4167-b1b5-255ec9e1cf03-istio-token\") pod \"e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7\" (UID: \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\") " pod="openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7" Jun 03 21:23:04.823625 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:04.823593 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4dpx\" (UniqueName: \"kubernetes.io/projected/3f57c386-6e44-4167-b1b5-255ec9e1cf03-kube-api-access-v4dpx\") pod \"e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7\" (UID: \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\") " pod="openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7" Jun 03 21:23:04.906132 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:04.906102 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7" Jun 03 21:23:05.051948 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:05.051917 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7"] Jun 03 21:23:05.053175 ip-10-0-141-159 kubenswrapper[2573]: W0603 21:23:05.053151 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f57c386_6e44_4167_b1b5_255ec9e1cf03.slice/crio-4a1b849a9f9153efa2df6254762401a333b044ad7914527305bf975443a0e997 WatchSource:0}: Error finding container 4a1b849a9f9153efa2df6254762401a333b044ad7914527305bf975443a0e997: Status 404 returned error can't find the container with id 4a1b849a9f9153efa2df6254762401a333b044ad7914527305bf975443a0e997 Jun 03 21:23:05.055216 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:05.055199 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 21:23:05.254944 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:05.254914 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5hwxg"] Jun 03 21:23:05.517969 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:05.517934 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7" event={"ID":"3f57c386-6e44-4167-b1b5-255ec9e1cf03","Type":"ContainerStarted","Data":"4a1b849a9f9153efa2df6254762401a333b044ad7914527305bf975443a0e997"} Jun 03 21:23:08.084157 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:08.084093 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:23:08.200858 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:08.200824 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 21:23:08.200945 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:08.200893 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 21:23:08.200945 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:08.200920 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 21:23:08.545162 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:08.545126 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7" event={"ID":"3f57c386-6e44-4167-b1b5-255ec9e1cf03","Type":"ContainerStarted","Data":"a9a67d5a6b4a30e1f08d30c5f0d0477503d24d092710532b2ab04cf1e669fe17"} Jun 03 21:23:08.568134 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:08.568078 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7" podStartSLOduration=1.422887301 podStartE2EDuration="4.568063931s" totalImagesPullingTime="3.14517663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:23:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:23:08.56531316 +0000 UTC m=+2414.814723636" watchObservedRunningTime="2026-06-03 21:23:08.568063931 +0000 UTC m=+2414.817474406" Jun 03 21:23:08.906808 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:08.906727 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7" Jun 03 21:23:09.911274 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:09.911245 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7" Jun 03 21:23:10.539114 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:10.539080 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7"] Jun 03 21:23:10.558708 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:10.558674 2573 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7" secret="" err="secret \"e2e-ait-3bc3a4ce-openshift-default-dockercfg-kgk8s\" not found" Jun 03 21:23:10.558708 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:10.558700 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7" Jun 03 21:23:10.559655 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:10.559636 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7" Jun 03 21:23:10.561312 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:10.561287 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:23:10.663978 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:10.663947 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:23:10.849159 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:10.849075 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:23:11.563408 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:11.563363 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7" podUID="3f57c386-6e44-4167-b1b5-255ec9e1cf03" containerName="istio-proxy" containerID="cri-o://a9a67d5a6b4a30e1f08d30c5f0d0477503d24d092710532b2ab04cf1e669fe17" gracePeriod=30 Jun 03 21:23:12.137457 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:12.137427 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:23:16.707964 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:16.707918 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:23:16.807973 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:16.807937 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:23:16.816826 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:16.816807 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7" Jun 03 21:23:16.983556 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:16.983396 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:23:17.009083 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:17.009060 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f57c386-6e44-4167-b1b5-255ec9e1cf03-workload-certs\") pod \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\" (UID: \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\") " Jun 03 21:23:17.009225 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:17.009106 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f57c386-6e44-4167-b1b5-255ec9e1cf03-istio-data\") pod \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\" (UID: \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\") " Jun 03 21:23:17.009225 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:17.009128 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f57c386-6e44-4167-b1b5-255ec9e1cf03-workload-socket\") pod \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\" (UID: \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\") " Jun 03 21:23:17.009225 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:17.009164 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4dpx\" (UniqueName: \"kubernetes.io/projected/3f57c386-6e44-4167-b1b5-255ec9e1cf03-kube-api-access-v4dpx\") pod \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\" (UID: \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\") " Jun 03 21:23:17.009225 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:17.009197 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f57c386-6e44-4167-b1b5-255ec9e1cf03-istio-podinfo\") pod \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\" (UID: \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\") " Jun 03 21:23:17.009225 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:17.009214 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f57c386-6e44-4167-b1b5-255ec9e1cf03-istiod-ca-cert\") pod \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\" (UID: \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\") " Jun 03 21:23:17.009518 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:17.009277 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f57c386-6e44-4167-b1b5-255ec9e1cf03-istio-token\") pod \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\" (UID: \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\") " Jun 03 21:23:17.009518 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:17.009322 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f57c386-6e44-4167-b1b5-255ec9e1cf03-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3f57c386-6e44-4167-b1b5-255ec9e1cf03" (UID: "3f57c386-6e44-4167-b1b5-255ec9e1cf03"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:23:17.009518 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:17.009334 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f57c386-6e44-4167-b1b5-255ec9e1cf03-istio-data" (OuterVolumeSpecName: "istio-data") pod "3f57c386-6e44-4167-b1b5-255ec9e1cf03" (UID: "3f57c386-6e44-4167-b1b5-255ec9e1cf03"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:23:17.009518 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:17.009375 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f57c386-6e44-4167-b1b5-255ec9e1cf03-istio-envoy\") pod \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\" (UID: \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\") " Jun 03 21:23:17.009518 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:17.009431 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f57c386-6e44-4167-b1b5-255ec9e1cf03-credential-socket\") pod \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\" (UID: \"3f57c386-6e44-4167-b1b5-255ec9e1cf03\") " Jun 03 21:23:17.009518 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:17.009453 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f57c386-6e44-4167-b1b5-255ec9e1cf03-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3f57c386-6e44-4167-b1b5-255ec9e1cf03" (UID: "3f57c386-6e44-4167-b1b5-255ec9e1cf03"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:23:17.009852 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:17.009677 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f57c386-6e44-4167-b1b5-255ec9e1cf03-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3f57c386-6e44-4167-b1b5-255ec9e1cf03" (UID: "3f57c386-6e44-4167-b1b5-255ec9e1cf03"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 21:23:17.009852 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:17.009727 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f57c386-6e44-4167-b1b5-255ec9e1cf03-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3f57c386-6e44-4167-b1b5-255ec9e1cf03" (UID: "3f57c386-6e44-4167-b1b5-255ec9e1cf03"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:23:17.009852 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:17.009820 2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f57c386-6e44-4167-b1b5-255ec9e1cf03-credential-socket\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 21:23:17.009852 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:17.009836 2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f57c386-6e44-4167-b1b5-255ec9e1cf03-workload-certs\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 21:23:17.009852 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:17.009849 2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f57c386-6e44-4167-b1b5-255ec9e1cf03-istio-data\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 21:23:17.010122 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:17.009861 2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f57c386-6e44-4167-b1b5-255ec9e1cf03-workload-socket\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 21:23:17.010122 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:17.009876 2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f57c386-6e44-4167-b1b5-255ec9e1cf03-istiod-ca-cert\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 21:23:17.011613 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:17.011588 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f57c386-6e44-4167-b1b5-255ec9e1cf03-kube-api-access-v4dpx" (OuterVolumeSpecName: "kube-api-access-v4dpx") pod "3f57c386-6e44-4167-b1b5-255ec9e1cf03" (UID: "3f57c386-6e44-4167-b1b5-255ec9e1cf03"). InnerVolumeSpecName "kube-api-access-v4dpx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:23:17.011742 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:17.011641 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f57c386-6e44-4167-b1b5-255ec9e1cf03-istio-token" (OuterVolumeSpecName: "istio-token") pod "3f57c386-6e44-4167-b1b5-255ec9e1cf03" (UID: "3f57c386-6e44-4167-b1b5-255ec9e1cf03"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:23:17.012070 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:17.011742 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3f57c386-6e44-4167-b1b5-255ec9e1cf03-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3f57c386-6e44-4167-b1b5-255ec9e1cf03" (UID: "3f57c386-6e44-4167-b1b5-255ec9e1cf03"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 03 21:23:17.012070 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:17.011840 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f57c386-6e44-4167-b1b5-255ec9e1cf03-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3f57c386-6e44-4167-b1b5-255ec9e1cf03" (UID: "3f57c386-6e44-4167-b1b5-255ec9e1cf03"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:23:17.110973 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:17.110938 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f57c386-6e44-4167-b1b5-255ec9e1cf03-istio-token\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 21:23:17.110973 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:17.110977 2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f57c386-6e44-4167-b1b5-255ec9e1cf03-istio-envoy\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 21:23:17.111199 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:17.110993 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4dpx\" (UniqueName: \"kubernetes.io/projected/3f57c386-6e44-4167-b1b5-255ec9e1cf03-kube-api-access-v4dpx\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 21:23:17.111199 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:17.111007 2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f57c386-6e44-4167-b1b5-255ec9e1cf03-istio-podinfo\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 03 21:23:17.114194 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:17.114162 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:23:17.207460 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:17.207426 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:23:17.597439 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:17.597410 2573 generic.go:356] "Generic (PLEG): container finished" podID="3f57c386-6e44-4167-b1b5-255ec9e1cf03" containerID="a9a67d5a6b4a30e1f08d30c5f0d0477503d24d092710532b2ab04cf1e669fe17" exitCode=0 Jun 03 21:23:17.597641 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:17.597453 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7" Jun 03 21:23:17.597641 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:17.597506 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7" event={"ID":"3f57c386-6e44-4167-b1b5-255ec9e1cf03","Type":"ContainerDied","Data":"a9a67d5a6b4a30e1f08d30c5f0d0477503d24d092710532b2ab04cf1e669fe17"} Jun 03 21:23:17.597641 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:17.597561 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7" event={"ID":"3f57c386-6e44-4167-b1b5-255ec9e1cf03","Type":"ContainerDied","Data":"4a1b849a9f9153efa2df6254762401a333b044ad7914527305bf975443a0e997"} Jun 03 21:23:17.597641 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:17.597584 2573 scope.go:117] "RemoveContainer" containerID="a9a67d5a6b4a30e1f08d30c5f0d0477503d24d092710532b2ab04cf1e669fe17" Jun 03 21:23:17.607179 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:17.607159 2573 scope.go:117] "RemoveContainer" containerID="a9a67d5a6b4a30e1f08d30c5f0d0477503d24d092710532b2ab04cf1e669fe17" Jun 03 21:23:17.607412 ip-10-0-141-159 kubenswrapper[2573]: E0603 21:23:17.607396 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9a67d5a6b4a30e1f08d30c5f0d0477503d24d092710532b2ab04cf1e669fe17\": container with ID starting with a9a67d5a6b4a30e1f08d30c5f0d0477503d24d092710532b2ab04cf1e669fe17 not found: ID does not exist" containerID="a9a67d5a6b4a30e1f08d30c5f0d0477503d24d092710532b2ab04cf1e669fe17" Jun 03 21:23:17.607458 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:17.607419 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9a67d5a6b4a30e1f08d30c5f0d0477503d24d092710532b2ab04cf1e669fe17"} err="failed to get container status \"a9a67d5a6b4a30e1f08d30c5f0d0477503d24d092710532b2ab04cf1e669fe17\": rpc error: code = NotFound desc = could not find container \"a9a67d5a6b4a30e1f08d30c5f0d0477503d24d092710532b2ab04cf1e669fe17\": container with ID starting with a9a67d5a6b4a30e1f08d30c5f0d0477503d24d092710532b2ab04cf1e669fe17 not found: ID does not exist" Jun 03 21:23:17.625871 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:17.625844 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7"] Jun 03 21:23:17.632989 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:17.632965 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-3bc3a4ce-openshift-default-967bb99c4-qkhs7"] Jun 03 21:23:18.211619 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:18.211589 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f57c386-6e44-4167-b1b5-255ec9e1cf03" path="/var/lib/kubelet/pods/3f57c386-6e44-4167-b1b5-255ec9e1cf03/volumes" Jun 03 21:23:20.239256 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:20.239224 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:23:23.048753 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:23.048720 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:23:23.148035 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:23.147971 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:23:23.930682 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:23.930643 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:23:24.031961 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:24.031931 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:23:24.306427 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:24.306392 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:23:25.080344 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:25.080317 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:23:30.267534 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:30.267493 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:23:30.366664 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:30.366631 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:23:41.160213 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:41.160184 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-b685d69dc-2v74v_13571a47-6031-47ee-a67d-2e261f504d5f/nginx/0.log" Jun 03 21:23:41.398736 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:41.398704 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-qmxfs_6eeafdc3-2a7b-4451-bc02-8ffcaff6a2db/manager/0.log" Jun 03 21:23:41.515930 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:41.515901 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-kk4kl_9fe7509d-793f-4fea-8098-7ddfe212c1f2/manager/0.log" Jun 03 21:23:41.628029 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:41.628002 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-8965c4cfb-k7ghf_09ad1159-e366-450a-82e5-72c6a9b7894e/maas-api/0.log" Jun 03 21:23:41.965159 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:41.965085 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-65794dbd75-q2ckj_1de089d5-5db8-46a7-9672-af72f4e56c02/manager/0.log" Jun 03 21:23:42.086484 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:42.086453 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-cvzlp_8b5bdcae-8bfe-4228-9a2b-13c944d71483/server/0.log" Jun 03 21:23:42.207818 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:42.207774 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-45mf7_ad210e1a-bd68-4eec-84b0-ff8ba1246fb4/manager/0.log" Jun 03 21:23:42.444320 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:42.444294 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fdd65c64b-w2cb4_aeba6bcf-a599-478e-afb3-2ac71f39a2c7/copy-manifests/0.log" Jun 03 21:23:42.457891 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:42.457863 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fdd65c64b-w2cb4_aeba6bcf-a599-478e-afb3-2ac71f39a2c7/manager/0.log" Jun 03 21:23:43.465728 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:43.465692 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ggln8_c0dd242a-c271-4154-b50a-078632f1e110/util/0.log" Jun 03 21:23:43.471915 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:43.471896 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ggln8_c0dd242a-c271-4154-b50a-078632f1e110/pull/0.log" Jun 03 21:23:43.478007 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:43.477977 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ggln8_c0dd242a-c271-4154-b50a-078632f1e110/extract/0.log" Jun 03 21:23:43.595984 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:43.595961 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qk8d6_b1cc82b2-5f14-4f31-a4b1-fc400bd103bd/extract/0.log" Jun 03 21:23:43.602577 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:43.602553 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qk8d6_b1cc82b2-5f14-4f31-a4b1-fc400bd103bd/util/0.log" Jun 03 21:23:43.609125 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:43.609107 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qk8d6_b1cc82b2-5f14-4f31-a4b1-fc400bd103bd/pull/0.log" Jun 03 21:23:43.719980 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:43.719921 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dpjhc_31d9d1ba-cdcc-4002-b333-cbf77268ca1c/util/0.log" Jun 03 21:23:43.726766 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:43.726743 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dpjhc_31d9d1ba-cdcc-4002-b333-cbf77268ca1c/pull/0.log" Jun 03 21:23:43.732928 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:43.732905 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dpjhc_31d9d1ba-cdcc-4002-b333-cbf77268ca1c/extract/0.log" Jun 03 21:23:43.841116 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:43.841088 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jj6rm_0f42b2d3-9411-4391-b2b4-a964d0bc931f/util/0.log" Jun 03 21:23:43.846888 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:43.846868 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jj6rm_0f42b2d3-9411-4391-b2b4-a964d0bc931f/pull/0.log" Jun 03 21:23:43.852666 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:43.852649 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jj6rm_0f42b2d3-9411-4391-b2b4-a964d0bc931f/extract/0.log" Jun 03 21:23:44.439984 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:44.439948 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-mh5kf_6b488700-62b6-4e5c-8e84-a067c6731be5/registry-server/0.log" Jun 03 21:23:44.564210 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:44.564179 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-gq6r4_25b0f41f-46bf-4f72-b0b4-99a3c726c95e/manager/0.log" Jun 03 21:23:44.674300 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:44.674264 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-5hwxg_1d7426dd-bf90-4538-9c00-cd0ad925651e/limitador/0.log" Jun 03 21:23:45.261234 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:45.261201 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-cbms5_1e80f295-7279-48b5-85ff-319655acd05b/discovery/0.log" Jun 03 21:23:45.368534 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:45.368507 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79b6b976dd-2j6k2_bdf1f347-6cef-4716-8ffd-5bc818c3fbf7/kube-auth-proxy/0.log" Jun 03 21:23:46.295731 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:46.295700 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-l824q_eb85b993-295e-4a0d-b479-0f62ffc1eda3/storage-initializer/0.log" Jun 03 21:23:46.302597 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:46.302579 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-l824q_eb85b993-295e-4a0d-b479-0f62ffc1eda3/main/0.log" Jun 03 21:23:51.403021 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:51.402988 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9m28l/must-gather-22pm6"] Jun 03 21:23:51.403444 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:51.403383 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f57c386-6e44-4167-b1b5-255ec9e1cf03" containerName="istio-proxy" Jun 03 21:23:51.403444 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:51.403398 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f57c386-6e44-4167-b1b5-255ec9e1cf03" containerName="istio-proxy" Jun 03 21:23:51.403647 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:51.403505 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f57c386-6e44-4167-b1b5-255ec9e1cf03" containerName="istio-proxy" Jun 03 21:23:51.406661 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:51.406643 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9m28l/must-gather-22pm6" Jun 03 21:23:51.409385 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:51.409366 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9m28l\"/\"kube-root-ca.crt\"" Jun 03 21:23:51.409494 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:51.409403 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9m28l\"/\"openshift-service-ca.crt\"" Jun 03 21:23:51.410361 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:51.410347 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9m28l\"/\"default-dockercfg-vwwch\"" Jun 03 21:23:51.418233 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:51.418210 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9m28l/must-gather-22pm6"] Jun 03 21:23:51.423007 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:51.422984 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:23:51.490875 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:51.490839 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:23:51.500444 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:51.500423 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvg5q\" (UniqueName: \"kubernetes.io/projected/be740aad-1a93-433b-a5a6-0bf25de1579c-kube-api-access-bvg5q\") pod \"must-gather-22pm6\" (UID: \"be740aad-1a93-433b-a5a6-0bf25de1579c\") " pod="openshift-must-gather-9m28l/must-gather-22pm6" Jun 03 21:23:51.500540 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:51.500498 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/be740aad-1a93-433b-a5a6-0bf25de1579c-must-gather-output\") pod \"must-gather-22pm6\" (UID: \"be740aad-1a93-433b-a5a6-0bf25de1579c\") " pod="openshift-must-gather-9m28l/must-gather-22pm6" Jun 03 21:23:51.601800 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:51.601771 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/be740aad-1a93-433b-a5a6-0bf25de1579c-must-gather-output\") pod \"must-gather-22pm6\" (UID: \"be740aad-1a93-433b-a5a6-0bf25de1579c\") " pod="openshift-must-gather-9m28l/must-gather-22pm6" Jun 03 21:23:51.601947 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:51.601838 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvg5q\" (UniqueName: \"kubernetes.io/projected/be740aad-1a93-433b-a5a6-0bf25de1579c-kube-api-access-bvg5q\") pod \"must-gather-22pm6\" (UID: \"be740aad-1a93-433b-a5a6-0bf25de1579c\") " pod="openshift-must-gather-9m28l/must-gather-22pm6" Jun 03 21:23:51.602097 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:51.602079 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/be740aad-1a93-433b-a5a6-0bf25de1579c-must-gather-output\") pod \"must-gather-22pm6\" (UID: \"be740aad-1a93-433b-a5a6-0bf25de1579c\") " pod="openshift-must-gather-9m28l/must-gather-22pm6" Jun 03 21:23:51.613390 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:51.613363 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvg5q\" (UniqueName: \"kubernetes.io/projected/be740aad-1a93-433b-a5a6-0bf25de1579c-kube-api-access-bvg5q\") pod \"must-gather-22pm6\" (UID: \"be740aad-1a93-433b-a5a6-0bf25de1579c\") " pod="openshift-must-gather-9m28l/must-gather-22pm6" Jun 03 21:23:51.717070 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:51.716995 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9m28l/must-gather-22pm6" Jun 03 21:23:51.863971 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:51.863941 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9m28l/must-gather-22pm6"] Jun 03 21:23:51.865093 ip-10-0-141-159 kubenswrapper[2573]: W0603 21:23:51.865069 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe740aad_1a93_433b_a5a6_0bf25de1579c.slice/crio-08c2522746ddc35e87db2c37fc631181ad8717042fd9089cdf077162c6e386f3 WatchSource:0}: Error finding container 08c2522746ddc35e87db2c37fc631181ad8717042fd9089cdf077162c6e386f3: Status 404 returned error can't find the container with id 08c2522746ddc35e87db2c37fc631181ad8717042fd9089cdf077162c6e386f3 Jun 03 21:23:52.360056 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:52.360021 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" limit=1024 Jun 03 21:23:52.804351 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:52.804319 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9m28l/must-gather-22pm6" event={"ID":"be740aad-1a93-433b-a5a6-0bf25de1579c","Type":"ContainerStarted","Data":"8a3b7d479a6f2f42228ca8fdce21bd93b67c912bfa3b0214c0ba414a37a5c0a6"} Jun 03 21:23:52.804747 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:52.804370 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9m28l/must-gather-22pm6" event={"ID":"be740aad-1a93-433b-a5a6-0bf25de1579c","Type":"ContainerStarted","Data":"08c2522746ddc35e87db2c37fc631181ad8717042fd9089cdf077162c6e386f3"} Jun 03 21:23:53.813221 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:53.813179 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9m28l/must-gather-22pm6" event={"ID":"be740aad-1a93-433b-a5a6-0bf25de1579c","Type":"ContainerStarted","Data":"5960b40851aa667195efe5a9eb227ced53e3258bd00a39e73202662f336f3a54"} Jun 03 21:23:53.833827 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:53.833765 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9m28l/must-gather-22pm6" podStartSLOduration=2.076069402 podStartE2EDuration="2.833744145s" totalImagesPullingTime="757.674743ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:23:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:23:53.830276321 +0000 UTC m=+2460.079686797" watchObservedRunningTime="2026-06-03 21:23:53.833744145 +0000 UTC m=+2460.083154621" Jun 03 21:23:54.632414 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:54.632371 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-m7dmv_025eda00-3ac0-406d-8bcc-48ea3697528f/global-pull-secret-syncer/0.log" Jun 03 21:23:54.688571 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:54.688541 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fgv2m_aee2b45f-422e-44e2-9cc1-eca625d64f5e/konnectivity-agent/0.log" Jun 03 21:23:54.826386 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:54.826346 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-159.ec2.internal_2cfaf7f25e0479ec5ca04027253aa5e2/haproxy/0.log" Jun 03 21:23:57.546688 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:57.546655 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-ccg7q_6518a83b-aff6-4523-b2e5-3acf84b9e818/sail-operator/0.log" Jun 03 21:23:59.207653 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:59.207618 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ggln8_c0dd242a-c271-4154-b50a-078632f1e110/extract/0.log" Jun 03 21:23:59.228950 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:59.228918 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ggln8_c0dd242a-c271-4154-b50a-078632f1e110/util/0.log" Jun 03 21:23:59.252951 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:59.252875 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ggln8_c0dd242a-c271-4154-b50a-078632f1e110/pull/0.log" Jun 03 21:23:59.287846 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:59.287812 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qk8d6_b1cc82b2-5f14-4f31-a4b1-fc400bd103bd/extract/0.log" Jun 03 21:23:59.313803 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:59.313776 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qk8d6_b1cc82b2-5f14-4f31-a4b1-fc400bd103bd/util/0.log" Jun 03 21:23:59.333752 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:59.333724 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qk8d6_b1cc82b2-5f14-4f31-a4b1-fc400bd103bd/pull/0.log" Jun 03 21:23:59.365608 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:59.365578 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dpjhc_31d9d1ba-cdcc-4002-b333-cbf77268ca1c/extract/0.log" Jun 03 21:23:59.389544 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:59.389514 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dpjhc_31d9d1ba-cdcc-4002-b333-cbf77268ca1c/util/0.log" Jun 03 21:23:59.435639 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:59.435609 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dpjhc_31d9d1ba-cdcc-4002-b333-cbf77268ca1c/pull/0.log" Jun 03 21:23:59.500883 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:59.500848 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jj6rm_0f42b2d3-9411-4391-b2b4-a964d0bc931f/extract/0.log" Jun 03 21:23:59.552034 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:59.552001 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jj6rm_0f42b2d3-9411-4391-b2b4-a964d0bc931f/util/0.log" Jun 03 21:23:59.591945 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:23:59.591909 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jj6rm_0f42b2d3-9411-4391-b2b4-a964d0bc931f/pull/0.log" Jun 03 21:24:00.020736 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:00.020702 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-mh5kf_6b488700-62b6-4e5c-8e84-a067c6731be5/registry-server/0.log" Jun 03 21:24:00.133197 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:00.133151 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-gq6r4_25b0f41f-46bf-4f72-b0b4-99a3c726c95e/manager/0.log" Jun 03 21:24:00.158127 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:00.158082 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-5hwxg_1d7426dd-bf90-4538-9c00-cd0ad925651e/limitador/0.log" Jun 03 21:24:02.059936 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:02.059882 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-79fb7d47d4-kwq4x_1ab6df49-7f74-4f69-a23c-c4abaf13785e/kube-state-metrics/0.log" Jun 03 21:24:02.080386 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:02.080361 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-79fb7d47d4-kwq4x_1ab6df49-7f74-4f69-a23c-c4abaf13785e/kube-rbac-proxy-main/0.log" Jun 03 21:24:02.100368 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:02.100342 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-79fb7d47d4-kwq4x_1ab6df49-7f74-4f69-a23c-c4abaf13785e/kube-rbac-proxy-self/0.log" Jun 03 21:24:02.165840 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:02.165794 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-9b9fc658-64gv9_02cb4f66-27ef-4f0d-ae4d-af0918a52a7b/monitoring-plugin/0.log" Jun 03 21:24:02.292020 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:02.291986 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9nr8m_8bc5c4e4-950d-48f7-81eb-e288419443b7/node-exporter/0.log" Jun 03 21:24:02.310187 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:02.310115 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9nr8m_8bc5c4e4-950d-48f7-81eb-e288419443b7/kube-rbac-proxy/0.log" Jun 03 21:24:02.330875 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:02.330845 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9nr8m_8bc5c4e4-950d-48f7-81eb-e288419443b7/init-textfile/0.log" Jun 03 21:24:05.771368 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:05.771333 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-55f45b7c4b-rp8sm_ff7774cd-5884-4434-8756-5a9483add0aa/console/0.log" Jun 03 21:24:05.810487 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:05.810420 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-56b467f5ff-nkkbr_13ecd0fe-a9f3-4ea5-bd41-1d7a6d771adb/download-server/0.log" Jun 03 21:24:07.067673 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:07.067638 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9m28l/perf-node-gather-daemonset-jm44f"] Jun 03 21:24:07.074489 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:07.074449 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-jm44f" Jun 03 21:24:07.080510 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:07.080486 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9m28l/perf-node-gather-daemonset-jm44f"] Jun 03 21:24:07.167638 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:07.167592 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbqgl\" (UniqueName: \"kubernetes.io/projected/a9cda885-26fa-4834-82ad-0e1fce9fa7df-kube-api-access-jbqgl\") pod \"perf-node-gather-daemonset-jm44f\" (UID: \"a9cda885-26fa-4834-82ad-0e1fce9fa7df\") " pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-jm44f" Jun 03 21:24:07.167900 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:07.167873 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a9cda885-26fa-4834-82ad-0e1fce9fa7df-podres\") pod \"perf-node-gather-daemonset-jm44f\" (UID: \"a9cda885-26fa-4834-82ad-0e1fce9fa7df\") " pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-jm44f" Jun 03 21:24:07.168019 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:07.167954 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a9cda885-26fa-4834-82ad-0e1fce9fa7df-proc\") pod \"perf-node-gather-daemonset-jm44f\" (UID: \"a9cda885-26fa-4834-82ad-0e1fce9fa7df\") " pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-jm44f" Jun 03 21:24:07.168137 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:07.168023 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a9cda885-26fa-4834-82ad-0e1fce9fa7df-lib-modules\") pod \"perf-node-gather-daemonset-jm44f\" (UID: \"a9cda885-26fa-4834-82ad-0e1fce9fa7df\") " pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-jm44f" Jun 03 21:24:07.168137 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:07.168056 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a9cda885-26fa-4834-82ad-0e1fce9fa7df-sys\") pod \"perf-node-gather-daemonset-jm44f\" (UID: \"a9cda885-26fa-4834-82ad-0e1fce9fa7df\") " pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-jm44f" Jun 03 21:24:07.269074 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:07.269032 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a9cda885-26fa-4834-82ad-0e1fce9fa7df-lib-modules\") pod \"perf-node-gather-daemonset-jm44f\" (UID: \"a9cda885-26fa-4834-82ad-0e1fce9fa7df\") " pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-jm44f" Jun 03 21:24:07.269528 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:07.269503 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a9cda885-26fa-4834-82ad-0e1fce9fa7df-sys\") pod \"perf-node-gather-daemonset-jm44f\" (UID: \"a9cda885-26fa-4834-82ad-0e1fce9fa7df\") " pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-jm44f" Jun 03 21:24:07.269818 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:07.269799 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbqgl\" (UniqueName: \"kubernetes.io/projected/a9cda885-26fa-4834-82ad-0e1fce9fa7df-kube-api-access-jbqgl\") pod \"perf-node-gather-daemonset-jm44f\" (UID: \"a9cda885-26fa-4834-82ad-0e1fce9fa7df\") " pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-jm44f" Jun 03 21:24:07.270306 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:07.270285 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a9cda885-26fa-4834-82ad-0e1fce9fa7df-podres\") pod \"perf-node-gather-daemonset-jm44f\" (UID: \"a9cda885-26fa-4834-82ad-0e1fce9fa7df\") " pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-jm44f" Jun 03 21:24:07.270594 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:07.270579 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a9cda885-26fa-4834-82ad-0e1fce9fa7df-proc\") pod \"perf-node-gather-daemonset-jm44f\" (UID: \"a9cda885-26fa-4834-82ad-0e1fce9fa7df\") " pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-jm44f" Jun 03 21:24:07.270800 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:07.269715 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a9cda885-26fa-4834-82ad-0e1fce9fa7df-sys\") pod \"perf-node-gather-daemonset-jm44f\" (UID: \"a9cda885-26fa-4834-82ad-0e1fce9fa7df\") " pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-jm44f" Jun 03 21:24:07.270914 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:07.270507 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a9cda885-26fa-4834-82ad-0e1fce9fa7df-podres\") pod \"perf-node-gather-daemonset-jm44f\" (UID: \"a9cda885-26fa-4834-82ad-0e1fce9fa7df\") " pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-jm44f" Jun 03 21:24:07.271003 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:07.269432 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a9cda885-26fa-4834-82ad-0e1fce9fa7df-lib-modules\") pod \"perf-node-gather-daemonset-jm44f\" (UID: \"a9cda885-26fa-4834-82ad-0e1fce9fa7df\") " pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-jm44f" Jun 03 21:24:07.271090 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:07.270738 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a9cda885-26fa-4834-82ad-0e1fce9fa7df-proc\") pod \"perf-node-gather-daemonset-jm44f\" (UID: \"a9cda885-26fa-4834-82ad-0e1fce9fa7df\") " pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-jm44f" Jun 03 21:24:07.279572 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:07.279533 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbqgl\" (UniqueName: \"kubernetes.io/projected/a9cda885-26fa-4834-82ad-0e1fce9fa7df-kube-api-access-jbqgl\") pod \"perf-node-gather-daemonset-jm44f\" (UID: \"a9cda885-26fa-4834-82ad-0e1fce9fa7df\") " pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-jm44f" Jun 03 21:24:07.394183 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:07.394094 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-jm44f" Jun 03 21:24:07.574647 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:07.574605 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9m28l/perf-node-gather-daemonset-jm44f"] Jun 03 21:24:07.577058 ip-10-0-141-159 kubenswrapper[2573]: W0603 21:24:07.577018 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda9cda885_26fa_4834_82ad_0e1fce9fa7df.slice/crio-6922a0f48d16b1ce6c722b9abd5a3fe19d29f1e9c1084980c3ce1fb172b1f248 WatchSource:0}: Error finding container 6922a0f48d16b1ce6c722b9abd5a3fe19d29f1e9c1084980c3ce1fb172b1f248: Status 404 returned error can't find the container with id 6922a0f48d16b1ce6c722b9abd5a3fe19d29f1e9c1084980c3ce1fb172b1f248 Jun 03 21:24:07.901140 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:07.901115 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xs8jn_a49042aa-131c-4704-b69e-b4ff4e0a1fd4/dns/0.log" Jun 03 21:24:07.924167 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:07.924101 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xs8jn_a49042aa-131c-4704-b69e-b4ff4e0a1fd4/kube-rbac-proxy/0.log" Jun 03 21:24:07.939844 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:07.939814 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-jm44f" event={"ID":"a9cda885-26fa-4834-82ad-0e1fce9fa7df","Type":"ContainerStarted","Data":"8967977bc7a53872bdb36e87f0d72f08c4fbdab9d1169fa10c4238a0a48000bb"} Jun 03 21:24:07.940025 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:07.939863 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-jm44f" event={"ID":"a9cda885-26fa-4834-82ad-0e1fce9fa7df","Type":"ContainerStarted","Data":"6922a0f48d16b1ce6c722b9abd5a3fe19d29f1e9c1084980c3ce1fb172b1f248"} Jun 03 21:24:07.940025 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:07.939936 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-jm44f" Jun 03 21:24:07.960637 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:07.960585 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-jm44f" podStartSLOduration=0.960565221 podStartE2EDuration="960.565221ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:24:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:24:07.958906152 +0000 UTC m=+2474.208316647" watchObservedRunningTime="2026-06-03 21:24:07.960565221 +0000 UTC m=+2474.209975692" Jun 03 21:24:08.010608 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:08.010580 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vf4jz_8999c8ff-31e0-4203-82b6-9969dd68a29e/dns-node-resolver/0.log" Jun 03 21:24:08.613699 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:08.613669 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4kgfh_3052984c-1fbe-473f-ac39-8c597c47c315/node-ca/0.log" Jun 03 21:24:09.754188 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:09.754151 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-cbms5_1e80f295-7279-48b5-85ff-319655acd05b/discovery/0.log" Jun 03 21:24:09.772839 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:09.772817 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79b6b976dd-2j6k2_bdf1f347-6cef-4716-8ffd-5bc818c3fbf7/kube-auth-proxy/0.log" Jun 03 21:24:10.742542 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:10.742514 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-znprx_c1ad9037-60f7-44e2-bcb8-3d9bc56ddc15/serve-healthcheck-canary/0.log" Jun 03 21:24:11.332972 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:11.332942 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k6ssk_dce4ed17-2435-4480-899b-271e12208236/kube-rbac-proxy/0.log" Jun 03 21:24:11.356519 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:11.356493 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k6ssk_dce4ed17-2435-4480-899b-271e12208236/exporter/0.log" Jun 03 21:24:11.381190 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:11.381153 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k6ssk_dce4ed17-2435-4480-899b-271e12208236/extractor/0.log" Jun 03 21:24:13.752424 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:13.752394 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-b685d69dc-2v74v_13571a47-6031-47ee-a67d-2e261f504d5f/nginx/0.log" Jun 03 21:24:13.799594 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:13.799567 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-qmxfs_6eeafdc3-2a7b-4451-bc02-8ffcaff6a2db/manager/0.log" Jun 03 21:24:13.902054 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:13.902019 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-kk4kl_9fe7509d-793f-4fea-8098-7ddfe212c1f2/manager/0.log" Jun 03 21:24:13.941670 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:13.941636 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-8965c4cfb-k7ghf_09ad1159-e366-450a-82e5-72c6a9b7894e/maas-api/0.log" Jun 03 21:24:13.956553 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:13.956527 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-jm44f" Jun 03 21:24:14.106505 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:14.106395 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-65794dbd75-q2ckj_1de089d5-5db8-46a7-9672-af72f4e56c02/manager/0.log" Jun 03 21:24:14.127297 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:14.127262 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-cvzlp_8b5bdcae-8bfe-4228-9a2b-13c944d71483/server/0.log" Jun 03 21:24:14.187758 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:14.187709 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-45mf7_ad210e1a-bd68-4eec-84b0-ff8ba1246fb4/manager/0.log" Jun 03 21:24:14.374462 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:14.374376 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fdd65c64b-w2cb4_aeba6bcf-a599-478e-afb3-2ac71f39a2c7/manager/0.log" Jun 03 21:24:14.398523 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:14.398500 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fdd65c64b-w2cb4_aeba6bcf-a599-478e-afb3-2ac71f39a2c7/copy-manifests/0.log" Jun 03 21:24:19.847699 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:19.847667 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-cbms5_1e80f295-7279-48b5-85ff-319655acd05b/discovery/0.log" Jun 03 21:24:19.861906 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:19.861881 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79b6b976dd-2j6k2_bdf1f347-6cef-4716-8ffd-5bc818c3fbf7/kube-auth-proxy/0.log" Jun 03 21:24:21.267285 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:21.267249 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-cbms5_1e80f295-7279-48b5-85ff-319655acd05b/discovery/0.log" Jun 03 21:24:21.280387 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:21.280357 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79b6b976dd-2j6k2_bdf1f347-6cef-4716-8ffd-5bc818c3fbf7/kube-auth-proxy/0.log" Jun 03 21:24:23.345043 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:23.345006 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-cbms5_1e80f295-7279-48b5-85ff-319655acd05b/discovery/0.log" Jun 03 21:24:23.359034 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:23.359007 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79b6b976dd-2j6k2_bdf1f347-6cef-4716-8ffd-5bc818c3fbf7/kube-auth-proxy/0.log" Jun 03 21:24:23.961150 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:23.961118 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hh664_c16d78e4-4fa7-4f14-9b41-3281ad9058d1/kube-multus-additional-cni-plugins/0.log" Jun 03 21:24:23.983733 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:23.983705 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hh664_c16d78e4-4fa7-4f14-9b41-3281ad9058d1/egress-router-binary-copy/0.log" Jun 03 21:24:24.002921 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:24.002898 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hh664_c16d78e4-4fa7-4f14-9b41-3281ad9058d1/cni-plugins/0.log" Jun 03 21:24:24.021793 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:24.021767 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hh664_c16d78e4-4fa7-4f14-9b41-3281ad9058d1/bond-cni-plugin/0.log" Jun 03 21:24:24.045443 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:24.045420 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hh664_c16d78e4-4fa7-4f14-9b41-3281ad9058d1/routeoverride-cni/0.log" Jun 03 21:24:24.068163 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:24.068138 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hh664_c16d78e4-4fa7-4f14-9b41-3281ad9058d1/whereabouts-cni-bincopy/0.log" Jun 03 21:24:24.088287 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:24.088258 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hh664_c16d78e4-4fa7-4f14-9b41-3281ad9058d1/whereabouts-cni/0.log" Jun 03 21:24:24.316985 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:24.316960 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qv9w9_ee74555b-6958-4016-aeaf-7ceec6fd794f/kube-multus/0.log" Jun 03 21:24:24.339658 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:24.339624 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5qxdz_a19725e1-b81e-4b3b-8cb9-173528f14f9d/network-metrics-daemon/0.log" Jun 03 21:24:24.359562 ip-10-0-141-159 kubenswrapper[2573]: I0603 21:24:24.359536 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5qxdz_a19725e1-b81e-4b3b-8cb9-173528f14f9d/kube-rbac-proxy/0.log"