Jul 20 16:27:43.315648 ip-10-0-130-209 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 20 16:27:43.315660 ip-10-0-130-209 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 20 16:27:43.315670 ip-10-0-130-209 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 20 16:27:43.316019 ip-10-0-130-209 systemd[1]: Failed to start Kubernetes Kubelet. Jul 20 16:27:53.446775 ip-10-0-130-209 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 20 16:27:53.446793 ip-10-0-130-209 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 5b6acadc092044e78dbf0a15d43e6cb7 -- Jul 20 16:29:40.398482 ip-10-0-130-209 systemd[1]: Starting Kubernetes Kubelet... Jul 20 16:29:40.788567 ip-10-0-130-209 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 16:29:40.788567 ip-10-0-130-209 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 20 16:29:40.788567 ip-10-0-130-209 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 16:29:40.788567 ip-10-0-130-209 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 20 16:29:40.788567 ip-10-0-130-209 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 16:29:40.788567 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.755038 2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 20 16:29:40.788567 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.759921 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 16:29:40.788567 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.759932 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 16:29:40.788567 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.759936 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 16:29:40.788567 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.759942 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 16:29:40.788567 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.759947 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 16:29:40.788567 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.759953 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 16:29:40.788567 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.759956 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 16:29:40.788567 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.759959 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 16:29:40.789492 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.759964 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 16:29:40.789492 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760000 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 16:29:40.789492 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760004 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 16:29:40.789492 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760007 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 16:29:40.789492 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760013 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 16:29:40.789492 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760015 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 16:29:40.789492 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760018 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 16:29:40.789492 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760022 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 16:29:40.789492 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760025 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 16:29:40.789492 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760028 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 16:29:40.789492 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760030 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 16:29:40.789492 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760035 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 16:29:40.789492 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760039 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 16:29:40.789492 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760042 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 16:29:40.789492 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760052 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 16:29:40.789492 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760055 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 16:29:40.789492 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760060 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 16:29:40.789492 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760063 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 16:29:40.789492 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760066 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 16:29:40.789492 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760071 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 16:29:40.790004 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760074 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 16:29:40.790004 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760077 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 16:29:40.790004 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760082 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 16:29:40.790004 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760085 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 16:29:40.790004 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760087 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 16:29:40.790004 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760090 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 16:29:40.790004 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760095 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 16:29:40.790004 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760098 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 16:29:40.790004 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760100 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 16:29:40.790004 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760103 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 16:29:40.790004 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760107 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 16:29:40.790004 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760110 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 16:29:40.790004 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760112 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 16:29:40.790004 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760115 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 16:29:40.790004 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760119 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 16:29:40.790004 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760122 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 16:29:40.790004 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760124 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 16:29:40.790004 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760129 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 16:29:40.790004 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760131 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 16:29:40.790004 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760134 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 16:29:40.790656 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760136 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 16:29:40.790656 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760139 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 16:29:40.790656 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760142 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 16:29:40.790656 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760145 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 16:29:40.790656 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760147 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 16:29:40.790656 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760151 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 16:29:40.790656 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760154 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 16:29:40.790656 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760156 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 16:29:40.790656 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760159 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 16:29:40.790656 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760164 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 16:29:40.790656 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760167 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 16:29:40.790656 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760174 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 16:29:40.790656 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760177 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 16:29:40.790656 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760180 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 16:29:40.790656 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760182 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 20 16:29:40.790656 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760187 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 16:29:40.790656 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760190 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 16:29:40.790656 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760193 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 16:29:40.790656 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760196 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 16:29:40.790656 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760212 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 16:29:40.791681 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760215 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 16:29:40.791681 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760218 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 16:29:40.791681 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760222 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 16:29:40.791681 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760225 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 16:29:40.791681 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760228 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 16:29:40.791681 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760231 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 16:29:40.791681 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760237 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 16:29:40.791681 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760241 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 16:29:40.791681 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760246 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 16:29:40.791681 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760249 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 16:29:40.791681 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760254 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 16:29:40.791681 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760259 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 16:29:40.791681 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760262 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 16:29:40.791681 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760265 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 16:29:40.791681 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760270 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 16:29:40.791681 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760273 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 16:29:40.791681 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760276 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 16:29:40.791681 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760278 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 16:29:40.791681 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760282 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 16:29:40.792311 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760285 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 16:29:40.792311 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760288 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 16:29:40.792311 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760291 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 16:29:40.792311 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760295 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 16:29:40.792311 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760298 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 16:29:40.792311 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760301 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 16:29:40.792311 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760305 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 16:29:40.792311 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760308 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 16:29:40.792311 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760311 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 16:29:40.792311 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760314 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 16:29:40.792311 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760318 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 16:29:40.792311 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.760321 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 16:29:40.792311 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761093 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 16:29:40.792311 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761102 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 16:29:40.792311 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761105 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 16:29:40.792311 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761107 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 16:29:40.792311 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761110 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 16:29:40.792311 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761116 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 16:29:40.792311 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761119 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 16:29:40.792311 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761122 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 16:29:40.792919 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761126 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 16:29:40.792919 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761129 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 16:29:40.792919 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761132 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 16:29:40.792919 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761134 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 16:29:40.792919 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761138 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 16:29:40.792919 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761141 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 16:29:40.792919 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761143 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 16:29:40.792919 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761146 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 16:29:40.792919 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761151 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 16:29:40.792919 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761154 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 16:29:40.792919 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761157 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 16:29:40.792919 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761159 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 16:29:40.792919 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761164 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 16:29:40.792919 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761166 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 16:29:40.792919 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761169 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 16:29:40.792919 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761171 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 16:29:40.792919 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761176 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 16:29:40.792919 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761179 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 16:29:40.792919 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761181 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 16:29:40.792919 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761186 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 20 16:29:40.793673 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761189 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 16:29:40.793673 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761195 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 16:29:40.793673 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761199 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 16:29:40.793673 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761215 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 16:29:40.793673 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761219 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 16:29:40.793673 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761222 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 16:29:40.793673 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761225 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 16:29:40.793673 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761228 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 16:29:40.793673 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761233 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 16:29:40.793673 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761236 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 16:29:40.793673 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761239 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 16:29:40.793673 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761241 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 16:29:40.793673 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761246 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 16:29:40.793673 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761248 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 16:29:40.793673 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761251 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 16:29:40.793673 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761254 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 16:29:40.793673 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761259 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 16:29:40.793673 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761261 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 16:29:40.793673 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761264 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 16:29:40.793673 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761268 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 16:29:40.794286 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761271 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 16:29:40.794286 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761274 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 16:29:40.794286 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761276 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 16:29:40.794286 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761281 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 16:29:40.794286 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761284 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 16:29:40.794286 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761287 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 16:29:40.794286 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761292 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 16:29:40.794286 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761294 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 16:29:40.794286 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761297 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 16:29:40.794286 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761299 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 16:29:40.794286 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761304 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 16:29:40.794286 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761306 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 16:29:40.794286 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761309 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 16:29:40.794286 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761312 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 16:29:40.794286 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761318 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 16:29:40.794286 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761322 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 16:29:40.794286 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761327 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 16:29:40.794286 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761330 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 16:29:40.794286 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761334 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 16:29:40.794834 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761339 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 16:29:40.794834 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761341 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 16:29:40.794834 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761344 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 16:29:40.794834 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761346 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 16:29:40.794834 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761351 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 16:29:40.794834 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761355 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 16:29:40.794834 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761359 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 16:29:40.794834 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761365 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 16:29:40.794834 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761368 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 16:29:40.794834 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761371 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 16:29:40.794834 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761376 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 16:29:40.794834 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761378 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 16:29:40.794834 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761381 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 16:29:40.794834 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761385 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 16:29:40.794834 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761388 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 16:29:40.794834 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761391 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 16:29:40.794834 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761393 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 16:29:40.794834 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761398 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 16:29:40.794834 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761401 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 16:29:40.883602 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761404 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 16:29:40.883602 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761408 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 16:29:40.883602 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761410 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 16:29:40.883602 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761413 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 16:29:40.883602 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761415 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 16:29:40.883602 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761418 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 16:29:40.883602 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761420 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 16:29:40.883602 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761423 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 16:29:40.883602 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761426 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 16:29:40.883602 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761430 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 16:29:40.883602 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761432 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 16:29:40.883602 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761435 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 16:29:40.883602 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761437 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 16:29:40.883602 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761848 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 16:29:40.883602 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761853 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 16:29:40.883602 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761858 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 16:29:40.883602 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761861 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 16:29:40.883602 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761864 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 16:29:40.883602 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761869 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 16:29:40.883602 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761872 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 16:29:40.834614 ip-10-0-130-209 systemd[1]: Started Kubernetes Kubelet. Jul 20 16:29:40.884912 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761875 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 16:29:40.884912 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761878 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 16:29:40.884912 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761882 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 16:29:40.884912 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761884 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 16:29:40.884912 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761887 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 16:29:40.884912 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761889 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 16:29:40.884912 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761894 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 16:29:40.884912 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761896 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 16:29:40.884912 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761899 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 16:29:40.884912 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761902 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 16:29:40.884912 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761906 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 16:29:40.884912 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761909 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 16:29:40.884912 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761912 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 16:29:40.884912 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761916 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 16:29:40.884912 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761920 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 16:29:40.884912 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761922 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 16:29:40.884912 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761925 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 16:29:40.884912 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761930 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 16:29:40.884912 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761932 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 16:29:40.886733 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761935 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 16:29:40.886733 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761937 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 16:29:40.886733 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761942 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 16:29:40.886733 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761945 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 16:29:40.886733 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761948 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 16:29:40.886733 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761950 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 16:29:40.886733 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761954 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 16:29:40.886733 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761957 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 16:29:40.886733 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761959 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 16:29:40.886733 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761967 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 16:29:40.886733 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761970 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 16:29:40.886733 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761973 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 16:29:40.886733 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761977 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 16:29:40.886733 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761979 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 16:29:40.886733 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761982 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 16:29:40.886733 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761984 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 16:29:40.886733 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761987 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 16:29:40.886733 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761992 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 16:29:40.886733 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761994 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 16:29:40.886733 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.761997 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 16:29:40.887531 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762003 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 16:29:40.887531 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762007 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 16:29:40.887531 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762010 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 16:29:40.887531 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762015 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 16:29:40.887531 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762018 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 16:29:40.887531 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762021 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 16:29:40.887531 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762024 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 16:29:40.887531 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762029 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 16:29:40.887531 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762032 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 16:29:40.887531 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762034 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 16:29:40.887531 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762038 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 16:29:40.887531 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762041 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 16:29:40.887531 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762052 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 16:29:40.887531 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762054 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 16:29:40.887531 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762057 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 16:29:40.887531 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762059 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 16:29:40.887531 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762064 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 16:29:40.887531 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762066 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 16:29:40.887531 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762069 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 16:29:40.888280 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762071 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 16:29:40.888280 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762076 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 16:29:40.888280 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762081 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 16:29:40.888280 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762083 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 16:29:40.888280 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762089 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 16:29:40.888280 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762093 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 16:29:40.888280 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762095 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 16:29:40.888280 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762101 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 16:29:40.888280 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762104 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 16:29:40.888280 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762106 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 16:29:40.888280 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762109 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 16:29:40.888280 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762113 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 16:29:40.888280 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762116 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 16:29:40.888280 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762118 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 16:29:40.888280 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762121 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 16:29:40.888280 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762127 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 16:29:40.888280 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762130 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 20 16:29:40.888280 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762133 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 16:29:40.888280 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762136 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 16:29:40.888280 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762141 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 16:29:40.888887 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762144 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 16:29:40.888887 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762147 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 16:29:40.888887 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762152 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 16:29:40.888887 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762155 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 16:29:40.888887 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762158 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 16:29:40.888887 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762161 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 16:29:40.888887 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762166 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 16:29:40.888887 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762169 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 16:29:40.888887 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762171 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 16:29:40.888887 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762176 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 16:29:40.888887 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762178 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 16:29:40.888887 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762181 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 16:29:40.888887 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762184 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 16:29:40.888887 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.762189 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 16:29:40.888887 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762284 2583 flags.go:64] FLAG: --address="0.0.0.0" Jul 20 16:29:40.888887 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762293 2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 20 16:29:40.888887 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762301 2583 flags.go:64] FLAG: --anonymous-auth="true" Jul 20 16:29:40.888887 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762308 2583 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 20 16:29:40.888887 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762313 2583 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 20 16:29:40.888887 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762318 2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 20 16:29:40.888887 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762323 2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 20 16:29:40.889544 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762326 2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 20 16:29:40.889544 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762332 2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 20 16:29:40.889544 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762335 2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 20 16:29:40.889544 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762338 2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 20 16:29:40.889544 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762343 2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 20 16:29:40.889544 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762346 2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 20 16:29:40.889544 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762349 2583 flags.go:64] FLAG: --cgroup-root="" Jul 20 16:29:40.889544 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762354 2583 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 20 16:29:40.889544 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762358 2583 flags.go:64] FLAG: --client-ca-file="" Jul 20 16:29:40.889544 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762361 2583 flags.go:64] FLAG: --cloud-provider="external" Jul 20 16:29:40.889544 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762364 2583 flags.go:64] FLAG: --cluster-dns="[]" Jul 20 16:29:40.889544 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762370 2583 flags.go:64] FLAG: --cluster-domain="" Jul 20 16:29:40.889544 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762373 2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 20 16:29:40.889544 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762379 2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 20 16:29:40.889544 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762382 2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 20 16:29:40.889544 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762385 2583 flags.go:64] FLAG: --container-log-max-files="5" Jul 20 16:29:40.889544 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762389 2583 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 20 16:29:40.889544 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762394 2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 20 16:29:40.889544 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762397 2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 20 16:29:40.889544 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762401 2583 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 20 16:29:40.889544 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762406 2583 flags.go:64] FLAG: --contention-profiling="false" Jul 20 16:29:40.889544 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762409 2583 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 20 16:29:40.889544 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762411 2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 20 16:29:40.889544 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762417 2583 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 20 16:29:40.890364 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762420 2583 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 20 16:29:40.890364 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762427 2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 20 16:29:40.890364 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762431 2583 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 20 16:29:40.890364 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762434 2583 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 20 16:29:40.890364 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762437 2583 flags.go:64] FLAG: --enable-load-reader="false" Jul 20 16:29:40.890364 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762441 2583 flags.go:64] FLAG: --enable-server="true" Jul 20 16:29:40.890364 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762446 2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 20 16:29:40.890364 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762450 2583 flags.go:64] FLAG: --event-burst="100" Jul 20 16:29:40.890364 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762455 2583 flags.go:64] FLAG: --event-qps="50" Jul 20 16:29:40.890364 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762458 2583 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 20 16:29:40.890364 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762461 2583 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 20 16:29:40.890364 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762466 2583 flags.go:64] FLAG: --eviction-hard="" Jul 20 16:29:40.890364 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762470 2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 20 16:29:40.890364 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762474 2583 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 20 16:29:40.890364 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762477 2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 20 16:29:40.890364 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762493 2583 flags.go:64] FLAG: --eviction-soft="" Jul 20 16:29:40.890364 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762499 2583 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 20 16:29:40.890364 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762502 2583 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 20 16:29:40.890364 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762505 2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 20 16:29:40.890364 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762510 2583 flags.go:64] FLAG: --experimental-mounter-path="" Jul 20 16:29:40.890364 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762513 2583 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 20 16:29:40.890364 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762516 2583 flags.go:64] FLAG: --fail-swap-on="true" Jul 20 16:29:40.890364 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762521 2583 flags.go:64] FLAG: --feature-gates="" Jul 20 16:29:40.890364 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762525 2583 flags.go:64] FLAG: --file-check-frequency="20s" Jul 20 16:29:40.890364 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762528 2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 20 16:29:40.891303 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762533 2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 20 16:29:40.891303 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762536 2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 20 16:29:40.891303 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762539 2583 flags.go:64] FLAG: --healthz-port="10248" Jul 20 16:29:40.891303 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762542 2583 flags.go:64] FLAG: --help="false" Jul 20 16:29:40.891303 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762549 2583 flags.go:64] FLAG: --hostname-override="ip-10-0-130-209.ec2.internal" Jul 20 16:29:40.891303 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762552 2583 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 20 16:29:40.891303 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762557 2583 flags.go:64] FLAG: --http-check-frequency="20s" Jul 20 16:29:40.891303 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762560 2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 20 16:29:40.891303 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762565 2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 20 16:29:40.891303 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762571 2583 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 20 16:29:40.891303 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762574 2583 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 20 16:29:40.891303 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762576 2583 flags.go:64] FLAG: --image-service-endpoint="" Jul 20 16:29:40.891303 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762581 2583 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 20 16:29:40.891303 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762584 2583 flags.go:64] FLAG: --kube-api-burst="100" Jul 20 16:29:40.891303 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762588 2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 20 16:29:40.891303 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762591 2583 flags.go:64] FLAG: --kube-api-qps="50" Jul 20 16:29:40.891303 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762596 2583 flags.go:64] FLAG: --kube-reserved="" Jul 20 16:29:40.891303 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762599 2583 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 20 16:29:40.891303 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762601 2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 20 16:29:40.891303 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762606 2583 flags.go:64] FLAG: --kubelet-cgroups="" Jul 20 16:29:40.891303 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762609 2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 20 16:29:40.891303 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762612 2583 flags.go:64] FLAG: --lock-file="" Jul 20 16:29:40.891303 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762614 2583 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 20 16:29:40.891303 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762620 2583 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 20 16:29:40.892044 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762623 2583 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 20 16:29:40.892044 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762629 2583 flags.go:64] FLAG: --log-json-split-stream="false" Jul 20 16:29:40.892044 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762632 2583 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 20 16:29:40.892044 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762635 2583 flags.go:64] FLAG: --log-text-split-stream="false" Jul 20 16:29:40.892044 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762638 2583 flags.go:64] FLAG: --logging-format="text" Jul 20 16:29:40.892044 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762643 2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 20 16:29:40.892044 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762646 2583 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 20 16:29:40.892044 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762649 2583 flags.go:64] FLAG: --manifest-url="" Jul 20 16:29:40.892044 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762653 2583 flags.go:64] FLAG: --manifest-url-header="" Jul 20 16:29:40.892044 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762658 2583 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 20 16:29:40.892044 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762661 2583 flags.go:64] FLAG: --max-open-files="1000000" Jul 20 16:29:40.892044 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762667 2583 flags.go:64] FLAG: --max-pods="110" Jul 20 16:29:40.892044 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762671 2583 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 20 16:29:40.892044 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762674 2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 20 16:29:40.892044 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762679 2583 flags.go:64] FLAG: --memory-manager-policy="None" Jul 20 16:29:40.892044 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762682 2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 20 16:29:40.892044 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762687 2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 20 16:29:40.892044 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762691 2583 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 20 16:29:40.892044 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762693 2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 20 16:29:40.892044 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762700 2583 flags.go:64] FLAG: --node-status-max-images="50" Jul 20 16:29:40.892044 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762703 2583 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 20 16:29:40.892044 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762706 2583 flags.go:64] FLAG: --oom-score-adj="-999" Jul 20 16:29:40.892044 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762711 2583 flags.go:64] FLAG: --pod-cidr="" Jul 20 16:29:40.892773 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762714 2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 20 16:29:40.892773 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762722 2583 flags.go:64] FLAG: --pod-manifest-path="" Jul 20 16:29:40.892773 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762725 2583 flags.go:64] FLAG: --pod-max-pids="-1" Jul 20 16:29:40.892773 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762728 2583 flags.go:64] FLAG: --pods-per-core="0" Jul 20 16:29:40.892773 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762733 2583 flags.go:64] FLAG: --port="10250" Jul 20 16:29:40.892773 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762736 2583 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 20 16:29:40.892773 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762739 2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-011b86a817c5c0b02" Jul 20 16:29:40.892773 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762742 2583 flags.go:64] FLAG: --qos-reserved="" Jul 20 16:29:40.892773 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762747 2583 flags.go:64] FLAG: --read-only-port="10255" Jul 20 16:29:40.892773 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762750 2583 flags.go:64] FLAG: --register-node="true" Jul 20 16:29:40.892773 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762753 2583 flags.go:64] FLAG: --register-with-taints="" Jul 20 16:29:40.892773 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762763 2583 flags.go:64] FLAG: --registry-burst="10" Jul 20 16:29:40.892773 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762766 2583 flags.go:64] FLAG: --registry-qps="5" Jul 20 16:29:40.892773 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762770 2583 flags.go:64] FLAG: --reserved-cpus="" Jul 20 16:29:40.892773 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762773 2583 flags.go:64] FLAG: --reserved-memory="" Jul 20 16:29:40.892773 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762777 2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 20 16:29:40.892773 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762782 2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 20 16:29:40.892773 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762785 2583 flags.go:64] FLAG: --rotate-certificates="false" Jul 20 16:29:40.892773 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762788 2583 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 20 16:29:40.892773 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762791 2583 flags.go:64] FLAG: --runonce="false" Jul 20 16:29:40.892773 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762795 2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 20 16:29:40.892773 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762799 2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 20 16:29:40.892773 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762802 2583 flags.go:64] FLAG: --seccomp-default="false" Jul 20 16:29:40.892773 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762807 2583 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 20 16:29:40.892773 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762809 2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 20 16:29:40.893537 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762812 2583 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 20 16:29:40.893537 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762819 2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 20 16:29:40.893537 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762822 2583 flags.go:64] FLAG: --storage-driver-password="root" Jul 20 16:29:40.893537 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762825 2583 flags.go:64] FLAG: --storage-driver-secure="false" Jul 20 16:29:40.893537 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762828 2583 flags.go:64] FLAG: --storage-driver-table="stats" Jul 20 16:29:40.893537 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762833 2583 flags.go:64] FLAG: --storage-driver-user="root" Jul 20 16:29:40.893537 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762836 2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 20 16:29:40.893537 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762839 2583 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 20 16:29:40.893537 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762844 2583 flags.go:64] FLAG: --system-cgroups="" Jul 20 16:29:40.893537 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762847 2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 20 16:29:40.893537 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762852 2583 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 20 16:29:40.893537 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762857 2583 flags.go:64] FLAG: --tls-cert-file="" Jul 20 16:29:40.893537 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762860 2583 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 20 16:29:40.893537 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762863 2583 flags.go:64] FLAG: --tls-min-version="" Jul 20 16:29:40.893537 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762866 2583 flags.go:64] FLAG: --tls-private-key-file="" Jul 20 16:29:40.893537 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762871 2583 flags.go:64] FLAG: --topology-manager-policy="none" Jul 20 16:29:40.893537 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762874 2583 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 20 16:29:40.893537 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762877 2583 flags.go:64] FLAG: --topology-manager-scope="container" Jul 20 16:29:40.893537 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762882 2583 flags.go:64] FLAG: --v="2" Jul 20 16:29:40.893537 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762886 2583 flags.go:64] FLAG: --version="false" Jul 20 16:29:40.893537 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762890 2583 flags.go:64] FLAG: --vmodule="" Jul 20 16:29:40.893537 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762895 2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 20 16:29:40.893537 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.762898 2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 20 16:29:40.893537 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763035 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 16:29:40.893537 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763040 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 16:29:40.896454 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763045 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 16:29:40.896454 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763048 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 16:29:40.896454 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763052 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 16:29:40.896454 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763058 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 20 16:29:40.896454 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763061 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 16:29:40.896454 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763064 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 16:29:40.896454 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763068 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 16:29:40.896454 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763071 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 16:29:40.896454 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763075 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 16:29:40.896454 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763081 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 16:29:40.896454 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763084 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 16:29:40.896454 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763086 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 16:29:40.896454 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763089 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 16:29:40.896454 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763094 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 16:29:40.896454 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763097 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 16:29:40.896454 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763100 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 16:29:40.896454 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763105 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 16:29:40.896454 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763107 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 16:29:40.896454 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763112 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 16:29:40.897491 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763114 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 16:29:40.897491 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763117 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 16:29:40.897491 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763119 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 16:29:40.897491 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763122 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 16:29:40.897491 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763125 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 16:29:40.897491 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763127 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 16:29:40.897491 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763130 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 16:29:40.897491 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763132 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 16:29:40.897491 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763136 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 16:29:40.897491 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763139 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 16:29:40.897491 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763141 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 16:29:40.897491 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763146 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 16:29:40.897491 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763149 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 16:29:40.897491 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763151 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 16:29:40.897491 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763154 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 16:29:40.897491 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763158 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 16:29:40.897491 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763163 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 16:29:40.897491 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763169 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 16:29:40.897491 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763173 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 16:29:40.898348 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763176 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 16:29:40.898348 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763182 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 16:29:40.898348 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763186 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 16:29:40.898348 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763189 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 16:29:40.898348 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763194 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 16:29:40.898348 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763197 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 16:29:40.898348 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763200 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 16:29:40.898348 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763218 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 16:29:40.898348 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763221 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 16:29:40.898348 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763226 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 16:29:40.898348 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763229 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 16:29:40.898348 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763232 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 16:29:40.898348 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763237 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 16:29:40.898348 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763240 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 16:29:40.898348 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763243 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 16:29:40.898348 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763245 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 16:29:40.898348 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763250 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 16:29:40.898348 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763253 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 16:29:40.898348 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763256 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 16:29:40.898348 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763260 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 16:29:40.899170 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763263 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 16:29:40.899170 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763265 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 16:29:40.899170 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763268 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 16:29:40.899170 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763272 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 16:29:40.899170 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763275 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 16:29:40.899170 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763277 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 16:29:40.899170 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763280 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 16:29:40.899170 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763285 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 16:29:40.899170 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763287 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 16:29:40.899170 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763291 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 16:29:40.899170 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763296 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 16:29:40.899170 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763299 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 16:29:40.899170 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763301 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 16:29:40.899170 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763306 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 16:29:40.899170 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763310 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 16:29:40.899170 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763312 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 16:29:40.899170 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763316 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 16:29:40.899170 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763319 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 16:29:40.899170 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763322 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 16:29:40.899170 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763325 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 16:29:40.900648 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763327 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 16:29:40.900648 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763330 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 16:29:40.900648 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763332 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 16:29:40.900648 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763335 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 16:29:40.900648 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763340 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 16:29:40.900648 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763342 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 16:29:40.900648 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763345 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 16:29:40.900648 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763349 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 16:29:40.900648 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763353 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 16:29:40.900648 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763355 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 16:29:40.900648 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763358 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 16:29:40.900648 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763362 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 16:29:40.900648 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763365 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 16:29:40.900648 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763368 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 16:29:40.900648 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763370 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 16:29:40.900648 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763375 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 16:29:40.900648 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763379 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 16:29:40.900648 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763382 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 16:29:40.900648 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.763387 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 16:29:40.901538 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.764192 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 16:29:40.901538 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.771091 2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 20 16:29:40.901538 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.771105 2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 20 16:29:40.901538 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.771124 2583 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 20 16:29:40.901538 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.771129 2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 20 16:29:40.901538 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771193 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 16:29:40.901538 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771198 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 16:29:40.901538 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771216 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 16:29:40.901538 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771222 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 16:29:40.901538 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771229 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 16:29:40.901538 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771233 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 16:29:40.901538 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771237 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 16:29:40.901538 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771240 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 16:29:40.901538 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771243 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 16:29:40.903124 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771246 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 16:29:40.903124 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771249 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 16:29:40.903124 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771252 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 16:29:40.903124 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771262 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 16:29:40.903124 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771265 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 16:29:40.903124 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771268 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 16:29:40.903124 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771271 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 16:29:40.903124 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771273 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 16:29:40.903124 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771276 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 16:29:40.903124 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771278 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 16:29:40.903124 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771281 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 16:29:40.903124 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771287 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 16:29:40.903124 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771290 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 16:29:40.903124 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771293 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 16:29:40.903124 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771296 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 16:29:40.903124 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771299 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 16:29:40.903124 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771302 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 16:29:40.903124 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771305 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 16:29:40.903124 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771308 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 16:29:40.903124 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771310 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 16:29:40.903785 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771313 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 16:29:40.903785 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771319 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 16:29:40.903785 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771321 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 16:29:40.903785 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771324 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 16:29:40.903785 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771326 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 16:29:40.903785 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771329 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 16:29:40.903785 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771332 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 16:29:40.903785 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771335 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 16:29:40.903785 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771337 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 16:29:40.903785 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771340 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 16:29:40.903785 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771343 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 16:29:40.903785 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771345 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 16:29:40.903785 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771348 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 16:29:40.903785 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771350 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 16:29:40.903785 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771353 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 16:29:40.903785 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771355 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 16:29:40.903785 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771364 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 16:29:40.903785 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771366 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 16:29:40.903785 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771369 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 16:29:40.903785 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771375 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 16:29:40.904444 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771378 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 16:29:40.904444 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771382 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 16:29:40.904444 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771385 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 16:29:40.904444 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771388 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 16:29:40.904444 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771391 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 16:29:40.904444 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771394 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 16:29:40.904444 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771397 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 16:29:40.904444 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771399 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 16:29:40.904444 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771402 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 16:29:40.904444 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771406 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 16:29:40.904444 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771409 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 16:29:40.904444 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771412 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 16:29:40.904444 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771415 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 16:29:40.904444 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771419 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 16:29:40.904444 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771421 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 16:29:40.904444 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771424 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 16:29:40.904444 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771426 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 16:29:40.904444 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771429 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 16:29:40.904444 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771432 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 16:29:40.904975 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771440 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 16:29:40.904975 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771443 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 16:29:40.904975 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771445 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 16:29:40.904975 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771448 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 16:29:40.904975 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771450 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 16:29:40.904975 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771452 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 16:29:40.904975 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771455 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 16:29:40.904975 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771457 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 16:29:40.904975 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771460 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 16:29:40.904975 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771462 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 20 16:29:40.904975 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771471 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 16:29:40.904975 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771473 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 16:29:40.904975 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771477 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 16:29:40.904975 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771480 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 16:29:40.904975 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771482 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 16:29:40.904975 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771485 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 16:29:40.904975 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771488 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 16:29:40.904975 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771490 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 16:29:40.904975 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771493 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 16:29:40.904975 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771495 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 16:29:40.905687 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771498 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 16:29:40.905687 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771500 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 16:29:40.905687 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771503 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 16:29:40.905687 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771506 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 16:29:40.905687 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771508 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 16:29:40.905687 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771511 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 16:29:40.905687 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771514 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 16:29:40.905687 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771517 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 16:29:40.905687 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771519 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 16:29:40.905687 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771522 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 16:29:40.905687 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771524 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 16:29:40.905687 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.771529 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 16:29:40.905687 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771709 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 16:29:40.905687 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771714 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 16:29:41.015319 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771717 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 16:29:41.015319 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771719 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 16:29:41.015319 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771722 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 16:29:41.015319 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771725 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 16:29:41.015319 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771727 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 16:29:41.015319 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771730 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 16:29:41.015319 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771732 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 16:29:41.015319 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771735 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 16:29:41.015319 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771737 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 16:29:41.015319 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771746 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 16:29:41.015319 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771748 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 16:29:41.015319 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771753 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 16:29:41.015319 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771755 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 20 16:29:41.015319 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771758 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 16:29:41.015319 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771760 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 16:29:41.015319 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771763 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 16:29:41.015319 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771766 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 16:29:41.015319 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771768 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 16:29:41.015319 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771771 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 16:29:41.015319 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771773 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 16:29:41.037233 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771776 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 16:29:41.037233 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771779 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 16:29:41.037233 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771781 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 16:29:41.037233 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771784 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 16:29:41.037233 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771788 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 16:29:41.037233 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771790 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 16:29:41.037233 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771793 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 16:29:41.037233 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771796 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 16:29:41.037233 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771798 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 16:29:41.037233 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771801 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 16:29:41.037233 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771803 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 16:29:41.037233 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771806 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 16:29:41.037233 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771809 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 16:29:41.037233 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771811 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 16:29:41.037233 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771814 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 16:29:41.037233 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771816 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 16:29:41.037233 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771819 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 16:29:41.037233 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771821 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 16:29:41.037233 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771824 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 16:29:41.037233 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771826 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 16:29:41.039217 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771829 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 16:29:41.039217 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771831 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 16:29:41.039217 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771839 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 16:29:41.039217 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771844 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 16:29:41.039217 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771846 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 16:29:41.039217 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771849 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 16:29:41.039217 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771853 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 16:29:41.039217 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771856 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 16:29:41.039217 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771859 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 16:29:41.039217 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771862 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 16:29:41.039217 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771865 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 16:29:41.039217 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771868 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 16:29:41.039217 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771870 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 16:29:41.039217 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771873 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 16:29:41.039217 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771877 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 16:29:41.039217 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771880 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 16:29:41.039217 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771885 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 16:29:41.039217 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771888 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 16:29:41.039217 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771891 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 16:29:41.040022 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771894 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 16:29:41.040022 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771897 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 16:29:41.040022 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771900 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 16:29:41.040022 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771902 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 16:29:41.040022 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771905 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 16:29:41.040022 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771907 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 16:29:41.040022 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771911 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 16:29:41.040022 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771914 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 16:29:41.040022 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771917 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 16:29:41.040022 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771920 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 16:29:41.040022 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771922 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 16:29:41.040022 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771925 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 16:29:41.040022 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771927 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 16:29:41.040022 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771930 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 16:29:41.040022 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771933 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 16:29:41.040022 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771935 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 16:29:41.040022 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771944 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 16:29:41.040022 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771947 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 16:29:41.040022 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771950 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 16:29:41.040022 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771952 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 16:29:41.040851 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771955 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 16:29:41.040851 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771957 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 16:29:41.040851 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771960 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 16:29:41.040851 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771962 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 16:29:41.040851 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771965 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 16:29:41.040851 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771967 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 16:29:41.040851 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771970 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 16:29:41.040851 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771973 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 16:29:41.040851 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771975 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 16:29:41.040851 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771979 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 16:29:41.040851 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771982 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 16:29:41.040851 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771984 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 16:29:41.040851 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771987 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 16:29:41.040851 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771989 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 16:29:41.040851 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771992 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 16:29:41.040851 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771994 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 16:29:41.040851 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.771997 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 16:29:41.040851 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:40.772000 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 16:29:41.041678 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.772004 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 16:29:41.041678 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.772102 2583 server.go:962] "Client rotation is on, will bootstrap in background" Jul 20 16:29:41.041678 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.774862 2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 20 16:29:41.041678 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.776017 2583 server.go:1019] "Starting client certificate rotation" Jul 20 16:29:41.041678 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.776112 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 20 16:29:41.041678 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.776145 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 20 16:29:41.041678 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.778266 2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 20 16:29:41.041678 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.780172 2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 20 16:29:41.041678 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.796609 2583 log.go:25] "Validated CRI v1 runtime API" Jul 20 16:29:41.041678 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.804930 2583 log.go:25] "Validated CRI v1 image API" Jul 20 16:29:41.041678 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.805798 2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 20 16:29:41.041678 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.809257 2583 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 cd23355e-5b86-4e74-bb50-9313e1fd3de9:/dev/nvme0n1p3 edd16ee2-cbcd-4108-a3ce-d2a6731783e8:/dev/nvme0n1p4] Jul 20 16:29:41.042719 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.809280 2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 20 16:29:41.042719 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.810589 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 20 16:29:41.043751 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.815238 2583 manager.go:216] Machine: {Timestamp:2026-07-20 16:29:40.813809532 +0000 UTC m=+0.310512553 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100901 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22c6b2d290ca0418f73f0ce5c973d0 SystemUUID:ec22c6b2-d290-ca04-18f7-3f0ce5c973d0 BootID:5b6acadc-0920-44e7-8dbf-0a15d43e6cb7 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2a:2b:9f:8d:25 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2a:2b:9f:8d:25 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a2:e8:d3:c5:48:92 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 20 16:29:41.043751 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.815396 2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 20 16:29:41.043751 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.815546 2583 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 20 16:29:41.043751 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.818056 2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 20 16:29:41.043751 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.818086 2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-209.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 20 16:29:41.043751 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.819226 2583 topology_manager.go:138] "Creating topology manager with none policy" Jul 20 16:29:41.043751 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.819239 2583 container_manager_linux.go:309] "Creating device plugin manager" Jul 20 16:29:41.043751 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.819246 2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 20 16:29:41.043751 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.819837 2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 20 16:29:41.043751 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.821082 2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 20 16:29:41.043751 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.825222 2583 state_mem.go:36] "Initialized new in-memory state store" Jul 20 16:29:41.043751 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.825325 2583 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 20 16:29:41.043751 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.825350 2583 kubelet.go:486] "Attempting to sync node with API server" Jul 20 16:29:41.043751 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.825360 2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 20 16:29:41.043751 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.825373 2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 20 16:29:41.043751 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.825382 2583 kubelet.go:398] "Adding apiserver pod source" Jul 20 16:29:41.043751 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.825391 2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 20 16:29:41.043751 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.825713 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 20 16:29:41.044594 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.825733 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 20 16:29:41.044594 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.827500 2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 20 16:29:41.044594 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.829249 2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 20 16:29:41.044594 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.829289 2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 20 16:29:41.044594 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.830432 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 20 16:29:41.044594 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.830448 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 20 16:29:41.044594 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.830457 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 20 16:29:41.044594 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.830465 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 20 16:29:41.044594 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.830477 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 20 16:29:41.044594 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.830485 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 20 16:29:41.044594 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.830496 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 20 16:29:41.044594 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.830503 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 20 16:29:41.044594 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.830512 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 20 16:29:41.044594 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.830521 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 20 16:29:41.044594 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.830538 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 20 16:29:41.044594 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.830547 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 20 16:29:41.044594 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.830571 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 20 16:29:41.044594 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.830579 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 20 16:29:41.044594 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.832673 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5l8fb" Jul 20 16:29:41.044594 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.833913 2583 server.go:1268] "Started kubelet" Jul 20 16:29:41.044594 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.834299 2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 20 16:29:41.044594 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.838614 2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 20 16:29:41.044594 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.839393 2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-209.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 20 16:29:41.044594 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:40.839845 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 20 16:29:41.044594 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:40.840018 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-209.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 20 16:29:41.044594 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.840078 2583 server.go:310] "Adding debug handlers to kubelet server" Jul 20 16:29:41.044594 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.840285 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5l8fb" Jul 20 16:29:41.044594 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.840347 2583 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 20 16:29:41.044594 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.842056 2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 20 16:29:41.044594 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:40.844932 2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 20 16:29:41.044594 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:40.845919 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-209.ec2.internal.18c40c652134bc89 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-209.ec2.internal,UID:ip-10-0-130-209.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-209.ec2.internal,},FirstTimestamp:2026-07-20 16:29:40.833893513 +0000 UTC m=+0.330596581,LastTimestamp:2026-07-20 16:29:40.833893513 +0000 UTC m=+0.330596581,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-209.ec2.internal,}" Jul 20 16:29:41.044594 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.850942 2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 20 16:29:41.044594 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.851015 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 20 16:29:41.044594 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:40.851055 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-209.ec2.internal\" not found" Jul 20 16:29:41.044594 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.851503 2583 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 20 16:29:41.044594 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.851518 2583 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 20 16:29:41.044594 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.851599 2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 20 16:29:41.044594 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.851652 2583 reconstruct.go:97] "Volume reconstruction finished" Jul 20 16:29:41.044594 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.851659 2583 reconciler.go:29] "Reconciler: start to sync state" Jul 20 16:29:41.044594 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.851992 2583 factory.go:153] Registering CRI-O factory Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.852005 2583 factory.go:223] Registration of the crio container factory successfully Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.852044 2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.852054 2583 factory.go:55] Registering systemd factory Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.852060 2583 factory.go:223] Registration of the systemd container factory successfully Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.852075 2583 factory.go:103] Registering Raw factory Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.852087 2583 manager.go:1196] Started watching for new ooms in manager Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.852397 2583 manager.go:349] Starting recovery of all containers Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.861794 2583 manager.go:354] Recovery completed Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.862583 2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:40.866393 2583 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-130-209.ec2.internal\" not found" node="ip-10-0-130-209.ec2.internal" Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.867216 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.868918 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-209.ec2.internal" event="NodeHasSufficientMemory" Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.868937 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-209.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.868949 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-209.ec2.internal" event="NodeHasSufficientPID" Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.869434 2583 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.869441 2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.869454 2583 state_mem.go:36] "Initialized new in-memory state store" Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.869869 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.870594 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-209.ec2.internal" event="NodeHasSufficientMemory" Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.870630 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-209.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.870640 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-209.ec2.internal" event="NodeHasSufficientPID" Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.871577 2583 policy_none.go:49] "None policy: Start" Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.871590 2583 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.871600 2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.873633 2583 policy_none.go:47] "Start" Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.917894 2583 manager.go:337] "Starting Device Plugin manager" Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:40.918028 2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.918041 2583 server.go:87] "Starting device plugin registration server" Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.918278 2583 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.918289 2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.918418 2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.918491 2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.918499 2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:40.918971 2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:40.919019 2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-209.ec2.internal\" not found" Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.980333 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.981441 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.981472 2583 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.981497 2583 kubelet.go:2448] "Starting kubelet main sync loop" Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:40.981528 2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:40.983708 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:41.018706 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:41.019444 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-209.ec2.internal" event="NodeHasSufficientMemory" Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:41.019470 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-209.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:41.019480 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-209.ec2.internal" event="NodeHasSufficientPID" Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:41.019499 2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-209.ec2.internal" Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:41.027406 2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-209.ec2.internal" Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:41.027423 2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-209.ec2.internal\": node \"ip-10-0-130-209.ec2.internal\" not found" Jul 20 16:29:41.045762 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:41.042834 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-209.ec2.internal\" not found" Jul 20 16:29:42.495880 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:41.082231 2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-209.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-209.ec2.internal"] Jul 20 16:29:42.495880 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:41.082296 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 16:29:42.495880 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:41.083014 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-209.ec2.internal" event="NodeHasSufficientMemory" Jul 20 16:29:42.495880 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:41.083038 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-209.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 16:29:42.495880 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:41.083050 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-209.ec2.internal" event="NodeHasSufficientPID" Jul 20 16:29:42.495880 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:41.085402 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 16:29:42.495880 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:41.085545 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-209.ec2.internal" Jul 20 16:29:42.495880 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:41.085571 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 16:29:42.495880 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:41.086093 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-209.ec2.internal" event="NodeHasSufficientMemory" Jul 20 16:29:42.495880 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:41.086112 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-209.ec2.internal" event="NodeHasSufficientMemory" Jul 20 16:29:42.495880 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:41.086122 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-209.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 16:29:42.495880 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:41.086135 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-209.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 16:29:42.495880 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:41.086139 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-209.ec2.internal" event="NodeHasSufficientPID" Jul 20 16:29:42.495880 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:41.086147 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-209.ec2.internal" event="NodeHasSufficientPID" Jul 20 16:29:42.495880 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:41.088444 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-209.ec2.internal" Jul 20 16:29:42.495880 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:41.088466 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 16:29:42.495880 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:42.436039 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-209.ec2.internal" event="NodeHasSufficientMemory" Jul 20 16:29:42.495880 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:42.436067 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-209.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 16:29:42.495880 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:42.436080 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-209.ec2.internal" event="NodeHasSufficientPID" Jul 20 16:29:42.495880 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:42.488643 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-209.ec2.internal\" not found" node="ip-10-0-130-209.ec2.internal" Jul 20 16:29:42.495880 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:42.489970 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-209.ec2.internal\" not found" Jul 20 16:29:42.495880 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:42.491908 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-209.ec2.internal\" not found" node="ip-10-0-130-209.ec2.internal" Jul 20 16:29:42.501246 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:42.501087 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/509de8619b3244aa78d17f1b84e02a27-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-209.ec2.internal\" (UID: \"509de8619b3244aa78d17f1b84e02a27\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-209.ec2.internal" Jul 20 16:29:42.501246 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:42.501121 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/509de8619b3244aa78d17f1b84e02a27-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-209.ec2.internal\" (UID: \"509de8619b3244aa78d17f1b84e02a27\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-209.ec2.internal" Jul 20 16:29:42.501246 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:42.501140 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7f834a056acbe47737d34ff21bd03fbb-config\") pod \"kube-apiserver-proxy-ip-10-0-130-209.ec2.internal\" (UID: \"7f834a056acbe47737d34ff21bd03fbb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-209.ec2.internal" Jul 20 16:29:42.620141 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:42.590262 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-209.ec2.internal\" not found" Jul 20 16:29:42.620141 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:42.601573 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/509de8619b3244aa78d17f1b84e02a27-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-209.ec2.internal\" (UID: \"509de8619b3244aa78d17f1b84e02a27\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-209.ec2.internal" Jul 20 16:29:42.620141 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:42.601597 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/509de8619b3244aa78d17f1b84e02a27-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-209.ec2.internal\" (UID: \"509de8619b3244aa78d17f1b84e02a27\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-209.ec2.internal" Jul 20 16:29:42.620141 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:42.601613 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7f834a056acbe47737d34ff21bd03fbb-config\") pod \"kube-apiserver-proxy-ip-10-0-130-209.ec2.internal\" (UID: \"7f834a056acbe47737d34ff21bd03fbb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-209.ec2.internal" Jul 20 16:29:42.620141 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:42.601653 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7f834a056acbe47737d34ff21bd03fbb-config\") pod \"kube-apiserver-proxy-ip-10-0-130-209.ec2.internal\" (UID: \"7f834a056acbe47737d34ff21bd03fbb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-209.ec2.internal" Jul 20 16:29:42.620141 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:42.601677 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/509de8619b3244aa78d17f1b84e02a27-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-209.ec2.internal\" (UID: \"509de8619b3244aa78d17f1b84e02a27\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-209.ec2.internal" Jul 20 16:29:42.620141 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:42.601691 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/509de8619b3244aa78d17f1b84e02a27-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-209.ec2.internal\" (UID: \"509de8619b3244aa78d17f1b84e02a27\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-209.ec2.internal" Jul 20 16:29:42.741915 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:42.690894 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-209.ec2.internal\" not found" Jul 20 16:29:42.834924 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:42.791341 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-209.ec2.internal\" not found" Jul 20 16:29:42.834924 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:42.791384 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-209.ec2.internal" Jul 20 16:29:42.834924 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:42.794761 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-209.ec2.internal" Jul 20 16:29:42.937486 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:42.892290 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-209.ec2.internal\" not found" Jul 20 16:29:43.036178 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:42.999164 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-209.ec2.internal\" not found" Jul 20 16:29:43.122521 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:43.099536 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-209.ec2.internal\" not found" Jul 20 16:29:43.122521 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:43.122340 2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 20 16:29:43.122521 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:43.122456 2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 20 16:29:43.122521 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:43.122482 2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 20 16:29:43.225241 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:43.194171 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 16:24:42 +0000 UTC" deadline="2027-12-23 14:26:32.757131503 +0000 UTC" Jul 20 16:29:43.225241 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:43.194205 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12501h56m49.562931325s" Jul 20 16:29:43.225241 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:43.199687 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-209.ec2.internal\" not found" Jul 20 16:29:43.300258 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:43.300225 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-209.ec2.internal\" not found" Jul 20 16:29:43.359060 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:43.359028 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f834a056acbe47737d34ff21bd03fbb.slice/crio-15c00f356476b7fe566da69eb481b3a076c6ef0a96753679b15da76ba1ecafb1 WatchSource:0}: Error finding container 15c00f356476b7fe566da69eb481b3a076c6ef0a96753679b15da76ba1ecafb1: Status 404 returned error can't find the container with id 15c00f356476b7fe566da69eb481b3a076c6ef0a96753679b15da76ba1ecafb1 Jul 20 16:29:43.359485 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:43.359465 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod509de8619b3244aa78d17f1b84e02a27.slice/crio-3de9b4d00164661646777cc94a7a9ffd6f3ed83fc858b9686b987e6a0455b559 WatchSource:0}: Error finding container 3de9b4d00164661646777cc94a7a9ffd6f3ed83fc858b9686b987e6a0455b559: Status 404 returned error can't find the container with id 3de9b4d00164661646777cc94a7a9ffd6f3ed83fc858b9686b987e6a0455b559 Jul 20 16:29:43.363263 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:43.363249 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 16:29:43.400740 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:43.400709 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-209.ec2.internal\" not found" Jul 20 16:29:43.404936 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:43.404922 2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 16:29:43.498940 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:43.498915 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-209.ec2.internal" Jul 20 16:29:43.509453 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:43.509430 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 20 16:29:43.511090 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:43.511076 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-209.ec2.internal" Jul 20 16:29:43.518734 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:43.518718 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 20 16:29:43.785593 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:43.785516 2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 16:29:44.173685 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.173650 2583 apiserver.go:52] "Watching apiserver" Jul 20 16:29:44.180637 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.180609 2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 20 16:29:44.182099 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.181625 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-fjgcb","kube-system/konnectivity-agent-mzzz4","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhmw4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-209.ec2.internal","openshift-multus/multus-additional-cni-plugins-gdmwn","openshift-multus/multus-rdkmf","openshift-multus/network-metrics-daemon-f5cnm","openshift-ovn-kubernetes/ovnkube-node-n6b6s","kube-system/kube-apiserver-proxy-ip-10-0-130-209.ec2.internal","openshift-cluster-node-tuning-operator/tuned-nbl8g","openshift-dns/node-resolver-v4zb9","openshift-image-registry/node-ca-zh5ql","openshift-network-diagnostics/network-check-target-wfzmp","openshift-network-operator/iptables-alerter-mqmng"] Jul 20 16:29:44.184261 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.184241 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.186499 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.186455 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfzmp" Jul 20 16:29:44.186602 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:44.186539 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfzmp" podUID="c6d194b8-0b62-40d1-97bc-c4b775b7ac9f" Jul 20 16:29:44.186668 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.186649 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-922wt\"" Jul 20 16:29:44.186870 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.186848 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 20 16:29:44.186870 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.186851 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 20 16:29:44.188935 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.188913 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhmw4" Jul 20 16:29:44.191839 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.191228 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 20 16:29:44.191839 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.191504 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 20 16:29:44.191839 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.191576 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6xlqj\"" Jul 20 16:29:44.191839 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.191632 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 20 16:29:44.191839 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.191775 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mqmng" Jul 20 16:29:44.194041 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.194021 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 20 16:29:44.194041 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.194037 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 20 16:29:44.194221 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.194056 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-27h4q\"" Jul 20 16:29:44.194221 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.194026 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gdmwn" Jul 20 16:29:44.194325 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.194291 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 20 16:29:44.196841 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.196341 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 20 16:29:44.196841 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.196521 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 20 16:29:44.196841 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.196521 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 20 16:29:44.196841 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.196598 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 20 16:29:44.196841 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.196700 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 20 16:29:44.196841 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.196801 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pwqdw\"" Jul 20 16:29:44.196841 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.196808 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.198389 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.198369 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 20 16:29:44.199408 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.199027 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.199915 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.199895 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 20 16:29:44.200183 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.199895 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vfjp6\"" Jul 20 16:29:44.201820 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.201795 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 20 16:29:44.201912 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.201879 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 20 16:29:44.201969 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.201951 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-thc65\"" Jul 20 16:29:44.202500 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.202483 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5cnm" Jul 20 16:29:44.202591 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.202553 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 20 16:29:44.202591 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.202559 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 20 16:29:44.202679 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:44.202552 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5cnm" podUID="623fa3c9-f7b4-4949-9122-d9f5a5207853" Jul 20 16:29:44.202857 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.202837 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 20 16:29:44.202936 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.202918 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 20 16:29:44.204716 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.204697 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mzzz4" Jul 20 16:29:44.206431 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.206411 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjgcb" Jul 20 16:29:44.206523 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:44.206473 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjgcb" podUID="d771112b-c7d6-4ee2-84a3-567150c4407a" Jul 20 16:29:44.206977 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.206956 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-clxcx\"" Jul 20 16:29:44.207071 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.207055 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 20 16:29:44.207172 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.207158 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 20 16:29:44.208588 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.208546 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 20 16:29:44.208824 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.208807 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v4zb9" Jul 20 16:29:44.210420 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.210392 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/33f884fa-086f-4493-b827-0b4b44423556-socket-dir\") pod \"aws-ebs-csi-driver-node-fhmw4\" (UID: \"33f884fa-086f-4493-b827-0b4b44423556\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhmw4" Jul 20 16:29:44.210738 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.210702 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8qpj\" (UniqueName: \"kubernetes.io/projected/33f884fa-086f-4493-b827-0b4b44423556-kube-api-access-k8qpj\") pod \"aws-ebs-csi-driver-node-fhmw4\" (UID: \"33f884fa-086f-4493-b827-0b4b44423556\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhmw4" Jul 20 16:29:44.210840 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.210767 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-log-socket\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.210840 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.210800 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-ovnkube-config\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.210840 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.210830 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bc8db184-def3-4066-8d3e-a7206b10506f-os-release\") pod \"multus-additional-cni-plugins-gdmwn\" (UID: \"bc8db184-def3-4066-8d3e-a7206b10506f\") " pod="openshift-multus/multus-additional-cni-plugins-gdmwn" Jul 20 16:29:44.213043 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.213018 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/538fa124-71ba-465b-9224-0b16af61a57a-host-var-lib-kubelet\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.213152 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.213073 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bc8db184-def3-4066-8d3e-a7206b10506f-cni-binary-copy\") pod \"multus-additional-cni-plugins-gdmwn\" (UID: \"bc8db184-def3-4066-8d3e-a7206b10506f\") " pod="openshift-multus/multus-additional-cni-plugins-gdmwn" Jul 20 16:29:44.213223 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.213151 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bc8db184-def3-4066-8d3e-a7206b10506f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gdmwn\" (UID: \"bc8db184-def3-4066-8d3e-a7206b10506f\") " pod="openshift-multus/multus-additional-cni-plugins-gdmwn" Jul 20 16:29:44.213223 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.213188 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2mbl\" (UniqueName: \"kubernetes.io/projected/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-kube-api-access-k2mbl\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.213323 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.213222 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/454e8e7a-6607-4e03-bf2b-7e806bb6324a-etc-kubernetes\") pod \"tuned-nbl8g\" (UID: \"454e8e7a-6607-4e03-bf2b-7e806bb6324a\") " pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.213323 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.213262 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/454e8e7a-6607-4e03-bf2b-7e806bb6324a-etc-systemd\") pod \"tuned-nbl8g\" (UID: \"454e8e7a-6607-4e03-bf2b-7e806bb6324a\") " pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.213323 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.213294 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/454e8e7a-6607-4e03-bf2b-7e806bb6324a-lib-modules\") pod \"tuned-nbl8g\" (UID: \"454e8e7a-6607-4e03-bf2b-7e806bb6324a\") " pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.213467 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.213321 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/538fa124-71ba-465b-9224-0b16af61a57a-multus-daemon-config\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.213467 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.213333 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6lrf6\"" Jul 20 16:29:44.213467 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.213354 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/454e8e7a-6607-4e03-bf2b-7e806bb6324a-etc-sysconfig\") pod \"tuned-nbl8g\" (UID: \"454e8e7a-6607-4e03-bf2b-7e806bb6324a\") " pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.213467 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.213372 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 20 16:29:44.213467 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.213386 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/33f884fa-086f-4493-b827-0b4b44423556-registration-dir\") pod \"aws-ebs-csi-driver-node-fhmw4\" (UID: \"33f884fa-086f-4493-b827-0b4b44423556\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhmw4" Jul 20 16:29:44.213467 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.213419 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/33f884fa-086f-4493-b827-0b4b44423556-sys-fs\") pod \"aws-ebs-csi-driver-node-fhmw4\" (UID: \"33f884fa-086f-4493-b827-0b4b44423556\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhmw4" Jul 20 16:29:44.213467 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.213452 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-host-kubelet\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.213772 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.213490 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-host-run-ovn-kubernetes\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.213772 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.213576 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/454e8e7a-6607-4e03-bf2b-7e806bb6324a-tmp\") pod \"tuned-nbl8g\" (UID: \"454e8e7a-6607-4e03-bf2b-7e806bb6324a\") " pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.213772 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.213613 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/33f884fa-086f-4493-b827-0b4b44423556-etc-selinux\") pod \"aws-ebs-csi-driver-node-fhmw4\" (UID: \"33f884fa-086f-4493-b827-0b4b44423556\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhmw4" Jul 20 16:29:44.213772 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.213667 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-host-run-netns\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.213772 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.213709 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-ovn-node-metrics-cert\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.213772 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.213762 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmqsn\" (UniqueName: \"kubernetes.io/projected/454e8e7a-6607-4e03-bf2b-7e806bb6324a-kube-api-access-lmqsn\") pod \"tuned-nbl8g\" (UID: \"454e8e7a-6607-4e03-bf2b-7e806bb6324a\") " pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.214032 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.213807 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/33f884fa-086f-4493-b827-0b4b44423556-device-dir\") pod \"aws-ebs-csi-driver-node-fhmw4\" (UID: \"33f884fa-086f-4493-b827-0b4b44423556\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhmw4" Jul 20 16:29:44.214032 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.213855 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bc8db184-def3-4066-8d3e-a7206b10506f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gdmwn\" (UID: \"bc8db184-def3-4066-8d3e-a7206b10506f\") " pod="openshift-multus/multus-additional-cni-plugins-gdmwn" Jul 20 16:29:44.214032 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.213890 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/538fa124-71ba-465b-9224-0b16af61a57a-system-cni-dir\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.214032 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.213913 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 20 16:29:44.214032 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.213937 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/538fa124-71ba-465b-9224-0b16af61a57a-multus-cni-dir\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.214032 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.213987 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/538fa124-71ba-465b-9224-0b16af61a57a-multus-conf-dir\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.214032 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.214023 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.214354 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.214097 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-env-overrides\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.214354 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.214201 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/454e8e7a-6607-4e03-bf2b-7e806bb6324a-etc-tuned\") pod \"tuned-nbl8g\" (UID: \"454e8e7a-6607-4e03-bf2b-7e806bb6324a\") " pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.214354 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.214238 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/538fa124-71ba-465b-9224-0b16af61a57a-host-run-netns\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.214354 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.214283 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/538fa124-71ba-465b-9224-0b16af61a57a-host-var-lib-cni-multus\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.214354 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.214335 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4w22\" (UniqueName: \"kubernetes.io/projected/538fa124-71ba-465b-9224-0b16af61a57a-kube-api-access-f4w22\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.214552 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.214370 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/454e8e7a-6607-4e03-bf2b-7e806bb6324a-etc-sysctl-conf\") pod \"tuned-nbl8g\" (UID: \"454e8e7a-6607-4e03-bf2b-7e806bb6324a\") " pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.214552 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.214400 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62dkw\" (UniqueName: \"kubernetes.io/projected/bc8db184-def3-4066-8d3e-a7206b10506f-kube-api-access-62dkw\") pod \"multus-additional-cni-plugins-gdmwn\" (UID: \"bc8db184-def3-4066-8d3e-a7206b10506f\") " pod="openshift-multus/multus-additional-cni-plugins-gdmwn" Jul 20 16:29:44.214552 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.214428 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/538fa124-71ba-465b-9224-0b16af61a57a-os-release\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.214552 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.214489 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-ovnkube-script-lib\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.214552 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.214520 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/538fa124-71ba-465b-9224-0b16af61a57a-multus-socket-dir-parent\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.214552 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.214551 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-systemd-units\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.214785 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.214578 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nmvj\" (UniqueName: \"kubernetes.io/projected/9a9effbe-fcf0-4fea-8a36-ca9c0d4b86cb-kube-api-access-2nmvj\") pod \"iptables-alerter-mqmng\" (UID: \"9a9effbe-fcf0-4fea-8a36-ca9c0d4b86cb\") " pod="openshift-network-operator/iptables-alerter-mqmng" Jul 20 16:29:44.214785 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.214602 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc8db184-def3-4066-8d3e-a7206b10506f-system-cni-dir\") pod \"multus-additional-cni-plugins-gdmwn\" (UID: \"bc8db184-def3-4066-8d3e-a7206b10506f\") " pod="openshift-multus/multus-additional-cni-plugins-gdmwn" Jul 20 16:29:44.214785 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.214629 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/538fa124-71ba-465b-9224-0b16af61a57a-host-run-k8s-cni-cncf-io\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.214785 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.214655 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/538fa124-71ba-465b-9224-0b16af61a57a-etc-kubernetes\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.214785 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.214681 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9a9effbe-fcf0-4fea-8a36-ca9c0d4b86cb-iptables-alerter-script\") pod \"iptables-alerter-mqmng\" (UID: \"9a9effbe-fcf0-4fea-8a36-ca9c0d4b86cb\") " pod="openshift-network-operator/iptables-alerter-mqmng" Jul 20 16:29:44.214785 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.214707 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-var-lib-openvswitch\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.214785 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.214730 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-run-ovn\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.214785 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.214770 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-node-log\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.215142 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.214828 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/454e8e7a-6607-4e03-bf2b-7e806bb6324a-run\") pod \"tuned-nbl8g\" (UID: \"454e8e7a-6607-4e03-bf2b-7e806bb6324a\") " pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.215142 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.214856 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/454e8e7a-6607-4e03-bf2b-7e806bb6324a-host\") pod \"tuned-nbl8g\" (UID: \"454e8e7a-6607-4e03-bf2b-7e806bb6324a\") " pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.215142 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.214890 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bc8db184-def3-4066-8d3e-a7206b10506f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gdmwn\" (UID: \"bc8db184-def3-4066-8d3e-a7206b10506f\") " pod="openshift-multus/multus-additional-cni-plugins-gdmwn" Jul 20 16:29:44.215142 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.214938 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/538fa124-71ba-465b-9224-0b16af61a57a-cni-binary-copy\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.215142 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.214970 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-host-slash\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.215142 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.214995 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-run-systemd\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.215142 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.215021 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-host-cni-bin\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.215142 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.215047 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/454e8e7a-6607-4e03-bf2b-7e806bb6324a-etc-modprobe-d\") pod \"tuned-nbl8g\" (UID: \"454e8e7a-6607-4e03-bf2b-7e806bb6324a\") " pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.215142 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.215069 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/454e8e7a-6607-4e03-bf2b-7e806bb6324a-var-lib-kubelet\") pod \"tuned-nbl8g\" (UID: \"454e8e7a-6607-4e03-bf2b-7e806bb6324a\") " pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.215142 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.215095 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a9effbe-fcf0-4fea-8a36-ca9c0d4b86cb-host-slash\") pod \"iptables-alerter-mqmng\" (UID: \"9a9effbe-fcf0-4fea-8a36-ca9c0d4b86cb\") " pod="openshift-network-operator/iptables-alerter-mqmng" Jul 20 16:29:44.215642 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.215164 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bc8db184-def3-4066-8d3e-a7206b10506f-cnibin\") pod \"multus-additional-cni-plugins-gdmwn\" (UID: \"bc8db184-def3-4066-8d3e-a7206b10506f\") " pod="openshift-multus/multus-additional-cni-plugins-gdmwn" Jul 20 16:29:44.215642 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.215200 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/538fa124-71ba-465b-9224-0b16af61a57a-host-var-lib-cni-bin\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.215642 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.215234 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-run-openvswitch\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.215642 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.215292 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-host-cni-netd\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.215642 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.215325 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf2tm\" (UniqueName: \"kubernetes.io/projected/c6d194b8-0b62-40d1-97bc-c4b775b7ac9f-kube-api-access-pf2tm\") pod \"network-check-target-wfzmp\" (UID: \"c6d194b8-0b62-40d1-97bc-c4b775b7ac9f\") " pod="openshift-network-diagnostics/network-check-target-wfzmp" Jul 20 16:29:44.215642 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.215532 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/538fa124-71ba-465b-9224-0b16af61a57a-hostroot\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.215642 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.215545 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zh5ql" Jul 20 16:29:44.215642 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.215577 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/454e8e7a-6607-4e03-bf2b-7e806bb6324a-sys\") pod \"tuned-nbl8g\" (UID: \"454e8e7a-6607-4e03-bf2b-7e806bb6324a\") " pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.215642 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.215604 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/538fa124-71ba-465b-9224-0b16af61a57a-cnibin\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.215642 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.215630 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/538fa124-71ba-465b-9224-0b16af61a57a-host-run-multus-certs\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.216065 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.215659 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-etc-openvswitch\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.216065 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.215688 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/454e8e7a-6607-4e03-bf2b-7e806bb6324a-etc-sysctl-d\") pod \"tuned-nbl8g\" (UID: \"454e8e7a-6607-4e03-bf2b-7e806bb6324a\") " pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.216065 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.215717 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/33f884fa-086f-4493-b827-0b4b44423556-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fhmw4\" (UID: \"33f884fa-086f-4493-b827-0b4b44423556\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhmw4" Jul 20 16:29:44.217834 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.217747 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 20 16:29:44.217969 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.217950 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 20 16:29:44.218081 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.217979 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 20 16:29:44.218081 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.218007 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4x88t\"" Jul 20 16:29:44.233950 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.233930 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-sntfr" Jul 20 16:29:44.242845 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.242822 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-sntfr" Jul 20 16:29:44.299117 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.299077 2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 20 16:29:44.316429 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.316398 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/454e8e7a-6607-4e03-bf2b-7e806bb6324a-etc-sysctl-conf\") pod \"tuned-nbl8g\" (UID: \"454e8e7a-6607-4e03-bf2b-7e806bb6324a\") " pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.316584 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.316438 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62dkw\" (UniqueName: \"kubernetes.io/projected/bc8db184-def3-4066-8d3e-a7206b10506f-kube-api-access-62dkw\") pod \"multus-additional-cni-plugins-gdmwn\" (UID: \"bc8db184-def3-4066-8d3e-a7206b10506f\") " pod="openshift-multus/multus-additional-cni-plugins-gdmwn" Jul 20 16:29:44.316584 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.316464 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/538fa124-71ba-465b-9224-0b16af61a57a-os-release\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.316584 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.316489 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-ovnkube-script-lib\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.316584 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.316512 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/538fa124-71ba-465b-9224-0b16af61a57a-multus-socket-dir-parent\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.316584 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.316532 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-systemd-units\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.316584 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.316546 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/454e8e7a-6607-4e03-bf2b-7e806bb6324a-etc-sysctl-conf\") pod \"tuned-nbl8g\" (UID: \"454e8e7a-6607-4e03-bf2b-7e806bb6324a\") " pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.316584 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.316553 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nmvj\" (UniqueName: \"kubernetes.io/projected/9a9effbe-fcf0-4fea-8a36-ca9c0d4b86cb-kube-api-access-2nmvj\") pod \"iptables-alerter-mqmng\" (UID: \"9a9effbe-fcf0-4fea-8a36-ca9c0d4b86cb\") " pod="openshift-network-operator/iptables-alerter-mqmng" Jul 20 16:29:44.316883 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.316581 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/538fa124-71ba-465b-9224-0b16af61a57a-os-release\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.316883 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.316602 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc8db184-def3-4066-8d3e-a7206b10506f-system-cni-dir\") pod \"multus-additional-cni-plugins-gdmwn\" (UID: \"bc8db184-def3-4066-8d3e-a7206b10506f\") " pod="openshift-multus/multus-additional-cni-plugins-gdmwn" Jul 20 16:29:44.316883 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.316647 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc8db184-def3-4066-8d3e-a7206b10506f-system-cni-dir\") pod \"multus-additional-cni-plugins-gdmwn\" (UID: \"bc8db184-def3-4066-8d3e-a7206b10506f\") " pod="openshift-multus/multus-additional-cni-plugins-gdmwn" Jul 20 16:29:44.316883 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.316721 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/538fa124-71ba-465b-9224-0b16af61a57a-multus-socket-dir-parent\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.316883 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.316777 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-systemd-units\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.316883 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.316814 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/538fa124-71ba-465b-9224-0b16af61a57a-host-run-k8s-cni-cncf-io\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.316883 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.316843 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/538fa124-71ba-465b-9224-0b16af61a57a-etc-kubernetes\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.316883 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.316858 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/538fa124-71ba-465b-9224-0b16af61a57a-host-run-k8s-cni-cncf-io\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.317286 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.316885 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/623fa3c9-f7b4-4949-9122-d9f5a5207853-metrics-certs\") pod \"network-metrics-daemon-f5cnm\" (UID: \"623fa3c9-f7b4-4949-9122-d9f5a5207853\") " pod="openshift-multus/network-metrics-daemon-f5cnm" Jul 20 16:29:44.317286 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.316906 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9a9effbe-fcf0-4fea-8a36-ca9c0d4b86cb-iptables-alerter-script\") pod \"iptables-alerter-mqmng\" (UID: \"9a9effbe-fcf0-4fea-8a36-ca9c0d4b86cb\") " pod="openshift-network-operator/iptables-alerter-mqmng" Jul 20 16:29:44.317286 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.316913 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/538fa124-71ba-465b-9224-0b16af61a57a-etc-kubernetes\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.317286 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.316925 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-var-lib-openvswitch\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.317286 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.317044 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-run-ovn\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.317286 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.317046 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-var-lib-openvswitch\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.317286 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.317074 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-node-log\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.317286 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.317088 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-run-ovn\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.317286 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.317147 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/454e8e7a-6607-4e03-bf2b-7e806bb6324a-run\") pod \"tuned-nbl8g\" (UID: \"454e8e7a-6607-4e03-bf2b-7e806bb6324a\") " pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.317286 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.317175 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/454e8e7a-6607-4e03-bf2b-7e806bb6324a-host\") pod \"tuned-nbl8g\" (UID: \"454e8e7a-6607-4e03-bf2b-7e806bb6324a\") " pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.317286 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.317211 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bc8db184-def3-4066-8d3e-a7206b10506f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gdmwn\" (UID: \"bc8db184-def3-4066-8d3e-a7206b10506f\") " pod="openshift-multus/multus-additional-cni-plugins-gdmwn" Jul 20 16:29:44.317286 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.317222 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/454e8e7a-6607-4e03-bf2b-7e806bb6324a-host\") pod \"tuned-nbl8g\" (UID: \"454e8e7a-6607-4e03-bf2b-7e806bb6324a\") " pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.317286 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.317241 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/538fa124-71ba-465b-9224-0b16af61a57a-cni-binary-copy\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.317286 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.317266 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-host-slash\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.317286 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.317275 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/454e8e7a-6607-4e03-bf2b-7e806bb6324a-run\") pod \"tuned-nbl8g\" (UID: \"454e8e7a-6607-4e03-bf2b-7e806bb6324a\") " pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.317917 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.317296 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-ovnkube-script-lib\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.317917 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.317338 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-run-systemd\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.317917 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.317347 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-host-slash\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.317917 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.317362 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-host-cni-bin\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.317917 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.317505 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-node-log\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.317917 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.317546 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-run-systemd\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.317917 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.317557 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/454e8e7a-6607-4e03-bf2b-7e806bb6324a-etc-modprobe-d\") pod \"tuned-nbl8g\" (UID: \"454e8e7a-6607-4e03-bf2b-7e806bb6324a\") " pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.317917 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.317590 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/454e8e7a-6607-4e03-bf2b-7e806bb6324a-var-lib-kubelet\") pod \"tuned-nbl8g\" (UID: \"454e8e7a-6607-4e03-bf2b-7e806bb6324a\") " pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.317917 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.317617 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a9effbe-fcf0-4fea-8a36-ca9c0d4b86cb-host-slash\") pod \"iptables-alerter-mqmng\" (UID: \"9a9effbe-fcf0-4fea-8a36-ca9c0d4b86cb\") " pod="openshift-network-operator/iptables-alerter-mqmng" Jul 20 16:29:44.317917 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.317622 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-host-cni-bin\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.317917 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.317618 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9a9effbe-fcf0-4fea-8a36-ca9c0d4b86cb-iptables-alerter-script\") pod \"iptables-alerter-mqmng\" (UID: \"9a9effbe-fcf0-4fea-8a36-ca9c0d4b86cb\") " pod="openshift-network-operator/iptables-alerter-mqmng" Jul 20 16:29:44.317917 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.317657 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a9effbe-fcf0-4fea-8a36-ca9c0d4b86cb-host-slash\") pod \"iptables-alerter-mqmng\" (UID: \"9a9effbe-fcf0-4fea-8a36-ca9c0d4b86cb\") " pod="openshift-network-operator/iptables-alerter-mqmng" Jul 20 16:29:44.317917 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.317670 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/454e8e7a-6607-4e03-bf2b-7e806bb6324a-var-lib-kubelet\") pod \"tuned-nbl8g\" (UID: \"454e8e7a-6607-4e03-bf2b-7e806bb6324a\") " pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.317917 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.317669 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bc8db184-def3-4066-8d3e-a7206b10506f-cnibin\") pod \"multus-additional-cni-plugins-gdmwn\" (UID: \"bc8db184-def3-4066-8d3e-a7206b10506f\") " pod="openshift-multus/multus-additional-cni-plugins-gdmwn" Jul 20 16:29:44.317917 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.317699 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bc8db184-def3-4066-8d3e-a7206b10506f-cnibin\") pod \"multus-additional-cni-plugins-gdmwn\" (UID: \"bc8db184-def3-4066-8d3e-a7206b10506f\") " pod="openshift-multus/multus-additional-cni-plugins-gdmwn" Jul 20 16:29:44.317917 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.317722 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d771112b-c7d6-4ee2-84a3-567150c4407a-dbus\") pod \"global-pull-secret-syncer-fjgcb\" (UID: \"d771112b-c7d6-4ee2-84a3-567150c4407a\") " pod="kube-system/global-pull-secret-syncer-fjgcb" Jul 20 16:29:44.317917 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.317745 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/454e8e7a-6607-4e03-bf2b-7e806bb6324a-etc-modprobe-d\") pod \"tuned-nbl8g\" (UID: \"454e8e7a-6607-4e03-bf2b-7e806bb6324a\") " pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.318767 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.317762 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/538fa124-71ba-465b-9224-0b16af61a57a-host-var-lib-cni-bin\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.318767 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.317794 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2d54e31a-0d64-4914-9613-ffc1e50ea9e1-hosts-file\") pod \"node-resolver-v4zb9\" (UID: \"2d54e31a-0d64-4914-9613-ffc1e50ea9e1\") " pod="openshift-dns/node-resolver-v4zb9" Jul 20 16:29:44.318767 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.317834 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/538fa124-71ba-465b-9224-0b16af61a57a-host-var-lib-cni-bin\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.318767 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.317849 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-run-openvswitch\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.318767 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.317875 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-host-cni-netd\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.318767 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.317881 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/538fa124-71ba-465b-9224-0b16af61a57a-cni-binary-copy\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.318767 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.317887 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-run-openvswitch\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.318767 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.317900 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf2tm\" (UniqueName: \"kubernetes.io/projected/c6d194b8-0b62-40d1-97bc-c4b775b7ac9f-kube-api-access-pf2tm\") pod \"network-check-target-wfzmp\" (UID: \"c6d194b8-0b62-40d1-97bc-c4b775b7ac9f\") " pod="openshift-network-diagnostics/network-check-target-wfzmp" Jul 20 16:29:44.318767 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.317848 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bc8db184-def3-4066-8d3e-a7206b10506f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gdmwn\" (UID: \"bc8db184-def3-4066-8d3e-a7206b10506f\") " pod="openshift-multus/multus-additional-cni-plugins-gdmwn" Jul 20 16:29:44.318767 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.317967 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-host-cni-netd\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.318767 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.318083 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/538fa124-71ba-465b-9224-0b16af61a57a-hostroot\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.318767 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.317943 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/538fa124-71ba-465b-9224-0b16af61a57a-hostroot\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.318767 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.318439 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6rz9\" (UniqueName: \"kubernetes.io/projected/2d54e31a-0d64-4914-9613-ffc1e50ea9e1-kube-api-access-r6rz9\") pod \"node-resolver-v4zb9\" (UID: \"2d54e31a-0d64-4914-9613-ffc1e50ea9e1\") " pod="openshift-dns/node-resolver-v4zb9" Jul 20 16:29:44.318767 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.318470 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/454e8e7a-6607-4e03-bf2b-7e806bb6324a-sys\") pod \"tuned-nbl8g\" (UID: \"454e8e7a-6607-4e03-bf2b-7e806bb6324a\") " pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.318767 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.318493 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/538fa124-71ba-465b-9224-0b16af61a57a-cnibin\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.318767 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.318518 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/538fa124-71ba-465b-9224-0b16af61a57a-host-run-multus-certs\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.318767 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.318553 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/538fa124-71ba-465b-9224-0b16af61a57a-host-run-multus-certs\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.318767 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.318545 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b5364d44-60be-4948-aeb0-08ee992afa1f-agent-certs\") pod \"konnectivity-agent-mzzz4\" (UID: \"b5364d44-60be-4948-aeb0-08ee992afa1f\") " pod="kube-system/konnectivity-agent-mzzz4" Jul 20 16:29:44.319498 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.318587 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/454e8e7a-6607-4e03-bf2b-7e806bb6324a-sys\") pod \"tuned-nbl8g\" (UID: \"454e8e7a-6607-4e03-bf2b-7e806bb6324a\") " pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.319498 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.318595 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d54e31a-0d64-4914-9613-ffc1e50ea9e1-tmp-dir\") pod \"node-resolver-v4zb9\" (UID: \"2d54e31a-0d64-4914-9613-ffc1e50ea9e1\") " pod="openshift-dns/node-resolver-v4zb9" Jul 20 16:29:44.319498 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.318620 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-etc-openvswitch\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.319498 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.318622 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/538fa124-71ba-465b-9224-0b16af61a57a-cnibin\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.319498 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.318671 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-etc-openvswitch\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.319498 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.318674 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/454e8e7a-6607-4e03-bf2b-7e806bb6324a-etc-sysctl-d\") pod \"tuned-nbl8g\" (UID: \"454e8e7a-6607-4e03-bf2b-7e806bb6324a\") " pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.319498 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.318724 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/33f884fa-086f-4493-b827-0b4b44423556-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fhmw4\" (UID: \"33f884fa-086f-4493-b827-0b4b44423556\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhmw4" Jul 20 16:29:44.319498 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.318765 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/33f884fa-086f-4493-b827-0b4b44423556-socket-dir\") pod \"aws-ebs-csi-driver-node-fhmw4\" (UID: \"33f884fa-086f-4493-b827-0b4b44423556\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhmw4" Jul 20 16:29:44.319498 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.318768 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/454e8e7a-6607-4e03-bf2b-7e806bb6324a-etc-sysctl-d\") pod \"tuned-nbl8g\" (UID: \"454e8e7a-6607-4e03-bf2b-7e806bb6324a\") " pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.319498 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.318791 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8qpj\" (UniqueName: \"kubernetes.io/projected/33f884fa-086f-4493-b827-0b4b44423556-kube-api-access-k8qpj\") pod \"aws-ebs-csi-driver-node-fhmw4\" (UID: \"33f884fa-086f-4493-b827-0b4b44423556\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhmw4" Jul 20 16:29:44.319498 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.318810 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d139ce10-11a1-4353-90e1-b3a3008f6959-serviceca\") pod \"node-ca-zh5ql\" (UID: \"d139ce10-11a1-4353-90e1-b3a3008f6959\") " pod="openshift-image-registry/node-ca-zh5ql" Jul 20 16:29:44.319498 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.318825 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nxlt\" (UniqueName: \"kubernetes.io/projected/d139ce10-11a1-4353-90e1-b3a3008f6959-kube-api-access-7nxlt\") pod \"node-ca-zh5ql\" (UID: \"d139ce10-11a1-4353-90e1-b3a3008f6959\") " pod="openshift-image-registry/node-ca-zh5ql" Jul 20 16:29:44.319498 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.318844 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-log-socket\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.319498 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.318849 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/33f884fa-086f-4493-b827-0b4b44423556-socket-dir\") pod \"aws-ebs-csi-driver-node-fhmw4\" (UID: \"33f884fa-086f-4493-b827-0b4b44423556\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhmw4" Jul 20 16:29:44.319498 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.318789 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/33f884fa-086f-4493-b827-0b4b44423556-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fhmw4\" (UID: \"33f884fa-086f-4493-b827-0b4b44423556\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhmw4" Jul 20 16:29:44.319498 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.318864 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-ovnkube-config\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.319498 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.318904 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-log-socket\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.320277 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.318907 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bc8db184-def3-4066-8d3e-a7206b10506f-os-release\") pod \"multus-additional-cni-plugins-gdmwn\" (UID: \"bc8db184-def3-4066-8d3e-a7206b10506f\") " pod="openshift-multus/multus-additional-cni-plugins-gdmwn" Jul 20 16:29:44.320277 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.318944 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/538fa124-71ba-465b-9224-0b16af61a57a-host-var-lib-kubelet\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.320277 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.318962 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bc8db184-def3-4066-8d3e-a7206b10506f-os-release\") pod \"multus-additional-cni-plugins-gdmwn\" (UID: \"bc8db184-def3-4066-8d3e-a7206b10506f\") " pod="openshift-multus/multus-additional-cni-plugins-gdmwn" Jul 20 16:29:44.320277 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.318970 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d139ce10-11a1-4353-90e1-b3a3008f6959-host\") pod \"node-ca-zh5ql\" (UID: \"d139ce10-11a1-4353-90e1-b3a3008f6959\") " pod="openshift-image-registry/node-ca-zh5ql" Jul 20 16:29:44.320277 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.318993 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bc8db184-def3-4066-8d3e-a7206b10506f-cni-binary-copy\") pod \"multus-additional-cni-plugins-gdmwn\" (UID: \"bc8db184-def3-4066-8d3e-a7206b10506f\") " pod="openshift-multus/multus-additional-cni-plugins-gdmwn" Jul 20 16:29:44.320277 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319004 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/538fa124-71ba-465b-9224-0b16af61a57a-host-var-lib-kubelet\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.320277 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319009 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bc8db184-def3-4066-8d3e-a7206b10506f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gdmwn\" (UID: \"bc8db184-def3-4066-8d3e-a7206b10506f\") " pod="openshift-multus/multus-additional-cni-plugins-gdmwn" Jul 20 16:29:44.320277 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319052 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2mbl\" (UniqueName: \"kubernetes.io/projected/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-kube-api-access-k2mbl\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.320277 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319077 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/454e8e7a-6607-4e03-bf2b-7e806bb6324a-etc-kubernetes\") pod \"tuned-nbl8g\" (UID: \"454e8e7a-6607-4e03-bf2b-7e806bb6324a\") " pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.320277 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319144 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/454e8e7a-6607-4e03-bf2b-7e806bb6324a-etc-kubernetes\") pod \"tuned-nbl8g\" (UID: \"454e8e7a-6607-4e03-bf2b-7e806bb6324a\") " pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.320277 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319220 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/454e8e7a-6607-4e03-bf2b-7e806bb6324a-etc-systemd\") pod \"tuned-nbl8g\" (UID: \"454e8e7a-6607-4e03-bf2b-7e806bb6324a\") " pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.320277 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319256 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/454e8e7a-6607-4e03-bf2b-7e806bb6324a-lib-modules\") pod \"tuned-nbl8g\" (UID: \"454e8e7a-6607-4e03-bf2b-7e806bb6324a\") " pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.320277 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319271 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/454e8e7a-6607-4e03-bf2b-7e806bb6324a-etc-systemd\") pod \"tuned-nbl8g\" (UID: \"454e8e7a-6607-4e03-bf2b-7e806bb6324a\") " pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.320277 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319291 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/538fa124-71ba-465b-9224-0b16af61a57a-multus-daemon-config\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.320277 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319319 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b5364d44-60be-4948-aeb0-08ee992afa1f-konnectivity-ca\") pod \"konnectivity-agent-mzzz4\" (UID: \"b5364d44-60be-4948-aeb0-08ee992afa1f\") " pod="kube-system/konnectivity-agent-mzzz4" Jul 20 16:29:44.320277 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319326 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-ovnkube-config\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.320277 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319344 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/454e8e7a-6607-4e03-bf2b-7e806bb6324a-etc-sysconfig\") pod \"tuned-nbl8g\" (UID: \"454e8e7a-6607-4e03-bf2b-7e806bb6324a\") " pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.320869 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319369 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/33f884fa-086f-4493-b827-0b4b44423556-registration-dir\") pod \"aws-ebs-csi-driver-node-fhmw4\" (UID: \"33f884fa-086f-4493-b827-0b4b44423556\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhmw4" Jul 20 16:29:44.320869 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319374 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/454e8e7a-6607-4e03-bf2b-7e806bb6324a-lib-modules\") pod \"tuned-nbl8g\" (UID: \"454e8e7a-6607-4e03-bf2b-7e806bb6324a\") " pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.320869 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319393 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/33f884fa-086f-4493-b827-0b4b44423556-sys-fs\") pod \"aws-ebs-csi-driver-node-fhmw4\" (UID: \"33f884fa-086f-4493-b827-0b4b44423556\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhmw4" Jul 20 16:29:44.320869 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319429 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d771112b-c7d6-4ee2-84a3-567150c4407a-original-pull-secret\") pod \"global-pull-secret-syncer-fjgcb\" (UID: \"d771112b-c7d6-4ee2-84a3-567150c4407a\") " pod="kube-system/global-pull-secret-syncer-fjgcb" Jul 20 16:29:44.320869 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319443 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/33f884fa-086f-4493-b827-0b4b44423556-sys-fs\") pod \"aws-ebs-csi-driver-node-fhmw4\" (UID: \"33f884fa-086f-4493-b827-0b4b44423556\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhmw4" Jul 20 16:29:44.320869 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319448 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/33f884fa-086f-4493-b827-0b4b44423556-registration-dir\") pod \"aws-ebs-csi-driver-node-fhmw4\" (UID: \"33f884fa-086f-4493-b827-0b4b44423556\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhmw4" Jul 20 16:29:44.320869 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319403 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/454e8e7a-6607-4e03-bf2b-7e806bb6324a-etc-sysconfig\") pod \"tuned-nbl8g\" (UID: \"454e8e7a-6607-4e03-bf2b-7e806bb6324a\") " pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.320869 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319452 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-host-kubelet\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.320869 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319492 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-host-run-ovn-kubernetes\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.320869 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319517 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/454e8e7a-6607-4e03-bf2b-7e806bb6324a-tmp\") pod \"tuned-nbl8g\" (UID: \"454e8e7a-6607-4e03-bf2b-7e806bb6324a\") " pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.320869 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319522 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-host-run-ovn-kubernetes\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.320869 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319493 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-host-kubelet\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.320869 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319541 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/33f884fa-086f-4493-b827-0b4b44423556-etc-selinux\") pod \"aws-ebs-csi-driver-node-fhmw4\" (UID: \"33f884fa-086f-4493-b827-0b4b44423556\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhmw4" Jul 20 16:29:44.320869 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319566 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d771112b-c7d6-4ee2-84a3-567150c4407a-kubelet-config\") pod \"global-pull-secret-syncer-fjgcb\" (UID: \"d771112b-c7d6-4ee2-84a3-567150c4407a\") " pod="kube-system/global-pull-secret-syncer-fjgcb" Jul 20 16:29:44.320869 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319589 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bc8db184-def3-4066-8d3e-a7206b10506f-cni-binary-copy\") pod \"multus-additional-cni-plugins-gdmwn\" (UID: \"bc8db184-def3-4066-8d3e-a7206b10506f\") " pod="openshift-multus/multus-additional-cni-plugins-gdmwn" Jul 20 16:29:44.320869 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319611 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/33f884fa-086f-4493-b827-0b4b44423556-etc-selinux\") pod \"aws-ebs-csi-driver-node-fhmw4\" (UID: \"33f884fa-086f-4493-b827-0b4b44423556\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhmw4" Jul 20 16:29:44.320869 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319591 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-host-run-netns\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.321383 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319634 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-host-run-netns\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.321383 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319650 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-ovn-node-metrics-cert\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.321383 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319674 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmqsn\" (UniqueName: \"kubernetes.io/projected/454e8e7a-6607-4e03-bf2b-7e806bb6324a-kube-api-access-lmqsn\") pod \"tuned-nbl8g\" (UID: \"454e8e7a-6607-4e03-bf2b-7e806bb6324a\") " pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.321383 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319709 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/33f884fa-086f-4493-b827-0b4b44423556-device-dir\") pod \"aws-ebs-csi-driver-node-fhmw4\" (UID: \"33f884fa-086f-4493-b827-0b4b44423556\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhmw4" Jul 20 16:29:44.321383 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319733 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bc8db184-def3-4066-8d3e-a7206b10506f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gdmwn\" (UID: \"bc8db184-def3-4066-8d3e-a7206b10506f\") " pod="openshift-multus/multus-additional-cni-plugins-gdmwn" Jul 20 16:29:44.321383 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319763 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/538fa124-71ba-465b-9224-0b16af61a57a-multus-daemon-config\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.321383 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319779 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/538fa124-71ba-465b-9224-0b16af61a57a-system-cni-dir\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.321383 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319805 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/33f884fa-086f-4493-b827-0b4b44423556-device-dir\") pod \"aws-ebs-csi-driver-node-fhmw4\" (UID: \"33f884fa-086f-4493-b827-0b4b44423556\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhmw4" Jul 20 16:29:44.321383 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319819 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/538fa124-71ba-465b-9224-0b16af61a57a-multus-cni-dir\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.321383 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319810 2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 20 16:29:44.321383 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319850 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/538fa124-71ba-465b-9224-0b16af61a57a-multus-conf-dir\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.321383 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319868 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/538fa124-71ba-465b-9224-0b16af61a57a-system-cni-dir\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.321383 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319875 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.321383 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319902 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-env-overrides\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.321383 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319914 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bc8db184-def3-4066-8d3e-a7206b10506f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gdmwn\" (UID: \"bc8db184-def3-4066-8d3e-a7206b10506f\") " pod="openshift-multus/multus-additional-cni-plugins-gdmwn" Jul 20 16:29:44.321383 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319925 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/454e8e7a-6607-4e03-bf2b-7e806bb6324a-etc-tuned\") pod \"tuned-nbl8g\" (UID: \"454e8e7a-6607-4e03-bf2b-7e806bb6324a\") " pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.321383 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319960 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.321882 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319968 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bc8db184-def3-4066-8d3e-a7206b10506f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gdmwn\" (UID: \"bc8db184-def3-4066-8d3e-a7206b10506f\") " pod="openshift-multus/multus-additional-cni-plugins-gdmwn" Jul 20 16:29:44.321882 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319974 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/538fa124-71ba-465b-9224-0b16af61a57a-multus-conf-dir\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.321882 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.319971 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/538fa124-71ba-465b-9224-0b16af61a57a-multus-cni-dir\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.321882 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.320003 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/538fa124-71ba-465b-9224-0b16af61a57a-host-run-netns\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.321882 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.320029 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/538fa124-71ba-465b-9224-0b16af61a57a-host-var-lib-cni-multus\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.321882 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.320054 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4w22\" (UniqueName: \"kubernetes.io/projected/538fa124-71ba-465b-9224-0b16af61a57a-kube-api-access-f4w22\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.321882 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.320076 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/538fa124-71ba-465b-9224-0b16af61a57a-host-run-netns\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.321882 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.320117 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/538fa124-71ba-465b-9224-0b16af61a57a-host-var-lib-cni-multus\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.321882 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.320144 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jttrn\" (UniqueName: \"kubernetes.io/projected/623fa3c9-f7b4-4949-9122-d9f5a5207853-kube-api-access-jttrn\") pod \"network-metrics-daemon-f5cnm\" (UID: \"623fa3c9-f7b4-4949-9122-d9f5a5207853\") " pod="openshift-multus/network-metrics-daemon-f5cnm" Jul 20 16:29:44.321882 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.320354 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-env-overrides\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.323053 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.323024 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/454e8e7a-6607-4e03-bf2b-7e806bb6324a-etc-tuned\") pod \"tuned-nbl8g\" (UID: \"454e8e7a-6607-4e03-bf2b-7e806bb6324a\") " pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.323150 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.323099 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-ovn-node-metrics-cert\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.323201 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.323155 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/454e8e7a-6607-4e03-bf2b-7e806bb6324a-tmp\") pod \"tuned-nbl8g\" (UID: \"454e8e7a-6607-4e03-bf2b-7e806bb6324a\") " pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.325233 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:44.325215 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 16:29:44.325233 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:44.325242 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 16:29:44.325365 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:44.325255 2583 projected.go:196] Error preparing data for projected volume kube-api-access-pf2tm for pod openshift-network-diagnostics/network-check-target-wfzmp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:29:44.325365 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:44.325319 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6d194b8-0b62-40d1-97bc-c4b775b7ac9f-kube-api-access-pf2tm podName:c6d194b8-0b62-40d1-97bc-c4b775b7ac9f nodeName:}" failed. No retries permitted until 2026-07-20 16:29:44.825299146 +0000 UTC m=+2.975099920 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pf2tm" (UniqueName: "kubernetes.io/projected/c6d194b8-0b62-40d1-97bc-c4b775b7ac9f-kube-api-access-pf2tm") pod "network-check-target-wfzmp" (UID: "c6d194b8-0b62-40d1-97bc-c4b775b7ac9f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:29:44.327480 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.327429 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62dkw\" (UniqueName: \"kubernetes.io/projected/bc8db184-def3-4066-8d3e-a7206b10506f-kube-api-access-62dkw\") pod \"multus-additional-cni-plugins-gdmwn\" (UID: \"bc8db184-def3-4066-8d3e-a7206b10506f\") " pod="openshift-multus/multus-additional-cni-plugins-gdmwn" Jul 20 16:29:44.328164 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.328141 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nmvj\" (UniqueName: \"kubernetes.io/projected/9a9effbe-fcf0-4fea-8a36-ca9c0d4b86cb-kube-api-access-2nmvj\") pod \"iptables-alerter-mqmng\" (UID: \"9a9effbe-fcf0-4fea-8a36-ca9c0d4b86cb\") " pod="openshift-network-operator/iptables-alerter-mqmng" Jul 20 16:29:44.329089 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.329065 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8qpj\" (UniqueName: \"kubernetes.io/projected/33f884fa-086f-4493-b827-0b4b44423556-kube-api-access-k8qpj\") pod \"aws-ebs-csi-driver-node-fhmw4\" (UID: \"33f884fa-086f-4493-b827-0b4b44423556\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhmw4" Jul 20 16:29:44.329213 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.329193 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2mbl\" (UniqueName: \"kubernetes.io/projected/8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5-kube-api-access-k2mbl\") pod \"ovnkube-node-n6b6s\" (UID: \"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.329476 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.329434 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmqsn\" (UniqueName: \"kubernetes.io/projected/454e8e7a-6607-4e03-bf2b-7e806bb6324a-kube-api-access-lmqsn\") pod \"tuned-nbl8g\" (UID: \"454e8e7a-6607-4e03-bf2b-7e806bb6324a\") " pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.330512 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.330491 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4w22\" (UniqueName: \"kubernetes.io/projected/538fa124-71ba-465b-9224-0b16af61a57a-kube-api-access-f4w22\") pod \"multus-rdkmf\" (UID: \"538fa124-71ba-465b-9224-0b16af61a57a\") " pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.335608 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.335564 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-209.ec2.internal" event={"ID":"7f834a056acbe47737d34ff21bd03fbb","Type":"ContainerStarted","Data":"15c00f356476b7fe566da69eb481b3a076c6ef0a96753679b15da76ba1ecafb1"} Jul 20 16:29:44.336655 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.336632 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-209.ec2.internal" event={"ID":"509de8619b3244aa78d17f1b84e02a27","Type":"ContainerStarted","Data":"3de9b4d00164661646777cc94a7a9ffd6f3ed83fc858b9686b987e6a0455b559"} Jul 20 16:29:44.420697 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.420660 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6rz9\" (UniqueName: \"kubernetes.io/projected/2d54e31a-0d64-4914-9613-ffc1e50ea9e1-kube-api-access-r6rz9\") pod \"node-resolver-v4zb9\" (UID: \"2d54e31a-0d64-4914-9613-ffc1e50ea9e1\") " pod="openshift-dns/node-resolver-v4zb9" Jul 20 16:29:44.420870 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.420705 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b5364d44-60be-4948-aeb0-08ee992afa1f-agent-certs\") pod \"konnectivity-agent-mzzz4\" (UID: \"b5364d44-60be-4948-aeb0-08ee992afa1f\") " pod="kube-system/konnectivity-agent-mzzz4" Jul 20 16:29:44.420870 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.420732 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d54e31a-0d64-4914-9613-ffc1e50ea9e1-tmp-dir\") pod \"node-resolver-v4zb9\" (UID: \"2d54e31a-0d64-4914-9613-ffc1e50ea9e1\") " pod="openshift-dns/node-resolver-v4zb9" Jul 20 16:29:44.420870 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.420762 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d139ce10-11a1-4353-90e1-b3a3008f6959-serviceca\") pod \"node-ca-zh5ql\" (UID: \"d139ce10-11a1-4353-90e1-b3a3008f6959\") " pod="openshift-image-registry/node-ca-zh5ql" Jul 20 16:29:44.420870 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.420784 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nxlt\" (UniqueName: \"kubernetes.io/projected/d139ce10-11a1-4353-90e1-b3a3008f6959-kube-api-access-7nxlt\") pod \"node-ca-zh5ql\" (UID: \"d139ce10-11a1-4353-90e1-b3a3008f6959\") " pod="openshift-image-registry/node-ca-zh5ql" Jul 20 16:29:44.420870 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.420810 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d139ce10-11a1-4353-90e1-b3a3008f6959-host\") pod \"node-ca-zh5ql\" (UID: \"d139ce10-11a1-4353-90e1-b3a3008f6959\") " pod="openshift-image-registry/node-ca-zh5ql" Jul 20 16:29:44.420870 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.420835 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b5364d44-60be-4948-aeb0-08ee992afa1f-konnectivity-ca\") pod \"konnectivity-agent-mzzz4\" (UID: \"b5364d44-60be-4948-aeb0-08ee992afa1f\") " pod="kube-system/konnectivity-agent-mzzz4" Jul 20 16:29:44.420870 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.420862 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d771112b-c7d6-4ee2-84a3-567150c4407a-original-pull-secret\") pod \"global-pull-secret-syncer-fjgcb\" (UID: \"d771112b-c7d6-4ee2-84a3-567150c4407a\") " pod="kube-system/global-pull-secret-syncer-fjgcb" Jul 20 16:29:44.421227 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.420887 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d771112b-c7d6-4ee2-84a3-567150c4407a-kubelet-config\") pod \"global-pull-secret-syncer-fjgcb\" (UID: \"d771112b-c7d6-4ee2-84a3-567150c4407a\") " pod="kube-system/global-pull-secret-syncer-fjgcb" Jul 20 16:29:44.421227 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.420924 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jttrn\" (UniqueName: \"kubernetes.io/projected/623fa3c9-f7b4-4949-9122-d9f5a5207853-kube-api-access-jttrn\") pod \"network-metrics-daemon-f5cnm\" (UID: \"623fa3c9-f7b4-4949-9122-d9f5a5207853\") " pod="openshift-multus/network-metrics-daemon-f5cnm" Jul 20 16:29:44.421227 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.420967 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/623fa3c9-f7b4-4949-9122-d9f5a5207853-metrics-certs\") pod \"network-metrics-daemon-f5cnm\" (UID: \"623fa3c9-f7b4-4949-9122-d9f5a5207853\") " pod="openshift-multus/network-metrics-daemon-f5cnm" Jul 20 16:29:44.421227 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.420999 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d771112b-c7d6-4ee2-84a3-567150c4407a-dbus\") pod \"global-pull-secret-syncer-fjgcb\" (UID: \"d771112b-c7d6-4ee2-84a3-567150c4407a\") " pod="kube-system/global-pull-secret-syncer-fjgcb" Jul 20 16:29:44.421227 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.421021 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2d54e31a-0d64-4914-9613-ffc1e50ea9e1-hosts-file\") pod \"node-resolver-v4zb9\" (UID: \"2d54e31a-0d64-4914-9613-ffc1e50ea9e1\") " pod="openshift-dns/node-resolver-v4zb9" Jul 20 16:29:44.421227 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.421099 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2d54e31a-0d64-4914-9613-ffc1e50ea9e1-hosts-file\") pod \"node-resolver-v4zb9\" (UID: \"2d54e31a-0d64-4914-9613-ffc1e50ea9e1\") " pod="openshift-dns/node-resolver-v4zb9" Jul 20 16:29:44.421227 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.421183 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d54e31a-0d64-4914-9613-ffc1e50ea9e1-tmp-dir\") pod \"node-resolver-v4zb9\" (UID: \"2d54e31a-0d64-4914-9613-ffc1e50ea9e1\") " pod="openshift-dns/node-resolver-v4zb9" Jul 20 16:29:44.421227 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:44.421200 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 16:29:44.421592 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.421250 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d771112b-c7d6-4ee2-84a3-567150c4407a-kubelet-config\") pod \"global-pull-secret-syncer-fjgcb\" (UID: \"d771112b-c7d6-4ee2-84a3-567150c4407a\") " pod="kube-system/global-pull-secret-syncer-fjgcb" Jul 20 16:29:44.421592 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:44.421281 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d771112b-c7d6-4ee2-84a3-567150c4407a-original-pull-secret podName:d771112b-c7d6-4ee2-84a3-567150c4407a nodeName:}" failed. No retries permitted until 2026-07-20 16:29:44.921261297 +0000 UTC m=+3.071062068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d771112b-c7d6-4ee2-84a3-567150c4407a-original-pull-secret") pod "global-pull-secret-syncer-fjgcb" (UID: "d771112b-c7d6-4ee2-84a3-567150c4407a") : object "kube-system"/"original-pull-secret" not registered Jul 20 16:29:44.421592 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.421309 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d771112b-c7d6-4ee2-84a3-567150c4407a-dbus\") pod \"global-pull-secret-syncer-fjgcb\" (UID: \"d771112b-c7d6-4ee2-84a3-567150c4407a\") " pod="kube-system/global-pull-secret-syncer-fjgcb" Jul 20 16:29:44.421592 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:44.421322 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:29:44.421592 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.421386 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d139ce10-11a1-4353-90e1-b3a3008f6959-host\") pod \"node-ca-zh5ql\" (UID: \"d139ce10-11a1-4353-90e1-b3a3008f6959\") " pod="openshift-image-registry/node-ca-zh5ql" Jul 20 16:29:44.421592 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:44.421393 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/623fa3c9-f7b4-4949-9122-d9f5a5207853-metrics-certs podName:623fa3c9-f7b4-4949-9122-d9f5a5207853 nodeName:}" failed. No retries permitted until 2026-07-20 16:29:44.92137858 +0000 UTC m=+3.071179345 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/623fa3c9-f7b4-4949-9122-d9f5a5207853-metrics-certs") pod "network-metrics-daemon-f5cnm" (UID: "623fa3c9-f7b4-4949-9122-d9f5a5207853") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:29:44.421592 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.421491 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d139ce10-11a1-4353-90e1-b3a3008f6959-serviceca\") pod \"node-ca-zh5ql\" (UID: \"d139ce10-11a1-4353-90e1-b3a3008f6959\") " pod="openshift-image-registry/node-ca-zh5ql" Jul 20 16:29:44.421592 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.421551 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b5364d44-60be-4948-aeb0-08ee992afa1f-konnectivity-ca\") pod \"konnectivity-agent-mzzz4\" (UID: \"b5364d44-60be-4948-aeb0-08ee992afa1f\") " pod="kube-system/konnectivity-agent-mzzz4" Jul 20 16:29:44.423466 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.423443 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b5364d44-60be-4948-aeb0-08ee992afa1f-agent-certs\") pod \"konnectivity-agent-mzzz4\" (UID: \"b5364d44-60be-4948-aeb0-08ee992afa1f\") " pod="kube-system/konnectivity-agent-mzzz4" Jul 20 16:29:44.431659 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.431609 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nxlt\" (UniqueName: \"kubernetes.io/projected/d139ce10-11a1-4353-90e1-b3a3008f6959-kube-api-access-7nxlt\") pod \"node-ca-zh5ql\" (UID: \"d139ce10-11a1-4353-90e1-b3a3008f6959\") " pod="openshift-image-registry/node-ca-zh5ql" Jul 20 16:29:44.431951 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.431931 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6rz9\" (UniqueName: \"kubernetes.io/projected/2d54e31a-0d64-4914-9613-ffc1e50ea9e1-kube-api-access-r6rz9\") pod \"node-resolver-v4zb9\" (UID: \"2d54e31a-0d64-4914-9613-ffc1e50ea9e1\") " pod="openshift-dns/node-resolver-v4zb9" Jul 20 16:29:44.432527 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.432509 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jttrn\" (UniqueName: \"kubernetes.io/projected/623fa3c9-f7b4-4949-9122-d9f5a5207853-kube-api-access-jttrn\") pod \"network-metrics-daemon-f5cnm\" (UID: \"623fa3c9-f7b4-4949-9122-d9f5a5207853\") " pod="openshift-multus/network-metrics-daemon-f5cnm" Jul 20 16:29:44.469616 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.469587 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 16:29:44.495575 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.495545 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" Jul 20 16:29:44.504119 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.504085 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhmw4" Jul 20 16:29:44.522791 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.522755 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mqmng" Jul 20 16:29:44.528488 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.528470 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mzzz4" Jul 20 16:29:44.536064 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.536046 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gdmwn" Jul 20 16:29:44.543651 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.543628 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rdkmf" Jul 20 16:29:44.551249 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.551233 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:29:44.559722 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.559705 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v4zb9" Jul 20 16:29:44.564136 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.564120 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zh5ql" Jul 20 16:29:44.683489 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.683413 2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 16:29:44.924565 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.924535 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d771112b-c7d6-4ee2-84a3-567150c4407a-original-pull-secret\") pod \"global-pull-secret-syncer-fjgcb\" (UID: \"d771112b-c7d6-4ee2-84a3-567150c4407a\") " pod="kube-system/global-pull-secret-syncer-fjgcb" Jul 20 16:29:44.924722 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.924580 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/623fa3c9-f7b4-4949-9122-d9f5a5207853-metrics-certs\") pod \"network-metrics-daemon-f5cnm\" (UID: \"623fa3c9-f7b4-4949-9122-d9f5a5207853\") " pod="openshift-multus/network-metrics-daemon-f5cnm" Jul 20 16:29:44.924722 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:44.924618 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf2tm\" (UniqueName: \"kubernetes.io/projected/c6d194b8-0b62-40d1-97bc-c4b775b7ac9f-kube-api-access-pf2tm\") pod \"network-check-target-wfzmp\" (UID: \"c6d194b8-0b62-40d1-97bc-c4b775b7ac9f\") " pod="openshift-network-diagnostics/network-check-target-wfzmp" Jul 20 16:29:44.924722 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:44.924704 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 16:29:44.924899 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:44.924763 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d771112b-c7d6-4ee2-84a3-567150c4407a-original-pull-secret podName:d771112b-c7d6-4ee2-84a3-567150c4407a nodeName:}" failed. No retries permitted until 2026-07-20 16:29:45.924746763 +0000 UTC m=+4.074547517 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d771112b-c7d6-4ee2-84a3-567150c4407a-original-pull-secret") pod "global-pull-secret-syncer-fjgcb" (UID: "d771112b-c7d6-4ee2-84a3-567150c4407a") : object "kube-system"/"original-pull-secret" not registered Jul 20 16:29:44.924899 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:44.924711 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:29:44.924899 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:44.924831 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 16:29:44.924899 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:44.924849 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 16:29:44.924899 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:44.924861 2583 projected.go:196] Error preparing data for projected volume kube-api-access-pf2tm for pod openshift-network-diagnostics/network-check-target-wfzmp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:29:44.924899 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:44.924897 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/623fa3c9-f7b4-4949-9122-d9f5a5207853-metrics-certs podName:623fa3c9-f7b4-4949-9122-d9f5a5207853 nodeName:}" failed. No retries permitted until 2026-07-20 16:29:45.924872395 +0000 UTC m=+4.074673163 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/623fa3c9-f7b4-4949-9122-d9f5a5207853-metrics-certs") pod "network-metrics-daemon-f5cnm" (UID: "623fa3c9-f7b4-4949-9122-d9f5a5207853") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:29:44.925198 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:44.924920 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6d194b8-0b62-40d1-97bc-c4b775b7ac9f-kube-api-access-pf2tm podName:c6d194b8-0b62-40d1-97bc-c4b775b7ac9f nodeName:}" failed. No retries permitted until 2026-07-20 16:29:45.924908388 +0000 UTC m=+4.074709149 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pf2tm" (UniqueName: "kubernetes.io/projected/c6d194b8-0b62-40d1-97bc-c4b775b7ac9f-kube-api-access-pf2tm") pod "network-check-target-wfzmp" (UID: "c6d194b8-0b62-40d1-97bc-c4b775b7ac9f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:29:45.246690 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:45.246656 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 16:24:44 +0000 UTC" deadline="2028-03-27 10:41:19.08358776 +0000 UTC" Jul 20 16:29:45.246690 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:45.246685 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14778h11m33.836906612s" Jul 20 16:29:45.286199 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:45.286135 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33f884fa_086f_4493_b827_0b4b44423556.slice/crio-f65549d1ffa289d6c0496de5dbbb88eafaa50bd823c397f24b63754e293a4002 WatchSource:0}: Error finding container f65549d1ffa289d6c0496de5dbbb88eafaa50bd823c397f24b63754e293a4002: Status 404 returned error can't find the container with id f65549d1ffa289d6c0496de5dbbb88eafaa50bd823c397f24b63754e293a4002 Jul 20 16:29:45.289270 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:45.289250 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc8db184_def3_4066_8d3e_a7206b10506f.slice/crio-76f97f04f6078d806a19206f0455f530f6e4cbe2374e3b2f2be461abdaba7343 WatchSource:0}: Error finding container 76f97f04f6078d806a19206f0455f530f6e4cbe2374e3b2f2be461abdaba7343: Status 404 returned error can't find the container with id 76f97f04f6078d806a19206f0455f530f6e4cbe2374e3b2f2be461abdaba7343 Jul 20 16:29:45.290246 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:45.290219 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd139ce10_11a1_4353_90e1_b3a3008f6959.slice/crio-93451c85544540ad2f9b3f640b54c2afdbca56d6bd5af869d886c82226ad04f3 WatchSource:0}: Error finding container 93451c85544540ad2f9b3f640b54c2afdbca56d6bd5af869d886c82226ad04f3: Status 404 returned error can't find the container with id 93451c85544540ad2f9b3f640b54c2afdbca56d6bd5af869d886c82226ad04f3 Jul 20 16:29:45.291336 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:45.290973 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod538fa124_71ba_465b_9224_0b16af61a57a.slice/crio-a86257d94984e0fc3c99bf08f9642b3f9a056fd51943b0845fc556548e942b0b WatchSource:0}: Error finding container a86257d94984e0fc3c99bf08f9642b3f9a056fd51943b0845fc556548e942b0b: Status 404 returned error can't find the container with id a86257d94984e0fc3c99bf08f9642b3f9a056fd51943b0845fc556548e942b0b Jul 20 16:29:45.291854 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:45.291827 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5364d44_60be_4948_aeb0_08ee992afa1f.slice/crio-1d1edba8707af7335157da08715e2df200e300099ab966e6c1c5932a8127b975 WatchSource:0}: Error finding container 1d1edba8707af7335157da08715e2df200e300099ab966e6c1c5932a8127b975: Status 404 returned error can't find the container with id 1d1edba8707af7335157da08715e2df200e300099ab966e6c1c5932a8127b975 Jul 20 16:29:45.293044 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:45.292977 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f44aed5_7d46_4dbc_bd2a_d3ba30f773c5.slice/crio-abde25ed2b66c5c20733274b06afb064a20e10e1ab71af70e9df135b3e0c0eeb WatchSource:0}: Error finding container abde25ed2b66c5c20733274b06afb064a20e10e1ab71af70e9df135b3e0c0eeb: Status 404 returned error can't find the container with id abde25ed2b66c5c20733274b06afb064a20e10e1ab71af70e9df135b3e0c0eeb Jul 20 16:29:45.297877 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:29:45.297854 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a9effbe_fcf0_4fea_8a36_ca9c0d4b86cb.slice/crio-a0d2472bc22fc22519055ad20192e9697b7f4ed623244b0e2351e4d05eff9252 WatchSource:0}: Error finding container a0d2472bc22fc22519055ad20192e9697b7f4ed623244b0e2351e4d05eff9252: Status 404 returned error can't find the container with id a0d2472bc22fc22519055ad20192e9697b7f4ed623244b0e2351e4d05eff9252 Jul 20 16:29:45.328646 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:45.328610 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjgcb" Jul 20 16:29:45.328755 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:45.328735 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjgcb" podUID="d771112b-c7d6-4ee2-84a3-567150c4407a" Jul 20 16:29:45.342248 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:45.342223 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mqmng" event={"ID":"9a9effbe-fcf0-4fea-8a36-ca9c0d4b86cb","Type":"ContainerStarted","Data":"a0d2472bc22fc22519055ad20192e9697b7f4ed623244b0e2351e4d05eff9252"} Jul 20 16:29:45.343641 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:45.343622 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" event={"ID":"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5","Type":"ContainerStarted","Data":"abde25ed2b66c5c20733274b06afb064a20e10e1ab71af70e9df135b3e0c0eeb"} Jul 20 16:29:45.344662 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:45.344642 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mzzz4" event={"ID":"b5364d44-60be-4948-aeb0-08ee992afa1f","Type":"ContainerStarted","Data":"1d1edba8707af7335157da08715e2df200e300099ab966e6c1c5932a8127b975"} Jul 20 16:29:45.345675 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:45.345654 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zh5ql" event={"ID":"d139ce10-11a1-4353-90e1-b3a3008f6959","Type":"ContainerStarted","Data":"93451c85544540ad2f9b3f640b54c2afdbca56d6bd5af869d886c82226ad04f3"} Jul 20 16:29:45.346865 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:45.346844 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhmw4" event={"ID":"33f884fa-086f-4493-b827-0b4b44423556","Type":"ContainerStarted","Data":"f65549d1ffa289d6c0496de5dbbb88eafaa50bd823c397f24b63754e293a4002"} Jul 20 16:29:45.348053 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:45.347995 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" event={"ID":"454e8e7a-6607-4e03-bf2b-7e806bb6324a","Type":"ContainerStarted","Data":"b52ec344dcf6e5697550a52796b449187e730b8c4e977a95ed1f2322bb9db73f"} Jul 20 16:29:45.349059 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:45.349041 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v4zb9" event={"ID":"2d54e31a-0d64-4914-9613-ffc1e50ea9e1","Type":"ContainerStarted","Data":"9df52e0ed35255f461fef785442a744e24563baf79787667b6bbe5348c8b9676"} Jul 20 16:29:45.350138 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:45.350117 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rdkmf" event={"ID":"538fa124-71ba-465b-9224-0b16af61a57a","Type":"ContainerStarted","Data":"a86257d94984e0fc3c99bf08f9642b3f9a056fd51943b0845fc556548e942b0b"} Jul 20 16:29:45.351203 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:45.351187 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gdmwn" event={"ID":"bc8db184-def3-4066-8d3e-a7206b10506f","Type":"ContainerStarted","Data":"76f97f04f6078d806a19206f0455f530f6e4cbe2374e3b2f2be461abdaba7343"} Jul 20 16:29:45.933326 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:45.933073 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/623fa3c9-f7b4-4949-9122-d9f5a5207853-metrics-certs\") pod \"network-metrics-daemon-f5cnm\" (UID: \"623fa3c9-f7b4-4949-9122-d9f5a5207853\") " pod="openshift-multus/network-metrics-daemon-f5cnm" Jul 20 16:29:45.933502 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:45.933348 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:29:45.933502 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:45.933370 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf2tm\" (UniqueName: \"kubernetes.io/projected/c6d194b8-0b62-40d1-97bc-c4b775b7ac9f-kube-api-access-pf2tm\") pod \"network-check-target-wfzmp\" (UID: \"c6d194b8-0b62-40d1-97bc-c4b775b7ac9f\") " pod="openshift-network-diagnostics/network-check-target-wfzmp" Jul 20 16:29:45.933502 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:45.933428 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/623fa3c9-f7b4-4949-9122-d9f5a5207853-metrics-certs podName:623fa3c9-f7b4-4949-9122-d9f5a5207853 nodeName:}" failed. No retries permitted until 2026-07-20 16:29:47.933405072 +0000 UTC m=+6.083205841 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/623fa3c9-f7b4-4949-9122-d9f5a5207853-metrics-certs") pod "network-metrics-daemon-f5cnm" (UID: "623fa3c9-f7b4-4949-9122-d9f5a5207853") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:29:45.933682 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:45.933501 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d771112b-c7d6-4ee2-84a3-567150c4407a-original-pull-secret\") pod \"global-pull-secret-syncer-fjgcb\" (UID: \"d771112b-c7d6-4ee2-84a3-567150c4407a\") " pod="kube-system/global-pull-secret-syncer-fjgcb" Jul 20 16:29:45.933682 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:45.933506 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 16:29:45.933682 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:45.933569 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 16:29:45.933682 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:45.933582 2583 projected.go:196] Error preparing data for projected volume kube-api-access-pf2tm for pod openshift-network-diagnostics/network-check-target-wfzmp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:29:45.933682 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:45.933631 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6d194b8-0b62-40d1-97bc-c4b775b7ac9f-kube-api-access-pf2tm podName:c6d194b8-0b62-40d1-97bc-c4b775b7ac9f nodeName:}" failed. No retries permitted until 2026-07-20 16:29:47.933617429 +0000 UTC m=+6.083418186 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pf2tm" (UniqueName: "kubernetes.io/projected/c6d194b8-0b62-40d1-97bc-c4b775b7ac9f-kube-api-access-pf2tm") pod "network-check-target-wfzmp" (UID: "c6d194b8-0b62-40d1-97bc-c4b775b7ac9f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:29:45.933941 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:45.933692 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 16:29:45.933941 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:45.933722 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d771112b-c7d6-4ee2-84a3-567150c4407a-original-pull-secret podName:d771112b-c7d6-4ee2-84a3-567150c4407a nodeName:}" failed. No retries permitted until 2026-07-20 16:29:47.93371206 +0000 UTC m=+6.083512821 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d771112b-c7d6-4ee2-84a3-567150c4407a-original-pull-secret") pod "global-pull-secret-syncer-fjgcb" (UID: "d771112b-c7d6-4ee2-84a3-567150c4407a") : object "kube-system"/"original-pull-secret" not registered Jul 20 16:29:46.247687 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:46.247576 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 16:24:44 +0000 UTC" deadline="2028-02-15 23:42:04.44026644 +0000 UTC" Jul 20 16:29:46.247687 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:46.247637 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13807h12m18.192633501s" Jul 20 16:29:46.329261 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:46.329227 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5cnm" Jul 20 16:29:46.329439 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:46.329372 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5cnm" podUID="623fa3c9-f7b4-4949-9122-d9f5a5207853" Jul 20 16:29:46.329721 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:46.329241 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfzmp" Jul 20 16:29:46.329822 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:46.329801 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfzmp" podUID="c6d194b8-0b62-40d1-97bc-c4b775b7ac9f" Jul 20 16:29:46.367870 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:46.367837 2583 generic.go:356] "Generic (PLEG): container finished" podID="509de8619b3244aa78d17f1b84e02a27" containerID="26d790f32a6cc3ff5f77c8f0f0e14f213d7aa573d93b2833dace75bcc99eb667" exitCode=0 Jul 20 16:29:46.368046 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:46.367935 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-209.ec2.internal" event={"ID":"509de8619b3244aa78d17f1b84e02a27","Type":"ContainerDied","Data":"26d790f32a6cc3ff5f77c8f0f0e14f213d7aa573d93b2833dace75bcc99eb667"} Jul 20 16:29:46.383753 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:46.383715 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-209.ec2.internal" event={"ID":"7f834a056acbe47737d34ff21bd03fbb","Type":"ContainerStarted","Data":"4d99bafd395855f31da7d36f60798a45a00bb39dd9df7fdcd9426a92ed9e8105"} Jul 20 16:29:46.401221 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:46.401169 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-209.ec2.internal" podStartSLOduration=3.401149372 podStartE2EDuration="3.401149372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:29:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:29:46.400162895 +0000 UTC m=+4.549963695" watchObservedRunningTime="2026-07-20 16:29:46.401149372 +0000 UTC m=+4.550950149" Jul 20 16:29:47.328859 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:47.328828 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjgcb" Jul 20 16:29:47.329323 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:47.328957 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjgcb" podUID="d771112b-c7d6-4ee2-84a3-567150c4407a" Jul 20 16:29:47.410637 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:47.410555 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-209.ec2.internal" event={"ID":"509de8619b3244aa78d17f1b84e02a27","Type":"ContainerStarted","Data":"fe5c9d62e72fa612d55bc12c17226ebbb53870c4b0a57225c249241bd3894c06"} Jul 20 16:29:47.954617 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:47.953617 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf2tm\" (UniqueName: \"kubernetes.io/projected/c6d194b8-0b62-40d1-97bc-c4b775b7ac9f-kube-api-access-pf2tm\") pod \"network-check-target-wfzmp\" (UID: \"c6d194b8-0b62-40d1-97bc-c4b775b7ac9f\") " pod="openshift-network-diagnostics/network-check-target-wfzmp" Jul 20 16:29:47.954617 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:47.953681 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d771112b-c7d6-4ee2-84a3-567150c4407a-original-pull-secret\") pod \"global-pull-secret-syncer-fjgcb\" (UID: \"d771112b-c7d6-4ee2-84a3-567150c4407a\") " pod="kube-system/global-pull-secret-syncer-fjgcb" Jul 20 16:29:47.954617 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:47.953726 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/623fa3c9-f7b4-4949-9122-d9f5a5207853-metrics-certs\") pod \"network-metrics-daemon-f5cnm\" (UID: \"623fa3c9-f7b4-4949-9122-d9f5a5207853\") " pod="openshift-multus/network-metrics-daemon-f5cnm" Jul 20 16:29:47.954617 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:47.953844 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:29:47.954617 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:47.953907 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/623fa3c9-f7b4-4949-9122-d9f5a5207853-metrics-certs podName:623fa3c9-f7b4-4949-9122-d9f5a5207853 nodeName:}" failed. No retries permitted until 2026-07-20 16:29:51.953886887 +0000 UTC m=+10.103687643 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/623fa3c9-f7b4-4949-9122-d9f5a5207853-metrics-certs") pod "network-metrics-daemon-f5cnm" (UID: "623fa3c9-f7b4-4949-9122-d9f5a5207853") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:29:47.954617 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:47.954339 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 16:29:47.954617 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:47.954361 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 16:29:47.954617 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:47.954374 2583 projected.go:196] Error preparing data for projected volume kube-api-access-pf2tm for pod openshift-network-diagnostics/network-check-target-wfzmp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:29:47.954617 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:47.954418 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6d194b8-0b62-40d1-97bc-c4b775b7ac9f-kube-api-access-pf2tm podName:c6d194b8-0b62-40d1-97bc-c4b775b7ac9f nodeName:}" failed. No retries permitted until 2026-07-20 16:29:51.95440447 +0000 UTC m=+10.104205227 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pf2tm" (UniqueName: "kubernetes.io/projected/c6d194b8-0b62-40d1-97bc-c4b775b7ac9f-kube-api-access-pf2tm") pod "network-check-target-wfzmp" (UID: "c6d194b8-0b62-40d1-97bc-c4b775b7ac9f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:29:47.954617 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:47.954477 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 16:29:47.954617 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:47.954510 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d771112b-c7d6-4ee2-84a3-567150c4407a-original-pull-secret podName:d771112b-c7d6-4ee2-84a3-567150c4407a nodeName:}" failed. No retries permitted until 2026-07-20 16:29:51.954500227 +0000 UTC m=+10.104300983 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d771112b-c7d6-4ee2-84a3-567150c4407a-original-pull-secret") pod "global-pull-secret-syncer-fjgcb" (UID: "d771112b-c7d6-4ee2-84a3-567150c4407a") : object "kube-system"/"original-pull-secret" not registered Jul 20 16:29:48.329881 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:48.329805 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5cnm" Jul 20 16:29:48.330358 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:48.329948 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5cnm" podUID="623fa3c9-f7b4-4949-9122-d9f5a5207853" Jul 20 16:29:48.330358 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:48.330339 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfzmp" Jul 20 16:29:48.330474 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:48.330431 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfzmp" podUID="c6d194b8-0b62-40d1-97bc-c4b775b7ac9f" Jul 20 16:29:49.329748 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:49.329592 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjgcb" Jul 20 16:29:49.329748 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:49.329736 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjgcb" podUID="d771112b-c7d6-4ee2-84a3-567150c4407a" Jul 20 16:29:50.329204 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:50.329172 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfzmp" Jul 20 16:29:50.329377 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:50.329174 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5cnm" Jul 20 16:29:50.329377 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:50.329302 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfzmp" podUID="c6d194b8-0b62-40d1-97bc-c4b775b7ac9f" Jul 20 16:29:50.329486 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:50.329419 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5cnm" podUID="623fa3c9-f7b4-4949-9122-d9f5a5207853" Jul 20 16:29:51.329535 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:51.329502 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjgcb" Jul 20 16:29:51.329996 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:51.329642 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjgcb" podUID="d771112b-c7d6-4ee2-84a3-567150c4407a" Jul 20 16:29:51.992127 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:51.991341 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d771112b-c7d6-4ee2-84a3-567150c4407a-original-pull-secret\") pod \"global-pull-secret-syncer-fjgcb\" (UID: \"d771112b-c7d6-4ee2-84a3-567150c4407a\") " pod="kube-system/global-pull-secret-syncer-fjgcb" Jul 20 16:29:51.992127 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:51.991405 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/623fa3c9-f7b4-4949-9122-d9f5a5207853-metrics-certs\") pod \"network-metrics-daemon-f5cnm\" (UID: \"623fa3c9-f7b4-4949-9122-d9f5a5207853\") " pod="openshift-multus/network-metrics-daemon-f5cnm" Jul 20 16:29:51.992127 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:51.991444 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf2tm\" (UniqueName: \"kubernetes.io/projected/c6d194b8-0b62-40d1-97bc-c4b775b7ac9f-kube-api-access-pf2tm\") pod \"network-check-target-wfzmp\" (UID: \"c6d194b8-0b62-40d1-97bc-c4b775b7ac9f\") " pod="openshift-network-diagnostics/network-check-target-wfzmp" Jul 20 16:29:51.992127 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:51.991588 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 16:29:51.992127 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:51.991605 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 16:29:51.992127 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:51.991617 2583 projected.go:196] Error preparing data for projected volume kube-api-access-pf2tm for pod openshift-network-diagnostics/network-check-target-wfzmp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:29:51.992127 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:51.991675 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6d194b8-0b62-40d1-97bc-c4b775b7ac9f-kube-api-access-pf2tm podName:c6d194b8-0b62-40d1-97bc-c4b775b7ac9f nodeName:}" failed. No retries permitted until 2026-07-20 16:29:59.991655942 +0000 UTC m=+18.141456697 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pf2tm" (UniqueName: "kubernetes.io/projected/c6d194b8-0b62-40d1-97bc-c4b775b7ac9f-kube-api-access-pf2tm") pod "network-check-target-wfzmp" (UID: "c6d194b8-0b62-40d1-97bc-c4b775b7ac9f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:29:51.992127 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:51.992050 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 16:29:51.992127 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:51.992058 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:29:51.992127 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:51.992096 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d771112b-c7d6-4ee2-84a3-567150c4407a-original-pull-secret podName:d771112b-c7d6-4ee2-84a3-567150c4407a nodeName:}" failed. No retries permitted until 2026-07-20 16:29:59.992082658 +0000 UTC m=+18.141883416 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d771112b-c7d6-4ee2-84a3-567150c4407a-original-pull-secret") pod "global-pull-secret-syncer-fjgcb" (UID: "d771112b-c7d6-4ee2-84a3-567150c4407a") : object "kube-system"/"original-pull-secret" not registered Jul 20 16:29:51.992127 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:51.992131 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/623fa3c9-f7b4-4949-9122-d9f5a5207853-metrics-certs podName:623fa3c9-f7b4-4949-9122-d9f5a5207853 nodeName:}" failed. No retries permitted until 2026-07-20 16:29:59.992121401 +0000 UTC m=+18.141922154 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/623fa3c9-f7b4-4949-9122-d9f5a5207853-metrics-certs") pod "network-metrics-daemon-f5cnm" (UID: "623fa3c9-f7b4-4949-9122-d9f5a5207853") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:29:52.330967 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:52.330288 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5cnm" Jul 20 16:29:52.330967 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:52.330439 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5cnm" podUID="623fa3c9-f7b4-4949-9122-d9f5a5207853" Jul 20 16:29:52.330967 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:52.330491 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfzmp" Jul 20 16:29:52.330967 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:52.330556 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfzmp" podUID="c6d194b8-0b62-40d1-97bc-c4b775b7ac9f" Jul 20 16:29:53.329220 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:53.329122 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjgcb" Jul 20 16:29:53.329399 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:53.329256 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjgcb" podUID="d771112b-c7d6-4ee2-84a3-567150c4407a" Jul 20 16:29:54.330122 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:54.329650 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfzmp" Jul 20 16:29:54.330122 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:54.329772 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfzmp" podUID="c6d194b8-0b62-40d1-97bc-c4b775b7ac9f" Jul 20 16:29:54.330122 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:54.329650 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5cnm" Jul 20 16:29:54.330628 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:54.330181 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5cnm" podUID="623fa3c9-f7b4-4949-9122-d9f5a5207853" Jul 20 16:29:55.328561 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:55.328534 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjgcb" Jul 20 16:29:55.328749 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:55.328657 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjgcb" podUID="d771112b-c7d6-4ee2-84a3-567150c4407a" Jul 20 16:29:56.329394 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:56.329320 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfzmp" Jul 20 16:29:56.329788 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:56.329450 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfzmp" podUID="c6d194b8-0b62-40d1-97bc-c4b775b7ac9f" Jul 20 16:29:56.329788 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:56.329543 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5cnm" Jul 20 16:29:56.329788 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:56.329681 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5cnm" podUID="623fa3c9-f7b4-4949-9122-d9f5a5207853" Jul 20 16:29:57.329290 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:57.329253 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjgcb" Jul 20 16:29:57.329479 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:57.329372 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjgcb" podUID="d771112b-c7d6-4ee2-84a3-567150c4407a" Jul 20 16:29:58.329093 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:58.329052 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfzmp" Jul 20 16:29:58.329259 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:58.329198 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfzmp" podUID="c6d194b8-0b62-40d1-97bc-c4b775b7ac9f" Jul 20 16:29:58.329346 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:58.329256 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5cnm" Jul 20 16:29:58.329425 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:58.329394 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5cnm" podUID="623fa3c9-f7b4-4949-9122-d9f5a5207853" Jul 20 16:29:59.328727 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:29:59.328696 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjgcb" Jul 20 16:29:59.329184 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:29:59.328816 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjgcb" podUID="d771112b-c7d6-4ee2-84a3-567150c4407a" Jul 20 16:30:00.055896 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:00.055857 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d771112b-c7d6-4ee2-84a3-567150c4407a-original-pull-secret\") pod \"global-pull-secret-syncer-fjgcb\" (UID: \"d771112b-c7d6-4ee2-84a3-567150c4407a\") " pod="kube-system/global-pull-secret-syncer-fjgcb" Jul 20 16:30:00.055896 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:00.055899 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/623fa3c9-f7b4-4949-9122-d9f5a5207853-metrics-certs\") pod \"network-metrics-daemon-f5cnm\" (UID: \"623fa3c9-f7b4-4949-9122-d9f5a5207853\") " pod="openshift-multus/network-metrics-daemon-f5cnm" Jul 20 16:30:00.056083 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:00.055928 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf2tm\" (UniqueName: \"kubernetes.io/projected/c6d194b8-0b62-40d1-97bc-c4b775b7ac9f-kube-api-access-pf2tm\") pod \"network-check-target-wfzmp\" (UID: \"c6d194b8-0b62-40d1-97bc-c4b775b7ac9f\") " pod="openshift-network-diagnostics/network-check-target-wfzmp" Jul 20 16:30:00.056083 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:00.056007 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 16:30:00.056083 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:00.056025 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:30:00.056083 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:00.056043 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 16:30:00.056083 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:00.056056 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 16:30:00.056083 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:00.056069 2583 projected.go:196] Error preparing data for projected volume kube-api-access-pf2tm for pod openshift-network-diagnostics/network-check-target-wfzmp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:30:00.056083 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:00.056073 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d771112b-c7d6-4ee2-84a3-567150c4407a-original-pull-secret podName:d771112b-c7d6-4ee2-84a3-567150c4407a nodeName:}" failed. No retries permitted until 2026-07-20 16:30:16.056056721 +0000 UTC m=+34.205857492 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d771112b-c7d6-4ee2-84a3-567150c4407a-original-pull-secret") pod "global-pull-secret-syncer-fjgcb" (UID: "d771112b-c7d6-4ee2-84a3-567150c4407a") : object "kube-system"/"original-pull-secret" not registered Jul 20 16:30:00.056324 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:00.056089 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/623fa3c9-f7b4-4949-9122-d9f5a5207853-metrics-certs podName:623fa3c9-f7b4-4949-9122-d9f5a5207853 nodeName:}" failed. No retries permitted until 2026-07-20 16:30:16.056082488 +0000 UTC m=+34.205883243 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/623fa3c9-f7b4-4949-9122-d9f5a5207853-metrics-certs") pod "network-metrics-daemon-f5cnm" (UID: "623fa3c9-f7b4-4949-9122-d9f5a5207853") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:30:00.056324 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:00.056101 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6d194b8-0b62-40d1-97bc-c4b775b7ac9f-kube-api-access-pf2tm podName:c6d194b8-0b62-40d1-97bc-c4b775b7ac9f nodeName:}" failed. No retries permitted until 2026-07-20 16:30:16.056095073 +0000 UTC m=+34.205895826 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pf2tm" (UniqueName: "kubernetes.io/projected/c6d194b8-0b62-40d1-97bc-c4b775b7ac9f-kube-api-access-pf2tm") pod "network-check-target-wfzmp" (UID: "c6d194b8-0b62-40d1-97bc-c4b775b7ac9f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:30:00.328704 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:00.328631 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfzmp" Jul 20 16:30:00.328852 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:00.328760 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfzmp" podUID="c6d194b8-0b62-40d1-97bc-c4b775b7ac9f" Jul 20 16:30:00.328852 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:00.328814 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5cnm" Jul 20 16:30:00.329230 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:00.328929 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5cnm" podUID="623fa3c9-f7b4-4949-9122-d9f5a5207853" Jul 20 16:30:01.328807 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:01.328776 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjgcb" Jul 20 16:30:01.328965 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:01.328906 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjgcb" podUID="d771112b-c7d6-4ee2-84a3-567150c4407a" Jul 20 16:30:02.330364 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:02.330327 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5cnm" Jul 20 16:30:02.330765 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:02.330473 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5cnm" podUID="623fa3c9-f7b4-4949-9122-d9f5a5207853" Jul 20 16:30:02.330765 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:02.330517 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfzmp" Jul 20 16:30:02.330765 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:02.330634 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfzmp" podUID="c6d194b8-0b62-40d1-97bc-c4b775b7ac9f" Jul 20 16:30:03.328912 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:03.328876 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjgcb" Jul 20 16:30:03.329092 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:03.329007 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjgcb" podUID="d771112b-c7d6-4ee2-84a3-567150c4407a" Jul 20 16:30:04.329388 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:04.329122 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5cnm" Jul 20 16:30:04.330043 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:04.329164 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfzmp" Jul 20 16:30:04.330043 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:04.329465 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5cnm" podUID="623fa3c9-f7b4-4949-9122-d9f5a5207853" Jul 20 16:30:04.330043 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:04.329539 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfzmp" podUID="c6d194b8-0b62-40d1-97bc-c4b775b7ac9f" Jul 20 16:30:04.448444 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:04.448414 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" event={"ID":"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5","Type":"ContainerStarted","Data":"87f1e383a914572791818745b016fcf4a929f05dc0ab297e5d5d7676c1afa596"} Jul 20 16:30:04.448533 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:04.448492 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" event={"ID":"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5","Type":"ContainerStarted","Data":"63439220d5c3e5042479c08090b502ae2833b8de805f9a951a6e8634f583e9ae"} Jul 20 16:30:04.448572 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:04.448538 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" event={"ID":"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5","Type":"ContainerStarted","Data":"03f71a51d5edd24375506195fcf2f1e7f5bf882140caeeb38c9371234ff371a3"} Jul 20 16:30:04.449735 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:04.449713 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mzzz4" event={"ID":"b5364d44-60be-4948-aeb0-08ee992afa1f","Type":"ContainerStarted","Data":"9019923e8bfc8b72e405c319c454d77bf442b75b5bbcc9a39aeaacd42a5f7656"} Jul 20 16:30:04.451033 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:04.450999 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zh5ql" event={"ID":"d139ce10-11a1-4353-90e1-b3a3008f6959","Type":"ContainerStarted","Data":"ee70b64403dcb5b3ccbffe0d6591f16a307cb808bc5c8f9475466e60c726c341"} Jul 20 16:30:04.452359 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:04.452342 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhmw4" event={"ID":"33f884fa-086f-4493-b827-0b4b44423556","Type":"ContainerStarted","Data":"fc1d86761355d4ecf43fd92a76c3fb9bfd4bc74ea93f4b0f9d8d6daff860b338"} Jul 20 16:30:04.453677 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:04.453658 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" event={"ID":"454e8e7a-6607-4e03-bf2b-7e806bb6324a","Type":"ContainerStarted","Data":"86535f66d091afada4b74c95324780b4cba76e886d1731fb104d311758944c11"} Jul 20 16:30:04.454956 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:04.454938 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v4zb9" event={"ID":"2d54e31a-0d64-4914-9613-ffc1e50ea9e1","Type":"ContainerStarted","Data":"48ab9d2e97dd10d0bfee85b09f85b1fb6fa7ee361f6802dc49d11926f1715a6d"} Jul 20 16:30:04.456275 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:04.456255 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rdkmf" event={"ID":"538fa124-71ba-465b-9224-0b16af61a57a","Type":"ContainerStarted","Data":"d2a9bef88cc9bb65cb44a86762632854a529e18a0f6eb509473aac510662b3c4"} Jul 20 16:30:04.457777 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:04.457758 2583 generic.go:356] "Generic (PLEG): container finished" podID="bc8db184-def3-4066-8d3e-a7206b10506f" containerID="22209d736fe61acfa6503fce2b455c2d0d5b540568d18242d6c2b7b37b098a04" exitCode=0 Jul 20 16:30:04.457861 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:04.457788 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gdmwn" event={"ID":"bc8db184-def3-4066-8d3e-a7206b10506f","Type":"ContainerDied","Data":"22209d736fe61acfa6503fce2b455c2d0d5b540568d18242d6c2b7b37b098a04"} Jul 20 16:30:04.467155 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:04.467079 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mzzz4" podStartSLOduration=3.900048823 podStartE2EDuration="22.467068232s" totalImagesPullingTime="18.567019409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:30:04.466182394 +0000 UTC m=+22.615983189" watchObservedRunningTime="2026-07-20 16:30:04.467068232 +0000 UTC m=+22.616869008" Jul 20 16:30:04.467293 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:04.467271 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-209.ec2.internal" podStartSLOduration=21.467264965 podStartE2EDuration="21.467264965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:29:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:29:47.425386173 +0000 UTC m=+5.575186950" watchObservedRunningTime="2026-07-20 16:30:04.467264965 +0000 UTC m=+22.617065779" Jul 20 16:30:04.483422 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:04.483389 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nbl8g" podStartSLOduration=3.845997071 podStartE2EDuration="22.483378391s" totalImagesPullingTime="18.63738132s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:30:04.483177287 +0000 UTC m=+22.632978070" watchObservedRunningTime="2026-07-20 16:30:04.483378391 +0000 UTC m=+22.633179205" Jul 20 16:30:04.524045 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:04.524008 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zh5ql" podStartSLOduration=3.9120907860000003 podStartE2EDuration="22.523997554s" totalImagesPullingTime="18.611906768s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:30:04.50025121 +0000 UTC m=+22.650052005" watchObservedRunningTime="2026-07-20 16:30:04.523997554 +0000 UTC m=+22.673798333" Jul 20 16:30:04.546596 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:04.546562 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rdkmf" podStartSLOduration=3.862299677 podStartE2EDuration="22.546551835s" totalImagesPullingTime="18.684252158s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:30:04.546265047 +0000 UTC m=+22.696065823" watchObservedRunningTime="2026-07-20 16:30:04.546551835 +0000 UTC m=+22.696352611" Jul 20 16:30:04.560492 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:04.560459 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-v4zb9" podStartSLOduration=3.940455999 podStartE2EDuration="22.560450235s" totalImagesPullingTime="18.619994236s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:30:04.560249018 +0000 UTC m=+22.710049804" watchObservedRunningTime="2026-07-20 16:30:04.560450235 +0000 UTC m=+22.710251011" Jul 20 16:30:05.329277 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:05.329156 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjgcb" Jul 20 16:30:05.329431 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:05.329373 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjgcb" podUID="d771112b-c7d6-4ee2-84a3-567150c4407a" Jul 20 16:30:05.379190 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:05.379166 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mzzz4" Jul 20 16:30:05.379829 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:05.379803 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mzzz4" Jul 20 16:30:05.461429 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:05.461397 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mqmng" event={"ID":"9a9effbe-fcf0-4fea-8a36-ca9c0d4b86cb","Type":"ContainerStarted","Data":"32a2baa00ad80a0229b170238772bc4cb2a7dcb8fbdfd9f0fa14ae32e6cec228"} Jul 20 16:30:05.464248 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:05.464223 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" event={"ID":"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5","Type":"ContainerStarted","Data":"c1719a6e553b6c9a2663b7781aa1cab837bd0dda3cedafda77f29fc6422da8c9"} Jul 20 16:30:05.464356 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:05.464278 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" event={"ID":"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5","Type":"ContainerStarted","Data":"f1779aefb0db3b8f62e5b0f7472df3c17377bbf20111f93f3eba302dc62d414d"} Jul 20 16:30:05.464356 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:05.464307 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" event={"ID":"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5","Type":"ContainerStarted","Data":"b83c207dcb6e0e72f9f8a6ff8eab9e2bf55fc74d9f86b4c50c888138ca8cf80a"} Jul 20 16:30:05.464841 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:05.464819 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mzzz4" Jul 20 16:30:05.465192 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:05.465177 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mzzz4" Jul 20 16:30:05.474787 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:05.474743 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mqmng" podStartSLOduration=4.857178663 podStartE2EDuration="23.47473093s" totalImagesPullingTime="18.617552267s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:30:05.47439203 +0000 UTC m=+23.624192824" watchObservedRunningTime="2026-07-20 16:30:05.47473093 +0000 UTC m=+23.624531706" Jul 20 16:30:05.716405 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:05.716372 2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 20 16:30:06.278753 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:06.278640 2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T16:30:05.71638972Z","UUID":"9728610e-9507-4ccf-982b-df203e6dc08d","Handler":null,"Name":"","Endpoint":""} Jul 20 16:30:06.280437 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:06.280413 2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 20 16:30:06.280571 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:06.280454 2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 20 16:30:06.329034 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:06.329007 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfzmp" Jul 20 16:30:06.329204 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:06.329141 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfzmp" podUID="c6d194b8-0b62-40d1-97bc-c4b775b7ac9f" Jul 20 16:30:06.329512 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:06.329493 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5cnm" Jul 20 16:30:06.329859 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:06.329582 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5cnm" podUID="623fa3c9-f7b4-4949-9122-d9f5a5207853" Jul 20 16:30:06.469390 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:06.469327 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhmw4" event={"ID":"33f884fa-086f-4493-b827-0b4b44423556","Type":"ContainerStarted","Data":"467be09fa8e23d0780cb71a70c4ff42cc981ae4b8bf493d041133723080bb84a"} Jul 20 16:30:07.329284 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:07.329006 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjgcb" Jul 20 16:30:07.329451 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:07.329356 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjgcb" podUID="d771112b-c7d6-4ee2-84a3-567150c4407a" Jul 20 16:30:07.474395 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:07.474351 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhmw4" event={"ID":"33f884fa-086f-4493-b827-0b4b44423556","Type":"ContainerStarted","Data":"125855606e91a591d8eabd5d17614733187870205af8d98af95f095210f94c42"} Jul 20 16:30:07.478245 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:07.478214 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" event={"ID":"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5","Type":"ContainerStarted","Data":"ff3c4ea99dc807605bc60e412b3a6bdffd589fe3c88a3375676ceeb6810afd2e"} Jul 20 16:30:07.491703 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:07.491659 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhmw4" podStartSLOduration=4.164556819 podStartE2EDuration="25.491644708s" totalImagesPullingTime="21.327087889s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:29:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:30:07.49094921 +0000 UTC m=+25.640749987" watchObservedRunningTime="2026-07-20 16:30:07.491644708 +0000 UTC m=+25.641445485" Jul 20 16:30:08.328853 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:08.328820 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfzmp" Jul 20 16:30:08.329085 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:08.328820 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5cnm" Jul 20 16:30:08.329085 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:08.328941 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfzmp" podUID="c6d194b8-0b62-40d1-97bc-c4b775b7ac9f" Jul 20 16:30:08.329085 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:08.329047 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5cnm" podUID="623fa3c9-f7b4-4949-9122-d9f5a5207853" Jul 20 16:30:09.329200 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:09.329168 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjgcb" Jul 20 16:30:09.329678 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:09.329272 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjgcb" podUID="d771112b-c7d6-4ee2-84a3-567150c4407a" Jul 20 16:30:10.329554 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:10.329386 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfzmp" Jul 20 16:30:10.330033 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:10.329446 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5cnm" Jul 20 16:30:10.330033 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:10.329626 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfzmp" podUID="c6d194b8-0b62-40d1-97bc-c4b775b7ac9f" Jul 20 16:30:10.330033 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:10.329693 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5cnm" podUID="623fa3c9-f7b4-4949-9122-d9f5a5207853" Jul 20 16:30:10.488101 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:10.488070 2583 generic.go:356] "Generic (PLEG): container finished" podID="bc8db184-def3-4066-8d3e-a7206b10506f" containerID="360984bbcec22c679e4a23b2a1c9d798744053feae0cc4b816f28ca4fb987a26" exitCode=0 Jul 20 16:30:10.488281 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:10.488134 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gdmwn" event={"ID":"bc8db184-def3-4066-8d3e-a7206b10506f","Type":"ContainerDied","Data":"360984bbcec22c679e4a23b2a1c9d798744053feae0cc4b816f28ca4fb987a26"} Jul 20 16:30:10.491988 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:10.491968 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" event={"ID":"8f44aed5-7d46-4dbc-bd2a-d3ba30f773c5","Type":"ContainerStarted","Data":"1b49192b5ccae5d7be3b72a5d14eb07fe86507f47c9045328c95a300368a172c"} Jul 20 16:30:10.492216 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:10.492205 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:30:10.492266 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:10.492245 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:30:10.506839 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:10.506822 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:30:10.583577 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:10.583541 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" podStartSLOduration=9.901150132 podStartE2EDuration="28.583529952s" totalImagesPullingTime="18.68237982s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:30:10.583219687 +0000 UTC m=+28.733020463" watchObservedRunningTime="2026-07-20 16:30:10.583529952 +0000 UTC m=+28.733330727" Jul 20 16:30:11.329454 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:11.329426 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjgcb" Jul 20 16:30:11.329611 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:11.329526 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjgcb" podUID="d771112b-c7d6-4ee2-84a3-567150c4407a" Jul 20 16:30:11.495245 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:11.495218 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:30:11.510553 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:11.510531 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:30:11.734208 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:11.734065 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fjgcb"] Jul 20 16:30:11.734301 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:11.734283 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjgcb" Jul 20 16:30:11.734390 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:11.734371 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjgcb" podUID="d771112b-c7d6-4ee2-84a3-567150c4407a" Jul 20 16:30:11.737575 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:11.737553 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wfzmp"] Jul 20 16:30:11.737661 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:11.737644 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfzmp" Jul 20 16:30:11.737754 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:11.737734 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfzmp" podUID="c6d194b8-0b62-40d1-97bc-c4b775b7ac9f" Jul 20 16:30:11.738238 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:11.738215 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f5cnm"] Jul 20 16:30:11.738340 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:11.738318 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5cnm" Jul 20 16:30:11.738441 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:11.738417 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5cnm" podUID="623fa3c9-f7b4-4949-9122-d9f5a5207853" Jul 20 16:30:12.498567 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:12.498534 2583 generic.go:356] "Generic (PLEG): container finished" podID="bc8db184-def3-4066-8d3e-a7206b10506f" containerID="6e319382f8c75c9cf2df1d39703b41d65f657b4eab0f7720cf1a29195c26c3bb" exitCode=0 Jul 20 16:30:12.499038 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:12.498616 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gdmwn" event={"ID":"bc8db184-def3-4066-8d3e-a7206b10506f","Type":"ContainerDied","Data":"6e319382f8c75c9cf2df1d39703b41d65f657b4eab0f7720cf1a29195c26c3bb"} Jul 20 16:30:13.328782 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:13.328755 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5cnm" Jul 20 16:30:13.328782 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:13.328778 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjgcb" Jul 20 16:30:13.328978 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:13.328884 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5cnm" podUID="623fa3c9-f7b4-4949-9122-d9f5a5207853" Jul 20 16:30:13.328978 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:13.328960 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjgcb" podUID="d771112b-c7d6-4ee2-84a3-567150c4407a" Jul 20 16:30:13.329096 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:13.328990 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfzmp" Jul 20 16:30:13.329168 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:13.329093 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfzmp" podUID="c6d194b8-0b62-40d1-97bc-c4b775b7ac9f" Jul 20 16:30:14.504681 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:14.504650 2583 generic.go:356] "Generic (PLEG): container finished" podID="bc8db184-def3-4066-8d3e-a7206b10506f" containerID="f76dd2e93e29f82bc6357dd9dd90e1974d7e28c07881cd92f67f630e5e290104" exitCode=0 Jul 20 16:30:14.505268 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:14.504703 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gdmwn" event={"ID":"bc8db184-def3-4066-8d3e-a7206b10506f","Type":"ContainerDied","Data":"f76dd2e93e29f82bc6357dd9dd90e1974d7e28c07881cd92f67f630e5e290104"} Jul 20 16:30:15.328941 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:15.328904 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfzmp" Jul 20 16:30:15.329097 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:15.328904 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjgcb" Jul 20 16:30:15.329097 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:15.329020 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfzmp" podUID="c6d194b8-0b62-40d1-97bc-c4b775b7ac9f" Jul 20 16:30:15.329233 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:15.328904 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5cnm" Jul 20 16:30:15.329233 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:15.329148 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjgcb" podUID="d771112b-c7d6-4ee2-84a3-567150c4407a" Jul 20 16:30:15.329308 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:15.329253 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5cnm" podUID="623fa3c9-f7b4-4949-9122-d9f5a5207853" Jul 20 16:30:16.074743 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:16.074711 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/623fa3c9-f7b4-4949-9122-d9f5a5207853-metrics-certs\") pod \"network-metrics-daemon-f5cnm\" (UID: \"623fa3c9-f7b4-4949-9122-d9f5a5207853\") " pod="openshift-multus/network-metrics-daemon-f5cnm" Jul 20 16:30:16.075287 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:16.074753 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf2tm\" (UniqueName: \"kubernetes.io/projected/c6d194b8-0b62-40d1-97bc-c4b775b7ac9f-kube-api-access-pf2tm\") pod \"network-check-target-wfzmp\" (UID: \"c6d194b8-0b62-40d1-97bc-c4b775b7ac9f\") " pod="openshift-network-diagnostics/network-check-target-wfzmp" Jul 20 16:30:16.075287 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:16.074783 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d771112b-c7d6-4ee2-84a3-567150c4407a-original-pull-secret\") pod \"global-pull-secret-syncer-fjgcb\" (UID: \"d771112b-c7d6-4ee2-84a3-567150c4407a\") " pod="kube-system/global-pull-secret-syncer-fjgcb" Jul 20 16:30:16.075287 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:16.074885 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:30:16.075287 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:16.074905 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 16:30:16.075287 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:16.074939 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 16:30:16.075287 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:16.074958 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d771112b-c7d6-4ee2-84a3-567150c4407a-original-pull-secret podName:d771112b-c7d6-4ee2-84a3-567150c4407a nodeName:}" failed. No retries permitted until 2026-07-20 16:30:48.074939668 +0000 UTC m=+66.224740441 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d771112b-c7d6-4ee2-84a3-567150c4407a-original-pull-secret") pod "global-pull-secret-syncer-fjgcb" (UID: "d771112b-c7d6-4ee2-84a3-567150c4407a") : object "kube-system"/"original-pull-secret" not registered Jul 20 16:30:16.075287 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:16.074962 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 16:30:16.075287 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:16.074976 2583 projected.go:196] Error preparing data for projected volume kube-api-access-pf2tm for pod openshift-network-diagnostics/network-check-target-wfzmp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:30:16.075287 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:16.074977 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/623fa3c9-f7b4-4949-9122-d9f5a5207853-metrics-certs podName:623fa3c9-f7b4-4949-9122-d9f5a5207853 nodeName:}" failed. No retries permitted until 2026-07-20 16:30:48.074968285 +0000 UTC m=+66.224769039 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/623fa3c9-f7b4-4949-9122-d9f5a5207853-metrics-certs") pod "network-metrics-daemon-f5cnm" (UID: "623fa3c9-f7b4-4949-9122-d9f5a5207853") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:30:16.075287 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:16.075031 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6d194b8-0b62-40d1-97bc-c4b775b7ac9f-kube-api-access-pf2tm podName:c6d194b8-0b62-40d1-97bc-c4b775b7ac9f nodeName:}" failed. No retries permitted until 2026-07-20 16:30:48.075010348 +0000 UTC m=+66.224811107 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pf2tm" (UniqueName: "kubernetes.io/projected/c6d194b8-0b62-40d1-97bc-c4b775b7ac9f-kube-api-access-pf2tm") pod "network-check-target-wfzmp" (UID: "c6d194b8-0b62-40d1-97bc-c4b775b7ac9f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:30:16.658246 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:16.658175 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-209.ec2.internal" event="NodeReady" Jul 20 16:30:16.658386 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:16.658323 2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 20 16:30:16.701875 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:16.701841 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-66kq4"] Jul 20 16:30:16.706208 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:16.706176 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ln95b"] Jul 20 16:30:16.706367 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:16.706295 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-66kq4" Jul 20 16:30:16.708674 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:16.708646 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 20 16:30:16.708789 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:16.708712 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 20 16:30:16.708789 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:16.708731 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lwj5v\"" Jul 20 16:30:16.710250 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:16.710200 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ln95b" Jul 20 16:30:16.712335 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:16.712318 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 20 16:30:16.712654 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:16.712541 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-djkfh\"" Jul 20 16:30:16.712654 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:16.712561 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 20 16:30:16.712795 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:16.712641 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 20 16:30:16.716391 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:16.716371 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-66kq4"] Jul 20 16:30:16.718518 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:16.718468 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ln95b"] Jul 20 16:30:16.881917 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:16.881882 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm28q\" (UniqueName: \"kubernetes.io/projected/47d88f39-08ac-4c56-a3da-942319bc7cd1-kube-api-access-tm28q\") pod \"ingress-canary-ln95b\" (UID: \"47d88f39-08ac-4c56-a3da-942319bc7cd1\") " pod="openshift-ingress-canary/ingress-canary-ln95b" Jul 20 16:30:16.881917 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:16.881920 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f1174be-e815-4547-88f8-5efa937dd72b-tmp-dir\") pod \"dns-default-66kq4\" (UID: \"3f1174be-e815-4547-88f8-5efa937dd72b\") " pod="openshift-dns/dns-default-66kq4" Jul 20 16:30:16.882168 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:16.881971 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj4tb\" (UniqueName: \"kubernetes.io/projected/3f1174be-e815-4547-88f8-5efa937dd72b-kube-api-access-nj4tb\") pod \"dns-default-66kq4\" (UID: \"3f1174be-e815-4547-88f8-5efa937dd72b\") " pod="openshift-dns/dns-default-66kq4" Jul 20 16:30:16.882168 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:16.882100 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3f1174be-e815-4547-88f8-5efa937dd72b-config-volume\") pod \"dns-default-66kq4\" (UID: \"3f1174be-e815-4547-88f8-5efa937dd72b\") " pod="openshift-dns/dns-default-66kq4" Jul 20 16:30:16.882168 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:16.882149 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47d88f39-08ac-4c56-a3da-942319bc7cd1-cert\") pod \"ingress-canary-ln95b\" (UID: \"47d88f39-08ac-4c56-a3da-942319bc7cd1\") " pod="openshift-ingress-canary/ingress-canary-ln95b" Jul 20 16:30:16.882328 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:16.882217 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f1174be-e815-4547-88f8-5efa937dd72b-metrics-tls\") pod \"dns-default-66kq4\" (UID: \"3f1174be-e815-4547-88f8-5efa937dd72b\") " pod="openshift-dns/dns-default-66kq4" Jul 20 16:30:16.983330 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:16.983255 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm28q\" (UniqueName: \"kubernetes.io/projected/47d88f39-08ac-4c56-a3da-942319bc7cd1-kube-api-access-tm28q\") pod \"ingress-canary-ln95b\" (UID: \"47d88f39-08ac-4c56-a3da-942319bc7cd1\") " pod="openshift-ingress-canary/ingress-canary-ln95b" Jul 20 16:30:16.983330 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:16.983293 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f1174be-e815-4547-88f8-5efa937dd72b-tmp-dir\") pod \"dns-default-66kq4\" (UID: \"3f1174be-e815-4547-88f8-5efa937dd72b\") " pod="openshift-dns/dns-default-66kq4" Jul 20 16:30:16.983330 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:16.983310 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj4tb\" (UniqueName: \"kubernetes.io/projected/3f1174be-e815-4547-88f8-5efa937dd72b-kube-api-access-nj4tb\") pod \"dns-default-66kq4\" (UID: \"3f1174be-e815-4547-88f8-5efa937dd72b\") " pod="openshift-dns/dns-default-66kq4" Jul 20 16:30:16.983578 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:16.983458 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3f1174be-e815-4547-88f8-5efa937dd72b-config-volume\") pod \"dns-default-66kq4\" (UID: \"3f1174be-e815-4547-88f8-5efa937dd72b\") " pod="openshift-dns/dns-default-66kq4" Jul 20 16:30:16.983578 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:16.983492 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47d88f39-08ac-4c56-a3da-942319bc7cd1-cert\") pod \"ingress-canary-ln95b\" (UID: \"47d88f39-08ac-4c56-a3da-942319bc7cd1\") " pod="openshift-ingress-canary/ingress-canary-ln95b" Jul 20 16:30:16.983578 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:16.983564 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f1174be-e815-4547-88f8-5efa937dd72b-metrics-tls\") pod \"dns-default-66kq4\" (UID: \"3f1174be-e815-4547-88f8-5efa937dd72b\") " pod="openshift-dns/dns-default-66kq4" Jul 20 16:30:16.983730 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:16.983634 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f1174be-e815-4547-88f8-5efa937dd72b-tmp-dir\") pod \"dns-default-66kq4\" (UID: \"3f1174be-e815-4547-88f8-5efa937dd72b\") " pod="openshift-dns/dns-default-66kq4" Jul 20 16:30:16.983730 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:16.983682 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 16:30:16.983826 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:16.983738 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f1174be-e815-4547-88f8-5efa937dd72b-metrics-tls podName:3f1174be-e815-4547-88f8-5efa937dd72b nodeName:}" failed. No retries permitted until 2026-07-20 16:30:17.483718753 +0000 UTC m=+35.633519507 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f1174be-e815-4547-88f8-5efa937dd72b-metrics-tls") pod "dns-default-66kq4" (UID: "3f1174be-e815-4547-88f8-5efa937dd72b") : secret "dns-default-metrics-tls" not found Jul 20 16:30:16.983993 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:16.983973 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3f1174be-e815-4547-88f8-5efa937dd72b-config-volume\") pod \"dns-default-66kq4\" (UID: \"3f1174be-e815-4547-88f8-5efa937dd72b\") " pod="openshift-dns/dns-default-66kq4" Jul 20 16:30:16.988323 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:16.988168 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47d88f39-08ac-4c56-a3da-942319bc7cd1-cert\") pod \"ingress-canary-ln95b\" (UID: \"47d88f39-08ac-4c56-a3da-942319bc7cd1\") " pod="openshift-ingress-canary/ingress-canary-ln95b" Jul 20 16:30:16.991827 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:16.991801 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj4tb\" (UniqueName: \"kubernetes.io/projected/3f1174be-e815-4547-88f8-5efa937dd72b-kube-api-access-nj4tb\") pod \"dns-default-66kq4\" (UID: \"3f1174be-e815-4547-88f8-5efa937dd72b\") " pod="openshift-dns/dns-default-66kq4" Jul 20 16:30:16.993288 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:16.993246 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm28q\" (UniqueName: \"kubernetes.io/projected/47d88f39-08ac-4c56-a3da-942319bc7cd1-kube-api-access-tm28q\") pod \"ingress-canary-ln95b\" (UID: \"47d88f39-08ac-4c56-a3da-942319bc7cd1\") " pod="openshift-ingress-canary/ingress-canary-ln95b" Jul 20 16:30:17.025201 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:17.025165 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ln95b" Jul 20 16:30:17.329447 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:17.329339 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfzmp" Jul 20 16:30:17.329447 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:17.329384 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5cnm" Jul 20 16:30:17.329447 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:17.329448 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjgcb" Jul 20 16:30:17.331878 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:17.331857 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 20 16:30:17.332707 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:17.332683 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f9blf\"" Jul 20 16:30:17.332817 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:17.332736 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 20 16:30:17.332817 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:17.332736 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 20 16:30:17.332817 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:17.332751 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k84bh\"" Jul 20 16:30:17.332817 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:17.332788 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 20 16:30:17.489400 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:17.489369 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f1174be-e815-4547-88f8-5efa937dd72b-metrics-tls\") pod \"dns-default-66kq4\" (UID: \"3f1174be-e815-4547-88f8-5efa937dd72b\") " pod="openshift-dns/dns-default-66kq4" Jul 20 16:30:17.489599 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:17.489522 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 16:30:17.489599 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:17.489598 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f1174be-e815-4547-88f8-5efa937dd72b-metrics-tls podName:3f1174be-e815-4547-88f8-5efa937dd72b nodeName:}" failed. No retries permitted until 2026-07-20 16:30:18.489576994 +0000 UTC m=+36.639377771 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f1174be-e815-4547-88f8-5efa937dd72b-metrics-tls") pod "dns-default-66kq4" (UID: "3f1174be-e815-4547-88f8-5efa937dd72b") : secret "dns-default-metrics-tls" not found Jul 20 16:30:18.236093 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.236065 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c755b9876-nrw2g"] Jul 20 16:30:18.240067 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.240042 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c755b9876-nrw2g" Jul 20 16:30:18.242331 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.242310 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 20 16:30:18.243205 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.243181 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 20 16:30:18.243334 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.243187 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 20 16:30:18.243334 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.243187 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 20 16:30:18.243334 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.243237 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-4lgwd\"" Jul 20 16:30:18.246651 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.246628 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c755b9876-nrw2g"] Jul 20 16:30:18.250051 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.250030 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f68cd9ffb-zl72g"] Jul 20 16:30:18.253923 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.253899 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f68cd9ffb-zl72g" Jul 20 16:30:18.256502 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.256457 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 20 16:30:18.256609 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.256458 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 20 16:30:18.256676 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.256634 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 20 16:30:18.257080 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.257066 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 20 16:30:18.263135 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.263056 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f68cd9ffb-zl72g"] Jul 20 16:30:18.397548 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.397518 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xbck\" (UniqueName: \"kubernetes.io/projected/ae3d07fb-9d11-4e53-8797-9f2c41b2d116-kube-api-access-4xbck\") pod \"managed-serviceaccount-addon-agent-7c755b9876-nrw2g\" (UID: \"ae3d07fb-9d11-4e53-8797-9f2c41b2d116\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c755b9876-nrw2g" Jul 20 16:30:18.397915 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.397561 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ae3d07fb-9d11-4e53-8797-9f2c41b2d116-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c755b9876-nrw2g\" (UID: \"ae3d07fb-9d11-4e53-8797-9f2c41b2d116\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c755b9876-nrw2g" Jul 20 16:30:18.397915 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.397579 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e60de867-01ae-4c0d-a2c5-849644efb1d3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5f68cd9ffb-zl72g\" (UID: \"e60de867-01ae-4c0d-a2c5-849644efb1d3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f68cd9ffb-zl72g" Jul 20 16:30:18.397915 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.397636 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e60de867-01ae-4c0d-a2c5-849644efb1d3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5f68cd9ffb-zl72g\" (UID: \"e60de867-01ae-4c0d-a2c5-849644efb1d3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f68cd9ffb-zl72g" Jul 20 16:30:18.397915 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.397708 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e60de867-01ae-4c0d-a2c5-849644efb1d3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5f68cd9ffb-zl72g\" (UID: \"e60de867-01ae-4c0d-a2c5-849644efb1d3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f68cd9ffb-zl72g" Jul 20 16:30:18.397915 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.397748 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e60de867-01ae-4c0d-a2c5-849644efb1d3-hub\") pod \"cluster-proxy-proxy-agent-5f68cd9ffb-zl72g\" (UID: \"e60de867-01ae-4c0d-a2c5-849644efb1d3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f68cd9ffb-zl72g" Jul 20 16:30:18.397915 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.397790 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e60de867-01ae-4c0d-a2c5-849644efb1d3-ca\") pod \"cluster-proxy-proxy-agent-5f68cd9ffb-zl72g\" (UID: \"e60de867-01ae-4c0d-a2c5-849644efb1d3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f68cd9ffb-zl72g" Jul 20 16:30:18.397915 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.397814 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcrsv\" (UniqueName: \"kubernetes.io/projected/e60de867-01ae-4c0d-a2c5-849644efb1d3-kube-api-access-rcrsv\") pod \"cluster-proxy-proxy-agent-5f68cd9ffb-zl72g\" (UID: \"e60de867-01ae-4c0d-a2c5-849644efb1d3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f68cd9ffb-zl72g" Jul 20 16:30:18.499572 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.499528 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e60de867-01ae-4c0d-a2c5-849644efb1d3-hub\") pod \"cluster-proxy-proxy-agent-5f68cd9ffb-zl72g\" (UID: \"e60de867-01ae-4c0d-a2c5-849644efb1d3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f68cd9ffb-zl72g" Jul 20 16:30:18.499690 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.499586 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e60de867-01ae-4c0d-a2c5-849644efb1d3-ca\") pod \"cluster-proxy-proxy-agent-5f68cd9ffb-zl72g\" (UID: \"e60de867-01ae-4c0d-a2c5-849644efb1d3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f68cd9ffb-zl72g" Jul 20 16:30:18.499690 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.499613 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcrsv\" (UniqueName: \"kubernetes.io/projected/e60de867-01ae-4c0d-a2c5-849644efb1d3-kube-api-access-rcrsv\") pod \"cluster-proxy-proxy-agent-5f68cd9ffb-zl72g\" (UID: \"e60de867-01ae-4c0d-a2c5-849644efb1d3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f68cd9ffb-zl72g" Jul 20 16:30:18.499690 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.499660 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f1174be-e815-4547-88f8-5efa937dd72b-metrics-tls\") pod \"dns-default-66kq4\" (UID: \"3f1174be-e815-4547-88f8-5efa937dd72b\") " pod="openshift-dns/dns-default-66kq4" Jul 20 16:30:18.499862 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.499714 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xbck\" (UniqueName: \"kubernetes.io/projected/ae3d07fb-9d11-4e53-8797-9f2c41b2d116-kube-api-access-4xbck\") pod \"managed-serviceaccount-addon-agent-7c755b9876-nrw2g\" (UID: \"ae3d07fb-9d11-4e53-8797-9f2c41b2d116\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c755b9876-nrw2g" Jul 20 16:30:18.499862 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.499756 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ae3d07fb-9d11-4e53-8797-9f2c41b2d116-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c755b9876-nrw2g\" (UID: \"ae3d07fb-9d11-4e53-8797-9f2c41b2d116\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c755b9876-nrw2g" Jul 20 16:30:18.499862 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.499788 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e60de867-01ae-4c0d-a2c5-849644efb1d3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5f68cd9ffb-zl72g\" (UID: \"e60de867-01ae-4c0d-a2c5-849644efb1d3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f68cd9ffb-zl72g" Jul 20 16:30:18.499862 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.499820 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e60de867-01ae-4c0d-a2c5-849644efb1d3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5f68cd9ffb-zl72g\" (UID: \"e60de867-01ae-4c0d-a2c5-849644efb1d3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f68cd9ffb-zl72g" Jul 20 16:30:18.499862 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.499851 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e60de867-01ae-4c0d-a2c5-849644efb1d3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5f68cd9ffb-zl72g\" (UID: \"e60de867-01ae-4c0d-a2c5-849644efb1d3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f68cd9ffb-zl72g" Jul 20 16:30:18.501705 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:18.501297 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 16:30:18.501705 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:18.501403 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f1174be-e815-4547-88f8-5efa937dd72b-metrics-tls podName:3f1174be-e815-4547-88f8-5efa937dd72b nodeName:}" failed. No retries permitted until 2026-07-20 16:30:20.501347229 +0000 UTC m=+38.651147985 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f1174be-e815-4547-88f8-5efa937dd72b-metrics-tls") pod "dns-default-66kq4" (UID: "3f1174be-e815-4547-88f8-5efa937dd72b") : secret "dns-default-metrics-tls" not found Jul 20 16:30:18.501705 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.501398 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e60de867-01ae-4c0d-a2c5-849644efb1d3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5f68cd9ffb-zl72g\" (UID: \"e60de867-01ae-4c0d-a2c5-849644efb1d3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f68cd9ffb-zl72g" Jul 20 16:30:18.506531 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.506487 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e60de867-01ae-4c0d-a2c5-849644efb1d3-hub\") pod \"cluster-proxy-proxy-agent-5f68cd9ffb-zl72g\" (UID: \"e60de867-01ae-4c0d-a2c5-849644efb1d3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f68cd9ffb-zl72g" Jul 20 16:30:18.509229 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.508585 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e60de867-01ae-4c0d-a2c5-849644efb1d3-ca\") pod \"cluster-proxy-proxy-agent-5f68cd9ffb-zl72g\" (UID: \"e60de867-01ae-4c0d-a2c5-849644efb1d3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f68cd9ffb-zl72g" Jul 20 16:30:18.509229 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.508852 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e60de867-01ae-4c0d-a2c5-849644efb1d3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5f68cd9ffb-zl72g\" (UID: \"e60de867-01ae-4c0d-a2c5-849644efb1d3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f68cd9ffb-zl72g" Jul 20 16:30:18.509229 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.509180 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ae3d07fb-9d11-4e53-8797-9f2c41b2d116-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c755b9876-nrw2g\" (UID: \"ae3d07fb-9d11-4e53-8797-9f2c41b2d116\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c755b9876-nrw2g" Jul 20 16:30:18.509606 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.509470 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcrsv\" (UniqueName: \"kubernetes.io/projected/e60de867-01ae-4c0d-a2c5-849644efb1d3-kube-api-access-rcrsv\") pod \"cluster-proxy-proxy-agent-5f68cd9ffb-zl72g\" (UID: \"e60de867-01ae-4c0d-a2c5-849644efb1d3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f68cd9ffb-zl72g" Jul 20 16:30:18.509680 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.509600 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xbck\" (UniqueName: \"kubernetes.io/projected/ae3d07fb-9d11-4e53-8797-9f2c41b2d116-kube-api-access-4xbck\") pod \"managed-serviceaccount-addon-agent-7c755b9876-nrw2g\" (UID: \"ae3d07fb-9d11-4e53-8797-9f2c41b2d116\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c755b9876-nrw2g" Jul 20 16:30:18.510072 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.510048 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e60de867-01ae-4c0d-a2c5-849644efb1d3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5f68cd9ffb-zl72g\" (UID: \"e60de867-01ae-4c0d-a2c5-849644efb1d3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f68cd9ffb-zl72g" Jul 20 16:30:18.544912 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.544888 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ln95b"] Jul 20 16:30:18.548648 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:30:18.548618 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47d88f39_08ac_4c56_a3da_942319bc7cd1.slice/crio-d5f953fcd7ca2d2b649d6bb7cb1533f90b4eb562e1617f7ec14d5370b4257e07 WatchSource:0}: Error finding container d5f953fcd7ca2d2b649d6bb7cb1533f90b4eb562e1617f7ec14d5370b4257e07: Status 404 returned error can't find the container with id d5f953fcd7ca2d2b649d6bb7cb1533f90b4eb562e1617f7ec14d5370b4257e07 Jul 20 16:30:18.560205 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.560187 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c755b9876-nrw2g" Jul 20 16:30:18.569741 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.569702 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f68cd9ffb-zl72g" Jul 20 16:30:18.685702 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.685546 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c755b9876-nrw2g"] Jul 20 16:30:18.702215 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:30:18.702179 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podae3d07fb_9d11_4e53_8797_9f2c41b2d116.slice/crio-930d05ce2ec2596ebbf9fe6136cd08270a0bf2b1858251b6aeb8f8f36ce28165 WatchSource:0}: Error finding container 930d05ce2ec2596ebbf9fe6136cd08270a0bf2b1858251b6aeb8f8f36ce28165: Status 404 returned error can't find the container with id 930d05ce2ec2596ebbf9fe6136cd08270a0bf2b1858251b6aeb8f8f36ce28165 Jul 20 16:30:18.796066 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:18.796040 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f68cd9ffb-zl72g"] Jul 20 16:30:18.798764 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:30:18.798736 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode60de867_01ae_4c0d_a2c5_849644efb1d3.slice/crio-a251200f06a8356d8d9595c2dee8a99b577c7edd21bf768875299d2f96cc0075 WatchSource:0}: Error finding container a251200f06a8356d8d9595c2dee8a99b577c7edd21bf768875299d2f96cc0075: Status 404 returned error can't find the container with id a251200f06a8356d8d9595c2dee8a99b577c7edd21bf768875299d2f96cc0075 Jul 20 16:30:19.519000 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:19.518960 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c755b9876-nrw2g" event={"ID":"ae3d07fb-9d11-4e53-8797-9f2c41b2d116","Type":"ContainerStarted","Data":"930d05ce2ec2596ebbf9fe6136cd08270a0bf2b1858251b6aeb8f8f36ce28165"} Jul 20 16:30:19.522672 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:19.522643 2583 generic.go:356] "Generic (PLEG): container finished" podID="bc8db184-def3-4066-8d3e-a7206b10506f" containerID="defbcf09baa40f6292efae01acdded79fd1b92aff45f587ccc56ddf62cc04762" exitCode=0 Jul 20 16:30:19.522811 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:19.522726 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gdmwn" event={"ID":"bc8db184-def3-4066-8d3e-a7206b10506f","Type":"ContainerDied","Data":"defbcf09baa40f6292efae01acdded79fd1b92aff45f587ccc56ddf62cc04762"} Jul 20 16:30:19.524279 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:19.524253 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f68cd9ffb-zl72g" event={"ID":"e60de867-01ae-4c0d-a2c5-849644efb1d3","Type":"ContainerStarted","Data":"a251200f06a8356d8d9595c2dee8a99b577c7edd21bf768875299d2f96cc0075"} Jul 20 16:30:19.526409 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:19.526176 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ln95b" event={"ID":"47d88f39-08ac-4c56-a3da-942319bc7cd1","Type":"ContainerStarted","Data":"d5f953fcd7ca2d2b649d6bb7cb1533f90b4eb562e1617f7ec14d5370b4257e07"} Jul 20 16:30:20.517400 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:20.517332 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f1174be-e815-4547-88f8-5efa937dd72b-metrics-tls\") pod \"dns-default-66kq4\" (UID: \"3f1174be-e815-4547-88f8-5efa937dd72b\") " pod="openshift-dns/dns-default-66kq4" Jul 20 16:30:20.517702 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:20.517460 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 16:30:20.517702 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:20.517543 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f1174be-e815-4547-88f8-5efa937dd72b-metrics-tls podName:3f1174be-e815-4547-88f8-5efa937dd72b nodeName:}" failed. No retries permitted until 2026-07-20 16:30:24.517524578 +0000 UTC m=+42.667325345 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f1174be-e815-4547-88f8-5efa937dd72b-metrics-tls") pod "dns-default-66kq4" (UID: "3f1174be-e815-4547-88f8-5efa937dd72b") : secret "dns-default-metrics-tls" not found Jul 20 16:30:20.532462 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:20.532429 2583 generic.go:356] "Generic (PLEG): container finished" podID="bc8db184-def3-4066-8d3e-a7206b10506f" containerID="ba17e9927d28d6142b3dbc648d7afd15fa30a07bf4dad78ac279bb31ed177b04" exitCode=0 Jul 20 16:30:20.533050 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:20.532474 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gdmwn" event={"ID":"bc8db184-def3-4066-8d3e-a7206b10506f","Type":"ContainerDied","Data":"ba17e9927d28d6142b3dbc648d7afd15fa30a07bf4dad78ac279bb31ed177b04"} Jul 20 16:30:22.101868 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:22.101828 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-h6vfc"] Jul 20 16:30:22.163646 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:22.163616 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h6vfc"] Jul 20 16:30:22.163809 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:22.163747 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h6vfc" Jul 20 16:30:22.165993 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:22.165965 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 20 16:30:22.166317 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:22.166297 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 20 16:30:22.166997 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:22.166972 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 20 16:30:22.167129 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:22.167023 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-w4qdt\"" Jul 20 16:30:22.167129 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:22.167040 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 20 16:30:22.331670 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:22.331629 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6vfc\" (UID: \"dd090edd-1a90-43b8-8e8b-3c2ea22e5de5\") " pod="openshift-insights/insights-runtime-extractor-h6vfc" Jul 20 16:30:22.331823 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:22.331681 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h6vfc\" (UID: \"dd090edd-1a90-43b8-8e8b-3c2ea22e5de5\") " pod="openshift-insights/insights-runtime-extractor-h6vfc" Jul 20 16:30:22.331823 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:22.331780 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-crio-socket\") pod \"insights-runtime-extractor-h6vfc\" (UID: \"dd090edd-1a90-43b8-8e8b-3c2ea22e5de5\") " pod="openshift-insights/insights-runtime-extractor-h6vfc" Jul 20 16:30:22.331920 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:22.331865 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-data-volume\") pod \"insights-runtime-extractor-h6vfc\" (UID: \"dd090edd-1a90-43b8-8e8b-3c2ea22e5de5\") " pod="openshift-insights/insights-runtime-extractor-h6vfc" Jul 20 16:30:22.331920 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:22.331895 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k56z\" (UniqueName: \"kubernetes.io/projected/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-kube-api-access-7k56z\") pod \"insights-runtime-extractor-h6vfc\" (UID: \"dd090edd-1a90-43b8-8e8b-3c2ea22e5de5\") " pod="openshift-insights/insights-runtime-extractor-h6vfc" Jul 20 16:30:22.432720 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:22.432685 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6vfc\" (UID: \"dd090edd-1a90-43b8-8e8b-3c2ea22e5de5\") " pod="openshift-insights/insights-runtime-extractor-h6vfc" Jul 20 16:30:22.432879 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:22.432736 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h6vfc\" (UID: \"dd090edd-1a90-43b8-8e8b-3c2ea22e5de5\") " pod="openshift-insights/insights-runtime-extractor-h6vfc" Jul 20 16:30:22.432879 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:22.432858 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-crio-socket\") pod \"insights-runtime-extractor-h6vfc\" (UID: \"dd090edd-1a90-43b8-8e8b-3c2ea22e5de5\") " pod="openshift-insights/insights-runtime-extractor-h6vfc" Jul 20 16:30:22.433012 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:22.432879 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-data-volume\") pod \"insights-runtime-extractor-h6vfc\" (UID: \"dd090edd-1a90-43b8-8e8b-3c2ea22e5de5\") " pod="openshift-insights/insights-runtime-extractor-h6vfc" Jul 20 16:30:22.433012 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:22.432855 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 16:30:22.433012 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:22.432949 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 16:30:22.433012 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:22.432903 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k56z\" (UniqueName: \"kubernetes.io/projected/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-kube-api-access-7k56z\") pod \"insights-runtime-extractor-h6vfc\" (UID: \"dd090edd-1a90-43b8-8e8b-3c2ea22e5de5\") " pod="openshift-insights/insights-runtime-extractor-h6vfc" Jul 20 16:30:22.433012 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:22.433002 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-insights-runtime-extractor-tls podName:dd090edd-1a90-43b8-8e8b-3c2ea22e5de5 nodeName:}" failed. No retries permitted until 2026-07-20 16:30:22.932976411 +0000 UTC m=+41.082777170 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h6vfc" (UID: "dd090edd-1a90-43b8-8e8b-3c2ea22e5de5") : secret "insights-runtime-extractor-tls" not found Jul 20 16:30:22.433217 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:22.433056 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-crio-socket\") pod \"insights-runtime-extractor-h6vfc\" (UID: \"dd090edd-1a90-43b8-8e8b-3c2ea22e5de5\") " pod="openshift-insights/insights-runtime-extractor-h6vfc" Jul 20 16:30:22.433217 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:22.433091 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-kube-rbac-proxy-cm podName:dd090edd-1a90-43b8-8e8b-3c2ea22e5de5 nodeName:}" failed. No retries permitted until 2026-07-20 16:30:22.933058893 +0000 UTC m=+41.082859659 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h6vfc" (UID: "dd090edd-1a90-43b8-8e8b-3c2ea22e5de5") : configmap "kube-rbac-proxy" not found Jul 20 16:30:22.433285 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:22.433236 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-data-volume\") pod \"insights-runtime-extractor-h6vfc\" (UID: \"dd090edd-1a90-43b8-8e8b-3c2ea22e5de5\") " pod="openshift-insights/insights-runtime-extractor-h6vfc" Jul 20 16:30:22.450046 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:22.450017 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k56z\" (UniqueName: \"kubernetes.io/projected/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-kube-api-access-7k56z\") pod \"insights-runtime-extractor-h6vfc\" (UID: \"dd090edd-1a90-43b8-8e8b-3c2ea22e5de5\") " pod="openshift-insights/insights-runtime-extractor-h6vfc" Jul 20 16:30:22.937697 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:22.937667 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6vfc\" (UID: \"dd090edd-1a90-43b8-8e8b-3c2ea22e5de5\") " pod="openshift-insights/insights-runtime-extractor-h6vfc" Jul 20 16:30:22.937856 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:22.937708 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h6vfc\" (UID: \"dd090edd-1a90-43b8-8e8b-3c2ea22e5de5\") " pod="openshift-insights/insights-runtime-extractor-h6vfc" Jul 20 16:30:22.937856 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:22.937804 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 16:30:22.937856 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:22.937822 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 16:30:22.937967 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:22.937860 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-kube-rbac-proxy-cm podName:dd090edd-1a90-43b8-8e8b-3c2ea22e5de5 nodeName:}" failed. No retries permitted until 2026-07-20 16:30:23.93784224 +0000 UTC m=+42.087642995 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h6vfc" (UID: "dd090edd-1a90-43b8-8e8b-3c2ea22e5de5") : configmap "kube-rbac-proxy" not found Jul 20 16:30:22.937967 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:22.937886 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-insights-runtime-extractor-tls podName:dd090edd-1a90-43b8-8e8b-3c2ea22e5de5 nodeName:}" failed. No retries permitted until 2026-07-20 16:30:23.937872754 +0000 UTC m=+42.087673509 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h6vfc" (UID: "dd090edd-1a90-43b8-8e8b-3c2ea22e5de5") : secret "insights-runtime-extractor-tls" not found Jul 20 16:30:23.945701 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:23.945556 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6vfc\" (UID: \"dd090edd-1a90-43b8-8e8b-3c2ea22e5de5\") " pod="openshift-insights/insights-runtime-extractor-h6vfc" Jul 20 16:30:23.945701 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:23.945619 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h6vfc\" (UID: \"dd090edd-1a90-43b8-8e8b-3c2ea22e5de5\") " pod="openshift-insights/insights-runtime-extractor-h6vfc" Jul 20 16:30:23.945701 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:23.945683 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 16:30:23.946265 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:23.945714 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 16:30:23.946265 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:23.945766 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-insights-runtime-extractor-tls podName:dd090edd-1a90-43b8-8e8b-3c2ea22e5de5 nodeName:}" failed. No retries permitted until 2026-07-20 16:30:25.945742403 +0000 UTC m=+44.095543173 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h6vfc" (UID: "dd090edd-1a90-43b8-8e8b-3c2ea22e5de5") : secret "insights-runtime-extractor-tls" not found Jul 20 16:30:23.946265 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:23.945785 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-kube-rbac-proxy-cm podName:dd090edd-1a90-43b8-8e8b-3c2ea22e5de5 nodeName:}" failed. No retries permitted until 2026-07-20 16:30:25.945776052 +0000 UTC m=+44.095576809 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h6vfc" (UID: "dd090edd-1a90-43b8-8e8b-3c2ea22e5de5") : configmap "kube-rbac-proxy" not found Jul 20 16:30:24.550949 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:24.550917 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f1174be-e815-4547-88f8-5efa937dd72b-metrics-tls\") pod \"dns-default-66kq4\" (UID: \"3f1174be-e815-4547-88f8-5efa937dd72b\") " pod="openshift-dns/dns-default-66kq4" Jul 20 16:30:24.551123 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:24.551018 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 16:30:24.551123 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:24.551075 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f1174be-e815-4547-88f8-5efa937dd72b-metrics-tls podName:3f1174be-e815-4547-88f8-5efa937dd72b nodeName:}" failed. No retries permitted until 2026-07-20 16:30:32.551062591 +0000 UTC m=+50.700863345 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f1174be-e815-4547-88f8-5efa937dd72b-metrics-tls") pod "dns-default-66kq4" (UID: "3f1174be-e815-4547-88f8-5efa937dd72b") : secret "dns-default-metrics-tls" not found Jul 20 16:30:25.087519 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:25.087497 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v4zb9_2d54e31a-0d64-4914-9613-ffc1e50ea9e1/dns-node-resolver/0.log" Jul 20 16:30:25.547944 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:25.547908 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c755b9876-nrw2g" event={"ID":"ae3d07fb-9d11-4e53-8797-9f2c41b2d116","Type":"ContainerStarted","Data":"0cf4ad8c4a9e9205947bdca2f494ba62cb5f73e9d30fa954fd5624f4b3940ae2"} Jul 20 16:30:25.551248 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:25.551219 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gdmwn" event={"ID":"bc8db184-def3-4066-8d3e-a7206b10506f","Type":"ContainerStarted","Data":"f4a6ee7f9c7925566acb714cee975349f8daf4e89c52e529b999cb5b3a60b02e"} Jul 20 16:30:25.553016 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:25.552993 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f68cd9ffb-zl72g" event={"ID":"e60de867-01ae-4c0d-a2c5-849644efb1d3","Type":"ContainerStarted","Data":"5c94365e9067cf36507ad9f6868b4f458e4274d6c87273d49890e124f0c5c034"} Jul 20 16:30:25.553117 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:25.553028 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f68cd9ffb-zl72g" event={"ID":"e60de867-01ae-4c0d-a2c5-849644efb1d3","Type":"ContainerStarted","Data":"4576349d2789f1709efcdda52f3cb316de9c8c9a90e34b92ce2553c7bee14e28"} Jul 20 16:30:25.553117 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:25.553045 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f68cd9ffb-zl72g" event={"ID":"e60de867-01ae-4c0d-a2c5-849644efb1d3","Type":"ContainerStarted","Data":"85b4b7184dfe784148470405e4c496cb3cf08c8bdece4e0646367407e9ed6eda"} Jul 20 16:30:25.554356 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:25.554334 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ln95b" event={"ID":"47d88f39-08ac-4c56-a3da-942319bc7cd1","Type":"ContainerStarted","Data":"80752c5fd314d39a759c59612b032b8ba2ce3a782acb4d7ae25a8c1a2653aeee"} Jul 20 16:30:25.571002 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:25.570961 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c755b9876-nrw2g" podStartSLOduration=1.620057962 podStartE2EDuration="7.570949987s" totalImagesPullingTime="5.950892025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:30:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:30:25.570123285 +0000 UTC m=+43.719924056" watchObservedRunningTime="2026-07-20 16:30:25.570949987 +0000 UTC m=+43.720750763" Jul 20 16:30:25.591881 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:25.591824 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ln95b" podStartSLOduration=3.50878073 podStartE2EDuration="9.591804978s" totalImagesPullingTime="6.083024248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:30:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:30:25.590879345 +0000 UTC m=+43.740680132" watchObservedRunningTime="2026-07-20 16:30:25.591804978 +0000 UTC m=+43.741605754" Jul 20 16:30:25.619502 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:25.619469 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gdmwn" podStartSLOduration=13.442402042 podStartE2EDuration="43.619459557s" totalImagesPullingTime="30.177057515s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:29:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:30:25.619217699 +0000 UTC m=+43.769018472" watchObservedRunningTime="2026-07-20 16:30:25.619459557 +0000 UTC m=+43.769260332" Jul 20 16:30:25.658339 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:25.658301 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f68cd9ffb-zl72g" podStartSLOduration=1.7873285829999999 podStartE2EDuration="7.65828759s" totalImagesPullingTime="5.870959007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:30:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:30:25.657627 +0000 UTC m=+43.807427776" watchObservedRunningTime="2026-07-20 16:30:25.65828759 +0000 UTC m=+43.808088366" Jul 20 16:30:25.960686 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:25.960648 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6vfc\" (UID: \"dd090edd-1a90-43b8-8e8b-3c2ea22e5de5\") " pod="openshift-insights/insights-runtime-extractor-h6vfc" Jul 20 16:30:25.960839 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:25.960703 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h6vfc\" (UID: \"dd090edd-1a90-43b8-8e8b-3c2ea22e5de5\") " pod="openshift-insights/insights-runtime-extractor-h6vfc" Jul 20 16:30:25.960839 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:25.960785 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 16:30:25.960839 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:25.960821 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 16:30:25.960981 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:25.960847 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-insights-runtime-extractor-tls podName:dd090edd-1a90-43b8-8e8b-3c2ea22e5de5 nodeName:}" failed. No retries permitted until 2026-07-20 16:30:29.960831907 +0000 UTC m=+48.110632660 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h6vfc" (UID: "dd090edd-1a90-43b8-8e8b-3c2ea22e5de5") : secret "insights-runtime-extractor-tls" not found Jul 20 16:30:25.960981 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:25.960873 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-kube-rbac-proxy-cm podName:dd090edd-1a90-43b8-8e8b-3c2ea22e5de5 nodeName:}" failed. No retries permitted until 2026-07-20 16:30:29.960856862 +0000 UTC m=+48.110657630 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h6vfc" (UID: "dd090edd-1a90-43b8-8e8b-3c2ea22e5de5") : configmap "kube-rbac-proxy" not found Jul 20 16:30:26.088201 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:26.088177 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zh5ql_d139ce10-11a1-4353-90e1-b3a3008f6959/node-ca/0.log" Jul 20 16:30:26.888556 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:26.888526 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ln95b_47d88f39-08ac-4c56-a3da-942319bc7cd1/serve-healthcheck-canary/0.log" Jul 20 16:30:29.987340 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:29.987301 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6vfc\" (UID: \"dd090edd-1a90-43b8-8e8b-3c2ea22e5de5\") " pod="openshift-insights/insights-runtime-extractor-h6vfc" Jul 20 16:30:29.987738 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:29.987352 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h6vfc\" (UID: \"dd090edd-1a90-43b8-8e8b-3c2ea22e5de5\") " pod="openshift-insights/insights-runtime-extractor-h6vfc" Jul 20 16:30:29.987738 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:29.987458 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 16:30:29.987738 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:29.987522 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-insights-runtime-extractor-tls podName:dd090edd-1a90-43b8-8e8b-3c2ea22e5de5 nodeName:}" failed. No retries permitted until 2026-07-20 16:30:37.987501727 +0000 UTC m=+56.137302481 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h6vfc" (UID: "dd090edd-1a90-43b8-8e8b-3c2ea22e5de5") : secret "insights-runtime-extractor-tls" not found Jul 20 16:30:29.987738 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:29.987542 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 16:30:29.987738 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:30:29.987593 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-kube-rbac-proxy-cm podName:dd090edd-1a90-43b8-8e8b-3c2ea22e5de5 nodeName:}" failed. No retries permitted until 2026-07-20 16:30:37.987579026 +0000 UTC m=+56.137379811 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h6vfc" (UID: "dd090edd-1a90-43b8-8e8b-3c2ea22e5de5") : configmap "kube-rbac-proxy" not found Jul 20 16:30:32.605554 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:32.605522 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f1174be-e815-4547-88f8-5efa937dd72b-metrics-tls\") pod \"dns-default-66kq4\" (UID: \"3f1174be-e815-4547-88f8-5efa937dd72b\") " pod="openshift-dns/dns-default-66kq4" Jul 20 16:30:32.607834 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:32.607808 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f1174be-e815-4547-88f8-5efa937dd72b-metrics-tls\") pod \"dns-default-66kq4\" (UID: \"3f1174be-e815-4547-88f8-5efa937dd72b\") " pod="openshift-dns/dns-default-66kq4" Jul 20 16:30:32.618699 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:32.618677 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-66kq4" Jul 20 16:30:32.750354 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:32.750324 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-66kq4"] Jul 20 16:30:32.753210 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:30:32.753182 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f1174be_e815_4547_88f8_5efa937dd72b.slice/crio-765137bccc62f18816ed01a65e62af23f485aef74d34d661f3b47cf14bb91dc6 WatchSource:0}: Error finding container 765137bccc62f18816ed01a65e62af23f485aef74d34d661f3b47cf14bb91dc6: Status 404 returned error can't find the container with id 765137bccc62f18816ed01a65e62af23f485aef74d34d661f3b47cf14bb91dc6 Jul 20 16:30:33.574490 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:33.574444 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-66kq4" event={"ID":"3f1174be-e815-4547-88f8-5efa937dd72b","Type":"ContainerStarted","Data":"765137bccc62f18816ed01a65e62af23f485aef74d34d661f3b47cf14bb91dc6"} Jul 20 16:30:35.582283 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:35.582211 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-66kq4" event={"ID":"3f1174be-e815-4547-88f8-5efa937dd72b","Type":"ContainerStarted","Data":"6344eac840b8006d6c79c29e4ce1bf0b48ce333a9b3c5a9c3b2e3365b163fd5b"} Jul 20 16:30:35.582283 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:35.582266 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-66kq4" event={"ID":"3f1174be-e815-4547-88f8-5efa937dd72b","Type":"ContainerStarted","Data":"10f9e3cbf834e2a241f568b2719987cdd005efd51d69b084f8d8d0f3255f3b77"} Jul 20 16:30:35.582658 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:35.582297 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-66kq4" Jul 20 16:30:38.046470 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:38.046435 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6vfc\" (UID: \"dd090edd-1a90-43b8-8e8b-3c2ea22e5de5\") " pod="openshift-insights/insights-runtime-extractor-h6vfc" Jul 20 16:30:38.046470 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:38.046470 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h6vfc\" (UID: \"dd090edd-1a90-43b8-8e8b-3c2ea22e5de5\") " pod="openshift-insights/insights-runtime-extractor-h6vfc" Jul 20 16:30:38.046936 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:38.046917 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h6vfc\" (UID: \"dd090edd-1a90-43b8-8e8b-3c2ea22e5de5\") " pod="openshift-insights/insights-runtime-extractor-h6vfc" Jul 20 16:30:38.048646 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:38.048624 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dd090edd-1a90-43b8-8e8b-3c2ea22e5de5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6vfc\" (UID: \"dd090edd-1a90-43b8-8e8b-3c2ea22e5de5\") " pod="openshift-insights/insights-runtime-extractor-h6vfc" Jul 20 16:30:38.076436 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:38.076417 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h6vfc" Jul 20 16:30:38.193764 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:38.193713 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-66kq4" podStartSLOduration=19.773294176 podStartE2EDuration="22.193673755s" totalImagesPullingTime="2.420379579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:30:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:30:35.597227713 +0000 UTC m=+53.747028490" watchObservedRunningTime="2026-07-20 16:30:38.193673755 +0000 UTC m=+56.343474530" Jul 20 16:30:38.194004 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:38.193987 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h6vfc"] Jul 20 16:30:38.197727 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:30:38.197699 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd090edd_1a90_43b8_8e8b_3c2ea22e5de5.slice/crio-d8e0b65ffbeddc22ee55ee25c9bafa1c75b7926359eca49e2b30ace022e60af7 WatchSource:0}: Error finding container d8e0b65ffbeddc22ee55ee25c9bafa1c75b7926359eca49e2b30ace022e60af7: Status 404 returned error can't find the container with id d8e0b65ffbeddc22ee55ee25c9bafa1c75b7926359eca49e2b30ace022e60af7 Jul 20 16:30:38.594082 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:38.594046 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h6vfc" event={"ID":"dd090edd-1a90-43b8-8e8b-3c2ea22e5de5","Type":"ContainerStarted","Data":"d8e0b65ffbeddc22ee55ee25c9bafa1c75b7926359eca49e2b30ace022e60af7"} Jul 20 16:30:43.518723 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:43.518695 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n6b6s" Jul 20 16:30:44.617841 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:44.617800 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h6vfc" event={"ID":"dd090edd-1a90-43b8-8e8b-3c2ea22e5de5","Type":"ContainerStarted","Data":"01bf02a9de8b25264de444338a9c05013413f43e87df461f67c848a3e31feddc"} Jul 20 16:30:45.588716 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:45.588683 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-66kq4" Jul 20 16:30:47.628233 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:47.628135 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h6vfc" event={"ID":"dd090edd-1a90-43b8-8e8b-3c2ea22e5de5","Type":"ContainerStarted","Data":"ee28db591b83dd58f53ebc85cb0cce332880804fca77e3301248cc47749ee055"} Jul 20 16:30:48.129766 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:48.129729 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf2tm\" (UniqueName: \"kubernetes.io/projected/c6d194b8-0b62-40d1-97bc-c4b775b7ac9f-kube-api-access-pf2tm\") pod \"network-check-target-wfzmp\" (UID: \"c6d194b8-0b62-40d1-97bc-c4b775b7ac9f\") " pod="openshift-network-diagnostics/network-check-target-wfzmp" Jul 20 16:30:48.129934 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:48.129781 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d771112b-c7d6-4ee2-84a3-567150c4407a-original-pull-secret\") pod \"global-pull-secret-syncer-fjgcb\" (UID: \"d771112b-c7d6-4ee2-84a3-567150c4407a\") " pod="kube-system/global-pull-secret-syncer-fjgcb" Jul 20 16:30:48.129934 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:48.129810 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/623fa3c9-f7b4-4949-9122-d9f5a5207853-metrics-certs\") pod \"network-metrics-daemon-f5cnm\" (UID: \"623fa3c9-f7b4-4949-9122-d9f5a5207853\") " pod="openshift-multus/network-metrics-daemon-f5cnm" Jul 20 16:30:48.131834 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:48.131817 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 20 16:30:48.132508 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:48.132495 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 20 16:30:48.132544 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:48.132501 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 20 16:30:48.142316 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:48.142292 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 20 16:30:48.142557 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:48.142537 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d771112b-c7d6-4ee2-84a3-567150c4407a-original-pull-secret\") pod \"global-pull-secret-syncer-fjgcb\" (UID: \"d771112b-c7d6-4ee2-84a3-567150c4407a\") " pod="kube-system/global-pull-secret-syncer-fjgcb" Jul 20 16:30:48.142629 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:48.142612 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/623fa3c9-f7b4-4949-9122-d9f5a5207853-metrics-certs\") pod \"network-metrics-daemon-f5cnm\" (UID: \"623fa3c9-f7b4-4949-9122-d9f5a5207853\") " pod="openshift-multus/network-metrics-daemon-f5cnm" Jul 20 16:30:48.152891 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:48.152868 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf2tm\" (UniqueName: \"kubernetes.io/projected/c6d194b8-0b62-40d1-97bc-c4b775b7ac9f-kube-api-access-pf2tm\") pod \"network-check-target-wfzmp\" (UID: \"c6d194b8-0b62-40d1-97bc-c4b775b7ac9f\") " pod="openshift-network-diagnostics/network-check-target-wfzmp" Jul 20 16:30:48.243787 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:48.243755 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f9blf\"" Jul 20 16:30:48.247950 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:48.247937 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjgcb" Jul 20 16:30:48.252628 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:48.252610 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfzmp" Jul 20 16:30:48.255690 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:48.255670 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k84bh\"" Jul 20 16:30:48.263983 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:48.263966 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5cnm" Jul 20 16:30:48.413040 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:48.412894 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fjgcb"] Jul 20 16:30:48.415765 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:30:48.415732 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd771112b_c7d6_4ee2_84a3_567150c4407a.slice/crio-f739d975da81bae68a2b37e71c3f1c2660eb32af551c16cbd331661d39bfa407 WatchSource:0}: Error finding container f739d975da81bae68a2b37e71c3f1c2660eb32af551c16cbd331661d39bfa407: Status 404 returned error can't find the container with id f739d975da81bae68a2b37e71c3f1c2660eb32af551c16cbd331661d39bfa407 Jul 20 16:30:48.632516 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:48.632465 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fjgcb" event={"ID":"d771112b-c7d6-4ee2-84a3-567150c4407a","Type":"ContainerStarted","Data":"f739d975da81bae68a2b37e71c3f1c2660eb32af551c16cbd331661d39bfa407"} Jul 20 16:30:48.632933 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:48.632694 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f5cnm"] Jul 20 16:30:48.634890 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:48.634869 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wfzmp"] Jul 20 16:30:48.637275 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:30:48.637248 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod623fa3c9_f7b4_4949_9122_d9f5a5207853.slice/crio-f7c12aaeefbbe5192cf104eff40f9922e28f2cd1a64f07de58e149e7bbb8914c WatchSource:0}: Error finding container f7c12aaeefbbe5192cf104eff40f9922e28f2cd1a64f07de58e149e7bbb8914c: Status 404 returned error can't find the container with id f7c12aaeefbbe5192cf104eff40f9922e28f2cd1a64f07de58e149e7bbb8914c Jul 20 16:30:48.639680 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:30:48.639647 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6d194b8_0b62_40d1_97bc_c4b775b7ac9f.slice/crio-d9989126b7295f08e30b285c896ad9e8bb741e0303178fee73929f9b03a34a16 WatchSource:0}: Error finding container d9989126b7295f08e30b285c896ad9e8bb741e0303178fee73929f9b03a34a16: Status 404 returned error can't find the container with id d9989126b7295f08e30b285c896ad9e8bb741e0303178fee73929f9b03a34a16 Jul 20 16:30:48.906015 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:48.905976 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5n5zm"] Jul 20 16:30:48.909262 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:48.909239 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5n5zm" Jul 20 16:30:48.911546 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:48.911521 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 20 16:30:48.911719 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:48.911699 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-d7j72\"" Jul 20 16:30:48.917232 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:48.917179 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5n5zm"] Jul 20 16:30:49.036588 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:49.036550 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b5bac671-1b85-4d29-b0fd-bc7b94772b8c-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-5n5zm\" (UID: \"b5bac671-1b85-4d29-b0fd-bc7b94772b8c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5n5zm" Jul 20 16:30:49.137918 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:49.137884 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b5bac671-1b85-4d29-b0fd-bc7b94772b8c-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-5n5zm\" (UID: \"b5bac671-1b85-4d29-b0fd-bc7b94772b8c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5n5zm" Jul 20 16:30:49.141039 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:49.141008 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b5bac671-1b85-4d29-b0fd-bc7b94772b8c-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-5n5zm\" (UID: \"b5bac671-1b85-4d29-b0fd-bc7b94772b8c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5n5zm" Jul 20 16:30:49.222121 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:49.222014 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5n5zm" Jul 20 16:30:49.394376 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:49.394337 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5n5zm"] Jul 20 16:30:49.401401 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:30:49.401371 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5bac671_1b85_4d29_b0fd_bc7b94772b8c.slice/crio-59904c2c68b1bda580730bbc567c816598ca0ebfe04aa2913110c0013d709f57 WatchSource:0}: Error finding container 59904c2c68b1bda580730bbc567c816598ca0ebfe04aa2913110c0013d709f57: Status 404 returned error can't find the container with id 59904c2c68b1bda580730bbc567c816598ca0ebfe04aa2913110c0013d709f57 Jul 20 16:30:49.638695 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:49.638565 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f5cnm" event={"ID":"623fa3c9-f7b4-4949-9122-d9f5a5207853","Type":"ContainerStarted","Data":"f7c12aaeefbbe5192cf104eff40f9922e28f2cd1a64f07de58e149e7bbb8914c"} Jul 20 16:30:49.640188 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:49.640156 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5n5zm" event={"ID":"b5bac671-1b85-4d29-b0fd-bc7b94772b8c","Type":"ContainerStarted","Data":"59904c2c68b1bda580730bbc567c816598ca0ebfe04aa2913110c0013d709f57"} Jul 20 16:30:49.641672 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:49.641624 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wfzmp" event={"ID":"c6d194b8-0b62-40d1-97bc-c4b775b7ac9f","Type":"ContainerStarted","Data":"d9989126b7295f08e30b285c896ad9e8bb741e0303178fee73929f9b03a34a16"} Jul 20 16:30:50.648364 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:50.648310 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f5cnm" event={"ID":"623fa3c9-f7b4-4949-9122-d9f5a5207853","Type":"ContainerStarted","Data":"6bea524295f00579608e5990ac1962c422af811b371dc5b278aea2e9a9df2d89"} Jul 20 16:30:50.648811 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:50.648398 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f5cnm" event={"ID":"623fa3c9-f7b4-4949-9122-d9f5a5207853","Type":"ContainerStarted","Data":"005042f14af9f8b727b78716547013c55d63ae94374df2899918c96ff6743a6b"} Jul 20 16:30:50.666072 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:50.665250 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-f5cnm" podStartSLOduration=67.26734627 podStartE2EDuration="1m8.665231003s" totalImagesPullingTime="1.397884733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:30:50.663615281 +0000 UTC m=+68.813416058" watchObservedRunningTime="2026-07-20 16:30:50.665231003 +0000 UTC m=+68.815031779" Jul 20 16:30:56.670621 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:56.670582 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fjgcb" event={"ID":"d771112b-c7d6-4ee2-84a3-567150c4407a","Type":"ContainerStarted","Data":"c3bd317aee00d3499eeab6a57a2a37b76cade139db94374e3cef78e9f931b00a"} Jul 20 16:30:56.672792 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:56.672764 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h6vfc" event={"ID":"dd090edd-1a90-43b8-8e8b-3c2ea22e5de5","Type":"ContainerStarted","Data":"d1d0f60338589fca5e1cb40ff2e147c8d4d22b197ff28eb8e00ae4f4242da9ed"} Jul 20 16:30:56.674143 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:56.674117 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5n5zm" event={"ID":"b5bac671-1b85-4d29-b0fd-bc7b94772b8c","Type":"ContainerStarted","Data":"dbbfbbe68f0f957de068a3a7856f96d96d2cccc8f9c5fe5a89a91538ac04e8e4"} Jul 20 16:30:56.674283 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:56.674259 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5n5zm" Jul 20 16:30:56.675583 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:56.675557 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wfzmp" event={"ID":"c6d194b8-0b62-40d1-97bc-c4b775b7ac9f","Type":"ContainerStarted","Data":"468e3375d8b3881604901c3a95cb39ad5f27f6aec862539f5da0a6306c61342c"} Jul 20 16:30:56.675756 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:56.675691 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wfzmp" Jul 20 16:30:56.679253 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:56.679237 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5n5zm" Jul 20 16:30:56.689821 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:56.689776 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fjgcb" podStartSLOduration=66.77444927 podStartE2EDuration="1m14.689764534s" totalImagesPullingTime="7.915315264s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:30:56.688917143 +0000 UTC m=+74.838717920" watchObservedRunningTime="2026-07-20 16:30:56.689764534 +0000 UTC m=+74.839565303" Jul 20 16:30:56.705751 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:56.705719 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-h6vfc" podStartSLOduration=16.720872634 podStartE2EDuration="34.705708197s" totalImagesPullingTime="17.984835563s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:30:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:30:56.705262713 +0000 UTC m=+74.855063491" watchObservedRunningTime="2026-07-20 16:30:56.705708197 +0000 UTC m=+74.855508973" Jul 20 16:30:56.719330 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:56.719295 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wfzmp" podStartSLOduration=67.016193202 podStartE2EDuration="1m14.719284818s" totalImagesPullingTime="7.703091616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:30:56.718967875 +0000 UTC m=+74.868768652" watchObservedRunningTime="2026-07-20 16:30:56.719284818 +0000 UTC m=+74.869085593" Jul 20 16:30:56.732984 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:56.732945 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5n5zm" podStartSLOduration=1.804169832 podStartE2EDuration="8.732934008s" totalImagesPullingTime="6.928764176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:30:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:30:56.732281225 +0000 UTC m=+74.882082001" watchObservedRunningTime="2026-07-20 16:30:56.732934008 +0000 UTC m=+74.882734784" Jul 20 16:30:56.971498 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:56.971419 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-l652s"] Jul 20 16:30:56.974059 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:56.974037 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-l652s" Jul 20 16:30:56.976567 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:56.976523 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 20 16:30:56.976567 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:56.976558 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 20 16:30:56.977279 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:56.977257 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 20 16:30:56.977390 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:56.977280 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-7js49\"" Jul 20 16:30:56.977390 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:56.977311 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 20 16:30:56.977390 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:56.977282 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 20 16:30:56.983743 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:56.983723 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-l652s"] Jul 20 16:30:57.091566 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:57.091540 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/202ea82f-a28b-4541-973d-6b345756f5a3-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-l652s\" (UID: \"202ea82f-a28b-4541-973d-6b345756f5a3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-l652s" Jul 20 16:30:57.091705 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:57.091579 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/202ea82f-a28b-4541-973d-6b345756f5a3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-l652s\" (UID: \"202ea82f-a28b-4541-973d-6b345756f5a3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-l652s" Jul 20 16:30:57.091705 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:57.091605 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvkvz\" (UniqueName: \"kubernetes.io/projected/202ea82f-a28b-4541-973d-6b345756f5a3-kube-api-access-kvkvz\") pod \"prometheus-operator-5945b5cfd-l652s\" (UID: \"202ea82f-a28b-4541-973d-6b345756f5a3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-l652s" Jul 20 16:30:57.091705 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:57.091661 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/202ea82f-a28b-4541-973d-6b345756f5a3-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-l652s\" (UID: \"202ea82f-a28b-4541-973d-6b345756f5a3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-l652s" Jul 20 16:30:57.192219 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:57.192192 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/202ea82f-a28b-4541-973d-6b345756f5a3-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-l652s\" (UID: \"202ea82f-a28b-4541-973d-6b345756f5a3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-l652s" Jul 20 16:30:57.192337 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:57.192229 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/202ea82f-a28b-4541-973d-6b345756f5a3-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-l652s\" (UID: \"202ea82f-a28b-4541-973d-6b345756f5a3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-l652s" Jul 20 16:30:57.192337 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:57.192255 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/202ea82f-a28b-4541-973d-6b345756f5a3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-l652s\" (UID: \"202ea82f-a28b-4541-973d-6b345756f5a3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-l652s" Jul 20 16:30:57.192337 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:57.192289 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvkvz\" (UniqueName: \"kubernetes.io/projected/202ea82f-a28b-4541-973d-6b345756f5a3-kube-api-access-kvkvz\") pod \"prometheus-operator-5945b5cfd-l652s\" (UID: \"202ea82f-a28b-4541-973d-6b345756f5a3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-l652s" Jul 20 16:30:57.192986 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:57.192967 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/202ea82f-a28b-4541-973d-6b345756f5a3-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-l652s\" (UID: \"202ea82f-a28b-4541-973d-6b345756f5a3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-l652s" Jul 20 16:30:57.194616 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:57.194594 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/202ea82f-a28b-4541-973d-6b345756f5a3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-l652s\" (UID: \"202ea82f-a28b-4541-973d-6b345756f5a3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-l652s" Jul 20 16:30:57.194616 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:57.194606 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/202ea82f-a28b-4541-973d-6b345756f5a3-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-l652s\" (UID: \"202ea82f-a28b-4541-973d-6b345756f5a3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-l652s" Jul 20 16:30:57.200613 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:57.200592 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvkvz\" (UniqueName: \"kubernetes.io/projected/202ea82f-a28b-4541-973d-6b345756f5a3-kube-api-access-kvkvz\") pod \"prometheus-operator-5945b5cfd-l652s\" (UID: \"202ea82f-a28b-4541-973d-6b345756f5a3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-l652s" Jul 20 16:30:57.282332 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:57.282283 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-l652s" Jul 20 16:30:57.401756 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:57.401728 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-l652s"] Jul 20 16:30:57.405259 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:30:57.405233 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod202ea82f_a28b_4541_973d_6b345756f5a3.slice/crio-de4ec103121d2f96650109085eb211719d047d418351c0f4c7f76af22e8f94d2 WatchSource:0}: Error finding container de4ec103121d2f96650109085eb211719d047d418351c0f4c7f76af22e8f94d2: Status 404 returned error can't find the container with id de4ec103121d2f96650109085eb211719d047d418351c0f4c7f76af22e8f94d2 Jul 20 16:30:57.679702 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:57.679671 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-l652s" event={"ID":"202ea82f-a28b-4541-973d-6b345756f5a3","Type":"ContainerStarted","Data":"de4ec103121d2f96650109085eb211719d047d418351c0f4c7f76af22e8f94d2"} Jul 20 16:30:59.688179 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:59.688133 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-l652s" event={"ID":"202ea82f-a28b-4541-973d-6b345756f5a3","Type":"ContainerStarted","Data":"e201560dddd6f2257125bbc11660bb6aa1a0c778f5da4441395eda6b545eb89a"} Jul 20 16:30:59.688569 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:59.688231 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-l652s" event={"ID":"202ea82f-a28b-4541-973d-6b345756f5a3","Type":"ContainerStarted","Data":"560b7386c3ed100937a123bf1d5cde0d285d33947c355f0055e7894565cba6e6"} Jul 20 16:30:59.705524 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:30:59.705476 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-l652s" podStartSLOduration=2.11338475 podStartE2EDuration="3.705460438s" totalImagesPullingTime="1.592075688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:30:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:30:59.703771877 +0000 UTC m=+77.853572653" watchObservedRunningTime="2026-07-20 16:30:59.705460438 +0000 UTC m=+77.855261215" Jul 20 16:31:01.350820 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:01.350787 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-f8gbz"] Jul 20 16:31:01.354043 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:01.354021 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f8gbz" Jul 20 16:31:01.356524 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:01.356502 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 20 16:31:01.356683 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:01.356632 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 20 16:31:01.356683 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:01.356679 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 20 16:31:01.356850 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:01.356831 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-25shj\"" Jul 20 16:31:01.422526 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:01.422503 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/201ed71d-cdf4-4b6e-a681-bf9206e2523f-root\") pod \"node-exporter-f8gbz\" (UID: \"201ed71d-cdf4-4b6e-a681-bf9206e2523f\") " pod="openshift-monitoring/node-exporter-f8gbz" Jul 20 16:31:01.422642 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:01.422537 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/201ed71d-cdf4-4b6e-a681-bf9206e2523f-metrics-client-ca\") pod \"node-exporter-f8gbz\" (UID: \"201ed71d-cdf4-4b6e-a681-bf9206e2523f\") " pod="openshift-monitoring/node-exporter-f8gbz" Jul 20 16:31:01.422642 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:01.422558 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkm55\" (UniqueName: \"kubernetes.io/projected/201ed71d-cdf4-4b6e-a681-bf9206e2523f-kube-api-access-zkm55\") pod \"node-exporter-f8gbz\" (UID: \"201ed71d-cdf4-4b6e-a681-bf9206e2523f\") " pod="openshift-monitoring/node-exporter-f8gbz" Jul 20 16:31:01.422642 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:01.422580 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/201ed71d-cdf4-4b6e-a681-bf9206e2523f-node-exporter-accelerators-collector-config\") pod \"node-exporter-f8gbz\" (UID: \"201ed71d-cdf4-4b6e-a681-bf9206e2523f\") " pod="openshift-monitoring/node-exporter-f8gbz" Jul 20 16:31:01.422642 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:01.422601 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/201ed71d-cdf4-4b6e-a681-bf9206e2523f-node-exporter-tls\") pod \"node-exporter-f8gbz\" (UID: \"201ed71d-cdf4-4b6e-a681-bf9206e2523f\") " pod="openshift-monitoring/node-exporter-f8gbz" Jul 20 16:31:01.422642 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:01.422621 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/201ed71d-cdf4-4b6e-a681-bf9206e2523f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f8gbz\" (UID: \"201ed71d-cdf4-4b6e-a681-bf9206e2523f\") " pod="openshift-monitoring/node-exporter-f8gbz" Jul 20 16:31:01.422869 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:01.422663 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/201ed71d-cdf4-4b6e-a681-bf9206e2523f-node-exporter-textfile\") pod \"node-exporter-f8gbz\" (UID: \"201ed71d-cdf4-4b6e-a681-bf9206e2523f\") " pod="openshift-monitoring/node-exporter-f8gbz" Jul 20 16:31:01.422869 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:01.422714 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/201ed71d-cdf4-4b6e-a681-bf9206e2523f-node-exporter-wtmp\") pod \"node-exporter-f8gbz\" (UID: \"201ed71d-cdf4-4b6e-a681-bf9206e2523f\") " pod="openshift-monitoring/node-exporter-f8gbz" Jul 20 16:31:01.422869 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:01.422773 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/201ed71d-cdf4-4b6e-a681-bf9206e2523f-sys\") pod \"node-exporter-f8gbz\" (UID: \"201ed71d-cdf4-4b6e-a681-bf9206e2523f\") " pod="openshift-monitoring/node-exporter-f8gbz" Jul 20 16:31:01.523501 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:01.523477 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/201ed71d-cdf4-4b6e-a681-bf9206e2523f-root\") pod \"node-exporter-f8gbz\" (UID: \"201ed71d-cdf4-4b6e-a681-bf9206e2523f\") " pod="openshift-monitoring/node-exporter-f8gbz" Jul 20 16:31:01.523625 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:01.523510 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/201ed71d-cdf4-4b6e-a681-bf9206e2523f-metrics-client-ca\") pod \"node-exporter-f8gbz\" (UID: \"201ed71d-cdf4-4b6e-a681-bf9206e2523f\") " pod="openshift-monitoring/node-exporter-f8gbz" Jul 20 16:31:01.523625 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:01.523531 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkm55\" (UniqueName: \"kubernetes.io/projected/201ed71d-cdf4-4b6e-a681-bf9206e2523f-kube-api-access-zkm55\") pod \"node-exporter-f8gbz\" (UID: \"201ed71d-cdf4-4b6e-a681-bf9206e2523f\") " pod="openshift-monitoring/node-exporter-f8gbz" Jul 20 16:31:01.523625 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:01.523562 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/201ed71d-cdf4-4b6e-a681-bf9206e2523f-node-exporter-accelerators-collector-config\") pod \"node-exporter-f8gbz\" (UID: \"201ed71d-cdf4-4b6e-a681-bf9206e2523f\") " pod="openshift-monitoring/node-exporter-f8gbz" Jul 20 16:31:01.523625 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:01.523588 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/201ed71d-cdf4-4b6e-a681-bf9206e2523f-root\") pod \"node-exporter-f8gbz\" (UID: \"201ed71d-cdf4-4b6e-a681-bf9206e2523f\") " pod="openshift-monitoring/node-exporter-f8gbz" Jul 20 16:31:01.523625 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:01.523594 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/201ed71d-cdf4-4b6e-a681-bf9206e2523f-node-exporter-tls\") pod \"node-exporter-f8gbz\" (UID: \"201ed71d-cdf4-4b6e-a681-bf9206e2523f\") " pod="openshift-monitoring/node-exporter-f8gbz" Jul 20 16:31:01.523879 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:01.523643 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/201ed71d-cdf4-4b6e-a681-bf9206e2523f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f8gbz\" (UID: \"201ed71d-cdf4-4b6e-a681-bf9206e2523f\") " pod="openshift-monitoring/node-exporter-f8gbz" Jul 20 16:31:01.523879 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:01.523674 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/201ed71d-cdf4-4b6e-a681-bf9206e2523f-node-exporter-textfile\") pod \"node-exporter-f8gbz\" (UID: \"201ed71d-cdf4-4b6e-a681-bf9206e2523f\") " pod="openshift-monitoring/node-exporter-f8gbz" Jul 20 16:31:01.523879 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:01.523701 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/201ed71d-cdf4-4b6e-a681-bf9206e2523f-node-exporter-wtmp\") pod \"node-exporter-f8gbz\" (UID: \"201ed71d-cdf4-4b6e-a681-bf9206e2523f\") " pod="openshift-monitoring/node-exporter-f8gbz" Jul 20 16:31:01.523879 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:01.523751 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/201ed71d-cdf4-4b6e-a681-bf9206e2523f-sys\") pod \"node-exporter-f8gbz\" (UID: \"201ed71d-cdf4-4b6e-a681-bf9206e2523f\") " pod="openshift-monitoring/node-exporter-f8gbz" Jul 20 16:31:01.523879 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:01.523820 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/201ed71d-cdf4-4b6e-a681-bf9206e2523f-sys\") pod \"node-exporter-f8gbz\" (UID: \"201ed71d-cdf4-4b6e-a681-bf9206e2523f\") " pod="openshift-monitoring/node-exporter-f8gbz" Jul 20 16:31:01.524052 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:01.523937 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/201ed71d-cdf4-4b6e-a681-bf9206e2523f-node-exporter-wtmp\") pod \"node-exporter-f8gbz\" (UID: \"201ed71d-cdf4-4b6e-a681-bf9206e2523f\") " pod="openshift-monitoring/node-exporter-f8gbz" Jul 20 16:31:01.524052 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:01.523992 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/201ed71d-cdf4-4b6e-a681-bf9206e2523f-node-exporter-textfile\") pod \"node-exporter-f8gbz\" (UID: \"201ed71d-cdf4-4b6e-a681-bf9206e2523f\") " pod="openshift-monitoring/node-exporter-f8gbz" Jul 20 16:31:01.524201 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:01.524182 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/201ed71d-cdf4-4b6e-a681-bf9206e2523f-node-exporter-accelerators-collector-config\") pod \"node-exporter-f8gbz\" (UID: \"201ed71d-cdf4-4b6e-a681-bf9206e2523f\") " pod="openshift-monitoring/node-exporter-f8gbz" Jul 20 16:31:01.524244 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:01.524232 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/201ed71d-cdf4-4b6e-a681-bf9206e2523f-metrics-client-ca\") pod \"node-exporter-f8gbz\" (UID: \"201ed71d-cdf4-4b6e-a681-bf9206e2523f\") " pod="openshift-monitoring/node-exporter-f8gbz" Jul 20 16:31:01.525808 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:01.525782 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/201ed71d-cdf4-4b6e-a681-bf9206e2523f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f8gbz\" (UID: \"201ed71d-cdf4-4b6e-a681-bf9206e2523f\") " pod="openshift-monitoring/node-exporter-f8gbz" Jul 20 16:31:01.525900 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:01.525807 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/201ed71d-cdf4-4b6e-a681-bf9206e2523f-node-exporter-tls\") pod \"node-exporter-f8gbz\" (UID: \"201ed71d-cdf4-4b6e-a681-bf9206e2523f\") " pod="openshift-monitoring/node-exporter-f8gbz" Jul 20 16:31:01.533914 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:01.533891 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkm55\" (UniqueName: \"kubernetes.io/projected/201ed71d-cdf4-4b6e-a681-bf9206e2523f-kube-api-access-zkm55\") pod \"node-exporter-f8gbz\" (UID: \"201ed71d-cdf4-4b6e-a681-bf9206e2523f\") " pod="openshift-monitoring/node-exporter-f8gbz" Jul 20 16:31:01.662575 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:01.662551 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f8gbz" Jul 20 16:31:01.673539 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:31:01.673510 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod201ed71d_cdf4_4b6e_a681_bf9206e2523f.slice/crio-94b56eea03d817ce5c03b930c7e4f94fc62ed507b3e29a05315e0833493529a1 WatchSource:0}: Error finding container 94b56eea03d817ce5c03b930c7e4f94fc62ed507b3e29a05315e0833493529a1: Status 404 returned error can't find the container with id 94b56eea03d817ce5c03b930c7e4f94fc62ed507b3e29a05315e0833493529a1 Jul 20 16:31:01.695008 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:01.694982 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f8gbz" event={"ID":"201ed71d-cdf4-4b6e-a681-bf9206e2523f","Type":"ContainerStarted","Data":"94b56eea03d817ce5c03b930c7e4f94fc62ed507b3e29a05315e0833493529a1"} Jul 20 16:31:03.705291 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:03.705253 2583 generic.go:356] "Generic (PLEG): container finished" podID="201ed71d-cdf4-4b6e-a681-bf9206e2523f" containerID="70ca4f71b54d1e3acbd5b4972ba705713f124ab14ecdc33ea814a6e4b06afc56" exitCode=0 Jul 20 16:31:03.705712 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:03.705340 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f8gbz" event={"ID":"201ed71d-cdf4-4b6e-a681-bf9206e2523f","Type":"ContainerDied","Data":"70ca4f71b54d1e3acbd5b4972ba705713f124ab14ecdc33ea814a6e4b06afc56"} Jul 20 16:31:04.710671 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:04.710566 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f8gbz" event={"ID":"201ed71d-cdf4-4b6e-a681-bf9206e2523f","Type":"ContainerStarted","Data":"aea64093dd0089528ef3f26cecf0a05e5a431fba0d10fe3f477f9ad1ae2949a7"} Jul 20 16:31:04.710671 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:04.710616 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f8gbz" event={"ID":"201ed71d-cdf4-4b6e-a681-bf9206e2523f","Type":"ContainerStarted","Data":"aeac2e09caa3fc6fbda4f853f575c7c3d287210879687f06a358720067fcfd90"} Jul 20 16:31:04.731761 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:04.731714 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-f8gbz" podStartSLOduration=2.5253732920000003 podStartE2EDuration="3.731702266s" totalImagesPullingTime="1.144826851s" totalInitContainerRuntime="61.502123ms" isStatefulPod=true podCreationTimestamp="2026-07-20 16:31:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:31:04.730295465 +0000 UTC m=+82.880096241" watchObservedRunningTime="2026-07-20 16:31:04.731702266 +0000 UTC m=+82.881503042" Jul 20 16:31:06.112162 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:06.112127 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-wpx4l"] Jul 20 16:31:06.116380 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:06.116360 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-wpx4l" Jul 20 16:31:06.118655 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:06.118632 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 20 16:31:06.118758 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:06.118636 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-jjcbn\"" Jul 20 16:31:06.122888 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:06.122707 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-wpx4l"] Jul 20 16:31:06.258596 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:06.258570 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ca9ea789-5f22-4e04-8eeb-a3a51ee2e72d-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-wpx4l\" (UID: \"ca9ea789-5f22-4e04-8eeb-a3a51ee2e72d\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-wpx4l" Jul 20 16:31:06.258745 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:06.258611 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-845m5\" (UniqueName: \"kubernetes.io/projected/ca9ea789-5f22-4e04-8eeb-a3a51ee2e72d-kube-api-access-845m5\") pod \"monitoring-plugin-7b7b7bc8bf-wpx4l\" (UID: \"ca9ea789-5f22-4e04-8eeb-a3a51ee2e72d\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-wpx4l" Jul 20 16:31:06.359931 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:06.359902 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ca9ea789-5f22-4e04-8eeb-a3a51ee2e72d-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-wpx4l\" (UID: \"ca9ea789-5f22-4e04-8eeb-a3a51ee2e72d\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-wpx4l" Jul 20 16:31:06.360067 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:06.359944 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-845m5\" (UniqueName: \"kubernetes.io/projected/ca9ea789-5f22-4e04-8eeb-a3a51ee2e72d-kube-api-access-845m5\") pod \"monitoring-plugin-7b7b7bc8bf-wpx4l\" (UID: \"ca9ea789-5f22-4e04-8eeb-a3a51ee2e72d\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-wpx4l" Jul 20 16:31:06.362340 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:06.362284 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ca9ea789-5f22-4e04-8eeb-a3a51ee2e72d-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-wpx4l\" (UID: \"ca9ea789-5f22-4e04-8eeb-a3a51ee2e72d\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-wpx4l" Jul 20 16:31:06.381715 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:06.381693 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-845m5\" (UniqueName: \"kubernetes.io/projected/ca9ea789-5f22-4e04-8eeb-a3a51ee2e72d-kube-api-access-845m5\") pod \"monitoring-plugin-7b7b7bc8bf-wpx4l\" (UID: \"ca9ea789-5f22-4e04-8eeb-a3a51ee2e72d\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-wpx4l" Jul 20 16:31:06.425628 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:06.425608 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-wpx4l" Jul 20 16:31:06.568835 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:06.568807 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-wpx4l"] Jul 20 16:31:06.572033 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:31:06.572009 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca9ea789_5f22_4e04_8eeb_a3a51ee2e72d.slice/crio-50e38a934bfa4c4353d305b865365430a230ad13dc80f5f655bb40a5350eb015 WatchSource:0}: Error finding container 50e38a934bfa4c4353d305b865365430a230ad13dc80f5f655bb40a5350eb015: Status 404 returned error can't find the container with id 50e38a934bfa4c4353d305b865365430a230ad13dc80f5f655bb40a5350eb015 Jul 20 16:31:06.724970 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:06.724926 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-wpx4l" event={"ID":"ca9ea789-5f22-4e04-8eeb-a3a51ee2e72d","Type":"ContainerStarted","Data":"50e38a934bfa4c4353d305b865365430a230ad13dc80f5f655bb40a5350eb015"} Jul 20 16:31:09.739086 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:09.739049 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-wpx4l" event={"ID":"ca9ea789-5f22-4e04-8eeb-a3a51ee2e72d","Type":"ContainerStarted","Data":"4a366e92970e983493609973b6a7eea864d6d082abe9b205ba32578f0fb9c034"} Jul 20 16:31:09.739460 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:09.739261 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-wpx4l" Jul 20 16:31:09.743954 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:09.743933 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-wpx4l" Jul 20 16:31:09.756279 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:09.756238 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-wpx4l" podStartSLOduration=1.224480088 podStartE2EDuration="3.756225261s" totalImagesPullingTime="2.531745173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:31:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:31:09.755073826 +0000 UTC m=+87.904874603" watchObservedRunningTime="2026-07-20 16:31:09.756225261 +0000 UTC m=+87.906026037" Jul 20 16:31:27.682252 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:27.682215 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wfzmp" Jul 20 16:31:58.571764 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:31:58.571707 2583 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f68cd9ffb-zl72g" podUID="e60de867-01ae-4c0d-a2c5-849644efb1d3" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 20 16:32:08.571475 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:32:08.571440 2583 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f68cd9ffb-zl72g" podUID="e60de867-01ae-4c0d-a2c5-849644efb1d3" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 20 16:32:18.571567 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:32:18.571531 2583 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f68cd9ffb-zl72g" podUID="e60de867-01ae-4c0d-a2c5-849644efb1d3" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 20 16:32:18.571935 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:32:18.571597 2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f68cd9ffb-zl72g" Jul 20 16:32:18.572031 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:32:18.572003 2583 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"5c94365e9067cf36507ad9f6868b4f458e4274d6c87273d49890e124f0c5c034"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f68cd9ffb-zl72g" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 20 16:32:18.572229 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:32:18.572049 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f68cd9ffb-zl72g" podUID="e60de867-01ae-4c0d-a2c5-849644efb1d3" containerName="service-proxy" containerID="cri-o://5c94365e9067cf36507ad9f6868b4f458e4274d6c87273d49890e124f0c5c034" gracePeriod=30 Jul 20 16:32:18.967299 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:32:18.967265 2583 generic.go:356] "Generic (PLEG): container finished" podID="e60de867-01ae-4c0d-a2c5-849644efb1d3" containerID="5c94365e9067cf36507ad9f6868b4f458e4274d6c87273d49890e124f0c5c034" exitCode=2 Jul 20 16:32:18.967299 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:32:18.967308 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f68cd9ffb-zl72g" event={"ID":"e60de867-01ae-4c0d-a2c5-849644efb1d3","Type":"ContainerDied","Data":"5c94365e9067cf36507ad9f6868b4f458e4274d6c87273d49890e124f0c5c034"} Jul 20 16:32:18.967554 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:32:18.967347 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f68cd9ffb-zl72g" event={"ID":"e60de867-01ae-4c0d-a2c5-849644efb1d3","Type":"ContainerStarted","Data":"7bb81ff9c182862bdf9a0cd792da9585b77afa2adb383011eeb3f0008ea2c772"} Jul 20 16:34:40.815054 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:34:40.815018 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrrxv"] Jul 20 16:34:40.818402 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:34:40.818383 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrrxv" Jul 20 16:34:40.820723 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:34:40.820703 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 20 16:34:40.820811 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:34:40.820742 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4lfs8\"" Jul 20 16:34:40.821476 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:34:40.821461 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 20 16:34:40.826727 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:34:40.826705 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrrxv"] Jul 20 16:34:40.872017 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:34:40.871995 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63967965-bbd8-4b77-811a-5515144a98ca-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrrxv\" (UID: \"63967965-bbd8-4b77-811a-5515144a98ca\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrrxv" Jul 20 16:34:40.872136 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:34:40.872032 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4mx4\" (UniqueName: \"kubernetes.io/projected/63967965-bbd8-4b77-811a-5515144a98ca-kube-api-access-j4mx4\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrrxv\" (UID: \"63967965-bbd8-4b77-811a-5515144a98ca\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrrxv" Jul 20 16:34:40.872136 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:34:40.872055 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63967965-bbd8-4b77-811a-5515144a98ca-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrrxv\" (UID: \"63967965-bbd8-4b77-811a-5515144a98ca\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrrxv" Jul 20 16:34:40.972409 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:34:40.972366 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4mx4\" (UniqueName: \"kubernetes.io/projected/63967965-bbd8-4b77-811a-5515144a98ca-kube-api-access-j4mx4\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrrxv\" (UID: \"63967965-bbd8-4b77-811a-5515144a98ca\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrrxv" Jul 20 16:34:40.972550 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:34:40.972418 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63967965-bbd8-4b77-811a-5515144a98ca-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrrxv\" (UID: \"63967965-bbd8-4b77-811a-5515144a98ca\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrrxv" Jul 20 16:34:40.972550 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:34:40.972478 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63967965-bbd8-4b77-811a-5515144a98ca-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrrxv\" (UID: \"63967965-bbd8-4b77-811a-5515144a98ca\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrrxv" Jul 20 16:34:40.972788 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:34:40.972769 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63967965-bbd8-4b77-811a-5515144a98ca-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrrxv\" (UID: \"63967965-bbd8-4b77-811a-5515144a98ca\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrrxv" Jul 20 16:34:40.972906 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:34:40.972882 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63967965-bbd8-4b77-811a-5515144a98ca-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrrxv\" (UID: \"63967965-bbd8-4b77-811a-5515144a98ca\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrrxv" Jul 20 16:34:40.980386 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:34:40.980357 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4mx4\" (UniqueName: \"kubernetes.io/projected/63967965-bbd8-4b77-811a-5515144a98ca-kube-api-access-j4mx4\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrrxv\" (UID: \"63967965-bbd8-4b77-811a-5515144a98ca\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrrxv" Jul 20 16:34:41.127809 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:34:41.127733 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrrxv" Jul 20 16:34:41.248201 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:34:41.248174 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrrxv"] Jul 20 16:34:41.250827 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:34:41.250802 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63967965_bbd8_4b77_811a_5515144a98ca.slice/crio-37868541b94ca03778184dae1c1ac7e14244305cbfa0e915ba4fd01151f6bcc1 WatchSource:0}: Error finding container 37868541b94ca03778184dae1c1ac7e14244305cbfa0e915ba4fd01151f6bcc1: Status 404 returned error can't find the container with id 37868541b94ca03778184dae1c1ac7e14244305cbfa0e915ba4fd01151f6bcc1 Jul 20 16:34:41.425031 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:34:41.425005 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrrxv" event={"ID":"63967965-bbd8-4b77-811a-5515144a98ca","Type":"ContainerStarted","Data":"37868541b94ca03778184dae1c1ac7e14244305cbfa0e915ba4fd01151f6bcc1"} Jul 20 16:34:42.216882 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:34:42.216839 2583 kubelet.go:1648] "Image garbage collection succeeded" Jul 20 16:34:49.454501 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:34:49.454463 2583 generic.go:356] "Generic (PLEG): container finished" podID="63967965-bbd8-4b77-811a-5515144a98ca" containerID="2e5fae2527c17ce698599cddbbe435dad33e6b1a1614e317682b8d22cff357fc" exitCode=0 Jul 20 16:34:49.454899 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:34:49.454512 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrrxv" event={"ID":"63967965-bbd8-4b77-811a-5515144a98ca","Type":"ContainerDied","Data":"2e5fae2527c17ce698599cddbbe435dad33e6b1a1614e317682b8d22cff357fc"} Jul 20 16:34:49.455516 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:34:49.455502 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 16:34:52.466977 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:34:52.466942 2583 generic.go:356] "Generic (PLEG): container finished" podID="63967965-bbd8-4b77-811a-5515144a98ca" containerID="d5f201aeebe2c15c5c5ff000312022f6a8f7b9d67ed01b4ff7cb903e82f354de" exitCode=0 Jul 20 16:34:52.467439 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:34:52.467015 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrrxv" event={"ID":"63967965-bbd8-4b77-811a-5515144a98ca","Type":"ContainerDied","Data":"d5f201aeebe2c15c5c5ff000312022f6a8f7b9d67ed01b4ff7cb903e82f354de"} Jul 20 16:35:01.502438 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:01.502403 2583 generic.go:356] "Generic (PLEG): container finished" podID="63967965-bbd8-4b77-811a-5515144a98ca" containerID="d0902d04cbbc7baea9cd0aa9dd9fdcc4f47b55349e82a3bb22f786c1a53087ef" exitCode=0 Jul 20 16:35:01.502771 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:01.502446 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrrxv" event={"ID":"63967965-bbd8-4b77-811a-5515144a98ca","Type":"ContainerDied","Data":"d0902d04cbbc7baea9cd0aa9dd9fdcc4f47b55349e82a3bb22f786c1a53087ef"} Jul 20 16:35:02.646939 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:02.646917 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrrxv" Jul 20 16:35:02.732638 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:02.732616 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4mx4\" (UniqueName: \"kubernetes.io/projected/63967965-bbd8-4b77-811a-5515144a98ca-kube-api-access-j4mx4\") pod \"63967965-bbd8-4b77-811a-5515144a98ca\" (UID: \"63967965-bbd8-4b77-811a-5515144a98ca\") " Jul 20 16:35:02.732766 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:02.732647 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63967965-bbd8-4b77-811a-5515144a98ca-bundle\") pod \"63967965-bbd8-4b77-811a-5515144a98ca\" (UID: \"63967965-bbd8-4b77-811a-5515144a98ca\") " Jul 20 16:35:02.732766 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:02.732696 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63967965-bbd8-4b77-811a-5515144a98ca-util\") pod \"63967965-bbd8-4b77-811a-5515144a98ca\" (UID: \"63967965-bbd8-4b77-811a-5515144a98ca\") " Jul 20 16:35:02.733326 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:02.733302 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63967965-bbd8-4b77-811a-5515144a98ca-bundle" (OuterVolumeSpecName: "bundle") pod "63967965-bbd8-4b77-811a-5515144a98ca" (UID: "63967965-bbd8-4b77-811a-5515144a98ca"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:35:02.734698 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:02.734670 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63967965-bbd8-4b77-811a-5515144a98ca-kube-api-access-j4mx4" (OuterVolumeSpecName: "kube-api-access-j4mx4") pod "63967965-bbd8-4b77-811a-5515144a98ca" (UID: "63967965-bbd8-4b77-811a-5515144a98ca"). InnerVolumeSpecName "kube-api-access-j4mx4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:35:02.736996 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:02.736976 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63967965-bbd8-4b77-811a-5515144a98ca-util" (OuterVolumeSpecName: "util") pod "63967965-bbd8-4b77-811a-5515144a98ca" (UID: "63967965-bbd8-4b77-811a-5515144a98ca"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:35:02.833166 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:02.833083 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4mx4\" (UniqueName: \"kubernetes.io/projected/63967965-bbd8-4b77-811a-5515144a98ca-kube-api-access-j4mx4\") on node \"ip-10-0-130-209.ec2.internal\" DevicePath \"\"" Jul 20 16:35:02.833166 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:02.833125 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63967965-bbd8-4b77-811a-5515144a98ca-bundle\") on node \"ip-10-0-130-209.ec2.internal\" DevicePath \"\"" Jul 20 16:35:02.833166 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:02.833137 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63967965-bbd8-4b77-811a-5515144a98ca-util\") on node \"ip-10-0-130-209.ec2.internal\" DevicePath \"\"" Jul 20 16:35:03.511202 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:03.511167 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrrxv" event={"ID":"63967965-bbd8-4b77-811a-5515144a98ca","Type":"ContainerDied","Data":"37868541b94ca03778184dae1c1ac7e14244305cbfa0e915ba4fd01151f6bcc1"} Jul 20 16:35:03.511202 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:03.511200 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrrxv" Jul 20 16:35:03.511410 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:03.511215 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="37868541b94ca03778184dae1c1ac7e14244305cbfa0e915ba4fd01151f6bcc1" Jul 20 16:35:13.111582 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:13.111545 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-r2hrn"] Jul 20 16:35:13.111938 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:13.111763 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63967965-bbd8-4b77-811a-5515144a98ca" containerName="pull" Jul 20 16:35:13.111938 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:13.111772 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="63967965-bbd8-4b77-811a-5515144a98ca" containerName="pull" Jul 20 16:35:13.111938 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:13.111785 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63967965-bbd8-4b77-811a-5515144a98ca" containerName="extract" Jul 20 16:35:13.111938 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:13.111790 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="63967965-bbd8-4b77-811a-5515144a98ca" containerName="extract" Jul 20 16:35:13.111938 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:13.111799 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63967965-bbd8-4b77-811a-5515144a98ca" containerName="util" Jul 20 16:35:13.111938 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:13.111804 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="63967965-bbd8-4b77-811a-5515144a98ca" containerName="util" Jul 20 16:35:13.111938 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:13.111842 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="63967965-bbd8-4b77-811a-5515144a98ca" containerName="extract" Jul 20 16:35:13.114115 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:13.114088 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-r2hrn" Jul 20 16:35:13.116717 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:13.116694 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 20 16:35:13.116828 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:13.116760 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 20 16:35:13.133246 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:13.133219 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-r2hrn"] Jul 20 16:35:13.200099 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:13.200071 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhdk5\" (UniqueName: \"kubernetes.io/projected/3e40c58d-810f-4137-bc22-5bee7f1c710c-kube-api-access-fhdk5\") pod \"cert-manager-webhook-6486ffd997-r2hrn\" (UID: \"3e40c58d-810f-4137-bc22-5bee7f1c710c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r2hrn" Jul 20 16:35:13.200207 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:13.200121 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3e40c58d-810f-4137-bc22-5bee7f1c710c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-r2hrn\" (UID: \"3e40c58d-810f-4137-bc22-5bee7f1c710c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r2hrn" Jul 20 16:35:13.301376 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:13.301354 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3e40c58d-810f-4137-bc22-5bee7f1c710c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-r2hrn\" (UID: \"3e40c58d-810f-4137-bc22-5bee7f1c710c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r2hrn" Jul 20 16:35:13.301543 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:13.301407 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhdk5\" (UniqueName: \"kubernetes.io/projected/3e40c58d-810f-4137-bc22-5bee7f1c710c-kube-api-access-fhdk5\") pod \"cert-manager-webhook-6486ffd997-r2hrn\" (UID: \"3e40c58d-810f-4137-bc22-5bee7f1c710c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r2hrn" Jul 20 16:35:13.320629 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:13.320603 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3e40c58d-810f-4137-bc22-5bee7f1c710c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-r2hrn\" (UID: \"3e40c58d-810f-4137-bc22-5bee7f1c710c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r2hrn" Jul 20 16:35:13.321010 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:13.320993 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhdk5\" (UniqueName: \"kubernetes.io/projected/3e40c58d-810f-4137-bc22-5bee7f1c710c-kube-api-access-fhdk5\") pod \"cert-manager-webhook-6486ffd997-r2hrn\" (UID: \"3e40c58d-810f-4137-bc22-5bee7f1c710c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r2hrn" Jul 20 16:35:13.422181 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:13.422161 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-r2hrn" Jul 20 16:35:13.539191 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:13.539027 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-r2hrn"] Jul 20 16:35:13.541590 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:35:13.541562 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e40c58d_810f_4137_bc22_5bee7f1c710c.slice/crio-8f305cea052e0e340448d80e929b3eb988901909f1840022e46e0f99bca1f67e WatchSource:0}: Error finding container 8f305cea052e0e340448d80e929b3eb988901909f1840022e46e0f99bca1f67e: Status 404 returned error can't find the container with id 8f305cea052e0e340448d80e929b3eb988901909f1840022e46e0f99bca1f67e Jul 20 16:35:14.549829 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:14.549767 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-r2hrn" event={"ID":"3e40c58d-810f-4137-bc22-5bee7f1c710c","Type":"ContainerStarted","Data":"8f305cea052e0e340448d80e929b3eb988901909f1840022e46e0f99bca1f67e"} Jul 20 16:35:16.562734 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:16.562636 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-r2hrn" event={"ID":"3e40c58d-810f-4137-bc22-5bee7f1c710c","Type":"ContainerStarted","Data":"a7ee29977a71678d56f9aed5f6b558c0b2f9709689f8267640e61451d2296b19"} Jul 20 16:35:16.563059 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:16.562775 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-r2hrn" Jul 20 16:35:16.578668 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:16.578616 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-r2hrn" podStartSLOduration=0.8495096 podStartE2EDuration="3.578602734s" totalImagesPullingTime="2.729093134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:35:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:35:16.577689136 +0000 UTC m=+334.727489912" watchObservedRunningTime="2026-07-20 16:35:16.578602734 +0000 UTC m=+334.728403511" Jul 20 16:35:22.568718 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:22.568690 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-r2hrn" Jul 20 16:35:44.286502 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:44.286426 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dlcbr"] Jul 20 16:35:44.289232 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:44.289215 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dlcbr" Jul 20 16:35:44.291399 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:44.291376 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-d5mgx\"" Jul 20 16:35:44.291399 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:44.291395 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 20 16:35:44.292185 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:44.292169 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 20 16:35:44.296820 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:44.296800 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dlcbr"] Jul 20 16:35:44.403771 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:44.403742 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jw5v\" (UniqueName: \"kubernetes.io/projected/b126576b-aae9-441d-a962-69543ca889e8-kube-api-access-7jw5v\") pod \"openshift-lws-operator-fd8ccff4c-dlcbr\" (UID: \"b126576b-aae9-441d-a962-69543ca889e8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dlcbr" Jul 20 16:35:44.403874 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:44.403779 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b126576b-aae9-441d-a962-69543ca889e8-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dlcbr\" (UID: \"b126576b-aae9-441d-a962-69543ca889e8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dlcbr" Jul 20 16:35:44.504148 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:44.504118 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jw5v\" (UniqueName: \"kubernetes.io/projected/b126576b-aae9-441d-a962-69543ca889e8-kube-api-access-7jw5v\") pod \"openshift-lws-operator-fd8ccff4c-dlcbr\" (UID: \"b126576b-aae9-441d-a962-69543ca889e8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dlcbr" Jul 20 16:35:44.504263 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:44.504166 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b126576b-aae9-441d-a962-69543ca889e8-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dlcbr\" (UID: \"b126576b-aae9-441d-a962-69543ca889e8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dlcbr" Jul 20 16:35:44.504497 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:44.504479 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b126576b-aae9-441d-a962-69543ca889e8-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dlcbr\" (UID: \"b126576b-aae9-441d-a962-69543ca889e8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dlcbr" Jul 20 16:35:44.511535 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:44.511519 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jw5v\" (UniqueName: \"kubernetes.io/projected/b126576b-aae9-441d-a962-69543ca889e8-kube-api-access-7jw5v\") pod \"openshift-lws-operator-fd8ccff4c-dlcbr\" (UID: \"b126576b-aae9-441d-a962-69543ca889e8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dlcbr" Jul 20 16:35:44.598420 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:44.598343 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dlcbr" Jul 20 16:35:44.720932 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:44.720903 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dlcbr"] Jul 20 16:35:44.723912 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:35:44.723872 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb126576b_aae9_441d_a962_69543ca889e8.slice/crio-987953e121f264e491a925354b298f458ac1dc9b49e2c93e617f4dd816ce12b9 WatchSource:0}: Error finding container 987953e121f264e491a925354b298f458ac1dc9b49e2c93e617f4dd816ce12b9: Status 404 returned error can't find the container with id 987953e121f264e491a925354b298f458ac1dc9b49e2c93e617f4dd816ce12b9 Jul 20 16:35:45.672427 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:45.672387 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dlcbr" event={"ID":"b126576b-aae9-441d-a962-69543ca889e8","Type":"ContainerStarted","Data":"987953e121f264e491a925354b298f458ac1dc9b49e2c93e617f4dd816ce12b9"} Jul 20 16:35:47.681997 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:47.681954 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dlcbr" event={"ID":"b126576b-aae9-441d-a962-69543ca889e8","Type":"ContainerStarted","Data":"d26b768d0fc7efaf40301f81224b7e0e7c2325d684a195d3331295015450e572"} Jul 20 16:35:47.698783 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:35:47.698730 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dlcbr" podStartSLOduration=0.973476008 podStartE2EDuration="3.698709528s" totalImagesPullingTime="2.72523352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:35:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:35:47.697090092 +0000 UTC m=+365.846890849" watchObservedRunningTime="2026-07-20 16:35:47.698709528 +0000 UTC m=+365.848510307" Jul 20 16:36:07.498176 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:07.498142 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9d55867bb-htxhd"] Jul 20 16:36:07.501234 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:07.501203 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-htxhd" Jul 20 16:36:07.505452 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:07.505428 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 20 16:36:07.505597 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:07.505471 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gt9k8\"" Jul 20 16:36:07.505597 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:07.505586 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 20 16:36:07.505714 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:07.505605 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 20 16:36:07.505714 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:07.505696 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 20 16:36:07.515384 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:07.515360 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9d55867bb-htxhd"] Jul 20 16:36:07.663301 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:07.663274 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/48cc570e-9a86-4b47-9f02-c19aaad58f86-tmp\") pod \"opendatahub-operator-controller-manager-9d55867bb-htxhd\" (UID: \"48cc570e-9a86-4b47-9f02-c19aaad58f86\") " pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-htxhd" Jul 20 16:36:07.663449 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:07.663307 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/48cc570e-9a86-4b47-9f02-c19aaad58f86-webhook-cert\") pod \"opendatahub-operator-controller-manager-9d55867bb-htxhd\" (UID: \"48cc570e-9a86-4b47-9f02-c19aaad58f86\") " pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-htxhd" Jul 20 16:36:07.663449 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:07.663331 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/48cc570e-9a86-4b47-9f02-c19aaad58f86-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9d55867bb-htxhd\" (UID: \"48cc570e-9a86-4b47-9f02-c19aaad58f86\") " pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-htxhd" Jul 20 16:36:07.663449 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:07.663419 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2h5q\" (UniqueName: \"kubernetes.io/projected/48cc570e-9a86-4b47-9f02-c19aaad58f86-kube-api-access-l2h5q\") pod \"opendatahub-operator-controller-manager-9d55867bb-htxhd\" (UID: \"48cc570e-9a86-4b47-9f02-c19aaad58f86\") " pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-htxhd" Jul 20 16:36:07.663594 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:07.663479 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/48cc570e-9a86-4b47-9f02-c19aaad58f86-manifests\") pod \"opendatahub-operator-controller-manager-9d55867bb-htxhd\" (UID: \"48cc570e-9a86-4b47-9f02-c19aaad58f86\") " pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-htxhd" Jul 20 16:36:07.764588 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:07.764522 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/48cc570e-9a86-4b47-9f02-c19aaad58f86-manifests\") pod \"opendatahub-operator-controller-manager-9d55867bb-htxhd\" (UID: \"48cc570e-9a86-4b47-9f02-c19aaad58f86\") " pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-htxhd" Jul 20 16:36:07.764588 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:07.764557 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/48cc570e-9a86-4b47-9f02-c19aaad58f86-tmp\") pod \"opendatahub-operator-controller-manager-9d55867bb-htxhd\" (UID: \"48cc570e-9a86-4b47-9f02-c19aaad58f86\") " pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-htxhd" Jul 20 16:36:07.764588 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:07.764581 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/48cc570e-9a86-4b47-9f02-c19aaad58f86-webhook-cert\") pod \"opendatahub-operator-controller-manager-9d55867bb-htxhd\" (UID: \"48cc570e-9a86-4b47-9f02-c19aaad58f86\") " pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-htxhd" Jul 20 16:36:07.764808 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:07.764613 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/48cc570e-9a86-4b47-9f02-c19aaad58f86-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9d55867bb-htxhd\" (UID: \"48cc570e-9a86-4b47-9f02-c19aaad58f86\") " pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-htxhd" Jul 20 16:36:07.764808 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:07.764657 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2h5q\" (UniqueName: \"kubernetes.io/projected/48cc570e-9a86-4b47-9f02-c19aaad58f86-kube-api-access-l2h5q\") pod \"opendatahub-operator-controller-manager-9d55867bb-htxhd\" (UID: \"48cc570e-9a86-4b47-9f02-c19aaad58f86\") " pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-htxhd" Jul 20 16:36:07.765032 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:07.764990 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/48cc570e-9a86-4b47-9f02-c19aaad58f86-manifests\") pod \"opendatahub-operator-controller-manager-9d55867bb-htxhd\" (UID: \"48cc570e-9a86-4b47-9f02-c19aaad58f86\") " pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-htxhd" Jul 20 16:36:07.766880 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:07.766852 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/48cc570e-9a86-4b47-9f02-c19aaad58f86-tmp\") pod \"opendatahub-operator-controller-manager-9d55867bb-htxhd\" (UID: \"48cc570e-9a86-4b47-9f02-c19aaad58f86\") " pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-htxhd" Jul 20 16:36:07.766972 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:07.766938 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/48cc570e-9a86-4b47-9f02-c19aaad58f86-webhook-cert\") pod \"opendatahub-operator-controller-manager-9d55867bb-htxhd\" (UID: \"48cc570e-9a86-4b47-9f02-c19aaad58f86\") " pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-htxhd" Jul 20 16:36:07.767010 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:07.766972 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/48cc570e-9a86-4b47-9f02-c19aaad58f86-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9d55867bb-htxhd\" (UID: \"48cc570e-9a86-4b47-9f02-c19aaad58f86\") " pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-htxhd" Jul 20 16:36:07.778556 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:07.778531 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2h5q\" (UniqueName: \"kubernetes.io/projected/48cc570e-9a86-4b47-9f02-c19aaad58f86-kube-api-access-l2h5q\") pod \"opendatahub-operator-controller-manager-9d55867bb-htxhd\" (UID: \"48cc570e-9a86-4b47-9f02-c19aaad58f86\") " pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-htxhd" Jul 20 16:36:07.810458 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:07.810430 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-htxhd" Jul 20 16:36:07.941691 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:07.941664 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9d55867bb-htxhd"] Jul 20 16:36:07.944631 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:36:07.944605 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48cc570e_9a86_4b47_9f02_c19aaad58f86.slice/crio-c1443da848d5c90e6dd86d88f207374e41a05c9e4aaa8786f3f36bbf1d010812 WatchSource:0}: Error finding container c1443da848d5c90e6dd86d88f207374e41a05c9e4aaa8786f3f36bbf1d010812: Status 404 returned error can't find the container with id c1443da848d5c90e6dd86d88f207374e41a05c9e4aaa8786f3f36bbf1d010812 Jul 20 16:36:08.755848 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:08.755810 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-htxhd" event={"ID":"48cc570e-9a86-4b47-9f02-c19aaad58f86","Type":"ContainerStarted","Data":"c1443da848d5c90e6dd86d88f207374e41a05c9e4aaa8786f3f36bbf1d010812"} Jul 20 16:36:11.772383 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:11.772351 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-htxhd" event={"ID":"48cc570e-9a86-4b47-9f02-c19aaad58f86","Type":"ContainerStarted","Data":"7ab8f0a5a0581aacdaa496fe8178ae718a3cbe17b779c5d77d09261d8dc7944d"} Jul 20 16:36:12.777897 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:12.777862 2583 generic.go:356] "Generic (PLEG): container finished" podID="48cc570e-9a86-4b47-9f02-c19aaad58f86" containerID="7ab8f0a5a0581aacdaa496fe8178ae718a3cbe17b779c5d77d09261d8dc7944d" exitCode=0 Jul 20 16:36:12.778309 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:12.777951 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-htxhd" event={"ID":"48cc570e-9a86-4b47-9f02-c19aaad58f86","Type":"ContainerDied","Data":"7ab8f0a5a0581aacdaa496fe8178ae718a3cbe17b779c5d77d09261d8dc7944d"} Jul 20 16:36:13.783391 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:13.783362 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-htxhd" event={"ID":"48cc570e-9a86-4b47-9f02-c19aaad58f86","Type":"ContainerStarted","Data":"09020aa74548d32a127e48f8d81535d56d9cedf87e8e6987d4c8199c313f9438"} Jul 20 16:36:13.783684 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:13.783505 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-htxhd" Jul 20 16:36:13.804738 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:13.804697 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-htxhd" podStartSLOduration=1.935213365 podStartE2EDuration="6.804671146s" totalImagesPullingTime="3.866165766s" totalInitContainerRuntime="1.003292015s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:36:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:36:13.803437679 +0000 UTC m=+391.953238483" watchObservedRunningTime="2026-07-20 16:36:13.804671146 +0000 UTC m=+391.954471921" Jul 20 16:36:24.789957 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:24.789926 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-htxhd" Jul 20 16:36:27.258802 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:27.258768 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9zf98"] Jul 20 16:36:27.267791 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:27.267768 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9zf98" Jul 20 16:36:27.270149 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:27.270129 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-r8459\"" Jul 20 16:36:27.270486 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:27.270099 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 20 16:36:27.272793 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:27.272771 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9zf98"] Jul 20 16:36:27.305960 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:27.305926 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n89j\" (UniqueName: \"kubernetes.io/projected/f1794d6e-7a49-480b-bd3d-4788ef9a33e3-kube-api-access-9n89j\") pod \"odh-model-controller-7998c67dc4-9zf98\" (UID: \"f1794d6e-7a49-480b-bd3d-4788ef9a33e3\") " pod="opendatahub/odh-model-controller-7998c67dc4-9zf98" Jul 20 16:36:27.306089 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:27.305968 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f1794d6e-7a49-480b-bd3d-4788ef9a33e3-cert\") pod \"odh-model-controller-7998c67dc4-9zf98\" (UID: \"f1794d6e-7a49-480b-bd3d-4788ef9a33e3\") " pod="opendatahub/odh-model-controller-7998c67dc4-9zf98" Jul 20 16:36:27.406807 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:27.406770 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f1794d6e-7a49-480b-bd3d-4788ef9a33e3-cert\") pod \"odh-model-controller-7998c67dc4-9zf98\" (UID: \"f1794d6e-7a49-480b-bd3d-4788ef9a33e3\") " pod="opendatahub/odh-model-controller-7998c67dc4-9zf98" Jul 20 16:36:27.406960 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:27.406849 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n89j\" (UniqueName: \"kubernetes.io/projected/f1794d6e-7a49-480b-bd3d-4788ef9a33e3-kube-api-access-9n89j\") pod \"odh-model-controller-7998c67dc4-9zf98\" (UID: \"f1794d6e-7a49-480b-bd3d-4788ef9a33e3\") " pod="opendatahub/odh-model-controller-7998c67dc4-9zf98" Jul 20 16:36:27.409094 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:27.409068 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f1794d6e-7a49-480b-bd3d-4788ef9a33e3-cert\") pod \"odh-model-controller-7998c67dc4-9zf98\" (UID: \"f1794d6e-7a49-480b-bd3d-4788ef9a33e3\") " pod="opendatahub/odh-model-controller-7998c67dc4-9zf98" Jul 20 16:36:27.420788 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:27.420766 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n89j\" (UniqueName: \"kubernetes.io/projected/f1794d6e-7a49-480b-bd3d-4788ef9a33e3-kube-api-access-9n89j\") pod \"odh-model-controller-7998c67dc4-9zf98\" (UID: \"f1794d6e-7a49-480b-bd3d-4788ef9a33e3\") " pod="opendatahub/odh-model-controller-7998c67dc4-9zf98" Jul 20 16:36:27.578930 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:27.578848 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9zf98" Jul 20 16:36:27.698841 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:27.698811 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9zf98"] Jul 20 16:36:27.701697 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:36:27.701675 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1794d6e_7a49_480b_bd3d_4788ef9a33e3.slice/crio-e5c1930865473cb207f47502cc0e40d21297d159b074f0dad1ff111eb1111c7a WatchSource:0}: Error finding container e5c1930865473cb207f47502cc0e40d21297d159b074f0dad1ff111eb1111c7a: Status 404 returned error can't find the container with id e5c1930865473cb207f47502cc0e40d21297d159b074f0dad1ff111eb1111c7a Jul 20 16:36:27.811284 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:27.811256 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-rsbfr"] Jul 20 16:36:27.815576 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:27.815557 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-rsbfr" Jul 20 16:36:27.817748 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:27.817727 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 20 16:36:27.817844 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:27.817769 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-ck78q\"" Jul 20 16:36:27.825173 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:27.825152 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-rsbfr"] Jul 20 16:36:27.842551 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:27.842493 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9zf98" event={"ID":"f1794d6e-7a49-480b-bd3d-4788ef9a33e3","Type":"ContainerStarted","Data":"e5c1930865473cb207f47502cc0e40d21297d159b074f0dad1ff111eb1111c7a"} Jul 20 16:36:27.910006 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:27.909978 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkbws\" (UniqueName: \"kubernetes.io/projected/447c9d52-2e46-4d04-91e6-028580234ef6-kube-api-access-zkbws\") pod \"model-serving-api-54d89bd5fc-rsbfr\" (UID: \"447c9d52-2e46-4d04-91e6-028580234ef6\") " pod="opendatahub/model-serving-api-54d89bd5fc-rsbfr" Jul 20 16:36:27.910087 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:27.910015 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/447c9d52-2e46-4d04-91e6-028580234ef6-tls-certs\") pod \"model-serving-api-54d89bd5fc-rsbfr\" (UID: \"447c9d52-2e46-4d04-91e6-028580234ef6\") " pod="opendatahub/model-serving-api-54d89bd5fc-rsbfr" Jul 20 16:36:28.010930 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:28.010910 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkbws\" (UniqueName: \"kubernetes.io/projected/447c9d52-2e46-4d04-91e6-028580234ef6-kube-api-access-zkbws\") pod \"model-serving-api-54d89bd5fc-rsbfr\" (UID: \"447c9d52-2e46-4d04-91e6-028580234ef6\") " pod="opendatahub/model-serving-api-54d89bd5fc-rsbfr" Jul 20 16:36:28.011015 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:28.010944 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/447c9d52-2e46-4d04-91e6-028580234ef6-tls-certs\") pod \"model-serving-api-54d89bd5fc-rsbfr\" (UID: \"447c9d52-2e46-4d04-91e6-028580234ef6\") " pod="opendatahub/model-serving-api-54d89bd5fc-rsbfr" Jul 20 16:36:28.011052 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:36:28.011033 2583 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 20 16:36:28.011085 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:36:28.011080 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/447c9d52-2e46-4d04-91e6-028580234ef6-tls-certs podName:447c9d52-2e46-4d04-91e6-028580234ef6 nodeName:}" failed. No retries permitted until 2026-07-20 16:36:28.511065003 +0000 UTC m=+406.660865757 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/447c9d52-2e46-4d04-91e6-028580234ef6-tls-certs") pod "model-serving-api-54d89bd5fc-rsbfr" (UID: "447c9d52-2e46-4d04-91e6-028580234ef6") : secret "model-serving-api-tls" not found Jul 20 16:36:28.022571 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:28.022551 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkbws\" (UniqueName: \"kubernetes.io/projected/447c9d52-2e46-4d04-91e6-028580234ef6-kube-api-access-zkbws\") pod \"model-serving-api-54d89bd5fc-rsbfr\" (UID: \"447c9d52-2e46-4d04-91e6-028580234ef6\") " pod="opendatahub/model-serving-api-54d89bd5fc-rsbfr" Jul 20 16:36:28.514712 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:28.514686 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/447c9d52-2e46-4d04-91e6-028580234ef6-tls-certs\") pod \"model-serving-api-54d89bd5fc-rsbfr\" (UID: \"447c9d52-2e46-4d04-91e6-028580234ef6\") " pod="opendatahub/model-serving-api-54d89bd5fc-rsbfr" Jul 20 16:36:28.516944 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:28.516924 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/447c9d52-2e46-4d04-91e6-028580234ef6-tls-certs\") pod \"model-serving-api-54d89bd5fc-rsbfr\" (UID: \"447c9d52-2e46-4d04-91e6-028580234ef6\") " pod="opendatahub/model-serving-api-54d89bd5fc-rsbfr" Jul 20 16:36:28.726465 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:28.726425 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-rsbfr" Jul 20 16:36:28.876619 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:28.876580 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-rsbfr"] Jul 20 16:36:28.878681 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:36:28.878649 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod447c9d52_2e46_4d04_91e6_028580234ef6.slice/crio-1d30ace7b32b1d96c70f823a0d03e7bf22651f16b2c50f01e9f87d4acd6e0e2e WatchSource:0}: Error finding container 1d30ace7b32b1d96c70f823a0d03e7bf22651f16b2c50f01e9f87d4acd6e0e2e: Status 404 returned error can't find the container with id 1d30ace7b32b1d96c70f823a0d03e7bf22651f16b2c50f01e9f87d4acd6e0e2e Jul 20 16:36:29.855990 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:29.855916 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-rsbfr" event={"ID":"447c9d52-2e46-4d04-91e6-028580234ef6","Type":"ContainerStarted","Data":"1d30ace7b32b1d96c70f823a0d03e7bf22651f16b2c50f01e9f87d4acd6e0e2e"} Jul 20 16:36:30.860552 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:30.860516 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9zf98" event={"ID":"f1794d6e-7a49-480b-bd3d-4788ef9a33e3","Type":"ContainerStarted","Data":"93f7f433647d3e3cd0a47278899735dda044813ff61b956b877513da16e1db69"} Jul 20 16:36:30.860904 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:30.860656 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-9zf98" Jul 20 16:36:30.877658 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:30.877600 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-9zf98" podStartSLOduration=0.816954307 podStartE2EDuration="3.877579037s" totalImagesPullingTime="3.06062473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:36:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:36:30.876271473 +0000 UTC m=+409.026072249" watchObservedRunningTime="2026-07-20 16:36:30.877579037 +0000 UTC m=+409.027379814" Jul 20 16:36:32.593812 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:32.593725 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-745b54bffd-p9mwc"] Jul 20 16:36:32.596840 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:32.596821 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-745b54bffd-p9mwc" Jul 20 16:36:32.598926 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:32.598902 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 20 16:36:32.599225 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:32.599206 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 20 16:36:32.599413 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:32.599398 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 20 16:36:32.600001 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:32.599983 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 20 16:36:32.600068 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:32.599988 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-kxjfw\"" Jul 20 16:36:32.605734 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:32.605712 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-745b54bffd-p9mwc"] Jul 20 16:36:32.648277 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:32.648251 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed6fff0c-1f01-408f-afe2-f7aac12096f2-tls-certs\") pod \"kube-auth-proxy-745b54bffd-p9mwc\" (UID: \"ed6fff0c-1f01-408f-afe2-f7aac12096f2\") " pod="openshift-ingress/kube-auth-proxy-745b54bffd-p9mwc" Jul 20 16:36:32.648412 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:32.648288 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed6fff0c-1f01-408f-afe2-f7aac12096f2-tmp\") pod \"kube-auth-proxy-745b54bffd-p9mwc\" (UID: \"ed6fff0c-1f01-408f-afe2-f7aac12096f2\") " pod="openshift-ingress/kube-auth-proxy-745b54bffd-p9mwc" Jul 20 16:36:32.648412 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:32.648319 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb6sm\" (UniqueName: \"kubernetes.io/projected/ed6fff0c-1f01-408f-afe2-f7aac12096f2-kube-api-access-wb6sm\") pod \"kube-auth-proxy-745b54bffd-p9mwc\" (UID: \"ed6fff0c-1f01-408f-afe2-f7aac12096f2\") " pod="openshift-ingress/kube-auth-proxy-745b54bffd-p9mwc" Jul 20 16:36:32.749654 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:32.749622 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed6fff0c-1f01-408f-afe2-f7aac12096f2-tls-certs\") pod \"kube-auth-proxy-745b54bffd-p9mwc\" (UID: \"ed6fff0c-1f01-408f-afe2-f7aac12096f2\") " pod="openshift-ingress/kube-auth-proxy-745b54bffd-p9mwc" Jul 20 16:36:32.749770 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:32.749659 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed6fff0c-1f01-408f-afe2-f7aac12096f2-tmp\") pod \"kube-auth-proxy-745b54bffd-p9mwc\" (UID: \"ed6fff0c-1f01-408f-afe2-f7aac12096f2\") " pod="openshift-ingress/kube-auth-proxy-745b54bffd-p9mwc" Jul 20 16:36:32.749770 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:32.749690 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb6sm\" (UniqueName: \"kubernetes.io/projected/ed6fff0c-1f01-408f-afe2-f7aac12096f2-kube-api-access-wb6sm\") pod \"kube-auth-proxy-745b54bffd-p9mwc\" (UID: \"ed6fff0c-1f01-408f-afe2-f7aac12096f2\") " pod="openshift-ingress/kube-auth-proxy-745b54bffd-p9mwc" Jul 20 16:36:32.749850 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:36:32.749764 2583 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 20 16:36:32.749850 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:36:32.749823 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed6fff0c-1f01-408f-afe2-f7aac12096f2-tls-certs podName:ed6fff0c-1f01-408f-afe2-f7aac12096f2 nodeName:}" failed. No retries permitted until 2026-07-20 16:36:33.249807561 +0000 UTC m=+411.399608315 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/ed6fff0c-1f01-408f-afe2-f7aac12096f2-tls-certs") pod "kube-auth-proxy-745b54bffd-p9mwc" (UID: "ed6fff0c-1f01-408f-afe2-f7aac12096f2") : secret "kube-auth-proxy-tls" not found Jul 20 16:36:32.751829 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:32.751807 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed6fff0c-1f01-408f-afe2-f7aac12096f2-tmp\") pod \"kube-auth-proxy-745b54bffd-p9mwc\" (UID: \"ed6fff0c-1f01-408f-afe2-f7aac12096f2\") " pod="openshift-ingress/kube-auth-proxy-745b54bffd-p9mwc" Jul 20 16:36:32.760096 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:32.760071 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb6sm\" (UniqueName: \"kubernetes.io/projected/ed6fff0c-1f01-408f-afe2-f7aac12096f2-kube-api-access-wb6sm\") pod \"kube-auth-proxy-745b54bffd-p9mwc\" (UID: \"ed6fff0c-1f01-408f-afe2-f7aac12096f2\") " pod="openshift-ingress/kube-auth-proxy-745b54bffd-p9mwc" Jul 20 16:36:32.870436 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:32.870359 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-rsbfr" event={"ID":"447c9d52-2e46-4d04-91e6-028580234ef6","Type":"ContainerStarted","Data":"99278a413bc587ac74bb059c901deee5c2bb700d1c3b616378d0446a89b6c04c"} Jul 20 16:36:32.870585 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:32.870493 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-rsbfr" Jul 20 16:36:32.890272 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:32.890224 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-rsbfr" podStartSLOduration=2.555093378 podStartE2EDuration="5.890209691s" totalImagesPullingTime="3.335116313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:36:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:36:32.889451656 +0000 UTC m=+411.039252443" watchObservedRunningTime="2026-07-20 16:36:32.890209691 +0000 UTC m=+411.040010467" Jul 20 16:36:33.252980 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:33.252946 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed6fff0c-1f01-408f-afe2-f7aac12096f2-tls-certs\") pod \"kube-auth-proxy-745b54bffd-p9mwc\" (UID: \"ed6fff0c-1f01-408f-afe2-f7aac12096f2\") " pod="openshift-ingress/kube-auth-proxy-745b54bffd-p9mwc" Jul 20 16:36:33.255291 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:33.255261 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed6fff0c-1f01-408f-afe2-f7aac12096f2-tls-certs\") pod \"kube-auth-proxy-745b54bffd-p9mwc\" (UID: \"ed6fff0c-1f01-408f-afe2-f7aac12096f2\") " pod="openshift-ingress/kube-auth-proxy-745b54bffd-p9mwc" Jul 20 16:36:33.506074 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:33.505996 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-745b54bffd-p9mwc" Jul 20 16:36:33.687935 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:33.687901 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-745b54bffd-p9mwc"] Jul 20 16:36:33.690920 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:36:33.690896 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded6fff0c_1f01_408f_afe2_f7aac12096f2.slice/crio-87e17cd6f35a391420f4cb557ad71471108653f35283dda92a5306e9f59455d9 WatchSource:0}: Error finding container 87e17cd6f35a391420f4cb557ad71471108653f35283dda92a5306e9f59455d9: Status 404 returned error can't find the container with id 87e17cd6f35a391420f4cb557ad71471108653f35283dda92a5306e9f59455d9 Jul 20 16:36:33.843022 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:33.842947 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szslf"] Jul 20 16:36:33.847221 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:33.847194 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szslf" Jul 20 16:36:33.857255 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:33.857236 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 20 16:36:33.857503 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:33.857491 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 20 16:36:33.857608 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:33.857591 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 20 16:36:33.857646 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:33.857594 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 20 16:36:33.857780 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:33.857737 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-7dtx8\"" Jul 20 16:36:33.876871 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:33.876728 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szslf"] Jul 20 16:36:33.878733 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:33.878673 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-745b54bffd-p9mwc" event={"ID":"ed6fff0c-1f01-408f-afe2-f7aac12096f2","Type":"ContainerStarted","Data":"87e17cd6f35a391420f4cb557ad71471108653f35283dda92a5306e9f59455d9"} Jul 20 16:36:33.959272 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:33.959235 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3951b40-36b6-4750-83c4-c580073544a3-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-szslf\" (UID: \"c3951b40-36b6-4750-83c4-c580073544a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szslf" Jul 20 16:36:33.959272 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:33.959271 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c3951b40-36b6-4750-83c4-c580073544a3-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-szslf\" (UID: \"c3951b40-36b6-4750-83c4-c580073544a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szslf" Jul 20 16:36:33.959476 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:33.959301 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c3951b40-36b6-4750-83c4-c580073544a3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-szslf\" (UID: \"c3951b40-36b6-4750-83c4-c580073544a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szslf" Jul 20 16:36:33.959476 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:33.959341 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c3951b40-36b6-4750-83c4-c580073544a3-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-szslf\" (UID: \"c3951b40-36b6-4750-83c4-c580073544a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szslf" Jul 20 16:36:33.959476 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:33.959383 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4tvf\" (UniqueName: \"kubernetes.io/projected/c3951b40-36b6-4750-83c4-c580073544a3-kube-api-access-z4tvf\") pod \"istiod-openshift-gateway-94bb8fbfd-szslf\" (UID: \"c3951b40-36b6-4750-83c4-c580073544a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szslf" Jul 20 16:36:33.959608 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:33.959464 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c3951b40-36b6-4750-83c4-c580073544a3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-szslf\" (UID: \"c3951b40-36b6-4750-83c4-c580073544a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szslf" Jul 20 16:36:33.959608 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:33.959500 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3951b40-36b6-4750-83c4-c580073544a3-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-szslf\" (UID: \"c3951b40-36b6-4750-83c4-c580073544a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szslf" Jul 20 16:36:34.060167 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:34.060125 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4tvf\" (UniqueName: \"kubernetes.io/projected/c3951b40-36b6-4750-83c4-c580073544a3-kube-api-access-z4tvf\") pod \"istiod-openshift-gateway-94bb8fbfd-szslf\" (UID: \"c3951b40-36b6-4750-83c4-c580073544a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szslf" Jul 20 16:36:34.060167 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:34.060179 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c3951b40-36b6-4750-83c4-c580073544a3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-szslf\" (UID: \"c3951b40-36b6-4750-83c4-c580073544a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szslf" Jul 20 16:36:34.060359 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:34.060198 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3951b40-36b6-4750-83c4-c580073544a3-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-szslf\" (UID: \"c3951b40-36b6-4750-83c4-c580073544a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szslf" Jul 20 16:36:34.060359 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:34.060234 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3951b40-36b6-4750-83c4-c580073544a3-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-szslf\" (UID: \"c3951b40-36b6-4750-83c4-c580073544a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szslf" Jul 20 16:36:34.060359 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:34.060248 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c3951b40-36b6-4750-83c4-c580073544a3-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-szslf\" (UID: \"c3951b40-36b6-4750-83c4-c580073544a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szslf" Jul 20 16:36:34.060359 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:34.060287 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c3951b40-36b6-4750-83c4-c580073544a3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-szslf\" (UID: \"c3951b40-36b6-4750-83c4-c580073544a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szslf" Jul 20 16:36:34.060359 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:34.060341 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c3951b40-36b6-4750-83c4-c580073544a3-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-szslf\" (UID: \"c3951b40-36b6-4750-83c4-c580073544a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szslf" Jul 20 16:36:34.060963 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:34.060934 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c3951b40-36b6-4750-83c4-c580073544a3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-szslf\" (UID: \"c3951b40-36b6-4750-83c4-c580073544a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szslf" Jul 20 16:36:34.062681 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:34.062655 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c3951b40-36b6-4750-83c4-c580073544a3-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-szslf\" (UID: \"c3951b40-36b6-4750-83c4-c580073544a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szslf" Jul 20 16:36:34.062794 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:34.062693 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c3951b40-36b6-4750-83c4-c580073544a3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-szslf\" (UID: \"c3951b40-36b6-4750-83c4-c580073544a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szslf" Jul 20 16:36:34.062889 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:34.062869 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3951b40-36b6-4750-83c4-c580073544a3-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-szslf\" (UID: \"c3951b40-36b6-4750-83c4-c580073544a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szslf" Jul 20 16:36:34.062950 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:34.062912 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c3951b40-36b6-4750-83c4-c580073544a3-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-szslf\" (UID: \"c3951b40-36b6-4750-83c4-c580073544a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szslf" Jul 20 16:36:34.069270 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:34.069244 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4tvf\" (UniqueName: \"kubernetes.io/projected/c3951b40-36b6-4750-83c4-c580073544a3-kube-api-access-z4tvf\") pod \"istiod-openshift-gateway-94bb8fbfd-szslf\" (UID: \"c3951b40-36b6-4750-83c4-c580073544a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szslf" Jul 20 16:36:34.069625 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:34.069604 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3951b40-36b6-4750-83c4-c580073544a3-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-szslf\" (UID: \"c3951b40-36b6-4750-83c4-c580073544a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szslf" Jul 20 16:36:34.157409 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:34.157391 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szslf" Jul 20 16:36:34.332586 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:36:34.332554 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3951b40_36b6_4750_83c4_c580073544a3.slice/crio-585c232a08dc13a22054d7480d67d89b35e9018e184fd3774eb5fa23e312b8c3 WatchSource:0}: Error finding container 585c232a08dc13a22054d7480d67d89b35e9018e184fd3774eb5fa23e312b8c3: Status 404 returned error can't find the container with id 585c232a08dc13a22054d7480d67d89b35e9018e184fd3774eb5fa23e312b8c3 Jul 20 16:36:34.339161 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:34.339135 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szslf"] Jul 20 16:36:34.882694 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:34.882661 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szslf" event={"ID":"c3951b40-36b6-4750-83c4-c580073544a3","Type":"ContainerStarted","Data":"585c232a08dc13a22054d7480d67d89b35e9018e184fd3774eb5fa23e312b8c3"} Jul 20 16:36:37.512973 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:37.512933 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:36:37.513298 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:37.513009 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:36:37.897218 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:37.897100 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-745b54bffd-p9mwc" event={"ID":"ed6fff0c-1f01-408f-afe2-f7aac12096f2","Type":"ContainerStarted","Data":"83f780b94ba6ce1726f5935e11b0e73c2a0edce0485e4143b4b123fffe1d4fd0"} Jul 20 16:36:37.898656 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:37.898626 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szslf" event={"ID":"c3951b40-36b6-4750-83c4-c580073544a3","Type":"ContainerStarted","Data":"e0ef0c2f099069869a19b7beda3df1ff06cd1c0987427f9948605b0f38cfffcd"} Jul 20 16:36:37.898775 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:37.898685 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szslf" Jul 20 16:36:37.916577 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:37.916527 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-745b54bffd-p9mwc" podStartSLOduration=2.098468903 podStartE2EDuration="5.916515241s" totalImagesPullingTime="3.818046338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:36:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:36:37.916001855 +0000 UTC m=+416.065802633" watchObservedRunningTime="2026-07-20 16:36:37.916515241 +0000 UTC m=+416.066316017" Jul 20 16:36:37.943340 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:37.943283 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szslf" podStartSLOduration=1.765469531 podStartE2EDuration="4.94326474s" totalImagesPullingTime="3.177795209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:36:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:36:37.942818764 +0000 UTC m=+416.092619584" watchObservedRunningTime="2026-07-20 16:36:37.94326474 +0000 UTC m=+416.093065519" Jul 20 16:36:38.904362 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:38.904320 2583 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-szslf container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 20 16:36:38.904947 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:38.904381 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szslf" podUID="c3951b40-36b6-4750-83c4-c580073544a3" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 20 16:36:39.273481 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:39.273405 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45kzsw"] Jul 20 16:36:39.276688 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:39.276668 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45kzsw" Jul 20 16:36:39.278946 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:39.278912 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-5dtdb\"" Jul 20 16:36:39.289640 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:39.289615 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45kzsw"] Jul 20 16:36:39.407770 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:39.407737 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/288bfa38-1130-4b06-9f5d-e69cab9b21f2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45kzsw\" (UID: \"288bfa38-1130-4b06-9f5d-e69cab9b21f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45kzsw" Jul 20 16:36:39.407770 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:39.407775 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/288bfa38-1130-4b06-9f5d-e69cab9b21f2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45kzsw\" (UID: \"288bfa38-1130-4b06-9f5d-e69cab9b21f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45kzsw" Jul 20 16:36:39.407967 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:39.407795 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/288bfa38-1130-4b06-9f5d-e69cab9b21f2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45kzsw\" (UID: \"288bfa38-1130-4b06-9f5d-e69cab9b21f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45kzsw" Jul 20 16:36:39.407967 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:39.407841 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6f64\" (UniqueName: \"kubernetes.io/projected/288bfa38-1130-4b06-9f5d-e69cab9b21f2-kube-api-access-n6f64\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45kzsw\" (UID: \"288bfa38-1130-4b06-9f5d-e69cab9b21f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45kzsw" Jul 20 16:36:39.407967 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:39.407916 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/288bfa38-1130-4b06-9f5d-e69cab9b21f2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45kzsw\" (UID: \"288bfa38-1130-4b06-9f5d-e69cab9b21f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45kzsw" Jul 20 16:36:39.407967 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:39.407937 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/288bfa38-1130-4b06-9f5d-e69cab9b21f2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45kzsw\" (UID: \"288bfa38-1130-4b06-9f5d-e69cab9b21f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45kzsw" Jul 20 16:36:39.408095 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:39.408025 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/288bfa38-1130-4b06-9f5d-e69cab9b21f2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45kzsw\" (UID: \"288bfa38-1130-4b06-9f5d-e69cab9b21f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45kzsw" Jul 20 16:36:39.408095 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:39.408051 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/288bfa38-1130-4b06-9f5d-e69cab9b21f2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45kzsw\" (UID: \"288bfa38-1130-4b06-9f5d-e69cab9b21f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45kzsw" Jul 20 16:36:39.408095 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:39.408072 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/288bfa38-1130-4b06-9f5d-e69cab9b21f2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45kzsw\" (UID: \"288bfa38-1130-4b06-9f5d-e69cab9b21f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45kzsw" Jul 20 16:36:39.508962 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:39.508928 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/288bfa38-1130-4b06-9f5d-e69cab9b21f2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45kzsw\" (UID: \"288bfa38-1130-4b06-9f5d-e69cab9b21f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45kzsw" Jul 20 16:36:39.508962 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:39.508966 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/288bfa38-1130-4b06-9f5d-e69cab9b21f2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45kzsw\" (UID: \"288bfa38-1130-4b06-9f5d-e69cab9b21f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45kzsw" Jul 20 16:36:39.509183 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:39.509016 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/288bfa38-1130-4b06-9f5d-e69cab9b21f2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45kzsw\" (UID: \"288bfa38-1130-4b06-9f5d-e69cab9b21f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45kzsw" Jul 20 16:36:39.509183 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:39.509149 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/288bfa38-1130-4b06-9f5d-e69cab9b21f2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45kzsw\" (UID: \"288bfa38-1130-4b06-9f5d-e69cab9b21f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45kzsw" Jul 20 16:36:39.509265 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:39.509194 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/288bfa38-1130-4b06-9f5d-e69cab9b21f2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45kzsw\" (UID: \"288bfa38-1130-4b06-9f5d-e69cab9b21f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45kzsw" Jul 20 16:36:39.509265 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:39.509239 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6f64\" (UniqueName: \"kubernetes.io/projected/288bfa38-1130-4b06-9f5d-e69cab9b21f2-kube-api-access-n6f64\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45kzsw\" (UID: \"288bfa38-1130-4b06-9f5d-e69cab9b21f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45kzsw" Jul 20 16:36:39.509370 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:39.509283 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/288bfa38-1130-4b06-9f5d-e69cab9b21f2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45kzsw\" (UID: \"288bfa38-1130-4b06-9f5d-e69cab9b21f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45kzsw" Jul 20 16:36:39.509370 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:39.509308 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/288bfa38-1130-4b06-9f5d-e69cab9b21f2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45kzsw\" (UID: \"288bfa38-1130-4b06-9f5d-e69cab9b21f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45kzsw" Jul 20 16:36:39.509370 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:39.509367 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/288bfa38-1130-4b06-9f5d-e69cab9b21f2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45kzsw\" (UID: \"288bfa38-1130-4b06-9f5d-e69cab9b21f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45kzsw" Jul 20 16:36:39.509514 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:39.509414 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/288bfa38-1130-4b06-9f5d-e69cab9b21f2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45kzsw\" (UID: \"288bfa38-1130-4b06-9f5d-e69cab9b21f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45kzsw" Jul 20 16:36:39.509597 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:39.509570 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/288bfa38-1130-4b06-9f5d-e69cab9b21f2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45kzsw\" (UID: \"288bfa38-1130-4b06-9f5d-e69cab9b21f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45kzsw" Jul 20 16:36:39.509706 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:39.509678 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/288bfa38-1130-4b06-9f5d-e69cab9b21f2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45kzsw\" (UID: \"288bfa38-1130-4b06-9f5d-e69cab9b21f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45kzsw" Jul 20 16:36:39.509774 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:39.509716 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/288bfa38-1130-4b06-9f5d-e69cab9b21f2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45kzsw\" (UID: \"288bfa38-1130-4b06-9f5d-e69cab9b21f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45kzsw" Jul 20 16:36:39.509774 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:39.509765 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/288bfa38-1130-4b06-9f5d-e69cab9b21f2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45kzsw\" (UID: \"288bfa38-1130-4b06-9f5d-e69cab9b21f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45kzsw" Jul 20 16:36:39.511574 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:39.511553 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/288bfa38-1130-4b06-9f5d-e69cab9b21f2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45kzsw\" (UID: \"288bfa38-1130-4b06-9f5d-e69cab9b21f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45kzsw" Jul 20 16:36:39.511786 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:39.511771 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/288bfa38-1130-4b06-9f5d-e69cab9b21f2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45kzsw\" (UID: \"288bfa38-1130-4b06-9f5d-e69cab9b21f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45kzsw" Jul 20 16:36:39.536737 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:39.536670 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/288bfa38-1130-4b06-9f5d-e69cab9b21f2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45kzsw\" (UID: \"288bfa38-1130-4b06-9f5d-e69cab9b21f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45kzsw" Jul 20 16:36:39.536839 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:39.536796 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6f64\" (UniqueName: \"kubernetes.io/projected/288bfa38-1130-4b06-9f5d-e69cab9b21f2-kube-api-access-n6f64\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45kzsw\" (UID: \"288bfa38-1130-4b06-9f5d-e69cab9b21f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45kzsw" Jul 20 16:36:39.586740 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:39.586712 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45kzsw" Jul 20 16:36:39.717278 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:39.717252 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45kzsw"] Jul 20 16:36:39.719731 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:36:39.719705 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod288bfa38_1130_4b06_9f5d_e69cab9b21f2.slice/crio-a8d23211ab4bb80fbc674288c9de374ab6c5ae5fe9227aa91c003e5a55bb732c WatchSource:0}: Error finding container a8d23211ab4bb80fbc674288c9de374ab6c5ae5fe9227aa91c003e5a55bb732c: Status 404 returned error can't find the container with id a8d23211ab4bb80fbc674288c9de374ab6c5ae5fe9227aa91c003e5a55bb732c Jul 20 16:36:39.907385 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:39.907354 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45kzsw" event={"ID":"288bfa38-1130-4b06-9f5d-e69cab9b21f2","Type":"ContainerStarted","Data":"a8d23211ab4bb80fbc674288c9de374ab6c5ae5fe9227aa91c003e5a55bb732c"} Jul 20 16:36:41.867248 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:41.867220 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-9zf98" Jul 20 16:36:41.903554 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:41.903518 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szslf" Jul 20 16:36:42.942962 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:42.942930 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:36:42.943217 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:42.943000 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:36:42.943217 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:42.943031 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:36:43.884963 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:43.884934 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-rsbfr" Jul 20 16:36:43.926962 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:43.926928 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45kzsw" event={"ID":"288bfa38-1130-4b06-9f5d-e69cab9b21f2","Type":"ContainerStarted","Data":"c1aa86dea1a2a364bfaa8402855525e7607f468df7270c8c9173336ada7eba8b"} Jul 20 16:36:43.947919 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:43.947858 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45kzsw" podStartSLOduration=1.7269230960000002 podStartE2EDuration="4.947842104s" totalImagesPullingTime="3.220919008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:36:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:36:43.946147157 +0000 UTC m=+422.095947935" watchObservedRunningTime="2026-07-20 16:36:43.947842104 +0000 UTC m=+422.097642880" Jul 20 16:36:44.587856 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:44.587818 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45kzsw" Jul 20 16:36:44.592778 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:44.592757 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45kzsw" Jul 20 16:36:44.932131 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:44.932091 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45kzsw" Jul 20 16:36:44.932931 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:36:44.932912 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45kzsw" Jul 20 16:38:04.214335 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:04.214301 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-m782l"] Jul 20 16:38:04.217666 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:04.217643 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-m782l" Jul 20 16:38:04.219914 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:04.219895 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 20 16:38:04.220010 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:04.219895 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 20 16:38:04.220010 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:04.219928 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 20 16:38:04.220751 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:04.220732 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-6cd9n\"" Jul 20 16:38:04.226504 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:04.226482 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-m782l"] Jul 20 16:38:04.371457 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:04.371427 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c48zz\" (UniqueName: \"kubernetes.io/projected/049a3f8b-8cb0-48f5-af56-16545098b474-kube-api-access-c48zz\") pod \"dns-operator-controller-manager-864dd78c4c-m782l\" (UID: \"049a3f8b-8cb0-48f5-af56-16545098b474\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-m782l" Jul 20 16:38:04.477056 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:04.472750 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c48zz\" (UniqueName: \"kubernetes.io/projected/049a3f8b-8cb0-48f5-af56-16545098b474-kube-api-access-c48zz\") pod \"dns-operator-controller-manager-864dd78c4c-m782l\" (UID: \"049a3f8b-8cb0-48f5-af56-16545098b474\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-m782l" Jul 20 16:38:04.480905 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:04.480876 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c48zz\" (UniqueName: \"kubernetes.io/projected/049a3f8b-8cb0-48f5-af56-16545098b474-kube-api-access-c48zz\") pod \"dns-operator-controller-manager-864dd78c4c-m782l\" (UID: \"049a3f8b-8cb0-48f5-af56-16545098b474\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-m782l" Jul 20 16:38:04.527934 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:04.527910 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-m782l" Jul 20 16:38:04.679364 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:38:04.679339 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod049a3f8b_8cb0_48f5_af56_16545098b474.slice/crio-cee927ff4f4c582ea1a03d0217fab7c1dc652c5561a66de96a82ea1662dd84b4 WatchSource:0}: Error finding container cee927ff4f4c582ea1a03d0217fab7c1dc652c5561a66de96a82ea1662dd84b4: Status 404 returned error can't find the container with id cee927ff4f4c582ea1a03d0217fab7c1dc652c5561a66de96a82ea1662dd84b4 Jul 20 16:38:04.685345 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:04.685321 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-m782l"] Jul 20 16:38:05.262262 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:05.262226 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-m782l" event={"ID":"049a3f8b-8cb0-48f5-af56-16545098b474","Type":"ContainerStarted","Data":"cee927ff4f4c582ea1a03d0217fab7c1dc652c5561a66de96a82ea1662dd84b4"} Jul 20 16:38:07.109220 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:07.109190 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62wjn"] Jul 20 16:38:07.112559 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:07.112538 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62wjn" Jul 20 16:38:07.114786 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:07.114763 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-mm2vn\"" Jul 20 16:38:07.123672 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:07.123650 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62wjn"] Jul 20 16:38:07.198700 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:07.198639 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7pdk\" (UniqueName: \"kubernetes.io/projected/7c3d9798-98ab-438f-b787-0667a3ec193b-kube-api-access-k7pdk\") pod \"limitador-operator-controller-manager-859d7b78bd-62wjn\" (UID: \"7c3d9798-98ab-438f-b787-0667a3ec193b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62wjn" Jul 20 16:38:07.273673 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:07.273639 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-m782l" event={"ID":"049a3f8b-8cb0-48f5-af56-16545098b474","Type":"ContainerStarted","Data":"aa8c56dd3362d53a72419efa81f8dd4f8fb411fa073e187e66c55d650ec3fac4"} Jul 20 16:38:07.273818 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:07.273750 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-m782l" Jul 20 16:38:07.290286 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:07.290239 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-m782l" podStartSLOduration=1.06404962 podStartE2EDuration="3.290225307s" totalImagesPullingTime="2.226175687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:38:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:38:07.288942733 +0000 UTC m=+505.438743508" watchObservedRunningTime="2026-07-20 16:38:07.290225307 +0000 UTC m=+505.440026131" Jul 20 16:38:07.299378 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:07.299351 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7pdk\" (UniqueName: \"kubernetes.io/projected/7c3d9798-98ab-438f-b787-0667a3ec193b-kube-api-access-k7pdk\") pod \"limitador-operator-controller-manager-859d7b78bd-62wjn\" (UID: \"7c3d9798-98ab-438f-b787-0667a3ec193b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62wjn" Jul 20 16:38:07.307237 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:07.307212 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7pdk\" (UniqueName: \"kubernetes.io/projected/7c3d9798-98ab-438f-b787-0667a3ec193b-kube-api-access-k7pdk\") pod \"limitador-operator-controller-manager-859d7b78bd-62wjn\" (UID: \"7c3d9798-98ab-438f-b787-0667a3ec193b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62wjn" Jul 20 16:38:07.422428 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:07.422401 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62wjn" Jul 20 16:38:07.546287 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:07.546266 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62wjn"] Jul 20 16:38:07.548147 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:38:07.548122 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c3d9798_98ab_438f_b787_0667a3ec193b.slice/crio-f757cec5bb615fdf2310f6119db5e557ab6123f6442ecf9308f6ec68af5552a1 WatchSource:0}: Error finding container f757cec5bb615fdf2310f6119db5e557ab6123f6442ecf9308f6ec68af5552a1: Status 404 returned error can't find the container with id f757cec5bb615fdf2310f6119db5e557ab6123f6442ecf9308f6ec68af5552a1 Jul 20 16:38:08.279913 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:08.279878 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62wjn" event={"ID":"7c3d9798-98ab-438f-b787-0667a3ec193b","Type":"ContainerStarted","Data":"f757cec5bb615fdf2310f6119db5e557ab6123f6442ecf9308f6ec68af5552a1"} Jul 20 16:38:10.291812 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:10.291777 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62wjn" event={"ID":"7c3d9798-98ab-438f-b787-0667a3ec193b","Type":"ContainerStarted","Data":"52621b568d2e7bd0f794c72a71c6dcb9f435bb559d3d97adc6dc1b7d5df70ea1"} Jul 20 16:38:10.292219 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:10.291844 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62wjn" Jul 20 16:38:10.310458 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:10.310413 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62wjn" podStartSLOduration=1.09563226 podStartE2EDuration="3.310397546s" totalImagesPullingTime="2.214765286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:38:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:38:10.308045247 +0000 UTC m=+508.457846036" watchObservedRunningTime="2026-07-20 16:38:10.310397546 +0000 UTC m=+508.460198322" Jul 20 16:38:18.282165 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:18.282135 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-m782l" Jul 20 16:38:21.297763 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:21.297734 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62wjn" Jul 20 16:38:22.260631 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:22.260601 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62wjn"] Jul 20 16:38:22.260809 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:22.260782 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62wjn" podUID="7c3d9798-98ab-438f-b787-0667a3ec193b" containerName="manager" containerID="cri-o://52621b568d2e7bd0f794c72a71c6dcb9f435bb559d3d97adc6dc1b7d5df70ea1" gracePeriod=2 Jul 20 16:38:22.271477 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:22.271451 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62wjn"] Jul 20 16:38:22.282661 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:38:22.282619 2583 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"7c3d9798-98ab-438f-b787-0667a3ec193b\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-62wjn\": pods \"limitador-operator-controller-manager-859d7b78bd-62wjn\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62wjn" Jul 20 16:38:22.284672 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:22.284650 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kzfmp"] Jul 20 16:38:22.284966 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:22.284954 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c3d9798-98ab-438f-b787-0667a3ec193b" containerName="manager" Jul 20 16:38:22.285010 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:22.284968 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c3d9798-98ab-438f-b787-0667a3ec193b" containerName="manager" Jul 20 16:38:22.285053 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:22.285035 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c3d9798-98ab-438f-b787-0667a3ec193b" containerName="manager" Jul 20 16:38:22.287794 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:22.287779 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kzfmp" Jul 20 16:38:22.297775 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:22.297750 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kzfmp"] Jul 20 16:38:22.318769 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:38:22.318745 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-62wjn\" is forbidden: User \"system:node:ip-10-0-130-209.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-209.ec2.internal' and this object" podUID="7c3d9798-98ab-438f-b787-0667a3ec193b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62wjn" Jul 20 16:38:22.332246 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:38:22.332222 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-62wjn\" is forbidden: User \"system:node:ip-10-0-130-209.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-209.ec2.internal' and this object" podUID="7c3d9798-98ab-438f-b787-0667a3ec193b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62wjn" Jul 20 16:38:22.415018 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:22.414987 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnzwz\" (UniqueName: \"kubernetes.io/projected/29a623ef-ec01-43b8-99d6-6f02809946fa-kube-api-access-jnzwz\") pod \"limitador-operator-controller-manager-859d7b78bd-kzfmp\" (UID: \"29a623ef-ec01-43b8-99d6-6f02809946fa\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kzfmp" Jul 20 16:38:22.501507 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:22.501481 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62wjn" Jul 20 16:38:22.515652 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:22.515602 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnzwz\" (UniqueName: \"kubernetes.io/projected/29a623ef-ec01-43b8-99d6-6f02809946fa-kube-api-access-jnzwz\") pod \"limitador-operator-controller-manager-859d7b78bd-kzfmp\" (UID: \"29a623ef-ec01-43b8-99d6-6f02809946fa\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kzfmp" Jul 20 16:38:22.531295 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:22.531270 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnzwz\" (UniqueName: \"kubernetes.io/projected/29a623ef-ec01-43b8-99d6-6f02809946fa-kube-api-access-jnzwz\") pod \"limitador-operator-controller-manager-859d7b78bd-kzfmp\" (UID: \"29a623ef-ec01-43b8-99d6-6f02809946fa\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kzfmp" Jul 20 16:38:22.616076 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:22.616052 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7pdk\" (UniqueName: \"kubernetes.io/projected/7c3d9798-98ab-438f-b787-0667a3ec193b-kube-api-access-k7pdk\") pod \"7c3d9798-98ab-438f-b787-0667a3ec193b\" (UID: \"7c3d9798-98ab-438f-b787-0667a3ec193b\") " Jul 20 16:38:22.617961 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:22.617940 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c3d9798-98ab-438f-b787-0667a3ec193b-kube-api-access-k7pdk" (OuterVolumeSpecName: "kube-api-access-k7pdk") pod "7c3d9798-98ab-438f-b787-0667a3ec193b" (UID: "7c3d9798-98ab-438f-b787-0667a3ec193b"). InnerVolumeSpecName "kube-api-access-k7pdk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:38:22.646950 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:22.646920 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kzfmp" Jul 20 16:38:22.716722 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:22.716698 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7pdk\" (UniqueName: \"kubernetes.io/projected/7c3d9798-98ab-438f-b787-0667a3ec193b-kube-api-access-k7pdk\") on node \"ip-10-0-130-209.ec2.internal\" DevicePath \"\"" Jul 20 16:38:22.772944 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:22.772918 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kzfmp"] Jul 20 16:38:22.774897 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:38:22.774871 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29a623ef_ec01_43b8_99d6_6f02809946fa.slice/crio-95b1162631c806ebdd63ace9d6e2c16305d07215c5d7b64793dddd9182312937 WatchSource:0}: Error finding container 95b1162631c806ebdd63ace9d6e2c16305d07215c5d7b64793dddd9182312937: Status 404 returned error can't find the container with id 95b1162631c806ebdd63ace9d6e2c16305d07215c5d7b64793dddd9182312937 Jul 20 16:38:23.355030 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:23.354987 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kzfmp" event={"ID":"29a623ef-ec01-43b8-99d6-6f02809946fa","Type":"ContainerStarted","Data":"65e7a709b8bb779e149f61fcd3e03584e37548c8ae5b8287c10dd33b459561db"} Jul 20 16:38:23.355484 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:23.355084 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kzfmp" event={"ID":"29a623ef-ec01-43b8-99d6-6f02809946fa","Type":"ContainerStarted","Data":"95b1162631c806ebdd63ace9d6e2c16305d07215c5d7b64793dddd9182312937"} Jul 20 16:38:23.355484 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:23.355209 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kzfmp" Jul 20 16:38:23.356298 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:23.356260 2583 generic.go:356] "Generic (PLEG): container finished" podID="7c3d9798-98ab-438f-b787-0667a3ec193b" containerID="52621b568d2e7bd0f794c72a71c6dcb9f435bb559d3d97adc6dc1b7d5df70ea1" exitCode=0 Jul 20 16:38:23.356426 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:23.356307 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62wjn" Jul 20 16:38:23.356426 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:23.356321 2583 scope.go:117] "RemoveContainer" containerID="52621b568d2e7bd0f794c72a71c6dcb9f435bb559d3d97adc6dc1b7d5df70ea1" Jul 20 16:38:23.365725 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:23.365709 2583 scope.go:117] "RemoveContainer" containerID="52621b568d2e7bd0f794c72a71c6dcb9f435bb559d3d97adc6dc1b7d5df70ea1" Jul 20 16:38:23.365973 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:38:23.365955 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52621b568d2e7bd0f794c72a71c6dcb9f435bb559d3d97adc6dc1b7d5df70ea1\": container with ID starting with 52621b568d2e7bd0f794c72a71c6dcb9f435bb559d3d97adc6dc1b7d5df70ea1 not found: ID does not exist" containerID="52621b568d2e7bd0f794c72a71c6dcb9f435bb559d3d97adc6dc1b7d5df70ea1" Jul 20 16:38:23.366033 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:23.365983 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52621b568d2e7bd0f794c72a71c6dcb9f435bb559d3d97adc6dc1b7d5df70ea1"} err="failed to get container status \"52621b568d2e7bd0f794c72a71c6dcb9f435bb559d3d97adc6dc1b7d5df70ea1\": rpc error: code = NotFound desc = could not find container \"52621b568d2e7bd0f794c72a71c6dcb9f435bb559d3d97adc6dc1b7d5df70ea1\": container with ID starting with 52621b568d2e7bd0f794c72a71c6dcb9f435bb559d3d97adc6dc1b7d5df70ea1 not found: ID does not exist" Jul 20 16:38:23.374208 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:23.374169 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kzfmp" podStartSLOduration=1.374157483 podStartE2EDuration="1.374157483s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:38:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:38:23.373149862 +0000 UTC m=+521.522950656" watchObservedRunningTime="2026-07-20 16:38:23.374157483 +0000 UTC m=+521.523958259" Jul 20 16:38:24.334184 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:24.334149 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c3d9798-98ab-438f-b787-0667a3ec193b" path="/var/lib/kubelet/pods/7c3d9798-98ab-438f-b787-0667a3ec193b/volumes" Jul 20 16:38:34.363239 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:34.363163 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kzfmp" Jul 20 16:38:50.982652 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:50.982620 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb"] Jul 20 16:38:50.989191 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:50.989172 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" Jul 20 16:38:50.991439 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:50.991417 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-fn2zs\"" Jul 20 16:38:50.999122 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:50.999090 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb"] Jul 20 16:38:51.000941 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:51.000917 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-gv5fb\" (UID: \"e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" Jul 20 16:38:51.001080 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:51.000958 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-gv5fb\" (UID: \"e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" Jul 20 16:38:51.001080 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:51.001046 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-gv5fb\" (UID: \"e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" Jul 20 16:38:51.001221 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:51.001080 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnzd9\" (UniqueName: \"kubernetes.io/projected/e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519-kube-api-access-jnzd9\") pod \"maas-default-gateway-openshift-default-56654dcf7-gv5fb\" (UID: \"e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" Jul 20 16:38:51.001221 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:51.001151 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-gv5fb\" (UID: \"e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" Jul 20 16:38:51.001221 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:51.001176 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-gv5fb\" (UID: \"e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" Jul 20 16:38:51.001387 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:51.001234 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-gv5fb\" (UID: \"e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" Jul 20 16:38:51.001387 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:51.001285 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-gv5fb\" (UID: \"e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" Jul 20 16:38:51.001387 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:51.001341 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-gv5fb\" (UID: \"e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" Jul 20 16:38:51.101836 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:51.101807 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-gv5fb\" (UID: \"e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" Jul 20 16:38:51.101968 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:51.101838 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnzd9\" (UniqueName: \"kubernetes.io/projected/e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519-kube-api-access-jnzd9\") pod \"maas-default-gateway-openshift-default-56654dcf7-gv5fb\" (UID: \"e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" Jul 20 16:38:51.101968 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:51.101867 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-gv5fb\" (UID: \"e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" Jul 20 16:38:51.101968 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:51.101884 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-gv5fb\" (UID: \"e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" Jul 20 16:38:51.101968 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:51.101904 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-gv5fb\" (UID: \"e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" Jul 20 16:38:51.102197 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:51.102073 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-gv5fb\" (UID: \"e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" Jul 20 16:38:51.102197 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:51.102139 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-gv5fb\" (UID: \"e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" Jul 20 16:38:51.102197 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:51.102186 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-gv5fb\" (UID: \"e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" Jul 20 16:38:51.102349 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:51.102216 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-gv5fb\" (UID: \"e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" Jul 20 16:38:51.102349 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:51.102266 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-gv5fb\" (UID: \"e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" Jul 20 16:38:51.102349 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:51.102214 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-gv5fb\" (UID: \"e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" Jul 20 16:38:51.102349 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:51.102306 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-gv5fb\" (UID: \"e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" Jul 20 16:38:51.102555 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:51.102446 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-gv5fb\" (UID: \"e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" Jul 20 16:38:51.102957 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:51.102933 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-gv5fb\" (UID: \"e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" Jul 20 16:38:51.104501 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:51.104467 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-gv5fb\" (UID: \"e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" Jul 20 16:38:51.104790 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:51.104767 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-gv5fb\" (UID: \"e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" Jul 20 16:38:51.109368 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:51.109345 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-gv5fb\" (UID: \"e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" Jul 20 16:38:51.109461 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:51.109442 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnzd9\" (UniqueName: \"kubernetes.io/projected/e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519-kube-api-access-jnzd9\") pod \"maas-default-gateway-openshift-default-56654dcf7-gv5fb\" (UID: \"e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" Jul 20 16:38:51.299521 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:51.299427 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" Jul 20 16:38:51.434411 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:51.434389 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb"] Jul 20 16:38:51.436801 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:38:51.436775 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6ff9675_4e9d_4b4b_9e10_7bd3da8d9519.slice/crio-3ae57759f4bcacd5c3d716d57db2737db11959e1e095f2af01f90f564a948a22 WatchSource:0}: Error finding container 3ae57759f4bcacd5c3d716d57db2737db11959e1e095f2af01f90f564a948a22: Status 404 returned error can't find the container with id 3ae57759f4bcacd5c3d716d57db2737db11959e1e095f2af01f90f564a948a22 Jul 20 16:38:51.438840 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:51.438804 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:38:51.438920 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:51.438882 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:38:51.439004 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:51.438965 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:38:51.474418 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:51.474393 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" event={"ID":"e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519","Type":"ContainerStarted","Data":"3ae57759f4bcacd5c3d716d57db2737db11959e1e095f2af01f90f564a948a22"} Jul 20 16:38:52.479776 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:52.479736 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" event={"ID":"e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519","Type":"ContainerStarted","Data":"f8cee05141f8786cc7ff8e42a9134af3439009cc01e92689104b86231828e26b"} Jul 20 16:38:52.510029 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:52.509983 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" podStartSLOduration=2.509968642 podStartE2EDuration="2.509968642s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:38:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:38:52.508320278 +0000 UTC m=+550.658121053" watchObservedRunningTime="2026-07-20 16:38:52.509968642 +0000 UTC m=+550.659769418" Jul 20 16:38:53.299977 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:53.299934 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" Jul 20 16:38:53.304659 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:53.304635 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" Jul 20 16:38:53.484015 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:53.483975 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" Jul 20 16:38:53.484911 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:53.484889 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" Jul 20 16:38:54.445329 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:54.445299 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-c4g68"] Jul 20 16:38:54.448914 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:54.448898 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-c4g68" Jul 20 16:38:54.451148 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:54.451126 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dd2w2\"" Jul 20 16:38:54.460268 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:54.460247 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-c4g68"] Jul 20 16:38:54.526063 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:54.526041 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtm2d\" (UniqueName: \"kubernetes.io/projected/dd5dda6c-1e6e-44b3-b57c-ef58231988e5-kube-api-access-rtm2d\") pod \"authorino-75d556bd77-c4g68\" (UID: \"dd5dda6c-1e6e-44b3-b57c-ef58231988e5\") " pod="kuadrant-system/authorino-75d556bd77-c4g68" Jul 20 16:38:54.627128 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:54.627071 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtm2d\" (UniqueName: \"kubernetes.io/projected/dd5dda6c-1e6e-44b3-b57c-ef58231988e5-kube-api-access-rtm2d\") pod \"authorino-75d556bd77-c4g68\" (UID: \"dd5dda6c-1e6e-44b3-b57c-ef58231988e5\") " pod="kuadrant-system/authorino-75d556bd77-c4g68" Jul 20 16:38:54.634739 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:54.634709 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtm2d\" (UniqueName: \"kubernetes.io/projected/dd5dda6c-1e6e-44b3-b57c-ef58231988e5-kube-api-access-rtm2d\") pod \"authorino-75d556bd77-c4g68\" (UID: \"dd5dda6c-1e6e-44b3-b57c-ef58231988e5\") " pod="kuadrant-system/authorino-75d556bd77-c4g68" Jul 20 16:38:54.758285 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:54.758207 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-c4g68" Jul 20 16:38:54.884975 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:54.884951 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-c4g68"] Jul 20 16:38:54.886773 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:38:54.886744 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd5dda6c_1e6e_44b3_b57c_ef58231988e5.slice/crio-5adbb5a85cc6021666751f28c32badf181d6c2d830ef31ff7bb23cd9e094206a WatchSource:0}: Error finding container 5adbb5a85cc6021666751f28c32badf181d6c2d830ef31ff7bb23cd9e094206a: Status 404 returned error can't find the container with id 5adbb5a85cc6021666751f28c32badf181d6c2d830ef31ff7bb23cd9e094206a Jul 20 16:38:55.494320 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:55.494270 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-c4g68" event={"ID":"dd5dda6c-1e6e-44b3-b57c-ef58231988e5","Type":"ContainerStarted","Data":"5adbb5a85cc6021666751f28c32badf181d6c2d830ef31ff7bb23cd9e094206a"} Jul 20 16:38:58.509993 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:58.509948 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-c4g68" event={"ID":"dd5dda6c-1e6e-44b3-b57c-ef58231988e5","Type":"ContainerStarted","Data":"cad9d9c4a937a02b322a8b3b54b90618c0c91a060f4f84d592d34720de4a46c6"} Jul 20 16:38:58.524818 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:38:58.524773 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-c4g68" podStartSLOduration=1.447645694 podStartE2EDuration="4.524758745s" totalImagesPullingTime="3.077113051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:38:58.523315891 +0000 UTC m=+556.673116686" watchObservedRunningTime="2026-07-20 16:38:58.524758745 +0000 UTC m=+556.674559521" Jul 20 16:39:30.061705 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:30.061670 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-c4g68"] Jul 20 16:39:30.062272 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:30.061854 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-c4g68" podUID="dd5dda6c-1e6e-44b3-b57c-ef58231988e5" containerName="authorino" containerID="cri-o://cad9d9c4a937a02b322a8b3b54b90618c0c91a060f4f84d592d34720de4a46c6" gracePeriod=30 Jul 20 16:39:30.306907 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:30.306879 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-c4g68" Jul 20 16:39:30.405952 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:30.405924 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtm2d\" (UniqueName: \"kubernetes.io/projected/dd5dda6c-1e6e-44b3-b57c-ef58231988e5-kube-api-access-rtm2d\") pod \"dd5dda6c-1e6e-44b3-b57c-ef58231988e5\" (UID: \"dd5dda6c-1e6e-44b3-b57c-ef58231988e5\") " Jul 20 16:39:30.407919 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:30.407892 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd5dda6c-1e6e-44b3-b57c-ef58231988e5-kube-api-access-rtm2d" (OuterVolumeSpecName: "kube-api-access-rtm2d") pod "dd5dda6c-1e6e-44b3-b57c-ef58231988e5" (UID: "dd5dda6c-1e6e-44b3-b57c-ef58231988e5"). InnerVolumeSpecName "kube-api-access-rtm2d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:39:30.506591 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:30.506556 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtm2d\" (UniqueName: \"kubernetes.io/projected/dd5dda6c-1e6e-44b3-b57c-ef58231988e5-kube-api-access-rtm2d\") on node \"ip-10-0-130-209.ec2.internal\" DevicePath \"\"" Jul 20 16:39:30.641752 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:30.641718 2583 generic.go:356] "Generic (PLEG): container finished" podID="dd5dda6c-1e6e-44b3-b57c-ef58231988e5" containerID="cad9d9c4a937a02b322a8b3b54b90618c0c91a060f4f84d592d34720de4a46c6" exitCode=0 Jul 20 16:39:30.641918 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:30.641760 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-c4g68" Jul 20 16:39:30.641918 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:30.641799 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-c4g68" event={"ID":"dd5dda6c-1e6e-44b3-b57c-ef58231988e5","Type":"ContainerDied","Data":"cad9d9c4a937a02b322a8b3b54b90618c0c91a060f4f84d592d34720de4a46c6"} Jul 20 16:39:30.641918 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:30.641850 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-c4g68" event={"ID":"dd5dda6c-1e6e-44b3-b57c-ef58231988e5","Type":"ContainerDied","Data":"5adbb5a85cc6021666751f28c32badf181d6c2d830ef31ff7bb23cd9e094206a"} Jul 20 16:39:30.641918 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:30.641868 2583 scope.go:117] "RemoveContainer" containerID="cad9d9c4a937a02b322a8b3b54b90618c0c91a060f4f84d592d34720de4a46c6" Jul 20 16:39:30.650846 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:30.650829 2583 scope.go:117] "RemoveContainer" containerID="cad9d9c4a937a02b322a8b3b54b90618c0c91a060f4f84d592d34720de4a46c6" Jul 20 16:39:30.651088 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:39:30.651067 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cad9d9c4a937a02b322a8b3b54b90618c0c91a060f4f84d592d34720de4a46c6\": container with ID starting with cad9d9c4a937a02b322a8b3b54b90618c0c91a060f4f84d592d34720de4a46c6 not found: ID does not exist" containerID="cad9d9c4a937a02b322a8b3b54b90618c0c91a060f4f84d592d34720de4a46c6" Jul 20 16:39:30.651153 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:30.651096 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cad9d9c4a937a02b322a8b3b54b90618c0c91a060f4f84d592d34720de4a46c6"} err="failed to get container status \"cad9d9c4a937a02b322a8b3b54b90618c0c91a060f4f84d592d34720de4a46c6\": rpc error: code = NotFound desc = could not find container \"cad9d9c4a937a02b322a8b3b54b90618c0c91a060f4f84d592d34720de4a46c6\": container with ID starting with cad9d9c4a937a02b322a8b3b54b90618c0c91a060f4f84d592d34720de4a46c6 not found: ID does not exist" Jul 20 16:39:30.661654 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:30.661603 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-c4g68"] Jul 20 16:39:30.666288 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:30.666268 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-c4g68"] Jul 20 16:39:32.338956 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:32.338922 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd5dda6c-1e6e-44b3-b57c-ef58231988e5" path="/var/lib/kubelet/pods/dd5dda6c-1e6e-44b3-b57c-ef58231988e5/volumes" Jul 20 16:39:34.698360 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:34.698326 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-77c668bb8b-dw2wm"] Jul 20 16:39:34.698838 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:34.698818 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd5dda6c-1e6e-44b3-b57c-ef58231988e5" containerName="authorino" Jul 20 16:39:34.698916 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:34.698841 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd5dda6c-1e6e-44b3-b57c-ef58231988e5" containerName="authorino" Jul 20 16:39:34.698965 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:34.698926 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd5dda6c-1e6e-44b3-b57c-ef58231988e5" containerName="authorino" Jul 20 16:39:34.702396 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:34.702375 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77c668bb8b-dw2wm" Jul 20 16:39:34.704633 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:34.704607 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 20 16:39:34.704633 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:34.704617 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-c56nc\"" Jul 20 16:39:34.705376 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:34.705359 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 20 16:39:34.710436 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:34.710407 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77c668bb8b-dw2wm"] Jul 20 16:39:34.839147 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:34.839098 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5e970c8a-aebf-40c9-9a21-877e6aef2511-webhook-cert\") pod \"maas-controller-77c668bb8b-dw2wm\" (UID: \"5e970c8a-aebf-40c9-9a21-877e6aef2511\") " pod="opendatahub/maas-controller-77c668bb8b-dw2wm" Jul 20 16:39:34.839297 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:34.839189 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mps9d\" (UniqueName: \"kubernetes.io/projected/5e970c8a-aebf-40c9-9a21-877e6aef2511-kube-api-access-mps9d\") pod \"maas-controller-77c668bb8b-dw2wm\" (UID: \"5e970c8a-aebf-40c9-9a21-877e6aef2511\") " pod="opendatahub/maas-controller-77c668bb8b-dw2wm" Jul 20 16:39:34.885431 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:34.885404 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-659f7c964b-ntz6c"] Jul 20 16:39:34.888140 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:34.888124 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-659f7c964b-ntz6c" Jul 20 16:39:34.898328 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:34.898306 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-659f7c964b-ntz6c"] Jul 20 16:39:34.939753 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:34.939728 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5e970c8a-aebf-40c9-9a21-877e6aef2511-webhook-cert\") pod \"maas-controller-77c668bb8b-dw2wm\" (UID: \"5e970c8a-aebf-40c9-9a21-877e6aef2511\") " pod="opendatahub/maas-controller-77c668bb8b-dw2wm" Jul 20 16:39:34.939844 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:34.939772 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mps9d\" (UniqueName: \"kubernetes.io/projected/5e970c8a-aebf-40c9-9a21-877e6aef2511-kube-api-access-mps9d\") pod \"maas-controller-77c668bb8b-dw2wm\" (UID: \"5e970c8a-aebf-40c9-9a21-877e6aef2511\") " pod="opendatahub/maas-controller-77c668bb8b-dw2wm" Jul 20 16:39:34.939887 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:39:34.939870 2583 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 20 16:39:34.939940 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:39:34.939930 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e970c8a-aebf-40c9-9a21-877e6aef2511-webhook-cert podName:5e970c8a-aebf-40c9-9a21-877e6aef2511 nodeName:}" failed. No retries permitted until 2026-07-20 16:39:35.439912054 +0000 UTC m=+593.589712828 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/5e970c8a-aebf-40c9-9a21-877e6aef2511-webhook-cert") pod "maas-controller-77c668bb8b-dw2wm" (UID: "5e970c8a-aebf-40c9-9a21-877e6aef2511") : secret "maas-controller-webhook-cert" not found Jul 20 16:39:34.947844 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:34.947818 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mps9d\" (UniqueName: \"kubernetes.io/projected/5e970c8a-aebf-40c9-9a21-877e6aef2511-kube-api-access-mps9d\") pod \"maas-controller-77c668bb8b-dw2wm\" (UID: \"5e970c8a-aebf-40c9-9a21-877e6aef2511\") " pod="opendatahub/maas-controller-77c668bb8b-dw2wm" Jul 20 16:39:35.041100 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:35.041039 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d08732e-0d10-4769-84fd-589ae752b7fc-webhook-cert\") pod \"maas-controller-659f7c964b-ntz6c\" (UID: \"1d08732e-0d10-4769-84fd-589ae752b7fc\") " pod="opendatahub/maas-controller-659f7c964b-ntz6c" Jul 20 16:39:35.041100 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:35.041095 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6mxc\" (UniqueName: \"kubernetes.io/projected/1d08732e-0d10-4769-84fd-589ae752b7fc-kube-api-access-h6mxc\") pod \"maas-controller-659f7c964b-ntz6c\" (UID: \"1d08732e-0d10-4769-84fd-589ae752b7fc\") " pod="opendatahub/maas-controller-659f7c964b-ntz6c" Jul 20 16:39:35.141783 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:35.141759 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6mxc\" (UniqueName: \"kubernetes.io/projected/1d08732e-0d10-4769-84fd-589ae752b7fc-kube-api-access-h6mxc\") pod \"maas-controller-659f7c964b-ntz6c\" (UID: \"1d08732e-0d10-4769-84fd-589ae752b7fc\") " pod="opendatahub/maas-controller-659f7c964b-ntz6c" Jul 20 16:39:35.141862 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:35.141828 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d08732e-0d10-4769-84fd-589ae752b7fc-webhook-cert\") pod \"maas-controller-659f7c964b-ntz6c\" (UID: \"1d08732e-0d10-4769-84fd-589ae752b7fc\") " pod="opendatahub/maas-controller-659f7c964b-ntz6c" Jul 20 16:39:35.141929 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:39:35.141915 2583 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 20 16:39:35.141988 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:39:35.141978 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d08732e-0d10-4769-84fd-589ae752b7fc-webhook-cert podName:1d08732e-0d10-4769-84fd-589ae752b7fc nodeName:}" failed. No retries permitted until 2026-07-20 16:39:35.641962179 +0000 UTC m=+593.791762942 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/1d08732e-0d10-4769-84fd-589ae752b7fc-webhook-cert") pod "maas-controller-659f7c964b-ntz6c" (UID: "1d08732e-0d10-4769-84fd-589ae752b7fc") : secret "maas-controller-webhook-cert" not found Jul 20 16:39:35.150456 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:35.150432 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6mxc\" (UniqueName: \"kubernetes.io/projected/1d08732e-0d10-4769-84fd-589ae752b7fc-kube-api-access-h6mxc\") pod \"maas-controller-659f7c964b-ntz6c\" (UID: \"1d08732e-0d10-4769-84fd-589ae752b7fc\") " pod="opendatahub/maas-controller-659f7c964b-ntz6c" Jul 20 16:39:35.445164 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:35.445133 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5e970c8a-aebf-40c9-9a21-877e6aef2511-webhook-cert\") pod \"maas-controller-77c668bb8b-dw2wm\" (UID: \"5e970c8a-aebf-40c9-9a21-877e6aef2511\") " pod="opendatahub/maas-controller-77c668bb8b-dw2wm" Jul 20 16:39:35.447427 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:35.447409 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5e970c8a-aebf-40c9-9a21-877e6aef2511-webhook-cert\") pod \"maas-controller-77c668bb8b-dw2wm\" (UID: \"5e970c8a-aebf-40c9-9a21-877e6aef2511\") " pod="opendatahub/maas-controller-77c668bb8b-dw2wm" Jul 20 16:39:35.613674 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:35.613647 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77c668bb8b-dw2wm" Jul 20 16:39:35.646940 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:35.646902 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d08732e-0d10-4769-84fd-589ae752b7fc-webhook-cert\") pod \"maas-controller-659f7c964b-ntz6c\" (UID: \"1d08732e-0d10-4769-84fd-589ae752b7fc\") " pod="opendatahub/maas-controller-659f7c964b-ntz6c" Jul 20 16:39:35.649131 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:35.649087 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d08732e-0d10-4769-84fd-589ae752b7fc-webhook-cert\") pod \"maas-controller-659f7c964b-ntz6c\" (UID: \"1d08732e-0d10-4769-84fd-589ae752b7fc\") " pod="opendatahub/maas-controller-659f7c964b-ntz6c" Jul 20 16:39:35.743402 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:35.743377 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77c668bb8b-dw2wm"] Jul 20 16:39:35.745029 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:39:35.744987 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e970c8a_aebf_40c9_9a21_877e6aef2511.slice/crio-b5353fef9d3b3f4991712d173977c3a8aec9815032932b71a026e76d49ad77ad WatchSource:0}: Error finding container b5353fef9d3b3f4991712d173977c3a8aec9815032932b71a026e76d49ad77ad: Status 404 returned error can't find the container with id b5353fef9d3b3f4991712d173977c3a8aec9815032932b71a026e76d49ad77ad Jul 20 16:39:35.797622 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:35.797601 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-659f7c964b-ntz6c" Jul 20 16:39:35.921189 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:35.921163 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-659f7c964b-ntz6c"] Jul 20 16:39:35.923193 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:39:35.923166 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d08732e_0d10_4769_84fd_589ae752b7fc.slice/crio-2ddf50730fe3a972a5b3539338f4c4801315dacf56ee300f8188a42feda393ca WatchSource:0}: Error finding container 2ddf50730fe3a972a5b3539338f4c4801315dacf56ee300f8188a42feda393ca: Status 404 returned error can't find the container with id 2ddf50730fe3a972a5b3539338f4c4801315dacf56ee300f8188a42feda393ca Jul 20 16:39:36.676185 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:36.676144 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77c668bb8b-dw2wm" event={"ID":"5e970c8a-aebf-40c9-9a21-877e6aef2511","Type":"ContainerStarted","Data":"b5353fef9d3b3f4991712d173977c3a8aec9815032932b71a026e76d49ad77ad"} Jul 20 16:39:36.679734 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:36.679698 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-659f7c964b-ntz6c" event={"ID":"1d08732e-0d10-4769-84fd-589ae752b7fc","Type":"ContainerStarted","Data":"2ddf50730fe3a972a5b3539338f4c4801315dacf56ee300f8188a42feda393ca"} Jul 20 16:39:38.691834 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:38.691801 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-659f7c964b-ntz6c" event={"ID":"1d08732e-0d10-4769-84fd-589ae752b7fc","Type":"ContainerStarted","Data":"923165f5d76735b14cce9226accd2cfcbb280c93ddb47c64484702adeb4534b6"} Jul 20 16:39:38.692246 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:38.691857 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-659f7c964b-ntz6c" Jul 20 16:39:38.693294 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:38.693263 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77c668bb8b-dw2wm" event={"ID":"5e970c8a-aebf-40c9-9a21-877e6aef2511","Type":"ContainerStarted","Data":"a525db36cfbfbf96d0bd5dc1bd7c8f748d0550b609935408f9c5cb3a3634f122"} Jul 20 16:39:38.693433 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:38.693397 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-77c668bb8b-dw2wm" Jul 20 16:39:38.709961 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:38.709918 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-659f7c964b-ntz6c" podStartSLOduration=2.361500831 podStartE2EDuration="4.709904698s" totalImagesPullingTime="2.348403867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:39:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:39:38.708392888 +0000 UTC m=+596.858193686" watchObservedRunningTime="2026-07-20 16:39:38.709904698 +0000 UTC m=+596.859705501" Jul 20 16:39:38.725291 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:38.725250 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-77c668bb8b-dw2wm" podStartSLOduration=2.20503366 podStartE2EDuration="4.725236142s" totalImagesPullingTime="2.520202482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:39:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:39:38.724029221 +0000 UTC m=+596.873829998" watchObservedRunningTime="2026-07-20 16:39:38.725236142 +0000 UTC m=+596.875036917" Jul 20 16:39:49.700249 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:49.700221 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-77c668bb8b-dw2wm" Jul 20 16:39:49.702561 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:49.700288 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-659f7c964b-ntz6c" Jul 20 16:39:49.755086 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:49.755054 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-77c668bb8b-dw2wm"] Jul 20 16:39:49.755332 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:49.755293 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-77c668bb8b-dw2wm" podUID="5e970c8a-aebf-40c9-9a21-877e6aef2511" containerName="manager" containerID="cri-o://a525db36cfbfbf96d0bd5dc1bd7c8f748d0550b609935408f9c5cb3a3634f122" gracePeriod=30 Jul 20 16:39:49.995080 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:49.995057 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77c668bb8b-dw2wm" Jul 20 16:39:50.166449 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:50.166424 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mps9d\" (UniqueName: \"kubernetes.io/projected/5e970c8a-aebf-40c9-9a21-877e6aef2511-kube-api-access-mps9d\") pod \"5e970c8a-aebf-40c9-9a21-877e6aef2511\" (UID: \"5e970c8a-aebf-40c9-9a21-877e6aef2511\") " Jul 20 16:39:50.166605 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:50.166491 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5e970c8a-aebf-40c9-9a21-877e6aef2511-webhook-cert\") pod \"5e970c8a-aebf-40c9-9a21-877e6aef2511\" (UID: \"5e970c8a-aebf-40c9-9a21-877e6aef2511\") " Jul 20 16:39:50.168600 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:50.168572 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e970c8a-aebf-40c9-9a21-877e6aef2511-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "5e970c8a-aebf-40c9-9a21-877e6aef2511" (UID: "5e970c8a-aebf-40c9-9a21-877e6aef2511"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:39:50.168707 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:50.168570 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e970c8a-aebf-40c9-9a21-877e6aef2511-kube-api-access-mps9d" (OuterVolumeSpecName: "kube-api-access-mps9d") pod "5e970c8a-aebf-40c9-9a21-877e6aef2511" (UID: "5e970c8a-aebf-40c9-9a21-877e6aef2511"). InnerVolumeSpecName "kube-api-access-mps9d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:39:50.267087 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:50.267027 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mps9d\" (UniqueName: \"kubernetes.io/projected/5e970c8a-aebf-40c9-9a21-877e6aef2511-kube-api-access-mps9d\") on node \"ip-10-0-130-209.ec2.internal\" DevicePath \"\"" Jul 20 16:39:50.267087 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:50.267048 2583 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5e970c8a-aebf-40c9-9a21-877e6aef2511-webhook-cert\") on node \"ip-10-0-130-209.ec2.internal\" DevicePath \"\"" Jul 20 16:39:50.745417 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:50.745382 2583 generic.go:356] "Generic (PLEG): container finished" podID="5e970c8a-aebf-40c9-9a21-877e6aef2511" containerID="a525db36cfbfbf96d0bd5dc1bd7c8f748d0550b609935408f9c5cb3a3634f122" exitCode=0 Jul 20 16:39:50.745843 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:50.745428 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77c668bb8b-dw2wm" Jul 20 16:39:50.745843 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:50.745476 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77c668bb8b-dw2wm" event={"ID":"5e970c8a-aebf-40c9-9a21-877e6aef2511","Type":"ContainerDied","Data":"a525db36cfbfbf96d0bd5dc1bd7c8f748d0550b609935408f9c5cb3a3634f122"} Jul 20 16:39:50.745843 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:50.745527 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77c668bb8b-dw2wm" event={"ID":"5e970c8a-aebf-40c9-9a21-877e6aef2511","Type":"ContainerDied","Data":"b5353fef9d3b3f4991712d173977c3a8aec9815032932b71a026e76d49ad77ad"} Jul 20 16:39:50.745843 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:50.745550 2583 scope.go:117] "RemoveContainer" containerID="a525db36cfbfbf96d0bd5dc1bd7c8f748d0550b609935408f9c5cb3a3634f122" Jul 20 16:39:50.753914 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:50.753899 2583 scope.go:117] "RemoveContainer" containerID="a525db36cfbfbf96d0bd5dc1bd7c8f748d0550b609935408f9c5cb3a3634f122" Jul 20 16:39:50.754205 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:39:50.754151 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a525db36cfbfbf96d0bd5dc1bd7c8f748d0550b609935408f9c5cb3a3634f122\": container with ID starting with a525db36cfbfbf96d0bd5dc1bd7c8f748d0550b609935408f9c5cb3a3634f122 not found: ID does not exist" containerID="a525db36cfbfbf96d0bd5dc1bd7c8f748d0550b609935408f9c5cb3a3634f122" Jul 20 16:39:50.754303 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:50.754212 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a525db36cfbfbf96d0bd5dc1bd7c8f748d0550b609935408f9c5cb3a3634f122"} err="failed to get container status \"a525db36cfbfbf96d0bd5dc1bd7c8f748d0550b609935408f9c5cb3a3634f122\": rpc error: code = NotFound desc = could not find container \"a525db36cfbfbf96d0bd5dc1bd7c8f748d0550b609935408f9c5cb3a3634f122\": container with ID starting with a525db36cfbfbf96d0bd5dc1bd7c8f748d0550b609935408f9c5cb3a3634f122 not found: ID does not exist" Jul 20 16:39:50.761712 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:50.761688 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-77c668bb8b-dw2wm"] Jul 20 16:39:50.765588 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:50.765570 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-77c668bb8b-dw2wm"] Jul 20 16:39:52.334637 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:39:52.334602 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e970c8a-aebf-40c9-9a21-877e6aef2511" path="/var/lib/kubelet/pods/5e970c8a-aebf-40c9-9a21-877e6aef2511/volumes" Jul 20 16:40:10.723056 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:10.722976 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6c8b896dcd-6x76z"] Jul 20 16:40:10.723503 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:10.723335 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e970c8a-aebf-40c9-9a21-877e6aef2511" containerName="manager" Jul 20 16:40:10.723503 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:10.723347 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e970c8a-aebf-40c9-9a21-877e6aef2511" containerName="manager" Jul 20 16:40:10.723503 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:10.723404 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e970c8a-aebf-40c9-9a21-877e6aef2511" containerName="manager" Jul 20 16:40:10.726340 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:10.726318 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6c8b896dcd-6x76z" Jul 20 16:40:10.728718 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:10.728697 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 20 16:40:10.728862 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:10.728842 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 20 16:40:10.729464 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:10.729448 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 20 16:40:10.729509 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:10.729464 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kxz6w\"" Jul 20 16:40:10.736713 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:10.736690 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6c8b896dcd-6x76z"] Jul 20 16:40:10.808846 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:10.808819 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/289715db-41ba-4f59-876e-a263443f1627-openshift-service-ca\") pod \"maas-api-6c8b896dcd-6x76z\" (UID: \"289715db-41ba-4f59-876e-a263443f1627\") " pod="odh-ai-gateway-infra/maas-api-6c8b896dcd-6x76z" Jul 20 16:40:10.808967 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:10.808856 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpp6z\" (UniqueName: \"kubernetes.io/projected/289715db-41ba-4f59-876e-a263443f1627-kube-api-access-cpp6z\") pod \"maas-api-6c8b896dcd-6x76z\" (UID: \"289715db-41ba-4f59-876e-a263443f1627\") " pod="odh-ai-gateway-infra/maas-api-6c8b896dcd-6x76z" Jul 20 16:40:10.808967 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:10.808886 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/289715db-41ba-4f59-876e-a263443f1627-maas-api-tls\") pod \"maas-api-6c8b896dcd-6x76z\" (UID: \"289715db-41ba-4f59-876e-a263443f1627\") " pod="odh-ai-gateway-infra/maas-api-6c8b896dcd-6x76z" Jul 20 16:40:10.910151 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:10.910088 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/289715db-41ba-4f59-876e-a263443f1627-openshift-service-ca\") pod \"maas-api-6c8b896dcd-6x76z\" (UID: \"289715db-41ba-4f59-876e-a263443f1627\") " pod="odh-ai-gateway-infra/maas-api-6c8b896dcd-6x76z" Jul 20 16:40:10.910326 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:10.910164 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpp6z\" (UniqueName: \"kubernetes.io/projected/289715db-41ba-4f59-876e-a263443f1627-kube-api-access-cpp6z\") pod \"maas-api-6c8b896dcd-6x76z\" (UID: \"289715db-41ba-4f59-876e-a263443f1627\") " pod="odh-ai-gateway-infra/maas-api-6c8b896dcd-6x76z" Jul 20 16:40:10.910326 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:10.910199 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/289715db-41ba-4f59-876e-a263443f1627-maas-api-tls\") pod \"maas-api-6c8b896dcd-6x76z\" (UID: \"289715db-41ba-4f59-876e-a263443f1627\") " pod="odh-ai-gateway-infra/maas-api-6c8b896dcd-6x76z" Jul 20 16:40:10.910326 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:40:10.910313 2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jul 20 16:40:10.910438 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:40:10.910361 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/289715db-41ba-4f59-876e-a263443f1627-maas-api-tls podName:289715db-41ba-4f59-876e-a263443f1627 nodeName:}" failed. No retries permitted until 2026-07-20 16:40:11.410347154 +0000 UTC m=+629.560147908 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/289715db-41ba-4f59-876e-a263443f1627-maas-api-tls") pod "maas-api-6c8b896dcd-6x76z" (UID: "289715db-41ba-4f59-876e-a263443f1627") : secret "maas-api-serving-cert" not found Jul 20 16:40:10.910795 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:10.910776 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/289715db-41ba-4f59-876e-a263443f1627-openshift-service-ca\") pod \"maas-api-6c8b896dcd-6x76z\" (UID: \"289715db-41ba-4f59-876e-a263443f1627\") " pod="odh-ai-gateway-infra/maas-api-6c8b896dcd-6x76z" Jul 20 16:40:10.918500 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:10.918471 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpp6z\" (UniqueName: \"kubernetes.io/projected/289715db-41ba-4f59-876e-a263443f1627-kube-api-access-cpp6z\") pod \"maas-api-6c8b896dcd-6x76z\" (UID: \"289715db-41ba-4f59-876e-a263443f1627\") " pod="odh-ai-gateway-infra/maas-api-6c8b896dcd-6x76z" Jul 20 16:40:11.303330 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:11.303297 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-fk6kj"] Jul 20 16:40:11.306656 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:11.306639 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-fk6kj" Jul 20 16:40:11.308922 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:11.308903 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 20 16:40:11.309000 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:11.308904 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-9p8x4\"" Jul 20 16:40:11.314383 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:11.314359 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-fk6kj"] Jul 20 16:40:11.413830 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:11.413796 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1c753ea-c04d-4604-973e-ab5ef84b3c0d-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-fk6kj\" (UID: \"a1c753ea-c04d-4604-973e-ab5ef84b3c0d\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fk6kj" Jul 20 16:40:11.414014 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:11.413873 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/289715db-41ba-4f59-876e-a263443f1627-maas-api-tls\") pod \"maas-api-6c8b896dcd-6x76z\" (UID: \"289715db-41ba-4f59-876e-a263443f1627\") " pod="odh-ai-gateway-infra/maas-api-6c8b896dcd-6x76z" Jul 20 16:40:11.414014 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:11.413946 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chxjt\" (UniqueName: \"kubernetes.io/projected/a1c753ea-c04d-4604-973e-ab5ef84b3c0d-kube-api-access-chxjt\") pod \"payload-pre-processing-7677b774bb-fk6kj\" (UID: \"a1c753ea-c04d-4604-973e-ab5ef84b3c0d\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fk6kj" Jul 20 16:40:11.414014 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:40:11.413953 2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jul 20 16:40:11.414200 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:40:11.414072 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/289715db-41ba-4f59-876e-a263443f1627-maas-api-tls podName:289715db-41ba-4f59-876e-a263443f1627 nodeName:}" failed. No retries permitted until 2026-07-20 16:40:12.414048765 +0000 UTC m=+630.563849533 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/289715db-41ba-4f59-876e-a263443f1627-maas-api-tls") pod "maas-api-6c8b896dcd-6x76z" (UID: "289715db-41ba-4f59-876e-a263443f1627") : secret "maas-api-serving-cert" not found Jul 20 16:40:11.515179 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:11.515147 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chxjt\" (UniqueName: \"kubernetes.io/projected/a1c753ea-c04d-4604-973e-ab5ef84b3c0d-kube-api-access-chxjt\") pod \"payload-pre-processing-7677b774bb-fk6kj\" (UID: \"a1c753ea-c04d-4604-973e-ab5ef84b3c0d\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fk6kj" Jul 20 16:40:11.515346 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:11.515214 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1c753ea-c04d-4604-973e-ab5ef84b3c0d-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-fk6kj\" (UID: \"a1c753ea-c04d-4604-973e-ab5ef84b3c0d\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fk6kj" Jul 20 16:40:11.515862 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:11.515841 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1c753ea-c04d-4604-973e-ab5ef84b3c0d-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-fk6kj\" (UID: \"a1c753ea-c04d-4604-973e-ab5ef84b3c0d\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fk6kj" Jul 20 16:40:11.522839 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:11.522801 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chxjt\" (UniqueName: \"kubernetes.io/projected/a1c753ea-c04d-4604-973e-ab5ef84b3c0d-kube-api-access-chxjt\") pod \"payload-pre-processing-7677b774bb-fk6kj\" (UID: \"a1c753ea-c04d-4604-973e-ab5ef84b3c0d\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fk6kj" Jul 20 16:40:11.617750 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:11.617679 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-fk6kj" Jul 20 16:40:11.747768 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:11.747697 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-fk6kj"] Jul 20 16:40:11.750120 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:40:11.750076 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1c753ea_c04d_4604_973e_ab5ef84b3c0d.slice/crio-9cffc95943b5c566a6442542807513b2ed0795ca0de83b9cd5eb9c694779c295 WatchSource:0}: Error finding container 9cffc95943b5c566a6442542807513b2ed0795ca0de83b9cd5eb9c694779c295: Status 404 returned error can't find the container with id 9cffc95943b5c566a6442542807513b2ed0795ca0de83b9cd5eb9c694779c295 Jul 20 16:40:11.752011 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:11.751994 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 16:40:11.837757 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:11.837728 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-fk6kj" event={"ID":"a1c753ea-c04d-4604-973e-ab5ef84b3c0d","Type":"ContainerStarted","Data":"9cffc95943b5c566a6442542807513b2ed0795ca0de83b9cd5eb9c694779c295"} Jul 20 16:40:12.422273 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:12.422226 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/289715db-41ba-4f59-876e-a263443f1627-maas-api-tls\") pod \"maas-api-6c8b896dcd-6x76z\" (UID: \"289715db-41ba-4f59-876e-a263443f1627\") " pod="odh-ai-gateway-infra/maas-api-6c8b896dcd-6x76z" Jul 20 16:40:12.425087 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:12.425039 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/289715db-41ba-4f59-876e-a263443f1627-maas-api-tls\") pod \"maas-api-6c8b896dcd-6x76z\" (UID: \"289715db-41ba-4f59-876e-a263443f1627\") " pod="odh-ai-gateway-infra/maas-api-6c8b896dcd-6x76z" Jul 20 16:40:12.537406 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:12.537368 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6c8b896dcd-6x76z" Jul 20 16:40:12.724272 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:12.723781 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6c8b896dcd-6x76z"] Jul 20 16:40:12.726294 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:40:12.726243 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod289715db_41ba_4f59_876e_a263443f1627.slice/crio-6700871cc1cd7283ecc31689492a7852c95be07a573c9dbc9154f0be68c31e04 WatchSource:0}: Error finding container 6700871cc1cd7283ecc31689492a7852c95be07a573c9dbc9154f0be68c31e04: Status 404 returned error can't find the container with id 6700871cc1cd7283ecc31689492a7852c95be07a573c9dbc9154f0be68c31e04 Jul 20 16:40:12.845546 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:12.845506 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6c8b896dcd-6x76z" event={"ID":"289715db-41ba-4f59-876e-a263443f1627","Type":"ContainerStarted","Data":"6700871cc1cd7283ecc31689492a7852c95be07a573c9dbc9154f0be68c31e04"} Jul 20 16:40:13.852760 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:13.852720 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-fk6kj" event={"ID":"a1c753ea-c04d-4604-973e-ab5ef84b3c0d","Type":"ContainerStarted","Data":"c767b65dbc985a167fd169172f6f6fcc22f7601a433ca12046c34c976fa993d0"} Jul 20 16:40:13.853195 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:13.852805 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-fk6kj" Jul 20 16:40:13.867195 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:13.867149 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-fk6kj" podStartSLOduration=0.924161935 podStartE2EDuration="2.867135215s" totalImagesPullingTime="1.94297328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:40:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:40:13.865265837 +0000 UTC m=+632.015066614" watchObservedRunningTime="2026-07-20 16:40:13.867135215 +0000 UTC m=+632.016935988" Jul 20 16:40:15.864060 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:15.864020 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6c8b896dcd-6x76z" event={"ID":"289715db-41ba-4f59-876e-a263443f1627","Type":"ContainerStarted","Data":"740a3a5a59ed75bd54f6137af545fd113f7e33c37eaf71086101d8b393ec79d3"} Jul 20 16:40:15.864445 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:15.864152 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6c8b896dcd-6x76z" Jul 20 16:40:15.882036 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:15.881976 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6c8b896dcd-6x76z" podStartSLOduration=3.490947752 podStartE2EDuration="5.881957016s" totalImagesPullingTime="2.391009264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:40:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:40:15.879154732 +0000 UTC m=+634.028955533" watchObservedRunningTime="2026-07-20 16:40:15.881957016 +0000 UTC m=+634.031757793" Jul 20 16:40:18.879319 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:18.879286 2583 generic.go:356] "Generic (PLEG): container finished" podID="e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519" containerID="f8cee05141f8786cc7ff8e42a9134af3439009cc01e92689104b86231828e26b" exitCode=0 Jul 20 16:40:18.879660 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:18.879358 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" event={"ID":"e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519","Type":"ContainerDied","Data":"f8cee05141f8786cc7ff8e42a9134af3439009cc01e92689104b86231828e26b"} Jul 20 16:40:18.879752 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:18.879738 2583 scope.go:117] "RemoveContainer" containerID="f8cee05141f8786cc7ff8e42a9134af3439009cc01e92689104b86231828e26b" Jul 20 16:40:18.880610 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:18.880581 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:40:18.880666 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:18.880649 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:40:18.880704 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:18.880689 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:40:19.885315 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:19.885282 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" event={"ID":"e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519","Type":"ContainerStarted","Data":"0dc90ef60bfafc2686ac4d01c07060b29c2f15d8dbe6e17fabc843c36b4b4750"} Jul 20 16:40:20.300571 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:20.300525 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" Jul 20 16:40:20.301950 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:20.301918 2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-gv5fb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jul 20 16:40:20.302066 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:20.301972 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" podUID="e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jul 20 16:40:21.300487 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:21.300449 2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-gv5fb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jul 20 16:40:21.300959 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:21.300514 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" podUID="e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jul 20 16:40:21.881441 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:21.881402 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6c8b896dcd-6x76z" Jul 20 16:40:22.299932 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:22.299899 2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-gv5fb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jul 20 16:40:22.300118 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:22.299957 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" podUID="e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jul 20 16:40:23.300343 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:23.300308 2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-gv5fb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jul 20 16:40:23.300738 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:23.300366 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" podUID="e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jul 20 16:40:23.484193 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:23.484155 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" Jul 20 16:40:24.300837 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:24.300802 2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-gv5fb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jul 20 16:40:24.301260 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:24.300857 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" podUID="e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jul 20 16:40:24.860688 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:24.860661 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-fk6kj" Jul 20 16:40:25.303310 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:25.303283 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" Jul 20 16:40:25.304154 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:40:25.304135 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gv5fb" Jul 20 16:41:09.888300 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:09.888261 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-nzrgr"] Jul 20 16:41:09.891651 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:09.891627 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzrgr" Jul 20 16:41:09.894978 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:09.894953 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 20 16:41:09.895082 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:09.894980 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 20 16:41:09.895082 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:09.894953 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-m2kx8\"" Jul 20 16:41:09.895082 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:09.894960 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 20 16:41:09.900942 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:09.900922 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-nzrgr"] Jul 20 16:41:10.005623 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:10.005587 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e8037aa-c527-4cd6-8a3f-e77665b9cbe2-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nzrgr\" (UID: \"5e8037aa-c527-4cd6-8a3f-e77665b9cbe2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzrgr" Jul 20 16:41:10.005756 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:10.005637 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e8037aa-c527-4cd6-8a3f-e77665b9cbe2-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nzrgr\" (UID: \"5e8037aa-c527-4cd6-8a3f-e77665b9cbe2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzrgr" Jul 20 16:41:10.005756 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:10.005655 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e8037aa-c527-4cd6-8a3f-e77665b9cbe2-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nzrgr\" (UID: \"5e8037aa-c527-4cd6-8a3f-e77665b9cbe2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzrgr" Jul 20 16:41:10.005756 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:10.005678 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftxdw\" (UniqueName: \"kubernetes.io/projected/5e8037aa-c527-4cd6-8a3f-e77665b9cbe2-kube-api-access-ftxdw\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nzrgr\" (UID: \"5e8037aa-c527-4cd6-8a3f-e77665b9cbe2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzrgr" Jul 20 16:41:10.005756 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:10.005721 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e8037aa-c527-4cd6-8a3f-e77665b9cbe2-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nzrgr\" (UID: \"5e8037aa-c527-4cd6-8a3f-e77665b9cbe2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzrgr" Jul 20 16:41:10.005756 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:10.005738 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e8037aa-c527-4cd6-8a3f-e77665b9cbe2-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nzrgr\" (UID: \"5e8037aa-c527-4cd6-8a3f-e77665b9cbe2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzrgr" Jul 20 16:41:10.106907 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:10.106865 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e8037aa-c527-4cd6-8a3f-e77665b9cbe2-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nzrgr\" (UID: \"5e8037aa-c527-4cd6-8a3f-e77665b9cbe2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzrgr" Jul 20 16:41:10.106907 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:10.106899 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e8037aa-c527-4cd6-8a3f-e77665b9cbe2-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nzrgr\" (UID: \"5e8037aa-c527-4cd6-8a3f-e77665b9cbe2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzrgr" Jul 20 16:41:10.107148 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:10.106916 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e8037aa-c527-4cd6-8a3f-e77665b9cbe2-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nzrgr\" (UID: \"5e8037aa-c527-4cd6-8a3f-e77665b9cbe2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzrgr" Jul 20 16:41:10.107148 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:10.106935 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftxdw\" (UniqueName: \"kubernetes.io/projected/5e8037aa-c527-4cd6-8a3f-e77665b9cbe2-kube-api-access-ftxdw\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nzrgr\" (UID: \"5e8037aa-c527-4cd6-8a3f-e77665b9cbe2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzrgr" Jul 20 16:41:10.107148 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:10.106969 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e8037aa-c527-4cd6-8a3f-e77665b9cbe2-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nzrgr\" (UID: \"5e8037aa-c527-4cd6-8a3f-e77665b9cbe2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzrgr" Jul 20 16:41:10.107148 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:10.106989 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e8037aa-c527-4cd6-8a3f-e77665b9cbe2-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nzrgr\" (UID: \"5e8037aa-c527-4cd6-8a3f-e77665b9cbe2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzrgr" Jul 20 16:41:10.107425 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:10.107404 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e8037aa-c527-4cd6-8a3f-e77665b9cbe2-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nzrgr\" (UID: \"5e8037aa-c527-4cd6-8a3f-e77665b9cbe2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzrgr" Jul 20 16:41:10.107497 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:10.107477 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e8037aa-c527-4cd6-8a3f-e77665b9cbe2-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nzrgr\" (UID: \"5e8037aa-c527-4cd6-8a3f-e77665b9cbe2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzrgr" Jul 20 16:41:10.107656 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:10.107621 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e8037aa-c527-4cd6-8a3f-e77665b9cbe2-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nzrgr\" (UID: \"5e8037aa-c527-4cd6-8a3f-e77665b9cbe2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzrgr" Jul 20 16:41:10.109342 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:10.109315 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e8037aa-c527-4cd6-8a3f-e77665b9cbe2-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nzrgr\" (UID: \"5e8037aa-c527-4cd6-8a3f-e77665b9cbe2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzrgr" Jul 20 16:41:10.109545 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:10.109526 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e8037aa-c527-4cd6-8a3f-e77665b9cbe2-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nzrgr\" (UID: \"5e8037aa-c527-4cd6-8a3f-e77665b9cbe2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzrgr" Jul 20 16:41:10.114457 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:10.114439 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftxdw\" (UniqueName: \"kubernetes.io/projected/5e8037aa-c527-4cd6-8a3f-e77665b9cbe2-kube-api-access-ftxdw\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nzrgr\" (UID: \"5e8037aa-c527-4cd6-8a3f-e77665b9cbe2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzrgr" Jul 20 16:41:10.203544 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:10.203527 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzrgr" Jul 20 16:41:10.332329 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:41:10.332297 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e8037aa_c527_4cd6_8a3f_e77665b9cbe2.slice/crio-351df67e6b028ed2cc00d2cf650959ba6e372ee480912885a7d2da7349da8fcd WatchSource:0}: Error finding container 351df67e6b028ed2cc00d2cf650959ba6e372ee480912885a7d2da7349da8fcd: Status 404 returned error can't find the container with id 351df67e6b028ed2cc00d2cf650959ba6e372ee480912885a7d2da7349da8fcd Jul 20 16:41:10.334672 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:10.334648 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-nzrgr"] Jul 20 16:41:11.127065 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:11.127024 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzrgr" event={"ID":"5e8037aa-c527-4cd6-8a3f-e77665b9cbe2","Type":"ContainerStarted","Data":"351df67e6b028ed2cc00d2cf650959ba6e372ee480912885a7d2da7349da8fcd"} Jul 20 16:41:12.133644 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:12.133608 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzrgr" event={"ID":"5e8037aa-c527-4cd6-8a3f-e77665b9cbe2","Type":"ContainerStarted","Data":"d4487a51b6af6f94054a75229115c006ff728ec4e2ccbae4c6ac82c42364163f"} Jul 20 16:41:12.151431 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:12.151384 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzrgr" podStartSLOduration=2.130660797 podStartE2EDuration="3.151369119s" totalImagesPullingTime="1.020708322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:41:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:41:12.149594156 +0000 UTC m=+690.299394932" watchObservedRunningTime="2026-07-20 16:41:12.151369119 +0000 UTC m=+690.301169896" Jul 20 16:41:15.388554 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:15.388515 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-474vw"] Jul 20 16:41:15.393128 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:15.393085 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-474vw" Jul 20 16:41:15.395570 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:15.395547 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 20 16:41:15.402525 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:15.402500 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-474vw"] Jul 20 16:41:15.449665 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:15.449632 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1d94e97-2f5a-423a-a732-09a06b0d5f41-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-474vw\" (UID: \"d1d94e97-2f5a-423a-a732-09a06b0d5f41\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-474vw" Jul 20 16:41:15.449665 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:15.449668 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1d94e97-2f5a-423a-a732-09a06b0d5f41-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-474vw\" (UID: \"d1d94e97-2f5a-423a-a732-09a06b0d5f41\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-474vw" Jul 20 16:41:15.449972 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:15.449778 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1d94e97-2f5a-423a-a732-09a06b0d5f41-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-474vw\" (UID: \"d1d94e97-2f5a-423a-a732-09a06b0d5f41\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-474vw" Jul 20 16:41:15.449972 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:15.449830 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1d94e97-2f5a-423a-a732-09a06b0d5f41-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-474vw\" (UID: \"d1d94e97-2f5a-423a-a732-09a06b0d5f41\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-474vw" Jul 20 16:41:15.449972 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:15.449902 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmt46\" (UniqueName: \"kubernetes.io/projected/d1d94e97-2f5a-423a-a732-09a06b0d5f41-kube-api-access-mmt46\") pod \"e2e-trlp-test-simulated-kserve-598466548d-474vw\" (UID: \"d1d94e97-2f5a-423a-a732-09a06b0d5f41\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-474vw" Jul 20 16:41:15.450177 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:15.449973 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1d94e97-2f5a-423a-a732-09a06b0d5f41-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-474vw\" (UID: \"d1d94e97-2f5a-423a-a732-09a06b0d5f41\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-474vw" Jul 20 16:41:15.550895 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:15.550859 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1d94e97-2f5a-423a-a732-09a06b0d5f41-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-474vw\" (UID: \"d1d94e97-2f5a-423a-a732-09a06b0d5f41\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-474vw" Jul 20 16:41:15.551061 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:15.550902 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmt46\" (UniqueName: \"kubernetes.io/projected/d1d94e97-2f5a-423a-a732-09a06b0d5f41-kube-api-access-mmt46\") pod \"e2e-trlp-test-simulated-kserve-598466548d-474vw\" (UID: \"d1d94e97-2f5a-423a-a732-09a06b0d5f41\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-474vw" Jul 20 16:41:15.551061 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:15.551024 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1d94e97-2f5a-423a-a732-09a06b0d5f41-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-474vw\" (UID: \"d1d94e97-2f5a-423a-a732-09a06b0d5f41\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-474vw" Jul 20 16:41:15.551206 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:15.551128 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1d94e97-2f5a-423a-a732-09a06b0d5f41-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-474vw\" (UID: \"d1d94e97-2f5a-423a-a732-09a06b0d5f41\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-474vw" Jul 20 16:41:15.551206 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:15.551155 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1d94e97-2f5a-423a-a732-09a06b0d5f41-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-474vw\" (UID: \"d1d94e97-2f5a-423a-a732-09a06b0d5f41\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-474vw" Jul 20 16:41:15.551312 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:15.551234 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1d94e97-2f5a-423a-a732-09a06b0d5f41-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-474vw\" (UID: \"d1d94e97-2f5a-423a-a732-09a06b0d5f41\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-474vw" Jul 20 16:41:15.551312 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:15.551276 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1d94e97-2f5a-423a-a732-09a06b0d5f41-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-474vw\" (UID: \"d1d94e97-2f5a-423a-a732-09a06b0d5f41\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-474vw" Jul 20 16:41:15.551497 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:15.551475 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1d94e97-2f5a-423a-a732-09a06b0d5f41-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-474vw\" (UID: \"d1d94e97-2f5a-423a-a732-09a06b0d5f41\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-474vw" Jul 20 16:41:15.551555 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:15.551511 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1d94e97-2f5a-423a-a732-09a06b0d5f41-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-474vw\" (UID: \"d1d94e97-2f5a-423a-a732-09a06b0d5f41\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-474vw" Jul 20 16:41:15.553400 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:15.553378 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1d94e97-2f5a-423a-a732-09a06b0d5f41-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-474vw\" (UID: \"d1d94e97-2f5a-423a-a732-09a06b0d5f41\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-474vw" Jul 20 16:41:15.553678 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:15.553658 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1d94e97-2f5a-423a-a732-09a06b0d5f41-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-474vw\" (UID: \"d1d94e97-2f5a-423a-a732-09a06b0d5f41\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-474vw" Jul 20 16:41:15.558357 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:15.558339 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmt46\" (UniqueName: \"kubernetes.io/projected/d1d94e97-2f5a-423a-a732-09a06b0d5f41-kube-api-access-mmt46\") pod \"e2e-trlp-test-simulated-kserve-598466548d-474vw\" (UID: \"d1d94e97-2f5a-423a-a732-09a06b0d5f41\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-474vw" Jul 20 16:41:15.704541 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:15.704497 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-474vw" Jul 20 16:41:15.839957 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:15.839928 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-474vw"] Jul 20 16:41:15.841523 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:41:15.841495 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1d94e97_2f5a_423a_a732_09a06b0d5f41.slice/crio-6c71387d114dfc41fa205386d893bdda504f6cf30e2b8621f991c77d214d58e8 WatchSource:0}: Error finding container 6c71387d114dfc41fa205386d893bdda504f6cf30e2b8621f991c77d214d58e8: Status 404 returned error can't find the container with id 6c71387d114dfc41fa205386d893bdda504f6cf30e2b8621f991c77d214d58e8 Jul 20 16:41:16.153530 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:16.153502 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-474vw" event={"ID":"d1d94e97-2f5a-423a-a732-09a06b0d5f41","Type":"ContainerStarted","Data":"bafee8b6ca5288f016538065d14cfb6d06244f13e07f4f43694a5bbc721110ba"} Jul 20 16:41:16.153686 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:16.153547 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-474vw" event={"ID":"d1d94e97-2f5a-423a-a732-09a06b0d5f41","Type":"ContainerStarted","Data":"6c71387d114dfc41fa205386d893bdda504f6cf30e2b8621f991c77d214d58e8"} Jul 20 16:41:16.170816 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:16.170765 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-474vw" podStartSLOduration=0.969220053 podStartE2EDuration="1.170750357s" totalImagesPullingTime="201.530304ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:41:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:41:16.168870226 +0000 UTC m=+694.318671022" watchObservedRunningTime="2026-07-20 16:41:16.170750357 +0000 UTC m=+694.320551134" Jul 20 16:41:20.203841 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:20.203805 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzrgr" Jul 20 16:41:20.204238 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:20.203872 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzrgr" Jul 20 16:41:20.216392 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:20.216365 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzrgr" Jul 20 16:41:21.191995 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:21.191966 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzrgr" Jul 20 16:41:23.281052 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:23.281007 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss"] Jul 20 16:41:23.284965 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:23.284942 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss" Jul 20 16:41:23.287256 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:23.287237 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 20 16:41:23.296554 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:23.296535 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss"] Jul 20 16:41:23.422364 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:23.422328 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4bb4dc8-f5e5-42c6-a5af-dc2e1930432b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss\" (UID: \"a4bb4dc8-f5e5-42c6-a5af-dc2e1930432b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss" Jul 20 16:41:23.422518 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:23.422394 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4bb4dc8-f5e5-42c6-a5af-dc2e1930432b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss\" (UID: \"a4bb4dc8-f5e5-42c6-a5af-dc2e1930432b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss" Jul 20 16:41:23.422518 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:23.422487 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4bb4dc8-f5e5-42c6-a5af-dc2e1930432b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss\" (UID: \"a4bb4dc8-f5e5-42c6-a5af-dc2e1930432b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss" Jul 20 16:41:23.422604 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:23.422555 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4bb4dc8-f5e5-42c6-a5af-dc2e1930432b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss\" (UID: \"a4bb4dc8-f5e5-42c6-a5af-dc2e1930432b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss" Jul 20 16:41:23.422652 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:23.422600 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4bb4dc8-f5e5-42c6-a5af-dc2e1930432b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss\" (UID: \"a4bb4dc8-f5e5-42c6-a5af-dc2e1930432b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss" Jul 20 16:41:23.422706 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:23.422657 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kn25\" (UniqueName: \"kubernetes.io/projected/a4bb4dc8-f5e5-42c6-a5af-dc2e1930432b-kube-api-access-8kn25\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss\" (UID: \"a4bb4dc8-f5e5-42c6-a5af-dc2e1930432b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss" Jul 20 16:41:23.523626 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:23.523590 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4bb4dc8-f5e5-42c6-a5af-dc2e1930432b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss\" (UID: \"a4bb4dc8-f5e5-42c6-a5af-dc2e1930432b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss" Jul 20 16:41:23.523626 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:23.523631 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4bb4dc8-f5e5-42c6-a5af-dc2e1930432b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss\" (UID: \"a4bb4dc8-f5e5-42c6-a5af-dc2e1930432b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss" Jul 20 16:41:23.523825 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:23.523663 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kn25\" (UniqueName: \"kubernetes.io/projected/a4bb4dc8-f5e5-42c6-a5af-dc2e1930432b-kube-api-access-8kn25\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss\" (UID: \"a4bb4dc8-f5e5-42c6-a5af-dc2e1930432b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss" Jul 20 16:41:23.523825 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:23.523692 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4bb4dc8-f5e5-42c6-a5af-dc2e1930432b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss\" (UID: \"a4bb4dc8-f5e5-42c6-a5af-dc2e1930432b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss" Jul 20 16:41:23.523825 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:23.523714 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4bb4dc8-f5e5-42c6-a5af-dc2e1930432b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss\" (UID: \"a4bb4dc8-f5e5-42c6-a5af-dc2e1930432b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss" Jul 20 16:41:23.523825 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:23.523759 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4bb4dc8-f5e5-42c6-a5af-dc2e1930432b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss\" (UID: \"a4bb4dc8-f5e5-42c6-a5af-dc2e1930432b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss" Jul 20 16:41:23.524240 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:23.524206 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4bb4dc8-f5e5-42c6-a5af-dc2e1930432b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss\" (UID: \"a4bb4dc8-f5e5-42c6-a5af-dc2e1930432b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss" Jul 20 16:41:23.524350 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:23.524243 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4bb4dc8-f5e5-42c6-a5af-dc2e1930432b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss\" (UID: \"a4bb4dc8-f5e5-42c6-a5af-dc2e1930432b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss" Jul 20 16:41:23.524350 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:23.524219 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4bb4dc8-f5e5-42c6-a5af-dc2e1930432b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss\" (UID: \"a4bb4dc8-f5e5-42c6-a5af-dc2e1930432b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss" Jul 20 16:41:23.525862 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:23.525839 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4bb4dc8-f5e5-42c6-a5af-dc2e1930432b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss\" (UID: \"a4bb4dc8-f5e5-42c6-a5af-dc2e1930432b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss" Jul 20 16:41:23.526254 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:23.526234 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4bb4dc8-f5e5-42c6-a5af-dc2e1930432b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss\" (UID: \"a4bb4dc8-f5e5-42c6-a5af-dc2e1930432b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss" Jul 20 16:41:23.531199 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:23.531140 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kn25\" (UniqueName: \"kubernetes.io/projected/a4bb4dc8-f5e5-42c6-a5af-dc2e1930432b-kube-api-access-8kn25\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss\" (UID: \"a4bb4dc8-f5e5-42c6-a5af-dc2e1930432b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss" Jul 20 16:41:23.596351 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:23.596319 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss" Jul 20 16:41:23.720654 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:23.720632 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss"] Jul 20 16:41:23.722559 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:41:23.722532 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4bb4dc8_f5e5_42c6_a5af_dc2e1930432b.slice/crio-fba4ce90a8a34a7afb4985a98dbc7e730385df2a02bea534fac524779bbc69c9 WatchSource:0}: Error finding container fba4ce90a8a34a7afb4985a98dbc7e730385df2a02bea534fac524779bbc69c9: Status 404 returned error can't find the container with id fba4ce90a8a34a7afb4985a98dbc7e730385df2a02bea534fac524779bbc69c9 Jul 20 16:41:24.196545 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:24.196460 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss" event={"ID":"a4bb4dc8-f5e5-42c6-a5af-dc2e1930432b","Type":"ContainerStarted","Data":"fbd78666d9df326f46233d66b122561ad70e66805c51e85aa19b8cbf20fcc1a1"} Jul 20 16:41:24.196685 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:24.196550 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss" event={"ID":"a4bb4dc8-f5e5-42c6-a5af-dc2e1930432b","Type":"ContainerStarted","Data":"fba4ce90a8a34a7afb4985a98dbc7e730385df2a02bea534fac524779bbc69c9"} Jul 20 16:41:24.212833 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:24.212786 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss" podStartSLOduration=1.027269949 podStartE2EDuration="1.212773297s" totalImagesPullingTime="185.503348ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:41:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:41:24.211767408 +0000 UTC m=+702.361568209" watchObservedRunningTime="2026-07-20 16:41:24.212773297 +0000 UTC m=+702.362574073" Jul 20 16:41:25.704949 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:25.704921 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-474vw" Jul 20 16:41:25.705333 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:25.705270 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-474vw" Jul 20 16:41:25.717464 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:25.717443 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-474vw" Jul 20 16:41:26.216911 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:26.216885 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-474vw" Jul 20 16:41:30.688419 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:30.688387 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-vxfjx"] Jul 20 16:41:30.691835 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:30.691816 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxfjx" Jul 20 16:41:30.694304 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:30.694281 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 20 16:41:30.701394 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:30.701370 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-vxfjx"] Jul 20 16:41:30.786756 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:30.786723 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d447328f-665e-4566-bf67-cbc39a08fc97-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vxfjx\" (UID: \"d447328f-665e-4566-bf67-cbc39a08fc97\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxfjx" Jul 20 16:41:30.786923 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:30.786764 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d447328f-665e-4566-bf67-cbc39a08fc97-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vxfjx\" (UID: \"d447328f-665e-4566-bf67-cbc39a08fc97\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxfjx" Jul 20 16:41:30.786923 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:30.786786 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d447328f-665e-4566-bf67-cbc39a08fc97-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vxfjx\" (UID: \"d447328f-665e-4566-bf67-cbc39a08fc97\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxfjx" Jul 20 16:41:30.786923 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:30.786810 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d447328f-665e-4566-bf67-cbc39a08fc97-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vxfjx\" (UID: \"d447328f-665e-4566-bf67-cbc39a08fc97\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxfjx" Jul 20 16:41:30.786923 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:30.786869 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk8hb\" (UniqueName: \"kubernetes.io/projected/d447328f-665e-4566-bf67-cbc39a08fc97-kube-api-access-hk8hb\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vxfjx\" (UID: \"d447328f-665e-4566-bf67-cbc39a08fc97\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxfjx" Jul 20 16:41:30.787071 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:30.786927 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d447328f-665e-4566-bf67-cbc39a08fc97-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vxfjx\" (UID: \"d447328f-665e-4566-bf67-cbc39a08fc97\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxfjx" Jul 20 16:41:30.888267 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:30.888231 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d447328f-665e-4566-bf67-cbc39a08fc97-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vxfjx\" (UID: \"d447328f-665e-4566-bf67-cbc39a08fc97\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxfjx" Jul 20 16:41:30.888447 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:30.888283 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d447328f-665e-4566-bf67-cbc39a08fc97-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vxfjx\" (UID: \"d447328f-665e-4566-bf67-cbc39a08fc97\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxfjx" Jul 20 16:41:30.888447 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:30.888409 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d447328f-665e-4566-bf67-cbc39a08fc97-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vxfjx\" (UID: \"d447328f-665e-4566-bf67-cbc39a08fc97\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxfjx" Jul 20 16:41:30.888570 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:30.888458 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d447328f-665e-4566-bf67-cbc39a08fc97-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vxfjx\" (UID: \"d447328f-665e-4566-bf67-cbc39a08fc97\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxfjx" Jul 20 16:41:30.888570 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:30.888488 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d447328f-665e-4566-bf67-cbc39a08fc97-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vxfjx\" (UID: \"d447328f-665e-4566-bf67-cbc39a08fc97\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxfjx" Jul 20 16:41:30.888570 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:30.888551 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk8hb\" (UniqueName: \"kubernetes.io/projected/d447328f-665e-4566-bf67-cbc39a08fc97-kube-api-access-hk8hb\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vxfjx\" (UID: \"d447328f-665e-4566-bf67-cbc39a08fc97\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxfjx" Jul 20 16:41:30.888712 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:30.888657 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d447328f-665e-4566-bf67-cbc39a08fc97-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vxfjx\" (UID: \"d447328f-665e-4566-bf67-cbc39a08fc97\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxfjx" Jul 20 16:41:30.888761 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:30.888727 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d447328f-665e-4566-bf67-cbc39a08fc97-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vxfjx\" (UID: \"d447328f-665e-4566-bf67-cbc39a08fc97\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxfjx" Jul 20 16:41:30.888836 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:30.888816 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d447328f-665e-4566-bf67-cbc39a08fc97-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vxfjx\" (UID: \"d447328f-665e-4566-bf67-cbc39a08fc97\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxfjx" Jul 20 16:41:30.890739 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:30.890713 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d447328f-665e-4566-bf67-cbc39a08fc97-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vxfjx\" (UID: \"d447328f-665e-4566-bf67-cbc39a08fc97\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxfjx" Jul 20 16:41:30.890928 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:30.890912 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d447328f-665e-4566-bf67-cbc39a08fc97-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vxfjx\" (UID: \"d447328f-665e-4566-bf67-cbc39a08fc97\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxfjx" Jul 20 16:41:30.896683 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:30.896657 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk8hb\" (UniqueName: \"kubernetes.io/projected/d447328f-665e-4566-bf67-cbc39a08fc97-kube-api-access-hk8hb\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vxfjx\" (UID: \"d447328f-665e-4566-bf67-cbc39a08fc97\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxfjx" Jul 20 16:41:31.003280 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:31.003197 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxfjx" Jul 20 16:41:31.153896 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:31.153871 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-vxfjx"] Jul 20 16:41:31.155865 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:41:31.155841 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd447328f_665e_4566_bf67_cbc39a08fc97.slice/crio-79e523d1d92eca3bbd4c433819e8a6635b97a930f4032beab5e4f26d3c7e80d3 WatchSource:0}: Error finding container 79e523d1d92eca3bbd4c433819e8a6635b97a930f4032beab5e4f26d3c7e80d3: Status 404 returned error can't find the container with id 79e523d1d92eca3bbd4c433819e8a6635b97a930f4032beab5e4f26d3c7e80d3 Jul 20 16:41:31.228893 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:31.228857 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxfjx" event={"ID":"d447328f-665e-4566-bf67-cbc39a08fc97","Type":"ContainerStarted","Data":"79e523d1d92eca3bbd4c433819e8a6635b97a930f4032beab5e4f26d3c7e80d3"} Jul 20 16:41:32.235449 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:32.235416 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxfjx" event={"ID":"d447328f-665e-4566-bf67-cbc39a08fc97","Type":"ContainerStarted","Data":"95eac5cab2e071a477caff652ba541e91bdc3b00a2ebd47409419f63269ffc3f"} Jul 20 16:41:32.252223 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:32.252172 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxfjx" podStartSLOduration=2.06965246 podStartE2EDuration="2.25215591s" totalImagesPullingTime="182.50345ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:41:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:41:32.251369326 +0000 UTC m=+710.401170102" watchObservedRunningTime="2026-07-20 16:41:32.25215591 +0000 UTC m=+710.401956685" Jul 20 16:41:33.596894 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:33.596854 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss" Jul 20 16:41:33.597355 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:33.596938 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss" Jul 20 16:41:33.609478 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:33.609456 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss" Jul 20 16:41:34.255862 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:34.255831 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss" Jul 20 16:41:41.003431 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:41.003401 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxfjx" Jul 20 16:41:41.003820 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:41.003457 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxfjx" Jul 20 16:41:41.015676 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:41.015653 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxfjx" Jul 20 16:41:41.288938 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:41:41.288860 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxfjx" Jul 20 16:43:39.850222 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:43:39.850184 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-659f7c964b-ntz6c"] Jul 20 16:43:39.850725 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:43:39.850369 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-659f7c964b-ntz6c" podUID="1d08732e-0d10-4769-84fd-589ae752b7fc" containerName="manager" containerID="cri-o://923165f5d76735b14cce9226accd2cfcbb280c93ddb47c64484702adeb4534b6" gracePeriod=30 Jul 20 16:43:40.102380 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:43:40.102327 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-659f7c964b-ntz6c" Jul 20 16:43:40.209250 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:43:40.209220 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d08732e-0d10-4769-84fd-589ae752b7fc-webhook-cert\") pod \"1d08732e-0d10-4769-84fd-589ae752b7fc\" (UID: \"1d08732e-0d10-4769-84fd-589ae752b7fc\") " Jul 20 16:43:40.209393 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:43:40.209338 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6mxc\" (UniqueName: \"kubernetes.io/projected/1d08732e-0d10-4769-84fd-589ae752b7fc-kube-api-access-h6mxc\") pod \"1d08732e-0d10-4769-84fd-589ae752b7fc\" (UID: \"1d08732e-0d10-4769-84fd-589ae752b7fc\") " Jul 20 16:43:40.211321 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:43:40.211290 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d08732e-0d10-4769-84fd-589ae752b7fc-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1d08732e-0d10-4769-84fd-589ae752b7fc" (UID: "1d08732e-0d10-4769-84fd-589ae752b7fc"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:43:40.211447 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:43:40.211314 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d08732e-0d10-4769-84fd-589ae752b7fc-kube-api-access-h6mxc" (OuterVolumeSpecName: "kube-api-access-h6mxc") pod "1d08732e-0d10-4769-84fd-589ae752b7fc" (UID: "1d08732e-0d10-4769-84fd-589ae752b7fc"). InnerVolumeSpecName "kube-api-access-h6mxc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:43:40.309993 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:43:40.309963 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6mxc\" (UniqueName: \"kubernetes.io/projected/1d08732e-0d10-4769-84fd-589ae752b7fc-kube-api-access-h6mxc\") on node \"ip-10-0-130-209.ec2.internal\" DevicePath \"\"" Jul 20 16:43:40.310138 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:43:40.309988 2583 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d08732e-0d10-4769-84fd-589ae752b7fc-webhook-cert\") on node \"ip-10-0-130-209.ec2.internal\" DevicePath \"\"" Jul 20 16:43:40.829419 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:43:40.829387 2583 generic.go:356] "Generic (PLEG): container finished" podID="1d08732e-0d10-4769-84fd-589ae752b7fc" containerID="923165f5d76735b14cce9226accd2cfcbb280c93ddb47c64484702adeb4534b6" exitCode=0 Jul 20 16:43:40.829603 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:43:40.829445 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-659f7c964b-ntz6c" Jul 20 16:43:40.829603 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:43:40.829479 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-659f7c964b-ntz6c" event={"ID":"1d08732e-0d10-4769-84fd-589ae752b7fc","Type":"ContainerDied","Data":"923165f5d76735b14cce9226accd2cfcbb280c93ddb47c64484702adeb4534b6"} Jul 20 16:43:40.829603 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:43:40.829562 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-659f7c964b-ntz6c" event={"ID":"1d08732e-0d10-4769-84fd-589ae752b7fc","Type":"ContainerDied","Data":"2ddf50730fe3a972a5b3539338f4c4801315dacf56ee300f8188a42feda393ca"} Jul 20 16:43:40.829603 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:43:40.829585 2583 scope.go:117] "RemoveContainer" containerID="923165f5d76735b14cce9226accd2cfcbb280c93ddb47c64484702adeb4534b6" Jul 20 16:43:40.837912 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:43:40.837891 2583 scope.go:117] "RemoveContainer" containerID="923165f5d76735b14cce9226accd2cfcbb280c93ddb47c64484702adeb4534b6" Jul 20 16:43:40.838184 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:43:40.838166 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"923165f5d76735b14cce9226accd2cfcbb280c93ddb47c64484702adeb4534b6\": container with ID starting with 923165f5d76735b14cce9226accd2cfcbb280c93ddb47c64484702adeb4534b6 not found: ID does not exist" containerID="923165f5d76735b14cce9226accd2cfcbb280c93ddb47c64484702adeb4534b6" Jul 20 16:43:40.838240 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:43:40.838193 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"923165f5d76735b14cce9226accd2cfcbb280c93ddb47c64484702adeb4534b6"} err="failed to get container status \"923165f5d76735b14cce9226accd2cfcbb280c93ddb47c64484702adeb4534b6\": rpc error: code = NotFound desc = could not find container \"923165f5d76735b14cce9226accd2cfcbb280c93ddb47c64484702adeb4534b6\": container with ID starting with 923165f5d76735b14cce9226accd2cfcbb280c93ddb47c64484702adeb4534b6 not found: ID does not exist" Jul 20 16:43:40.846751 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:43:40.846732 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-659f7c964b-ntz6c"] Jul 20 16:43:40.849586 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:43:40.849563 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-659f7c964b-ntz6c"] Jul 20 16:43:42.335177 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:43:42.335150 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d08732e-0d10-4769-84fd-589ae752b7fc" path="/var/lib/kubelet/pods/1d08732e-0d10-4769-84fd-589ae752b7fc/volumes" Jul 20 16:44:41.675425 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:41.672703 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-659f7c964b-dgn74"] Jul 20 16:44:41.675425 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:41.673466 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d08732e-0d10-4769-84fd-589ae752b7fc" containerName="manager" Jul 20 16:44:41.675425 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:41.673493 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d08732e-0d10-4769-84fd-589ae752b7fc" containerName="manager" Jul 20 16:44:41.675425 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:41.673690 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d08732e-0d10-4769-84fd-589ae752b7fc" containerName="manager" Jul 20 16:44:41.677373 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:41.677349 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-659f7c964b-dgn74" Jul 20 16:44:41.679735 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:41.679713 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 20 16:44:41.679844 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:41.679713 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 20 16:44:41.680651 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:41.680627 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-c56nc\"" Jul 20 16:44:41.682993 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:41.682967 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-659f7c964b-dgn74"] Jul 20 16:44:41.724235 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:41.724209 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/de656fe7-6aed-401a-a6f8-a5c62fec5f44-webhook-cert\") pod \"maas-controller-659f7c964b-dgn74\" (UID: \"de656fe7-6aed-401a-a6f8-a5c62fec5f44\") " pod="opendatahub/maas-controller-659f7c964b-dgn74" Jul 20 16:44:41.724366 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:41.724256 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc4mt\" (UniqueName: \"kubernetes.io/projected/de656fe7-6aed-401a-a6f8-a5c62fec5f44-kube-api-access-cc4mt\") pod \"maas-controller-659f7c964b-dgn74\" (UID: \"de656fe7-6aed-401a-a6f8-a5c62fec5f44\") " pod="opendatahub/maas-controller-659f7c964b-dgn74" Jul 20 16:44:41.825469 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:41.825433 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/de656fe7-6aed-401a-a6f8-a5c62fec5f44-webhook-cert\") pod \"maas-controller-659f7c964b-dgn74\" (UID: \"de656fe7-6aed-401a-a6f8-a5c62fec5f44\") " pod="opendatahub/maas-controller-659f7c964b-dgn74" Jul 20 16:44:41.825627 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:41.825483 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc4mt\" (UniqueName: \"kubernetes.io/projected/de656fe7-6aed-401a-a6f8-a5c62fec5f44-kube-api-access-cc4mt\") pod \"maas-controller-659f7c964b-dgn74\" (UID: \"de656fe7-6aed-401a-a6f8-a5c62fec5f44\") " pod="opendatahub/maas-controller-659f7c964b-dgn74" Jul 20 16:44:41.827847 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:41.827826 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/de656fe7-6aed-401a-a6f8-a5c62fec5f44-webhook-cert\") pod \"maas-controller-659f7c964b-dgn74\" (UID: \"de656fe7-6aed-401a-a6f8-a5c62fec5f44\") " pod="opendatahub/maas-controller-659f7c964b-dgn74" Jul 20 16:44:41.833325 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:41.833296 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc4mt\" (UniqueName: \"kubernetes.io/projected/de656fe7-6aed-401a-a6f8-a5c62fec5f44-kube-api-access-cc4mt\") pod \"maas-controller-659f7c964b-dgn74\" (UID: \"de656fe7-6aed-401a-a6f8-a5c62fec5f44\") " pod="opendatahub/maas-controller-659f7c964b-dgn74" Jul 20 16:44:41.988940 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:41.988856 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-659f7c964b-dgn74" Jul 20 16:44:42.121844 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:42.121817 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-659f7c964b-dgn74"] Jul 20 16:44:42.124499 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:44:42.124465 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde656fe7_6aed_401a_a6f8_a5c62fec5f44.slice/crio-1ce2d8539d33413387525ed3cbc750e1a7f8528f245705f9fe1e58ccf9785d22 WatchSource:0}: Error finding container 1ce2d8539d33413387525ed3cbc750e1a7f8528f245705f9fe1e58ccf9785d22: Status 404 returned error can't find the container with id 1ce2d8539d33413387525ed3cbc750e1a7f8528f245705f9fe1e58ccf9785d22 Jul 20 16:44:42.558958 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:42.558934 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 20 16:44:43.117428 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:43.117392 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-659f7c964b-dgn74" event={"ID":"de656fe7-6aed-401a-a6f8-a5c62fec5f44","Type":"ContainerStarted","Data":"cb278009be5e8886316841a7d78582a787837a033e55fdae98c2e365c59e9920"} Jul 20 16:44:43.117792 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:43.117450 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-659f7c964b-dgn74" event={"ID":"de656fe7-6aed-401a-a6f8-a5c62fec5f44","Type":"ContainerStarted","Data":"1ce2d8539d33413387525ed3cbc750e1a7f8528f245705f9fe1e58ccf9785d22"} Jul 20 16:44:43.117792 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:43.117471 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-659f7c964b-dgn74" Jul 20 16:44:43.135581 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:43.135526 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-659f7c964b-dgn74" podStartSLOduration=1.704334291 podStartE2EDuration="2.135511569s" totalImagesPullingTime="431.177278ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:44:43.133524453 +0000 UTC m=+901.283325230" watchObservedRunningTime="2026-07-20 16:44:43.135511569 +0000 UTC m=+901.285312398" Jul 20 16:44:54.125219 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:54.125185 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-659f7c964b-dgn74" Jul 20 16:44:58.752012 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:58.751973 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-659f7c964b-dgn74"] Jul 20 16:44:58.752504 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:58.752192 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-659f7c964b-dgn74" podUID="de656fe7-6aed-401a-a6f8-a5c62fec5f44" containerName="manager" containerID="cri-o://cb278009be5e8886316841a7d78582a787837a033e55fdae98c2e365c59e9920" gracePeriod=30 Jul 20 16:44:59.003823 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:59.003761 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-659f7c964b-dgn74" Jul 20 16:44:59.078381 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:59.078347 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/de656fe7-6aed-401a-a6f8-a5c62fec5f44-webhook-cert\") pod \"de656fe7-6aed-401a-a6f8-a5c62fec5f44\" (UID: \"de656fe7-6aed-401a-a6f8-a5c62fec5f44\") " Jul 20 16:44:59.078531 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:59.078400 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cc4mt\" (UniqueName: \"kubernetes.io/projected/de656fe7-6aed-401a-a6f8-a5c62fec5f44-kube-api-access-cc4mt\") pod \"de656fe7-6aed-401a-a6f8-a5c62fec5f44\" (UID: \"de656fe7-6aed-401a-a6f8-a5c62fec5f44\") " Jul 20 16:44:59.080482 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:59.080449 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de656fe7-6aed-401a-a6f8-a5c62fec5f44-kube-api-access-cc4mt" (OuterVolumeSpecName: "kube-api-access-cc4mt") pod "de656fe7-6aed-401a-a6f8-a5c62fec5f44" (UID: "de656fe7-6aed-401a-a6f8-a5c62fec5f44"). InnerVolumeSpecName "kube-api-access-cc4mt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:44:59.080590 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:59.080455 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de656fe7-6aed-401a-a6f8-a5c62fec5f44-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "de656fe7-6aed-401a-a6f8-a5c62fec5f44" (UID: "de656fe7-6aed-401a-a6f8-a5c62fec5f44"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:44:59.179960 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:59.179926 2583 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/de656fe7-6aed-401a-a6f8-a5c62fec5f44-webhook-cert\") on node \"ip-10-0-130-209.ec2.internal\" DevicePath \"\"" Jul 20 16:44:59.179960 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:59.179955 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cc4mt\" (UniqueName: \"kubernetes.io/projected/de656fe7-6aed-401a-a6f8-a5c62fec5f44-kube-api-access-cc4mt\") on node \"ip-10-0-130-209.ec2.internal\" DevicePath \"\"" Jul 20 16:44:59.194057 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:59.194025 2583 generic.go:356] "Generic (PLEG): container finished" podID="de656fe7-6aed-401a-a6f8-a5c62fec5f44" containerID="cb278009be5e8886316841a7d78582a787837a033e55fdae98c2e365c59e9920" exitCode=0 Jul 20 16:44:59.194219 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:59.194061 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-659f7c964b-dgn74" event={"ID":"de656fe7-6aed-401a-a6f8-a5c62fec5f44","Type":"ContainerDied","Data":"cb278009be5e8886316841a7d78582a787837a033e55fdae98c2e365c59e9920"} Jul 20 16:44:59.194219 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:59.194070 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-659f7c964b-dgn74" Jul 20 16:44:59.194219 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:59.194096 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-659f7c964b-dgn74" event={"ID":"de656fe7-6aed-401a-a6f8-a5c62fec5f44","Type":"ContainerDied","Data":"1ce2d8539d33413387525ed3cbc750e1a7f8528f245705f9fe1e58ccf9785d22"} Jul 20 16:44:59.194219 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:59.194150 2583 scope.go:117] "RemoveContainer" containerID="cb278009be5e8886316841a7d78582a787837a033e55fdae98c2e365c59e9920" Jul 20 16:44:59.203279 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:59.203262 2583 scope.go:117] "RemoveContainer" containerID="cb278009be5e8886316841a7d78582a787837a033e55fdae98c2e365c59e9920" Jul 20 16:44:59.203525 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:44:59.203504 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb278009be5e8886316841a7d78582a787837a033e55fdae98c2e365c59e9920\": container with ID starting with cb278009be5e8886316841a7d78582a787837a033e55fdae98c2e365c59e9920 not found: ID does not exist" containerID="cb278009be5e8886316841a7d78582a787837a033e55fdae98c2e365c59e9920" Jul 20 16:44:59.203587 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:59.203534 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb278009be5e8886316841a7d78582a787837a033e55fdae98c2e365c59e9920"} err="failed to get container status \"cb278009be5e8886316841a7d78582a787837a033e55fdae98c2e365c59e9920\": rpc error: code = NotFound desc = could not find container \"cb278009be5e8886316841a7d78582a787837a033e55fdae98c2e365c59e9920\": container with ID starting with cb278009be5e8886316841a7d78582a787837a033e55fdae98c2e365c59e9920 not found: ID does not exist" Jul 20 16:44:59.214958 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:59.214933 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-659f7c964b-dgn74"] Jul 20 16:44:59.221236 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:59.221213 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-659f7c964b-dgn74"] Jul 20 16:44:59.968129 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:59.968081 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-659f7c964b-jd6z7"] Jul 20 16:44:59.968511 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:59.968441 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de656fe7-6aed-401a-a6f8-a5c62fec5f44" containerName="manager" Jul 20 16:44:59.968511 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:59.968452 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="de656fe7-6aed-401a-a6f8-a5c62fec5f44" containerName="manager" Jul 20 16:44:59.968580 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:59.968515 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="de656fe7-6aed-401a-a6f8-a5c62fec5f44" containerName="manager" Jul 20 16:44:59.972681 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:59.972664 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-659f7c964b-jd6z7" Jul 20 16:44:59.974940 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:59.974913 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-c56nc\"" Jul 20 16:44:59.975036 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:59.974968 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 20 16:44:59.976016 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:59.976002 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 20 16:44:59.980049 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:44:59.980014 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-659f7c964b-jd6z7"] Jul 20 16:45:00.089577 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:45:00.089537 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aeccf530-48ec-43b0-a65f-6d911bd782f3-webhook-cert\") pod \"maas-controller-659f7c964b-jd6z7\" (UID: \"aeccf530-48ec-43b0-a65f-6d911bd782f3\") " pod="opendatahub/maas-controller-659f7c964b-jd6z7" Jul 20 16:45:00.089757 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:45:00.089706 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svjq6\" (UniqueName: \"kubernetes.io/projected/aeccf530-48ec-43b0-a65f-6d911bd782f3-kube-api-access-svjq6\") pod \"maas-controller-659f7c964b-jd6z7\" (UID: \"aeccf530-48ec-43b0-a65f-6d911bd782f3\") " pod="opendatahub/maas-controller-659f7c964b-jd6z7" Jul 20 16:45:00.190233 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:45:00.190194 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svjq6\" (UniqueName: \"kubernetes.io/projected/aeccf530-48ec-43b0-a65f-6d911bd782f3-kube-api-access-svjq6\") pod \"maas-controller-659f7c964b-jd6z7\" (UID: \"aeccf530-48ec-43b0-a65f-6d911bd782f3\") " pod="opendatahub/maas-controller-659f7c964b-jd6z7" Jul 20 16:45:00.190406 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:45:00.190244 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aeccf530-48ec-43b0-a65f-6d911bd782f3-webhook-cert\") pod \"maas-controller-659f7c964b-jd6z7\" (UID: \"aeccf530-48ec-43b0-a65f-6d911bd782f3\") " pod="opendatahub/maas-controller-659f7c964b-jd6z7" Jul 20 16:45:00.192662 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:45:00.192640 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aeccf530-48ec-43b0-a65f-6d911bd782f3-webhook-cert\") pod \"maas-controller-659f7c964b-jd6z7\" (UID: \"aeccf530-48ec-43b0-a65f-6d911bd782f3\") " pod="opendatahub/maas-controller-659f7c964b-jd6z7" Jul 20 16:45:00.198709 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:45:00.198681 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svjq6\" (UniqueName: \"kubernetes.io/projected/aeccf530-48ec-43b0-a65f-6d911bd782f3-kube-api-access-svjq6\") pod \"maas-controller-659f7c964b-jd6z7\" (UID: \"aeccf530-48ec-43b0-a65f-6d911bd782f3\") " pod="opendatahub/maas-controller-659f7c964b-jd6z7" Jul 20 16:45:00.284073 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:45:00.283986 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-659f7c964b-jd6z7" Jul 20 16:45:00.338376 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:45:00.338281 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de656fe7-6aed-401a-a6f8-a5c62fec5f44" path="/var/lib/kubelet/pods/de656fe7-6aed-401a-a6f8-a5c62fec5f44/volumes" Jul 20 16:45:00.415198 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:45:00.415170 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-659f7c964b-jd6z7"] Jul 20 16:45:00.417376 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:45:00.417351 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeccf530_48ec_43b0_a65f_6d911bd782f3.slice/crio-f041f17e15c4800cc8e25746dc080e898e2524b3775ec5ddcb8480ff36ed8d42 WatchSource:0}: Error finding container f041f17e15c4800cc8e25746dc080e898e2524b3775ec5ddcb8480ff36ed8d42: Status 404 returned error can't find the container with id f041f17e15c4800cc8e25746dc080e898e2524b3775ec5ddcb8480ff36ed8d42 Jul 20 16:45:01.205161 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:45:01.205130 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-659f7c964b-jd6z7" event={"ID":"aeccf530-48ec-43b0-a65f-6d911bd782f3","Type":"ContainerStarted","Data":"f041f17e15c4800cc8e25746dc080e898e2524b3775ec5ddcb8480ff36ed8d42"} Jul 20 16:45:02.211148 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:45:02.211090 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-659f7c964b-jd6z7" event={"ID":"aeccf530-48ec-43b0-a65f-6d911bd782f3","Type":"ContainerStarted","Data":"666c9bf77b370626fed56f389813a283afb093cec2ea39c5f9f26294cbc57805"} Jul 20 16:45:02.211619 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:45:02.211204 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-659f7c964b-jd6z7" Jul 20 16:45:02.228962 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:45:02.228913 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-659f7c964b-jd6z7" podStartSLOduration=2.106027766 podStartE2EDuration="3.228895708s" totalImagesPullingTime="1.122867942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:44:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:45:02.228258385 +0000 UTC m=+920.378059158" watchObservedRunningTime="2026-07-20 16:45:02.228895708 +0000 UTC m=+920.378696485" Jul 20 16:45:13.218188 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:45:13.218159 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-659f7c964b-jd6z7" Jul 20 16:58:10.311670 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:10.311598 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr"] Jul 20 16:58:10.314965 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:10.314948 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" Jul 20 16:58:10.319640 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:10.319619 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-d88d04e6-openshift-default-dockercfg-lxgq7\"" Jul 20 16:58:10.348394 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:10.348372 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr"] Jul 20 16:58:10.397811 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:10.397778 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d17d02c-6491-47f8-8519-2339c82574a2-credential-socket\") pod \"e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr\" (UID: \"8d17d02c-6491-47f8-8519-2339c82574a2\") " pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" Jul 20 16:58:10.397970 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:10.397855 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d17d02c-6491-47f8-8519-2339c82574a2-istio-envoy\") pod \"e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr\" (UID: \"8d17d02c-6491-47f8-8519-2339c82574a2\") " pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" Jul 20 16:58:10.398037 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:10.398016 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d17d02c-6491-47f8-8519-2339c82574a2-workload-certs\") pod \"e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr\" (UID: \"8d17d02c-6491-47f8-8519-2339c82574a2\") " pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" Jul 20 16:58:10.398101 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:10.398060 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d17d02c-6491-47f8-8519-2339c82574a2-istio-data\") pod \"e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr\" (UID: \"8d17d02c-6491-47f8-8519-2339c82574a2\") " pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" Jul 20 16:58:10.398195 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:10.398134 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d17d02c-6491-47f8-8519-2339c82574a2-istio-token\") pod \"e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr\" (UID: \"8d17d02c-6491-47f8-8519-2339c82574a2\") " pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" Jul 20 16:58:10.398195 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:10.398177 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d17d02c-6491-47f8-8519-2339c82574a2-istiod-ca-cert\") pod \"e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr\" (UID: \"8d17d02c-6491-47f8-8519-2339c82574a2\") " pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" Jul 20 16:58:10.398293 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:10.398254 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqjln\" (UniqueName: \"kubernetes.io/projected/8d17d02c-6491-47f8-8519-2339c82574a2-kube-api-access-vqjln\") pod \"e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr\" (UID: \"8d17d02c-6491-47f8-8519-2339c82574a2\") " pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" Jul 20 16:58:10.398387 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:10.398372 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d17d02c-6491-47f8-8519-2339c82574a2-workload-socket\") pod \"e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr\" (UID: \"8d17d02c-6491-47f8-8519-2339c82574a2\") " pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" Jul 20 16:58:10.398435 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:10.398405 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d17d02c-6491-47f8-8519-2339c82574a2-istio-podinfo\") pod \"e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr\" (UID: \"8d17d02c-6491-47f8-8519-2339c82574a2\") " pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" Jul 20 16:58:10.499347 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:10.499311 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d17d02c-6491-47f8-8519-2339c82574a2-workload-socket\") pod \"e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr\" (UID: \"8d17d02c-6491-47f8-8519-2339c82574a2\") " pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" Jul 20 16:58:10.499347 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:10.499353 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d17d02c-6491-47f8-8519-2339c82574a2-istio-podinfo\") pod \"e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr\" (UID: \"8d17d02c-6491-47f8-8519-2339c82574a2\") " pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" Jul 20 16:58:10.499568 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:10.499381 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d17d02c-6491-47f8-8519-2339c82574a2-credential-socket\") pod \"e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr\" (UID: \"8d17d02c-6491-47f8-8519-2339c82574a2\") " pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" Jul 20 16:58:10.499568 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:10.499436 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d17d02c-6491-47f8-8519-2339c82574a2-istio-envoy\") pod \"e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr\" (UID: \"8d17d02c-6491-47f8-8519-2339c82574a2\") " pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" Jul 20 16:58:10.499568 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:10.499480 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d17d02c-6491-47f8-8519-2339c82574a2-workload-certs\") pod \"e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr\" (UID: \"8d17d02c-6491-47f8-8519-2339c82574a2\") " pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" Jul 20 16:58:10.499568 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:10.499504 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d17d02c-6491-47f8-8519-2339c82574a2-istio-data\") pod \"e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr\" (UID: \"8d17d02c-6491-47f8-8519-2339c82574a2\") " pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" Jul 20 16:58:10.499568 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:10.499535 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d17d02c-6491-47f8-8519-2339c82574a2-istio-token\") pod \"e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr\" (UID: \"8d17d02c-6491-47f8-8519-2339c82574a2\") " pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" Jul 20 16:58:10.499843 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:10.499590 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d17d02c-6491-47f8-8519-2339c82574a2-istiod-ca-cert\") pod \"e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr\" (UID: \"8d17d02c-6491-47f8-8519-2339c82574a2\") " pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" Jul 20 16:58:10.499843 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:10.499642 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqjln\" (UniqueName: \"kubernetes.io/projected/8d17d02c-6491-47f8-8519-2339c82574a2-kube-api-access-vqjln\") pod \"e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr\" (UID: \"8d17d02c-6491-47f8-8519-2339c82574a2\") " pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" Jul 20 16:58:10.499843 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:10.499721 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d17d02c-6491-47f8-8519-2339c82574a2-workload-socket\") pod \"e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr\" (UID: \"8d17d02c-6491-47f8-8519-2339c82574a2\") " pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" Jul 20 16:58:10.499843 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:10.499779 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d17d02c-6491-47f8-8519-2339c82574a2-credential-socket\") pod \"e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr\" (UID: \"8d17d02c-6491-47f8-8519-2339c82574a2\") " pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" Jul 20 16:58:10.500128 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:10.500082 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d17d02c-6491-47f8-8519-2339c82574a2-workload-certs\") pod \"e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr\" (UID: \"8d17d02c-6491-47f8-8519-2339c82574a2\") " pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" Jul 20 16:58:10.500303 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:10.500224 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d17d02c-6491-47f8-8519-2339c82574a2-istio-data\") pod \"e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr\" (UID: \"8d17d02c-6491-47f8-8519-2339c82574a2\") " pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" Jul 20 16:58:10.500373 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:10.500345 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d17d02c-6491-47f8-8519-2339c82574a2-istiod-ca-cert\") pod \"e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr\" (UID: \"8d17d02c-6491-47f8-8519-2339c82574a2\") " pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" Jul 20 16:58:10.502770 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:10.502740 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d17d02c-6491-47f8-8519-2339c82574a2-istio-envoy\") pod \"e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr\" (UID: \"8d17d02c-6491-47f8-8519-2339c82574a2\") " pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" Jul 20 16:58:10.502925 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:10.502909 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d17d02c-6491-47f8-8519-2339c82574a2-istio-podinfo\") pod \"e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr\" (UID: \"8d17d02c-6491-47f8-8519-2339c82574a2\") " pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" Jul 20 16:58:10.511449 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:10.511430 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d17d02c-6491-47f8-8519-2339c82574a2-istio-token\") pod \"e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr\" (UID: \"8d17d02c-6491-47f8-8519-2339c82574a2\") " pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" Jul 20 16:58:10.511697 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:10.511678 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqjln\" (UniqueName: \"kubernetes.io/projected/8d17d02c-6491-47f8-8519-2339c82574a2-kube-api-access-vqjln\") pod \"e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr\" (UID: \"8d17d02c-6491-47f8-8519-2339c82574a2\") " pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" Jul 20 16:58:10.624758 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:10.624705 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" Jul 20 16:58:10.770974 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:10.770944 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr"] Jul 20 16:58:10.773233 ip-10-0-130-209 kubenswrapper[2583]: W0720 16:58:10.773203 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d17d02c_6491_47f8_8519_2339c82574a2.slice/crio-1702067faaf30e1792e89760109bf57cc9bf5d04921639bd358aa7747ded7182 WatchSource:0}: Error finding container 1702067faaf30e1792e89760109bf57cc9bf5d04921639bd358aa7747ded7182: Status 404 returned error can't find the container with id 1702067faaf30e1792e89760109bf57cc9bf5d04921639bd358aa7747ded7182 Jul 20 16:58:10.775222 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:10.775192 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:58:10.775306 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:10.775252 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:58:10.775306 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:10.775280 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:58:10.878235 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:10.878138 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" event={"ID":"8d17d02c-6491-47f8-8519-2339c82574a2","Type":"ContainerStarted","Data":"364b6347f44c3ee87799b7663cef6361000d392033ec62e669a58a54f0e3765a"} Jul 20 16:58:10.878380 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:10.878243 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" event={"ID":"8d17d02c-6491-47f8-8519-2339c82574a2","Type":"ContainerStarted","Data":"1702067faaf30e1792e89760109bf57cc9bf5d04921639bd358aa7747ded7182"} Jul 20 16:58:10.898481 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:10.898429 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" podStartSLOduration=0.898414199 podStartE2EDuration="898.414199ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:58:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:58:10.896608461 +0000 UTC m=+1709.046409265" watchObservedRunningTime="2026-07-20 16:58:10.898414199 +0000 UTC m=+1709.048214975" Jul 20 16:58:11.625612 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:11.625586 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" Jul 20 16:58:11.630231 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:11.630210 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" Jul 20 16:58:11.882619 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:11.882549 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" Jul 20 16:58:11.883495 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:11.883478 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" Jul 20 16:58:23.952552 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:23.952478 2583 generic.go:356] "Generic (PLEG): container finished" podID="8d17d02c-6491-47f8-8519-2339c82574a2" containerID="364b6347f44c3ee87799b7663cef6361000d392033ec62e669a58a54f0e3765a" exitCode=0 Jul 20 16:58:23.953020 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:23.952556 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" event={"ID":"8d17d02c-6491-47f8-8519-2339c82574a2","Type":"ContainerDied","Data":"364b6347f44c3ee87799b7663cef6361000d392033ec62e669a58a54f0e3765a"} Jul 20 16:58:23.953093 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:23.953061 2583 scope.go:117] "RemoveContainer" containerID="364b6347f44c3ee87799b7663cef6361000d392033ec62e669a58a54f0e3765a" Jul 20 16:58:23.954157 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:23.954127 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:58:23.954218 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:23.954206 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:58:23.954261 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:23.954248 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:58:24.958869 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:24.958835 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" event={"ID":"8d17d02c-6491-47f8-8519-2339c82574a2","Type":"ContainerStarted","Data":"92c4d702c3bf34723b5973232fdef3bd02d1ff2cb7f6d6abac8e2eed02e2e0ca"} Jul 20 16:58:25.625031 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:25.624997 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" Jul 20 16:58:25.626179 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:25.626152 2583 patch_prober.go:28] interesting pod/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 20 16:58:25.626279 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:25.626204 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" podUID="8d17d02c-6491-47f8-8519-2339c82574a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 20 16:58:26.626119 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:26.626079 2583 patch_prober.go:28] interesting pod/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 20 16:58:26.626483 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:26.626159 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" podUID="8d17d02c-6491-47f8-8519-2339c82574a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 20 16:58:26.882815 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:26.882725 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" Jul 20 16:58:27.624969 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:27.624934 2583 patch_prober.go:28] interesting pod/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 20 16:58:27.625151 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:27.625004 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" podUID="8d17d02c-6491-47f8-8519-2339c82574a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 20 16:58:28.625060 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:28.625022 2583 patch_prober.go:28] interesting pod/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 20 16:58:28.625444 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:28.625079 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" podUID="8d17d02c-6491-47f8-8519-2339c82574a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 20 16:58:29.629093 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:29.629063 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" Jul 20 16:58:29.629961 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:29.629942 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" Jul 20 16:58:53.102804 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:53.102772 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr"] Jul 20 16:58:53.103358 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:53.103030 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" podUID="8d17d02c-6491-47f8-8519-2339c82574a2" containerName="istio-proxy" containerID="cri-o://92c4d702c3bf34723b5973232fdef3bd02d1ff2cb7f6d6abac8e2eed02e2e0ca" gracePeriod=30 Jul 20 16:58:58.358940 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:58.358915 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" Jul 20 16:58:58.436785 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:58.436762 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d17d02c-6491-47f8-8519-2339c82574a2-istio-podinfo\") pod \"8d17d02c-6491-47f8-8519-2339c82574a2\" (UID: \"8d17d02c-6491-47f8-8519-2339c82574a2\") " Jul 20 16:58:58.436920 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:58.436797 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d17d02c-6491-47f8-8519-2339c82574a2-credential-socket\") pod \"8d17d02c-6491-47f8-8519-2339c82574a2\" (UID: \"8d17d02c-6491-47f8-8519-2339c82574a2\") " Jul 20 16:58:58.436920 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:58.436821 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d17d02c-6491-47f8-8519-2339c82574a2-istiod-ca-cert\") pod \"8d17d02c-6491-47f8-8519-2339c82574a2\" (UID: \"8d17d02c-6491-47f8-8519-2339c82574a2\") " Jul 20 16:58:58.436920 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:58.436855 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqjln\" (UniqueName: \"kubernetes.io/projected/8d17d02c-6491-47f8-8519-2339c82574a2-kube-api-access-vqjln\") pod \"8d17d02c-6491-47f8-8519-2339c82574a2\" (UID: \"8d17d02c-6491-47f8-8519-2339c82574a2\") " Jul 20 16:58:58.437081 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:58.436922 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d17d02c-6491-47f8-8519-2339c82574a2-workload-certs\") pod \"8d17d02c-6491-47f8-8519-2339c82574a2\" (UID: \"8d17d02c-6491-47f8-8519-2339c82574a2\") " Jul 20 16:58:58.437081 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:58.436949 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d17d02c-6491-47f8-8519-2339c82574a2-istio-envoy\") pod \"8d17d02c-6491-47f8-8519-2339c82574a2\" (UID: \"8d17d02c-6491-47f8-8519-2339c82574a2\") " Jul 20 16:58:58.437081 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:58.436984 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d17d02c-6491-47f8-8519-2339c82574a2-workload-socket\") pod \"8d17d02c-6491-47f8-8519-2339c82574a2\" (UID: \"8d17d02c-6491-47f8-8519-2339c82574a2\") " Jul 20 16:58:58.437081 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:58.437035 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d17d02c-6491-47f8-8519-2339c82574a2-istio-token\") pod \"8d17d02c-6491-47f8-8519-2339c82574a2\" (UID: \"8d17d02c-6491-47f8-8519-2339c82574a2\") " Jul 20 16:58:58.437081 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:58.437061 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d17d02c-6491-47f8-8519-2339c82574a2-istio-data\") pod \"8d17d02c-6491-47f8-8519-2339c82574a2\" (UID: \"8d17d02c-6491-47f8-8519-2339c82574a2\") " Jul 20 16:58:58.437360 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:58.437153 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d17d02c-6491-47f8-8519-2339c82574a2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8d17d02c-6491-47f8-8519-2339c82574a2" (UID: "8d17d02c-6491-47f8-8519-2339c82574a2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:58:58.437360 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:58.437237 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d17d02c-6491-47f8-8519-2339c82574a2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8d17d02c-6491-47f8-8519-2339c82574a2" (UID: "8d17d02c-6491-47f8-8519-2339c82574a2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:58:58.437360 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:58.437249 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d17d02c-6491-47f8-8519-2339c82574a2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8d17d02c-6491-47f8-8519-2339c82574a2" (UID: "8d17d02c-6491-47f8-8519-2339c82574a2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:58:58.437510 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:58.437433 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d17d02c-6491-47f8-8519-2339c82574a2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8d17d02c-6491-47f8-8519-2339c82574a2" (UID: "8d17d02c-6491-47f8-8519-2339c82574a2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:58:58.437722 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:58.437597 2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d17d02c-6491-47f8-8519-2339c82574a2-credential-socket\") on node \"ip-10-0-130-209.ec2.internal\" DevicePath \"\"" Jul 20 16:58:58.437722 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:58.437620 2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d17d02c-6491-47f8-8519-2339c82574a2-istiod-ca-cert\") on node \"ip-10-0-130-209.ec2.internal\" DevicePath \"\"" Jul 20 16:58:58.437722 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:58.437635 2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d17d02c-6491-47f8-8519-2339c82574a2-workload-certs\") on node \"ip-10-0-130-209.ec2.internal\" DevicePath \"\"" Jul 20 16:58:58.437722 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:58.437649 2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d17d02c-6491-47f8-8519-2339c82574a2-workload-socket\") on node \"ip-10-0-130-209.ec2.internal\" DevicePath \"\"" Jul 20 16:58:58.438141 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:58.438098 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d17d02c-6491-47f8-8519-2339c82574a2-istio-data" (OuterVolumeSpecName: "istio-data") pod "8d17d02c-6491-47f8-8519-2339c82574a2" (UID: "8d17d02c-6491-47f8-8519-2339c82574a2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:58:58.439299 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:58.439270 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d17d02c-6491-47f8-8519-2339c82574a2-kube-api-access-vqjln" (OuterVolumeSpecName: "kube-api-access-vqjln") pod "8d17d02c-6491-47f8-8519-2339c82574a2" (UID: "8d17d02c-6491-47f8-8519-2339c82574a2"). InnerVolumeSpecName "kube-api-access-vqjln". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:58:58.439299 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:58.439291 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8d17d02c-6491-47f8-8519-2339c82574a2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8d17d02c-6491-47f8-8519-2339c82574a2" (UID: "8d17d02c-6491-47f8-8519-2339c82574a2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 16:58:58.439619 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:58.439599 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d17d02c-6491-47f8-8519-2339c82574a2-istio-token" (OuterVolumeSpecName: "istio-token") pod "8d17d02c-6491-47f8-8519-2339c82574a2" (UID: "8d17d02c-6491-47f8-8519-2339c82574a2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:58:58.439704 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:58.439683 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d17d02c-6491-47f8-8519-2339c82574a2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8d17d02c-6491-47f8-8519-2339c82574a2" (UID: "8d17d02c-6491-47f8-8519-2339c82574a2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:58:58.538220 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:58.538192 2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d17d02c-6491-47f8-8519-2339c82574a2-istio-podinfo\") on node \"ip-10-0-130-209.ec2.internal\" DevicePath \"\"" Jul 20 16:58:58.538220 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:58.538218 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqjln\" (UniqueName: \"kubernetes.io/projected/8d17d02c-6491-47f8-8519-2339c82574a2-kube-api-access-vqjln\") on node \"ip-10-0-130-209.ec2.internal\" DevicePath \"\"" Jul 20 16:58:58.538375 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:58.538230 2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d17d02c-6491-47f8-8519-2339c82574a2-istio-envoy\") on node \"ip-10-0-130-209.ec2.internal\" DevicePath \"\"" Jul 20 16:58:58.538375 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:58.538239 2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d17d02c-6491-47f8-8519-2339c82574a2-istio-token\") on node \"ip-10-0-130-209.ec2.internal\" DevicePath \"\"" Jul 20 16:58:58.538375 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:58.538247 2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d17d02c-6491-47f8-8519-2339c82574a2-istio-data\") on node \"ip-10-0-130-209.ec2.internal\" DevicePath \"\"" Jul 20 16:58:59.128712 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:59.128681 2583 generic.go:356] "Generic (PLEG): container finished" podID="8d17d02c-6491-47f8-8519-2339c82574a2" containerID="92c4d702c3bf34723b5973232fdef3bd02d1ff2cb7f6d6abac8e2eed02e2e0ca" exitCode=0 Jul 20 16:58:59.128856 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:59.128726 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" Jul 20 16:58:59.128856 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:59.128760 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" event={"ID":"8d17d02c-6491-47f8-8519-2339c82574a2","Type":"ContainerDied","Data":"92c4d702c3bf34723b5973232fdef3bd02d1ff2cb7f6d6abac8e2eed02e2e0ca"} Jul 20 16:58:59.128856 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:59.128811 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr" event={"ID":"8d17d02c-6491-47f8-8519-2339c82574a2","Type":"ContainerDied","Data":"1702067faaf30e1792e89760109bf57cc9bf5d04921639bd358aa7747ded7182"} Jul 20 16:58:59.128856 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:59.128834 2583 scope.go:117] "RemoveContainer" containerID="92c4d702c3bf34723b5973232fdef3bd02d1ff2cb7f6d6abac8e2eed02e2e0ca" Jul 20 16:58:59.137865 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:59.137849 2583 scope.go:117] "RemoveContainer" containerID="364b6347f44c3ee87799b7663cef6361000d392033ec62e669a58a54f0e3765a" Jul 20 16:58:59.146777 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:59.146758 2583 scope.go:117] "RemoveContainer" containerID="92c4d702c3bf34723b5973232fdef3bd02d1ff2cb7f6d6abac8e2eed02e2e0ca" Jul 20 16:58:59.147066 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:58:59.147031 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92c4d702c3bf34723b5973232fdef3bd02d1ff2cb7f6d6abac8e2eed02e2e0ca\": container with ID starting with 92c4d702c3bf34723b5973232fdef3bd02d1ff2cb7f6d6abac8e2eed02e2e0ca not found: ID does not exist" containerID="92c4d702c3bf34723b5973232fdef3bd02d1ff2cb7f6d6abac8e2eed02e2e0ca" Jul 20 16:58:59.147212 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:59.147064 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92c4d702c3bf34723b5973232fdef3bd02d1ff2cb7f6d6abac8e2eed02e2e0ca"} err="failed to get container status \"92c4d702c3bf34723b5973232fdef3bd02d1ff2cb7f6d6abac8e2eed02e2e0ca\": rpc error: code = NotFound desc = could not find container \"92c4d702c3bf34723b5973232fdef3bd02d1ff2cb7f6d6abac8e2eed02e2e0ca\": container with ID starting with 92c4d702c3bf34723b5973232fdef3bd02d1ff2cb7f6d6abac8e2eed02e2e0ca not found: ID does not exist" Jul 20 16:58:59.147212 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:59.147089 2583 scope.go:117] "RemoveContainer" containerID="364b6347f44c3ee87799b7663cef6361000d392033ec62e669a58a54f0e3765a" Jul 20 16:58:59.147399 ip-10-0-130-209 kubenswrapper[2583]: E0720 16:58:59.147380 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"364b6347f44c3ee87799b7663cef6361000d392033ec62e669a58a54f0e3765a\": container with ID starting with 364b6347f44c3ee87799b7663cef6361000d392033ec62e669a58a54f0e3765a not found: ID does not exist" containerID="364b6347f44c3ee87799b7663cef6361000d392033ec62e669a58a54f0e3765a" Jul 20 16:58:59.147466 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:59.147406 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"364b6347f44c3ee87799b7663cef6361000d392033ec62e669a58a54f0e3765a"} err="failed to get container status \"364b6347f44c3ee87799b7663cef6361000d392033ec62e669a58a54f0e3765a\": rpc error: code = NotFound desc = could not find container \"364b6347f44c3ee87799b7663cef6361000d392033ec62e669a58a54f0e3765a\": container with ID starting with 364b6347f44c3ee87799b7663cef6361000d392033ec62e669a58a54f0e3765a not found: ID does not exist" Jul 20 16:58:59.153921 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:59.153899 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr"] Jul 20 16:58:59.160343 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:58:59.160324 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-d88d04e6-openshift-default-5dc9dd8897-t6rvr"] Jul 20 16:59:00.334590 ip-10-0-130-209 kubenswrapper[2583]: I0720 16:59:00.334560 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d17d02c-6491-47f8-8519-2339c82574a2" path="/var/lib/kubelet/pods/8d17d02c-6491-47f8-8519-2339c82574a2/volumes" Jul 20 17:06:47.743909 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:06:47.743872 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ab00cf-6669bd8c85-r6h7d"] Jul 20 17:06:47.744499 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:06:47.744442 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d17d02c-6491-47f8-8519-2339c82574a2" containerName="istio-proxy" Jul 20 17:06:47.744499 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:06:47.744464 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d17d02c-6491-47f8-8519-2339c82574a2" containerName="istio-proxy" Jul 20 17:06:47.744499 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:06:47.744488 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d17d02c-6491-47f8-8519-2339c82574a2" containerName="istio-proxy" Jul 20 17:06:47.744499 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:06:47.744497 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d17d02c-6491-47f8-8519-2339c82574a2" containerName="istio-proxy" Jul 20 17:06:47.744705 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:06:47.744592 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d17d02c-6491-47f8-8519-2339c82574a2" containerName="istio-proxy" Jul 20 17:06:47.747606 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:06:47.747586 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab00cf-6669bd8c85-r6h7d" Jul 20 17:06:47.752417 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:06:47.752394 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-ab00cf-serving-cert\"" Jul 20 17:06:47.761697 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:06:47.761671 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ab00cf-6669bd8c85-r6h7d"] Jul 20 17:06:47.868609 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:06:47.868574 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79b808bc-00a4-41bf-b235-574f638bd48c-maas-api-tls\") pod \"maas-api-e2e-inf-b-ab00cf-6669bd8c85-r6h7d\" (UID: \"79b808bc-00a4-41bf-b235-574f638bd48c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab00cf-6669bd8c85-r6h7d" Jul 20 17:06:47.868780 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:06:47.868701 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79b808bc-00a4-41bf-b235-574f638bd48c-openshift-service-ca\") pod \"maas-api-e2e-inf-b-ab00cf-6669bd8c85-r6h7d\" (UID: \"79b808bc-00a4-41bf-b235-574f638bd48c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab00cf-6669bd8c85-r6h7d" Jul 20 17:06:47.868780 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:06:47.868738 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2txbm\" (UniqueName: \"kubernetes.io/projected/79b808bc-00a4-41bf-b235-574f638bd48c-kube-api-access-2txbm\") pod \"maas-api-e2e-inf-b-ab00cf-6669bd8c85-r6h7d\" (UID: \"79b808bc-00a4-41bf-b235-574f638bd48c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab00cf-6669bd8c85-r6h7d" Jul 20 17:06:47.969938 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:06:47.969901 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79b808bc-00a4-41bf-b235-574f638bd48c-maas-api-tls\") pod \"maas-api-e2e-inf-b-ab00cf-6669bd8c85-r6h7d\" (UID: \"79b808bc-00a4-41bf-b235-574f638bd48c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab00cf-6669bd8c85-r6h7d" Jul 20 17:06:47.970160 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:06:47.969968 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79b808bc-00a4-41bf-b235-574f638bd48c-openshift-service-ca\") pod \"maas-api-e2e-inf-b-ab00cf-6669bd8c85-r6h7d\" (UID: \"79b808bc-00a4-41bf-b235-574f638bd48c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab00cf-6669bd8c85-r6h7d" Jul 20 17:06:47.970160 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:06:47.969990 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2txbm\" (UniqueName: \"kubernetes.io/projected/79b808bc-00a4-41bf-b235-574f638bd48c-kube-api-access-2txbm\") pod \"maas-api-e2e-inf-b-ab00cf-6669bd8c85-r6h7d\" (UID: \"79b808bc-00a4-41bf-b235-574f638bd48c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab00cf-6669bd8c85-r6h7d" Jul 20 17:06:47.970160 ip-10-0-130-209 kubenswrapper[2583]: E0720 17:06:47.970082 2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-ab00cf-serving-cert: secret "maas-api-e2e-inf-b-ab00cf-serving-cert" not found Jul 20 17:06:47.970346 ip-10-0-130-209 kubenswrapper[2583]: E0720 17:06:47.970197 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79b808bc-00a4-41bf-b235-574f638bd48c-maas-api-tls podName:79b808bc-00a4-41bf-b235-574f638bd48c nodeName:}" failed. No retries permitted until 2026-07-20 17:06:48.470174357 +0000 UTC m=+2226.619975112 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/79b808bc-00a4-41bf-b235-574f638bd48c-maas-api-tls") pod "maas-api-e2e-inf-b-ab00cf-6669bd8c85-r6h7d" (UID: "79b808bc-00a4-41bf-b235-574f638bd48c") : secret "maas-api-e2e-inf-b-ab00cf-serving-cert" not found Jul 20 17:06:47.970674 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:06:47.970654 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79b808bc-00a4-41bf-b235-574f638bd48c-openshift-service-ca\") pod \"maas-api-e2e-inf-b-ab00cf-6669bd8c85-r6h7d\" (UID: \"79b808bc-00a4-41bf-b235-574f638bd48c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab00cf-6669bd8c85-r6h7d" Jul 20 17:06:47.980575 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:06:47.980547 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2txbm\" (UniqueName: \"kubernetes.io/projected/79b808bc-00a4-41bf-b235-574f638bd48c-kube-api-access-2txbm\") pod \"maas-api-e2e-inf-b-ab00cf-6669bd8c85-r6h7d\" (UID: \"79b808bc-00a4-41bf-b235-574f638bd48c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab00cf-6669bd8c85-r6h7d" Jul 20 17:06:48.474393 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:06:48.474359 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79b808bc-00a4-41bf-b235-574f638bd48c-maas-api-tls\") pod \"maas-api-e2e-inf-b-ab00cf-6669bd8c85-r6h7d\" (UID: \"79b808bc-00a4-41bf-b235-574f638bd48c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab00cf-6669bd8c85-r6h7d" Jul 20 17:06:48.476733 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:06:48.476704 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79b808bc-00a4-41bf-b235-574f638bd48c-maas-api-tls\") pod \"maas-api-e2e-inf-b-ab00cf-6669bd8c85-r6h7d\" (UID: \"79b808bc-00a4-41bf-b235-574f638bd48c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab00cf-6669bd8c85-r6h7d" Jul 20 17:06:48.657509 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:06:48.657460 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab00cf-6669bd8c85-r6h7d" Jul 20 17:06:49.000481 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:06:49.000457 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ab00cf-6669bd8c85-r6h7d"] Jul 20 17:06:49.002815 ip-10-0-130-209 kubenswrapper[2583]: W0720 17:06:49.002784 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79b808bc_00a4_41bf_b235_574f638bd48c.slice/crio-eeecbd4074add08240493f7233ab8bf564c5b1cb8bf4800207eb0787dd31dc7c WatchSource:0}: Error finding container eeecbd4074add08240493f7233ab8bf564c5b1cb8bf4800207eb0787dd31dc7c: Status 404 returned error can't find the container with id eeecbd4074add08240493f7233ab8bf564c5b1cb8bf4800207eb0787dd31dc7c Jul 20 17:06:49.004151 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:06:49.004134 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 17:06:49.353038 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:06:49.352953 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab00cf-6669bd8c85-r6h7d" event={"ID":"79b808bc-00a4-41bf-b235-574f638bd48c","Type":"ContainerStarted","Data":"eeecbd4074add08240493f7233ab8bf564c5b1cb8bf4800207eb0787dd31dc7c"} Jul 20 17:06:50.361077 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:06:50.360968 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab00cf-6669bd8c85-r6h7d" event={"ID":"79b808bc-00a4-41bf-b235-574f638bd48c","Type":"ContainerStarted","Data":"55b7fad6cb070bf1e7804eb9681fddfa212775a7595f1f5960f8235cd8eb6c4e"} Jul 20 17:06:50.361077 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:06:50.361054 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab00cf-6669bd8c85-r6h7d" Jul 20 17:06:50.380307 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:06:50.380260 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab00cf-6669bd8c85-r6h7d" podStartSLOduration=2.432844455 podStartE2EDuration="3.380246657s" totalImagesPullingTime="947.402202ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:06:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:06:50.378702121 +0000 UTC m=+2228.528502897" watchObservedRunningTime="2026-07-20 17:06:50.380246657 +0000 UTC m=+2228.530047432" Jul 20 17:06:56.371573 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:06:56.371543 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab00cf-6669bd8c85-r6h7d" Jul 20 17:08:55.802601 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:08:55.802517 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ab00cf-6669bd8c85-r6h7d"] Jul 20 17:08:55.803098 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:08:55.802774 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab00cf-6669bd8c85-r6h7d" podUID="79b808bc-00a4-41bf-b235-574f638bd48c" containerName="maas-api" containerID="cri-o://55b7fad6cb070bf1e7804eb9681fddfa212775a7595f1f5960f8235cd8eb6c4e" gracePeriod=30 Jul 20 17:08:55.933875 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:08:55.933843 2583 generic.go:356] "Generic (PLEG): container finished" podID="79b808bc-00a4-41bf-b235-574f638bd48c" containerID="55b7fad6cb070bf1e7804eb9681fddfa212775a7595f1f5960f8235cd8eb6c4e" exitCode=0 Jul 20 17:08:55.933985 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:08:55.933877 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab00cf-6669bd8c85-r6h7d" event={"ID":"79b808bc-00a4-41bf-b235-574f638bd48c","Type":"ContainerDied","Data":"55b7fad6cb070bf1e7804eb9681fddfa212775a7595f1f5960f8235cd8eb6c4e"} Jul 20 17:08:56.050309 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:08:56.050288 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab00cf-6669bd8c85-r6h7d" Jul 20 17:08:56.154459 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:08:56.154439 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79b808bc-00a4-41bf-b235-574f638bd48c-maas-api-tls\") pod \"79b808bc-00a4-41bf-b235-574f638bd48c\" (UID: \"79b808bc-00a4-41bf-b235-574f638bd48c\") " Jul 20 17:08:56.154585 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:08:56.154494 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79b808bc-00a4-41bf-b235-574f638bd48c-openshift-service-ca\") pod \"79b808bc-00a4-41bf-b235-574f638bd48c\" (UID: \"79b808bc-00a4-41bf-b235-574f638bd48c\") " Jul 20 17:08:56.154585 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:08:56.154538 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2txbm\" (UniqueName: \"kubernetes.io/projected/79b808bc-00a4-41bf-b235-574f638bd48c-kube-api-access-2txbm\") pod \"79b808bc-00a4-41bf-b235-574f638bd48c\" (UID: \"79b808bc-00a4-41bf-b235-574f638bd48c\") " Jul 20 17:08:56.154823 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:08:56.154794 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79b808bc-00a4-41bf-b235-574f638bd48c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "79b808bc-00a4-41bf-b235-574f638bd48c" (UID: "79b808bc-00a4-41bf-b235-574f638bd48c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 17:08:56.156609 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:08:56.156582 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79b808bc-00a4-41bf-b235-574f638bd48c-kube-api-access-2txbm" (OuterVolumeSpecName: "kube-api-access-2txbm") pod "79b808bc-00a4-41bf-b235-574f638bd48c" (UID: "79b808bc-00a4-41bf-b235-574f638bd48c"). InnerVolumeSpecName "kube-api-access-2txbm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 17:08:56.156672 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:08:56.156588 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79b808bc-00a4-41bf-b235-574f638bd48c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "79b808bc-00a4-41bf-b235-574f638bd48c" (UID: "79b808bc-00a4-41bf-b235-574f638bd48c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 17:08:56.255965 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:08:56.255942 2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79b808bc-00a4-41bf-b235-574f638bd48c-maas-api-tls\") on node \"ip-10-0-130-209.ec2.internal\" DevicePath \"\"" Jul 20 17:08:56.255965 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:08:56.255964 2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79b808bc-00a4-41bf-b235-574f638bd48c-openshift-service-ca\") on node \"ip-10-0-130-209.ec2.internal\" DevicePath \"\"" Jul 20 17:08:56.256098 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:08:56.255973 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2txbm\" (UniqueName: \"kubernetes.io/projected/79b808bc-00a4-41bf-b235-574f638bd48c-kube-api-access-2txbm\") on node \"ip-10-0-130-209.ec2.internal\" DevicePath \"\"" Jul 20 17:08:56.939330 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:08:56.939296 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab00cf-6669bd8c85-r6h7d" event={"ID":"79b808bc-00a4-41bf-b235-574f638bd48c","Type":"ContainerDied","Data":"eeecbd4074add08240493f7233ab8bf564c5b1cb8bf4800207eb0787dd31dc7c"} Jul 20 17:08:56.939702 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:08:56.939351 2583 scope.go:117] "RemoveContainer" containerID="55b7fad6cb070bf1e7804eb9681fddfa212775a7595f1f5960f8235cd8eb6c4e" Jul 20 17:08:56.939702 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:08:56.939308 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab00cf-6669bd8c85-r6h7d" Jul 20 17:08:56.955565 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:08:56.955543 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ab00cf-6669bd8c85-r6h7d"] Jul 20 17:08:56.959893 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:08:56.959874 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ab00cf-6669bd8c85-r6h7d"] Jul 20 17:08:58.335127 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:08:58.335084 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79b808bc-00a4-41bf-b235-574f638bd48c" path="/var/lib/kubelet/pods/79b808bc-00a4-41bf-b235-574f638bd48c/volumes" Jul 20 17:10:37.944158 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:10:37.944117 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e142d5-dc85d77d-rslzk"] Jul 20 17:10:37.944734 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:10:37.944648 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79b808bc-00a4-41bf-b235-574f638bd48c" containerName="maas-api" Jul 20 17:10:37.944734 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:10:37.944670 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="79b808bc-00a4-41bf-b235-574f638bd48c" containerName="maas-api" Jul 20 17:10:37.944855 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:10:37.944766 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d17d02c-6491-47f8-8519-2339c82574a2" containerName="istio-proxy" Jul 20 17:10:37.944855 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:10:37.944783 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="79b808bc-00a4-41bf-b235-574f638bd48c" containerName="maas-api" Jul 20 17:10:37.947822 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:10:37.947801 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e142d5-dc85d77d-rslzk" Jul 20 17:10:37.950233 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:10:37.950213 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-e142d5-serving-cert\"" Jul 20 17:10:37.959868 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:10:37.959844 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e142d5-dc85d77d-rslzk"] Jul 20 17:10:38.112197 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:10:38.112165 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a46dd97f-cea0-480e-a72b-ecb428a42b2d-maas-api-tls\") pod \"maas-api-e2e-shared-b-e142d5-dc85d77d-rslzk\" (UID: \"a46dd97f-cea0-480e-a72b-ecb428a42b2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e142d5-dc85d77d-rslzk" Jul 20 17:10:38.112381 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:10:38.112230 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2d8r\" (UniqueName: \"kubernetes.io/projected/a46dd97f-cea0-480e-a72b-ecb428a42b2d-kube-api-access-k2d8r\") pod \"maas-api-e2e-shared-b-e142d5-dc85d77d-rslzk\" (UID: \"a46dd97f-cea0-480e-a72b-ecb428a42b2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e142d5-dc85d77d-rslzk" Jul 20 17:10:38.112381 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:10:38.112338 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a46dd97f-cea0-480e-a72b-ecb428a42b2d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-e142d5-dc85d77d-rslzk\" (UID: \"a46dd97f-cea0-480e-a72b-ecb428a42b2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e142d5-dc85d77d-rslzk" Jul 20 17:10:38.212997 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:10:38.212902 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2d8r\" (UniqueName: \"kubernetes.io/projected/a46dd97f-cea0-480e-a72b-ecb428a42b2d-kube-api-access-k2d8r\") pod \"maas-api-e2e-shared-b-e142d5-dc85d77d-rslzk\" (UID: \"a46dd97f-cea0-480e-a72b-ecb428a42b2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e142d5-dc85d77d-rslzk" Jul 20 17:10:38.212997 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:10:38.212976 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a46dd97f-cea0-480e-a72b-ecb428a42b2d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-e142d5-dc85d77d-rslzk\" (UID: \"a46dd97f-cea0-480e-a72b-ecb428a42b2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e142d5-dc85d77d-rslzk" Jul 20 17:10:38.213202 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:10:38.213013 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a46dd97f-cea0-480e-a72b-ecb428a42b2d-maas-api-tls\") pod \"maas-api-e2e-shared-b-e142d5-dc85d77d-rslzk\" (UID: \"a46dd97f-cea0-480e-a72b-ecb428a42b2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e142d5-dc85d77d-rslzk" Jul 20 17:10:38.213643 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:10:38.213619 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a46dd97f-cea0-480e-a72b-ecb428a42b2d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-e142d5-dc85d77d-rslzk\" (UID: \"a46dd97f-cea0-480e-a72b-ecb428a42b2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e142d5-dc85d77d-rslzk" Jul 20 17:10:38.215463 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:10:38.215440 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a46dd97f-cea0-480e-a72b-ecb428a42b2d-maas-api-tls\") pod \"maas-api-e2e-shared-b-e142d5-dc85d77d-rslzk\" (UID: \"a46dd97f-cea0-480e-a72b-ecb428a42b2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e142d5-dc85d77d-rslzk" Jul 20 17:10:38.222755 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:10:38.222734 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2d8r\" (UniqueName: \"kubernetes.io/projected/a46dd97f-cea0-480e-a72b-ecb428a42b2d-kube-api-access-k2d8r\") pod \"maas-api-e2e-shared-b-e142d5-dc85d77d-rslzk\" (UID: \"a46dd97f-cea0-480e-a72b-ecb428a42b2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e142d5-dc85d77d-rslzk" Jul 20 17:10:38.258693 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:10:38.258668 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e142d5-dc85d77d-rslzk" Jul 20 17:10:38.395818 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:10:38.395794 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e142d5-dc85d77d-rslzk"] Jul 20 17:10:38.397834 ip-10-0-130-209 kubenswrapper[2583]: W0720 17:10:38.397806 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda46dd97f_cea0_480e_a72b_ecb428a42b2d.slice/crio-7f3be6781ea3b168e20ddccdb1b4d9cd33bc7136836ce9558b3387bf734ba400 WatchSource:0}: Error finding container 7f3be6781ea3b168e20ddccdb1b4d9cd33bc7136836ce9558b3387bf734ba400: Status 404 returned error can't find the container with id 7f3be6781ea3b168e20ddccdb1b4d9cd33bc7136836ce9558b3387bf734ba400 Jul 20 17:10:38.413955 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:10:38.413927 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e142d5-dc85d77d-rslzk" event={"ID":"a46dd97f-cea0-480e-a72b-ecb428a42b2d","Type":"ContainerStarted","Data":"7f3be6781ea3b168e20ddccdb1b4d9cd33bc7136836ce9558b3387bf734ba400"} Jul 20 17:10:39.419665 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:10:39.419631 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e142d5-dc85d77d-rslzk" event={"ID":"a46dd97f-cea0-480e-a72b-ecb428a42b2d","Type":"ContainerStarted","Data":"57264ec0b1931a1888d9fcda0d36a30c2ef055dc147c9028529f3c0e5e9848f4"} Jul 20 17:10:39.420029 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:10:39.419723 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e142d5-dc85d77d-rslzk" Jul 20 17:10:39.447138 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:10:39.447028 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e142d5-dc85d77d-rslzk" podStartSLOduration=1.6697830310000001 podStartE2EDuration="2.447013191s" totalImagesPullingTime="777.23016ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:10:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:10:39.445485699 +0000 UTC m=+2457.595286474" watchObservedRunningTime="2026-07-20 17:10:39.447013191 +0000 UTC m=+2457.596813967" Jul 20 17:10:45.433609 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:10:45.433575 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e142d5-dc85d77d-rslzk" Jul 20 17:17:59.770368 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:17:59.770333 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e142d5-dc85d77d-rslzk"] Jul 20 17:17:59.770795 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:17:59.770644 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e142d5-dc85d77d-rslzk" podUID="a46dd97f-cea0-480e-a72b-ecb428a42b2d" containerName="maas-api" containerID="cri-o://57264ec0b1931a1888d9fcda0d36a30c2ef055dc147c9028529f3c0e5e9848f4" gracePeriod=30 Jul 20 17:18:00.022249 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:00.022189 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e142d5-dc85d77d-rslzk" Jul 20 17:18:00.079670 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:00.079641 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a46dd97f-cea0-480e-a72b-ecb428a42b2d-openshift-service-ca\") pod \"a46dd97f-cea0-480e-a72b-ecb428a42b2d\" (UID: \"a46dd97f-cea0-480e-a72b-ecb428a42b2d\") " Jul 20 17:18:00.079842 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:00.079759 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a46dd97f-cea0-480e-a72b-ecb428a42b2d-maas-api-tls\") pod \"a46dd97f-cea0-480e-a72b-ecb428a42b2d\" (UID: \"a46dd97f-cea0-480e-a72b-ecb428a42b2d\") " Jul 20 17:18:00.079842 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:00.079795 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2d8r\" (UniqueName: \"kubernetes.io/projected/a46dd97f-cea0-480e-a72b-ecb428a42b2d-kube-api-access-k2d8r\") pod \"a46dd97f-cea0-480e-a72b-ecb428a42b2d\" (UID: \"a46dd97f-cea0-480e-a72b-ecb428a42b2d\") " Jul 20 17:18:00.079957 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:00.079936 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a46dd97f-cea0-480e-a72b-ecb428a42b2d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a46dd97f-cea0-480e-a72b-ecb428a42b2d" (UID: "a46dd97f-cea0-480e-a72b-ecb428a42b2d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 17:18:00.080056 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:00.080042 2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a46dd97f-cea0-480e-a72b-ecb428a42b2d-openshift-service-ca\") on node \"ip-10-0-130-209.ec2.internal\" DevicePath \"\"" Jul 20 17:18:00.081734 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:00.081708 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a46dd97f-cea0-480e-a72b-ecb428a42b2d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a46dd97f-cea0-480e-a72b-ecb428a42b2d" (UID: "a46dd97f-cea0-480e-a72b-ecb428a42b2d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 17:18:00.081831 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:00.081748 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a46dd97f-cea0-480e-a72b-ecb428a42b2d-kube-api-access-k2d8r" (OuterVolumeSpecName: "kube-api-access-k2d8r") pod "a46dd97f-cea0-480e-a72b-ecb428a42b2d" (UID: "a46dd97f-cea0-480e-a72b-ecb428a42b2d"). InnerVolumeSpecName "kube-api-access-k2d8r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 17:18:00.180603 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:00.180570 2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a46dd97f-cea0-480e-a72b-ecb428a42b2d-maas-api-tls\") on node \"ip-10-0-130-209.ec2.internal\" DevicePath \"\"" Jul 20 17:18:00.180603 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:00.180597 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2d8r\" (UniqueName: \"kubernetes.io/projected/a46dd97f-cea0-480e-a72b-ecb428a42b2d-kube-api-access-k2d8r\") on node \"ip-10-0-130-209.ec2.internal\" DevicePath \"\"" Jul 20 17:18:00.478895 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:00.478856 2583 generic.go:356] "Generic (PLEG): container finished" podID="a46dd97f-cea0-480e-a72b-ecb428a42b2d" containerID="57264ec0b1931a1888d9fcda0d36a30c2ef055dc147c9028529f3c0e5e9848f4" exitCode=0 Jul 20 17:18:00.478895 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:00.478898 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e142d5-dc85d77d-rslzk" Jul 20 17:18:00.479060 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:00.478916 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e142d5-dc85d77d-rslzk" event={"ID":"a46dd97f-cea0-480e-a72b-ecb428a42b2d","Type":"ContainerDied","Data":"57264ec0b1931a1888d9fcda0d36a30c2ef055dc147c9028529f3c0e5e9848f4"} Jul 20 17:18:00.479060 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:00.478961 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e142d5-dc85d77d-rslzk" event={"ID":"a46dd97f-cea0-480e-a72b-ecb428a42b2d","Type":"ContainerDied","Data":"7f3be6781ea3b168e20ddccdb1b4d9cd33bc7136836ce9558b3387bf734ba400"} Jul 20 17:18:00.479060 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:00.478983 2583 scope.go:117] "RemoveContainer" containerID="57264ec0b1931a1888d9fcda0d36a30c2ef055dc147c9028529f3c0e5e9848f4" Jul 20 17:18:00.487227 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:00.487208 2583 scope.go:117] "RemoveContainer" containerID="57264ec0b1931a1888d9fcda0d36a30c2ef055dc147c9028529f3c0e5e9848f4" Jul 20 17:18:00.487494 ip-10-0-130-209 kubenswrapper[2583]: E0720 17:18:00.487476 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57264ec0b1931a1888d9fcda0d36a30c2ef055dc147c9028529f3c0e5e9848f4\": container with ID starting with 57264ec0b1931a1888d9fcda0d36a30c2ef055dc147c9028529f3c0e5e9848f4 not found: ID does not exist" containerID="57264ec0b1931a1888d9fcda0d36a30c2ef055dc147c9028529f3c0e5e9848f4" Jul 20 17:18:00.487547 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:00.487502 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57264ec0b1931a1888d9fcda0d36a30c2ef055dc147c9028529f3c0e5e9848f4"} err="failed to get container status \"57264ec0b1931a1888d9fcda0d36a30c2ef055dc147c9028529f3c0e5e9848f4\": rpc error: code = NotFound desc = could not find container \"57264ec0b1931a1888d9fcda0d36a30c2ef055dc147c9028529f3c0e5e9848f4\": container with ID starting with 57264ec0b1931a1888d9fcda0d36a30c2ef055dc147c9028529f3c0e5e9848f4 not found: ID does not exist" Jul 20 17:18:00.498312 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:00.498293 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e142d5-dc85d77d-rslzk"] Jul 20 17:18:00.506404 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:00.506385 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e142d5-dc85d77d-rslzk"] Jul 20 17:18:02.335757 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:02.335724 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a46dd97f-cea0-480e-a72b-ecb428a42b2d" path="/var/lib/kubelet/pods/a46dd97f-cea0-480e-a72b-ecb428a42b2d/volumes" Jul 20 17:18:18.934061 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:18.934027 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-659f7c964b-jd6z7_aeccf530-48ec-43b0-a65f-6d911bd782f3/manager/0.log" Jul 20 17:18:19.073415 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:19.073383 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-rsbfr_447c9d52-2e46-4d04-91e6-028580234ef6/server/0.log" Jul 20 17:18:19.207487 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:19.207407 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9zf98_f1794d6e-7a49-480b-bd3d-4788ef9a33e3/manager/0.log" Jul 20 17:18:19.471941 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:19.471863 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9d55867bb-htxhd_48cc570e-9a86-4b47-9f02-c19aaad58f86/copy-manifests/0.log" Jul 20 17:18:19.479322 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:19.479281 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9d55867bb-htxhd_48cc570e-9a86-4b47-9f02-c19aaad58f86/manager/0.log" Jul 20 17:18:20.072822 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:20.072790 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6c8b896dcd-6x76z_289715db-41ba-4f59-876e-a263443f1627/maas-api/0.log" Jul 20 17:18:22.469876 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:22.469835 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-m782l_049a3f8b-8cb0-48f5-af56-16545098b474/manager/0.log" Jul 20 17:18:23.252716 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:23.252678 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-kzfmp_29a623ef-ec01-43b8-99d6-6f02809946fa/manager/0.log" Jul 20 17:18:23.636302 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:23.636201 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf45kzsw_288bfa38-1130-4b06-9f5d-e69cab9b21f2/istio-proxy/0.log" Jul 20 17:18:23.773683 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:23.773651 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-szslf_c3951b40-36b6-4750-83c4-c580073544a3/discovery/0.log" Jul 20 17:18:23.891309 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:23.891219 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-745b54bffd-p9mwc_ed6fff0c-1f01-408f-afe2-f7aac12096f2/kube-auth-proxy/0.log" Jul 20 17:18:24.173583 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:24.173546 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gv5fb_e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519/istio-proxy/1.log" Jul 20 17:18:24.316035 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:24.316010 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-fk6kj_a1c753ea-c04d-4604-973e-ab5ef84b3c0d/payload-pre-processing/0.log" Jul 20 17:18:25.119209 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:25.119178 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-nzrgr_5e8037aa-c527-4cd6-8a3f-e77665b9cbe2/main/0.log" Jul 20 17:18:25.237902 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:25.237867 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-474vw_d1d94e97-2f5a-423a-a732-09a06b0d5f41/main/0.log" Jul 20 17:18:25.361418 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:25.361385 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqbss_a4bb4dc8-f5e5-42c6-a5af-dc2e1930432b/main/0.log" Jul 20 17:18:25.477588 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:25.477561 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-vxfjx_d447328f-665e-4566-bf67-cbc39a08fc97/main/0.log" Jul 20 17:18:35.287904 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:35.287869 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fjgcb_d771112b-c7d6-4ee2-84a3-567150c4407a/global-pull-secret-syncer/0.log" Jul 20 17:18:35.450536 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:35.450499 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mzzz4_b5364d44-60be-4948-aeb0-08ee992afa1f/konnectivity-agent/0.log" Jul 20 17:18:35.543254 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:35.543172 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-209.ec2.internal_7f834a056acbe47737d34ff21bd03fbb/haproxy/0.log" Jul 20 17:18:40.961183 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:40.961148 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-m782l_049a3f8b-8cb0-48f5-af56-16545098b474/manager/0.log" Jul 20 17:18:41.596753 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:41.596724 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-kzfmp_29a623ef-ec01-43b8-99d6-6f02809946fa/manager/0.log" Jul 20 17:18:43.653774 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:43.653737 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-wpx4l_ca9ea789-5f22-4e04-8eeb-a3a51ee2e72d/monitoring-plugin/0.log" Jul 20 17:18:43.870051 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:43.870022 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f8gbz_201ed71d-cdf4-4b6e-a681-bf9206e2523f/node-exporter/0.log" Jul 20 17:18:43.892154 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:43.892125 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f8gbz_201ed71d-cdf4-4b6e-a681-bf9206e2523f/kube-rbac-proxy/0.log" Jul 20 17:18:43.921061 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:43.920998 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f8gbz_201ed71d-cdf4-4b6e-a681-bf9206e2523f/init-textfile/0.log" Jul 20 17:18:44.293221 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:44.293134 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-l652s_202ea82f-a28b-4541-973d-6b345756f5a3/prometheus-operator/0.log" Jul 20 17:18:44.325343 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:44.325317 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-l652s_202ea82f-a28b-4541-973d-6b345756f5a3/kube-rbac-proxy/0.log" Jul 20 17:18:44.361050 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:44.361023 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-5n5zm_b5bac671-1b85-4d29-b0fd-bc7b94772b8c/prometheus-operator-admission-webhook/0.log" Jul 20 17:18:45.145687 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:45.145653 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-m6c6l/perf-node-gather-daemonset-79v7s"] Jul 20 17:18:45.146069 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:45.146040 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a46dd97f-cea0-480e-a72b-ecb428a42b2d" containerName="maas-api" Jul 20 17:18:45.146069 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:45.146054 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a46dd97f-cea0-480e-a72b-ecb428a42b2d" containerName="maas-api" Jul 20 17:18:45.146206 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:45.146145 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a46dd97f-cea0-480e-a72b-ecb428a42b2d" containerName="maas-api" Jul 20 17:18:45.150204 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:45.150184 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-79v7s" Jul 20 17:18:45.153375 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:45.153355 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m6c6l\"/\"kube-root-ca.crt\"" Jul 20 17:18:45.154306 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:45.154288 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m6c6l\"/\"openshift-service-ca.crt\"" Jul 20 17:18:45.154453 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:45.154435 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-m6c6l\"/\"default-dockercfg-szprv\"" Jul 20 17:18:45.163817 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:45.163797 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m6c6l/perf-node-gather-daemonset-79v7s"] Jul 20 17:18:45.266059 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:45.266033 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/11556e6e-b513-4999-9922-9bb021897c6b-podres\") pod \"perf-node-gather-daemonset-79v7s\" (UID: \"11556e6e-b513-4999-9922-9bb021897c6b\") " pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-79v7s" Jul 20 17:18:45.266194 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:45.266092 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/11556e6e-b513-4999-9922-9bb021897c6b-sys\") pod \"perf-node-gather-daemonset-79v7s\" (UID: \"11556e6e-b513-4999-9922-9bb021897c6b\") " pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-79v7s" Jul 20 17:18:45.266194 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:45.266134 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd7kw\" (UniqueName: \"kubernetes.io/projected/11556e6e-b513-4999-9922-9bb021897c6b-kube-api-access-bd7kw\") pod \"perf-node-gather-daemonset-79v7s\" (UID: \"11556e6e-b513-4999-9922-9bb021897c6b\") " pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-79v7s" Jul 20 17:18:45.266194 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:45.266158 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/11556e6e-b513-4999-9922-9bb021897c6b-lib-modules\") pod \"perf-node-gather-daemonset-79v7s\" (UID: \"11556e6e-b513-4999-9922-9bb021897c6b\") " pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-79v7s" Jul 20 17:18:45.266194 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:45.266174 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/11556e6e-b513-4999-9922-9bb021897c6b-proc\") pod \"perf-node-gather-daemonset-79v7s\" (UID: \"11556e6e-b513-4999-9922-9bb021897c6b\") " pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-79v7s" Jul 20 17:18:45.367227 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:45.367189 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/11556e6e-b513-4999-9922-9bb021897c6b-sys\") pod \"perf-node-gather-daemonset-79v7s\" (UID: \"11556e6e-b513-4999-9922-9bb021897c6b\") " pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-79v7s" Jul 20 17:18:45.367336 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:45.367235 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd7kw\" (UniqueName: \"kubernetes.io/projected/11556e6e-b513-4999-9922-9bb021897c6b-kube-api-access-bd7kw\") pod \"perf-node-gather-daemonset-79v7s\" (UID: \"11556e6e-b513-4999-9922-9bb021897c6b\") " pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-79v7s" Jul 20 17:18:45.367336 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:45.367267 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/11556e6e-b513-4999-9922-9bb021897c6b-lib-modules\") pod \"perf-node-gather-daemonset-79v7s\" (UID: \"11556e6e-b513-4999-9922-9bb021897c6b\") " pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-79v7s" Jul 20 17:18:45.367336 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:45.367294 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/11556e6e-b513-4999-9922-9bb021897c6b-proc\") pod \"perf-node-gather-daemonset-79v7s\" (UID: \"11556e6e-b513-4999-9922-9bb021897c6b\") " pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-79v7s" Jul 20 17:18:45.367336 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:45.367309 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/11556e6e-b513-4999-9922-9bb021897c6b-sys\") pod \"perf-node-gather-daemonset-79v7s\" (UID: \"11556e6e-b513-4999-9922-9bb021897c6b\") " pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-79v7s" Jul 20 17:18:45.367467 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:45.367341 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/11556e6e-b513-4999-9922-9bb021897c6b-podres\") pod \"perf-node-gather-daemonset-79v7s\" (UID: \"11556e6e-b513-4999-9922-9bb021897c6b\") " pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-79v7s" Jul 20 17:18:45.367467 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:45.367369 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/11556e6e-b513-4999-9922-9bb021897c6b-proc\") pod \"perf-node-gather-daemonset-79v7s\" (UID: \"11556e6e-b513-4999-9922-9bb021897c6b\") " pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-79v7s" Jul 20 17:18:45.367467 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:45.367444 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/11556e6e-b513-4999-9922-9bb021897c6b-lib-modules\") pod \"perf-node-gather-daemonset-79v7s\" (UID: \"11556e6e-b513-4999-9922-9bb021897c6b\") " pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-79v7s" Jul 20 17:18:45.367467 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:45.367457 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/11556e6e-b513-4999-9922-9bb021897c6b-podres\") pod \"perf-node-gather-daemonset-79v7s\" (UID: \"11556e6e-b513-4999-9922-9bb021897c6b\") " pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-79v7s" Jul 20 17:18:45.377580 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:45.377552 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd7kw\" (UniqueName: \"kubernetes.io/projected/11556e6e-b513-4999-9922-9bb021897c6b-kube-api-access-bd7kw\") pod \"perf-node-gather-daemonset-79v7s\" (UID: \"11556e6e-b513-4999-9922-9bb021897c6b\") " pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-79v7s" Jul 20 17:18:45.459405 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:45.459378 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-79v7s" Jul 20 17:18:45.596018 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:45.595995 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m6c6l/perf-node-gather-daemonset-79v7s"] Jul 20 17:18:45.597678 ip-10-0-130-209 kubenswrapper[2583]: W0720 17:18:45.597650 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod11556e6e_b513_4999_9922_9bb021897c6b.slice/crio-8772b8d99f27cd0ef4261479f4041b9a160ac830c36bb02a38c92025b7af5171 WatchSource:0}: Error finding container 8772b8d99f27cd0ef4261479f4041b9a160ac830c36bb02a38c92025b7af5171: Status 404 returned error can't find the container with id 8772b8d99f27cd0ef4261479f4041b9a160ac830c36bb02a38c92025b7af5171 Jul 20 17:18:45.694648 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:45.694618 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-79v7s" event={"ID":"11556e6e-b513-4999-9922-9bb021897c6b","Type":"ContainerStarted","Data":"b10d50182c17ed06c83180bd463d6e880858781659d456c21f1e4885118280a8"} Jul 20 17:18:45.694771 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:45.694706 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-79v7s" event={"ID":"11556e6e-b513-4999-9922-9bb021897c6b","Type":"ContainerStarted","Data":"8772b8d99f27cd0ef4261479f4041b9a160ac830c36bb02a38c92025b7af5171"} Jul 20 17:18:45.694771 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:45.694748 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-79v7s" Jul 20 17:18:45.711854 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:45.711773 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-79v7s" podStartSLOduration=0.711759027 podStartE2EDuration="711.759027ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 17:18:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:18:45.711155648 +0000 UTC m=+2943.860956439" watchObservedRunningTime="2026-07-20 17:18:45.711759027 +0000 UTC m=+2943.861559804" Jul 20 17:18:48.852579 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:48.852547 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-66kq4_3f1174be-e815-4547-88f8-5efa937dd72b/dns/0.log" Jul 20 17:18:48.876667 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:48.876635 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-66kq4_3f1174be-e815-4547-88f8-5efa937dd72b/kube-rbac-proxy/0.log" Jul 20 17:18:49.168523 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:49.168492 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v4zb9_2d54e31a-0d64-4914-9613-ffc1e50ea9e1/dns-node-resolver/0.log" Jul 20 17:18:49.846392 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:49.846364 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zh5ql_d139ce10-11a1-4353-90e1-b3a3008f6959/node-ca/0.log" Jul 20 17:18:50.848043 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:50.847962 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf45kzsw_288bfa38-1130-4b06-9f5d-e69cab9b21f2/istio-proxy/0.log" Jul 20 17:18:51.079575 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:51.079548 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-szslf_c3951b40-36b6-4750-83c4-c580073544a3/discovery/0.log" Jul 20 17:18:51.104782 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:51.104701 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-745b54bffd-p9mwc_ed6fff0c-1f01-408f-afe2-f7aac12096f2/kube-auth-proxy/0.log" Jul 20 17:18:51.173707 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:51.173678 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gv5fb_e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519/istio-proxy/0.log" Jul 20 17:18:51.230804 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:51.230774 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gv5fb_e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519/istio-proxy/1.log" Jul 20 17:18:51.275190 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:51.275159 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-fk6kj_a1c753ea-c04d-4604-973e-ab5ef84b3c0d/payload-pre-processing/0.log" Jul 20 17:18:51.709373 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:51.709347 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-79v7s" Jul 20 17:18:52.114087 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:52.114006 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ln95b_47d88f39-08ac-4c56-a3da-942319bc7cd1/serve-healthcheck-canary/0.log" Jul 20 17:18:52.794838 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:52.794810 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h6vfc_dd090edd-1a90-43b8-8e8b-3c2ea22e5de5/kube-rbac-proxy/0.log" Jul 20 17:18:52.822733 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:52.822705 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h6vfc_dd090edd-1a90-43b8-8e8b-3c2ea22e5de5/exporter/0.log" Jul 20 17:18:52.852254 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:52.852226 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h6vfc_dd090edd-1a90-43b8-8e8b-3c2ea22e5de5/extractor/0.log" Jul 20 17:18:55.828004 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:55.827976 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf45kzsw_288bfa38-1130-4b06-9f5d-e69cab9b21f2/istio-proxy/0.log" Jul 20 17:18:56.086641 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:56.086550 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-659f7c964b-jd6z7_aeccf530-48ec-43b0-a65f-6d911bd782f3/manager/0.log" Jul 20 17:18:56.114231 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:56.114205 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-szslf_c3951b40-36b6-4750-83c4-c580073544a3/discovery/0.log" Jul 20 17:18:56.153306 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:56.153282 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-745b54bffd-p9mwc_ed6fff0c-1f01-408f-afe2-f7aac12096f2/kube-auth-proxy/0.log" Jul 20 17:18:56.159778 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:56.159756 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-rsbfr_447c9d52-2e46-4d04-91e6-028580234ef6/server/0.log" Jul 20 17:18:56.212042 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:56.212017 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gv5fb_e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519/istio-proxy/0.log" Jul 20 17:18:56.285159 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:56.285133 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gv5fb_e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519/istio-proxy/1.log" Jul 20 17:18:56.306605 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:56.306584 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9zf98_f1794d6e-7a49-480b-bd3d-4788ef9a33e3/manager/0.log" Jul 20 17:18:56.322858 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:56.322839 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-fk6kj_a1c753ea-c04d-4604-973e-ab5ef84b3c0d/payload-pre-processing/0.log" Jul 20 17:18:56.409967 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:56.409942 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9d55867bb-htxhd_48cc570e-9a86-4b47-9f02-c19aaad58f86/manager/0.log" Jul 20 17:18:56.435750 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:56.435729 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9d55867bb-htxhd_48cc570e-9a86-4b47-9f02-c19aaad58f86/copy-manifests/0.log" Jul 20 17:18:57.573784 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:57.573751 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf45kzsw_288bfa38-1130-4b06-9f5d-e69cab9b21f2/istio-proxy/0.log" Jul 20 17:18:57.789305 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:57.789277 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-szslf_c3951b40-36b6-4750-83c4-c580073544a3/discovery/0.log" Jul 20 17:18:57.818351 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:57.818324 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-745b54bffd-p9mwc_ed6fff0c-1f01-408f-afe2-f7aac12096f2/kube-auth-proxy/0.log" Jul 20 17:18:57.860338 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:57.860255 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gv5fb_e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519/istio-proxy/0.log" Jul 20 17:18:57.912974 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:57.912947 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gv5fb_e6ff9675-4e9d-4b4b-9e10-7bd3da8d9519/istio-proxy/1.log" Jul 20 17:18:57.914978 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:57.914936 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-dlcbr_b126576b-aae9-441d-a962-69543ca889e8/openshift-lws-operator/0.log" Jul 20 17:18:57.954346 ip-10-0-130-209 kubenswrapper[2583]: I0720 17:18:57.954324 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-fk6kj_a1c753ea-c04d-4604-973e-ab5ef84b3c0d/payload-pre-processing/0.log"