Jul 15 16:38:04.899312 ip-10-0-132-162 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 15 16:38:04.899324 ip-10-0-132-162 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 15 16:38:04.899330 ip-10-0-132-162 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 15 16:38:04.899591 ip-10-0-132-162 systemd[1]: Failed to start Kubernetes Kubelet. Jul 15 16:38:15.093875 ip-10-0-132-162 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 15 16:38:15.093894 ip-10-0-132-162 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot ab1562a6ea8043ddaf09acc6334359a9 -- Jul 15 16:40:11.853632 ip-10-0-132-162 systemd[1]: Starting Kubernetes Kubelet... Jul 15 16:40:12.418643 ip-10-0-132-162 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 16:40:12.418643 ip-10-0-132-162 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 15 16:40:12.418643 ip-10-0-132-162 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 16:40:12.418643 ip-10-0-132-162 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 15 16:40:12.418643 ip-10-0-132-162 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 16:40:12.418643 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.321871 2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 15 16:40:12.418643 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328024 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 16:40:12.418643 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328040 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 16:40:12.418643 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328045 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 16:40:12.418643 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328048 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 16:40:12.418643 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328051 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 16:40:12.418643 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328054 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 16:40:12.418643 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328058 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 16:40:12.390700 ip-10-0-132-162 systemd[1]: Started Kubernetes Kubelet. Jul 15 16:40:12.419695 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328060 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 16:40:12.419695 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328063 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 16:40:12.419695 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328066 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 16:40:12.419695 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328069 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 16:40:12.419695 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328073 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 16:40:12.419695 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328076 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 16:40:12.419695 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328079 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 16:40:12.419695 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328082 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 16:40:12.419695 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328085 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 16:40:12.419695 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328087 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 16:40:12.419695 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328090 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 16:40:12.419695 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328100 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 16:40:12.419695 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328103 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 16:40:12.419695 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328106 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 16:40:12.419695 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328109 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 16:40:12.419695 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328112 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 16:40:12.419695 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328114 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 16:40:12.419695 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328117 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 16:40:12.419695 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328119 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 16:40:12.419695 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328122 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 16:40:12.420798 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328130 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 16:40:12.420798 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328133 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 16:40:12.420798 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328136 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 16:40:12.420798 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328138 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 16:40:12.420798 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328141 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 16:40:12.420798 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328144 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 16:40:12.420798 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328147 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 16:40:12.420798 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328149 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 16:40:12.420798 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328152 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 16:40:12.420798 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328155 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 16:40:12.420798 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328158 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 16:40:12.420798 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328161 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 16:40:12.420798 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328163 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 16:40:12.420798 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328166 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 16:40:12.420798 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328169 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 16:40:12.420798 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328171 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 16:40:12.420798 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328174 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 16:40:12.420798 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328177 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 16:40:12.420798 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328179 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 16:40:12.420798 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328181 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 16:40:12.421655 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328184 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 16:40:12.421655 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328187 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 16:40:12.421655 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328189 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 16:40:12.421655 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328193 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 16:40:12.421655 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328196 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 16:40:12.421655 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328199 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 16:40:12.421655 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328201 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 16:40:12.421655 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328204 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 16:40:12.421655 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328207 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 16:40:12.421655 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328209 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 16:40:12.421655 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328212 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 16:40:12.421655 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328215 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 16:40:12.421655 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328218 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 16:40:12.421655 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328222 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 16:40:12.421655 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328225 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 16:40:12.421655 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328228 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 16:40:12.421655 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328230 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 16:40:12.421655 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328233 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 16:40:12.421655 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328235 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 16:40:12.422304 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328238 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 16:40:12.422304 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328241 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 16:40:12.422304 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328244 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 16:40:12.422304 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328247 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 16:40:12.422304 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328249 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 16:40:12.422304 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328251 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 16:40:12.422304 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328254 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 16:40:12.422304 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328257 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 16:40:12.422304 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328260 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 16:40:12.422304 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328262 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 16:40:12.422304 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328265 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 16:40:12.422304 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328268 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 16:40:12.422304 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328270 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 16:40:12.422304 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328272 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 16:40:12.422304 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328275 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 16:40:12.422304 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328278 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 16:40:12.422304 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328280 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 16:40:12.422304 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328283 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 16:40:12.422304 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328286 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 16:40:12.422304 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328288 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 16:40:12.423151 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328291 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 16:40:12.423151 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328293 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 16:40:12.423151 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328295 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 16:40:12.423151 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328298 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 16:40:12.423151 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328300 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 16:40:12.423151 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328303 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 16:40:12.423151 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328305 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 16:40:12.423151 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328308 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 16:40:12.423151 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328310 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 16:40:12.423151 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328313 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 15 16:40:12.423151 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328315 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 16:40:12.423151 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328318 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 16:40:12.423151 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328321 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 16:40:12.423151 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.328991 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 16:40:12.423151 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329000 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 16:40:12.423151 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329003 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 16:40:12.423151 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329007 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 16:40:12.423151 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329011 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 16:40:12.423151 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329014 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 16:40:12.423151 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329017 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 16:40:12.424007 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329020 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 16:40:12.424007 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329023 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 16:40:12.424007 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329025 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 16:40:12.424007 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329028 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 16:40:12.424007 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329031 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 16:40:12.424007 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329033 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 16:40:12.424007 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329036 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 16:40:12.424007 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329038 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 16:40:12.424007 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329041 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 16:40:12.424007 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329044 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 16:40:12.424007 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329046 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 16:40:12.424007 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329049 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 16:40:12.424007 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329051 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 16:40:12.424007 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329056 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 16:40:12.424007 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329060 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 16:40:12.424007 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329063 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 16:40:12.424007 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329067 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 16:40:12.424007 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329070 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 16:40:12.424007 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329072 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 16:40:12.424601 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329075 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 16:40:12.424601 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329078 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 16:40:12.424601 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329081 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 16:40:12.424601 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329084 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 16:40:12.424601 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329086 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 16:40:12.424601 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329089 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 16:40:12.424601 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329092 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 16:40:12.424601 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329094 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 16:40:12.424601 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329097 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 16:40:12.424601 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329099 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 16:40:12.424601 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329103 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 16:40:12.424601 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329105 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 16:40:12.424601 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329108 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 16:40:12.424601 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329111 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 16:40:12.424601 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329113 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 16:40:12.424601 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329116 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 16:40:12.424601 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329119 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 16:40:12.424601 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329121 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 16:40:12.424601 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329124 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 16:40:12.424601 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329126 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 16:40:12.425600 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329129 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 16:40:12.425600 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329131 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 16:40:12.425600 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329134 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 16:40:12.425600 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329136 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 16:40:12.425600 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329139 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 16:40:12.425600 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329141 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 16:40:12.425600 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329144 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 16:40:12.425600 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329146 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 16:40:12.425600 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329149 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 16:40:12.425600 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329151 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 16:40:12.425600 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329154 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 15 16:40:12.425600 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329156 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 16:40:12.425600 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329158 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 16:40:12.425600 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329161 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 16:40:12.425600 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329164 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 16:40:12.425600 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329166 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 16:40:12.425600 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329169 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 16:40:12.425600 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329171 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 16:40:12.425600 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329175 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 16:40:12.426183 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329177 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 16:40:12.426183 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329179 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 16:40:12.426183 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329182 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 16:40:12.426183 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329185 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 16:40:12.426183 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329187 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 16:40:12.426183 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329190 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 16:40:12.426183 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329193 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 16:40:12.426183 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329195 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 16:40:12.426183 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329197 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 16:40:12.426183 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329200 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 16:40:12.426183 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329202 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 16:40:12.426183 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329205 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 16:40:12.426183 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329207 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 16:40:12.426183 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329210 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 16:40:12.426183 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329215 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 16:40:12.426183 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329218 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 16:40:12.426183 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329220 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 16:40:12.426183 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329223 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 16:40:12.426183 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329226 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 16:40:12.426183 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329228 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 16:40:12.426935 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329231 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 16:40:12.426935 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329233 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 16:40:12.426935 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329236 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 16:40:12.426935 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329238 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 16:40:12.426935 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329241 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 16:40:12.426935 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329243 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 16:40:12.426935 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329246 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 16:40:12.426935 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329248 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 16:40:12.426935 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329250 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 16:40:12.426935 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329253 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 16:40:12.426935 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329255 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 16:40:12.426935 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329258 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 16:40:12.426935 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329260 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 16:40:12.426935 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329264 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 16:40:12.426935 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329650 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 16:40:12.426935 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329656 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 16:40:12.426935 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329659 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 16:40:12.426935 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329661 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 16:40:12.426935 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329665 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 16:40:12.426935 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329667 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 16:40:12.427720 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329670 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 16:40:12.427720 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329672 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 16:40:12.427720 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329675 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 16:40:12.427720 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329677 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 16:40:12.427720 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329680 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 16:40:12.427720 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329683 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 16:40:12.427720 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329688 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 16:40:12.427720 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329691 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 16:40:12.427720 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329693 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 16:40:12.427720 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329696 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 16:40:12.427720 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329699 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 16:40:12.427720 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329701 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 16:40:12.427720 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329704 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 16:40:12.427720 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329707 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 16:40:12.427720 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329710 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 16:40:12.427720 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329712 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 16:40:12.427720 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329715 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 16:40:12.427720 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329717 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 16:40:12.427720 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329720 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 16:40:12.427720 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329722 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 16:40:12.428742 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329725 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 16:40:12.428742 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329727 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 16:40:12.428742 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329729 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 16:40:12.428742 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329732 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 16:40:12.428742 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329734 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 16:40:12.428742 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329739 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 16:40:12.428742 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329742 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 16:40:12.428742 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329745 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 16:40:12.428742 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329748 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 16:40:12.428742 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329751 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 16:40:12.428742 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329754 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 16:40:12.428742 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329756 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 16:40:12.428742 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329759 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 16:40:12.428742 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329762 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 16:40:12.428742 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329764 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 16:40:12.428742 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329767 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 16:40:12.428742 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329770 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 16:40:12.428742 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329773 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 16:40:12.428742 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329777 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 16:40:12.428742 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329779 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 16:40:12.429426 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329782 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 15 16:40:12.429426 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329784 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 16:40:12.429426 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329787 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 16:40:12.429426 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329790 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 16:40:12.429426 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329792 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 16:40:12.429426 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329795 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 16:40:12.429426 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329797 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 16:40:12.429426 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329800 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 16:40:12.429426 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329802 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 16:40:12.429426 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329805 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 16:40:12.429426 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329807 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 16:40:12.429426 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329809 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 16:40:12.429426 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329812 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 16:40:12.429426 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329814 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 16:40:12.429426 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329817 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 16:40:12.429426 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329819 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 16:40:12.429426 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329821 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 16:40:12.429426 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329824 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 16:40:12.429426 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329826 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 16:40:12.429426 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329829 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 16:40:12.430007 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329831 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 16:40:12.430007 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329833 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 16:40:12.430007 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329836 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 16:40:12.430007 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329838 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 16:40:12.430007 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329842 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 16:40:12.430007 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329845 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 16:40:12.430007 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329847 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 16:40:12.430007 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329850 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 16:40:12.430007 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329852 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 16:40:12.430007 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329854 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 16:40:12.430007 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329860 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 16:40:12.430007 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329864 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 16:40:12.430007 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329866 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 16:40:12.430007 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329870 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 16:40:12.430007 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329872 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 16:40:12.430007 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329874 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 16:40:12.430007 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329877 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 16:40:12.430007 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329880 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 16:40:12.430007 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329883 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 16:40:12.430521 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329885 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 16:40:12.430521 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329887 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 16:40:12.430521 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329890 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 16:40:12.430521 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329892 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 16:40:12.430521 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329896 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 16:40:12.430521 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329900 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 16:40:12.430521 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329902 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 16:40:12.430521 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329905 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 16:40:12.430521 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329908 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 16:40:12.430521 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329911 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 16:40:12.430521 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329914 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 16:40:12.430521 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329916 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 16:40:12.430521 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329918 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 16:40:12.430521 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.329921 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 16:40:12.430521 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.329987 2559 flags.go:64] FLAG: --address="0.0.0.0" Jul 15 16:40:12.430521 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.329994 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 15 16:40:12.430521 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330000 2559 flags.go:64] FLAG: --anonymous-auth="true" Jul 15 16:40:12.430521 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330005 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 15 16:40:12.430521 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330009 2559 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 15 16:40:12.430521 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330012 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 15 16:40:12.431068 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330016 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 15 16:40:12.431068 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330020 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 15 16:40:12.431068 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330023 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 15 16:40:12.431068 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330027 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 15 16:40:12.431068 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330031 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 15 16:40:12.431068 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330034 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 15 16:40:12.431068 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330037 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 15 16:40:12.431068 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330040 2559 flags.go:64] FLAG: --cgroup-root="" Jul 15 16:40:12.431068 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330042 2559 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 15 16:40:12.431068 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330045 2559 flags.go:64] FLAG: --client-ca-file="" Jul 15 16:40:12.431068 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330049 2559 flags.go:64] FLAG: --cloud-provider="external" Jul 15 16:40:12.431068 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330052 2559 flags.go:64] FLAG: --cluster-dns="[]" Jul 15 16:40:12.431068 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330056 2559 flags.go:64] FLAG: --cluster-domain="" Jul 15 16:40:12.431068 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330059 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 15 16:40:12.431068 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330062 2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 15 16:40:12.431068 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330065 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 15 16:40:12.431068 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330068 2559 flags.go:64] FLAG: --container-log-max-files="5" Jul 15 16:40:12.431068 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330072 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 15 16:40:12.431068 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330075 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 15 16:40:12.431068 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330077 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 15 16:40:12.431068 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330081 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 15 16:40:12.431068 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330084 2559 flags.go:64] FLAG: --contention-profiling="false" Jul 15 16:40:12.431068 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330086 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 15 16:40:12.431068 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330089 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 15 16:40:12.431709 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330092 2559 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 15 16:40:12.431709 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330095 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 15 16:40:12.431709 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330099 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 15 16:40:12.431709 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330102 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 15 16:40:12.431709 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330104 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 15 16:40:12.431709 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330108 2559 flags.go:64] FLAG: --enable-load-reader="false" Jul 15 16:40:12.431709 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330111 2559 flags.go:64] FLAG: --enable-server="true" Jul 15 16:40:12.431709 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330114 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 15 16:40:12.431709 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330118 2559 flags.go:64] FLAG: --event-burst="100" Jul 15 16:40:12.431709 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330121 2559 flags.go:64] FLAG: --event-qps="50" Jul 15 16:40:12.431709 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330123 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 15 16:40:12.431709 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330128 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 15 16:40:12.431709 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330131 2559 flags.go:64] FLAG: --eviction-hard="" Jul 15 16:40:12.431709 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330134 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 15 16:40:12.431709 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330137 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 15 16:40:12.431709 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330140 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 15 16:40:12.431709 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330143 2559 flags.go:64] FLAG: --eviction-soft="" Jul 15 16:40:12.431709 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330146 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 15 16:40:12.431709 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330148 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 15 16:40:12.431709 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330152 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 15 16:40:12.431709 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330155 2559 flags.go:64] FLAG: --experimental-mounter-path="" Jul 15 16:40:12.431709 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330157 2559 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 15 16:40:12.431709 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330160 2559 flags.go:64] FLAG: --fail-swap-on="true" Jul 15 16:40:12.431709 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330163 2559 flags.go:64] FLAG: --feature-gates="" Jul 15 16:40:12.431709 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330167 2559 flags.go:64] FLAG: --file-check-frequency="20s" Jul 15 16:40:12.432607 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330170 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 15 16:40:12.432607 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330172 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 15 16:40:12.432607 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330175 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 15 16:40:12.432607 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330178 2559 flags.go:64] FLAG: --healthz-port="10248" Jul 15 16:40:12.432607 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330181 2559 flags.go:64] FLAG: --help="false" Jul 15 16:40:12.432607 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330184 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-132-162.ec2.internal" Jul 15 16:40:12.432607 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330186 2559 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 15 16:40:12.432607 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330189 2559 flags.go:64] FLAG: --http-check-frequency="20s" Jul 15 16:40:12.432607 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330192 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 15 16:40:12.432607 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330195 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 15 16:40:12.432607 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330198 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 15 16:40:12.432607 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330201 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 15 16:40:12.432607 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330205 2559 flags.go:64] FLAG: --image-service-endpoint="" Jul 15 16:40:12.432607 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330208 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 15 16:40:12.432607 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330211 2559 flags.go:64] FLAG: --kube-api-burst="100" Jul 15 16:40:12.432607 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330214 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 15 16:40:12.432607 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330217 2559 flags.go:64] FLAG: --kube-api-qps="50" Jul 15 16:40:12.432607 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330219 2559 flags.go:64] FLAG: --kube-reserved="" Jul 15 16:40:12.432607 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330223 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 15 16:40:12.432607 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330226 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 15 16:40:12.432607 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330229 2559 flags.go:64] FLAG: --kubelet-cgroups="" Jul 15 16:40:12.432607 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330231 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 15 16:40:12.432607 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330234 2559 flags.go:64] FLAG: --lock-file="" Jul 15 16:40:12.432607 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330237 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 15 16:40:12.435649 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330240 2559 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 15 16:40:12.435649 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330243 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 15 16:40:12.435649 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330248 2559 flags.go:64] FLAG: --log-json-split-stream="false" Jul 15 16:40:12.435649 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330251 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 15 16:40:12.435649 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330254 2559 flags.go:64] FLAG: --log-text-split-stream="false" Jul 15 16:40:12.435649 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330257 2559 flags.go:64] FLAG: --logging-format="text" Jul 15 16:40:12.435649 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330260 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 15 16:40:12.435649 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330263 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 15 16:40:12.435649 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330266 2559 flags.go:64] FLAG: --manifest-url="" Jul 15 16:40:12.435649 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330268 2559 flags.go:64] FLAG: --manifest-url-header="" Jul 15 16:40:12.435649 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330272 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 15 16:40:12.435649 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330275 2559 flags.go:64] FLAG: --max-open-files="1000000" Jul 15 16:40:12.435649 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330279 2559 flags.go:64] FLAG: --max-pods="110" Jul 15 16:40:12.435649 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330282 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 15 16:40:12.435649 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330284 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 15 16:40:12.435649 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330287 2559 flags.go:64] FLAG: --memory-manager-policy="None" Jul 15 16:40:12.435649 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330290 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 15 16:40:12.435649 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330293 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 15 16:40:12.435649 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330295 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 15 16:40:12.435649 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330298 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 15 16:40:12.435649 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330326 2559 flags.go:64] FLAG: --node-status-max-images="50" Jul 15 16:40:12.435649 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330329 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 15 16:40:12.435649 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330333 2559 flags.go:64] FLAG: --oom-score-adj="-999" Jul 15 16:40:12.435649 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330336 2559 flags.go:64] FLAG: --pod-cidr="" Jul 15 16:40:12.437016 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330338 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 15 16:40:12.437016 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330344 2559 flags.go:64] FLAG: --pod-manifest-path="" Jul 15 16:40:12.437016 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330347 2559 flags.go:64] FLAG: --pod-max-pids="-1" Jul 15 16:40:12.437016 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330351 2559 flags.go:64] FLAG: --pods-per-core="0" Jul 15 16:40:12.437016 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330354 2559 flags.go:64] FLAG: --port="10250" Jul 15 16:40:12.437016 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330357 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 15 16:40:12.437016 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330377 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ada696097245c1ad" Jul 15 16:40:12.437016 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330382 2559 flags.go:64] FLAG: --qos-reserved="" Jul 15 16:40:12.437016 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330385 2559 flags.go:64] FLAG: --read-only-port="10255" Jul 15 16:40:12.437016 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330388 2559 flags.go:64] FLAG: --register-node="true" Jul 15 16:40:12.437016 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330390 2559 flags.go:64] FLAG: --register-with-taints="" Jul 15 16:40:12.437016 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330394 2559 flags.go:64] FLAG: --registry-burst="10" Jul 15 16:40:12.437016 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330398 2559 flags.go:64] FLAG: --registry-qps="5" Jul 15 16:40:12.437016 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330400 2559 flags.go:64] FLAG: --reserved-cpus="" Jul 15 16:40:12.437016 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330403 2559 flags.go:64] FLAG: --reserved-memory="" Jul 15 16:40:12.437016 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330407 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 15 16:40:12.437016 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330410 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 15 16:40:12.437016 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330413 2559 flags.go:64] FLAG: --rotate-certificates="false" Jul 15 16:40:12.437016 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330415 2559 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 15 16:40:12.437016 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330418 2559 flags.go:64] FLAG: --runonce="false" Jul 15 16:40:12.437016 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330421 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 15 16:40:12.437016 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330423 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 15 16:40:12.437016 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330426 2559 flags.go:64] FLAG: --seccomp-default="false" Jul 15 16:40:12.437016 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330429 2559 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 15 16:40:12.437016 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330431 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 15 16:40:14.212825 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330434 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 15 16:40:14.212825 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330437 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 15 16:40:14.212825 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330440 2559 flags.go:64] FLAG: --storage-driver-password="root" Jul 15 16:40:14.212825 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330445 2559 flags.go:64] FLAG: --storage-driver-secure="false" Jul 15 16:40:14.212825 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330447 2559 flags.go:64] FLAG: --storage-driver-table="stats" Jul 15 16:40:14.212825 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330450 2559 flags.go:64] FLAG: --storage-driver-user="root" Jul 15 16:40:14.212825 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330453 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 15 16:40:14.212825 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330456 2559 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 15 16:40:14.212825 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330459 2559 flags.go:64] FLAG: --system-cgroups="" Jul 15 16:40:14.212825 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330461 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 15 16:40:14.212825 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330468 2559 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 15 16:40:14.212825 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330471 2559 flags.go:64] FLAG: --tls-cert-file="" Jul 15 16:40:14.212825 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330473 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 15 16:40:14.212825 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330478 2559 flags.go:64] FLAG: --tls-min-version="" Jul 15 16:40:14.212825 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330480 2559 flags.go:64] FLAG: --tls-private-key-file="" Jul 15 16:40:14.212825 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330483 2559 flags.go:64] FLAG: --topology-manager-policy="none" Jul 15 16:40:14.212825 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330486 2559 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 15 16:40:14.212825 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330488 2559 flags.go:64] FLAG: --topology-manager-scope="container" Jul 15 16:40:14.212825 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330492 2559 flags.go:64] FLAG: --v="2" Jul 15 16:40:14.212825 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330495 2559 flags.go:64] FLAG: --version="false" Jul 15 16:40:14.212825 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330500 2559 flags.go:64] FLAG: --vmodule="" Jul 15 16:40:14.212825 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330504 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 15 16:40:14.212825 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.330507 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 15 16:40:14.212825 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330636 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 16:40:14.228160 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330642 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 16:40:14.228160 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330646 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 16:40:14.228160 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330649 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 16:40:14.228160 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330652 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 16:40:14.228160 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330654 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 16:40:14.228160 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330657 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 16:40:14.228160 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330660 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 16:40:14.228160 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330662 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 16:40:14.228160 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330664 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 16:40:14.228160 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330667 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 16:40:14.228160 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330670 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 16:40:14.228160 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330674 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 16:40:14.228160 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330676 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 16:40:14.228160 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330679 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 16:40:14.228160 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330681 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 16:40:14.228160 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330684 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 16:40:14.228160 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330686 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 16:40:14.228160 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330689 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 16:40:14.228160 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330692 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 16:40:14.228850 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330695 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 16:40:14.228850 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330697 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 16:40:14.228850 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330699 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 16:40:14.228850 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330702 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 16:40:14.228850 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330704 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 16:40:14.228850 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330707 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 16:40:14.228850 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330709 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 16:40:14.228850 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330712 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 15 16:40:14.228850 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330714 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 16:40:14.228850 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330716 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 16:40:14.228850 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330719 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 16:40:14.228850 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330722 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 16:40:14.228850 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330725 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 16:40:14.228850 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330727 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 16:40:14.228850 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330729 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 16:40:14.228850 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330732 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 16:40:14.228850 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330735 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 16:40:14.228850 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330737 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 16:40:14.228850 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330740 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 16:40:14.228850 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330742 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 16:40:14.229457 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330745 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 16:40:14.229457 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330747 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 16:40:14.229457 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330749 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 16:40:14.229457 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330752 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 16:40:14.229457 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330756 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 16:40:14.229457 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330758 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 16:40:14.229457 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330760 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 16:40:14.229457 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330763 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 16:40:14.229457 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330765 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 16:40:14.229457 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330768 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 16:40:14.229457 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330770 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 16:40:14.229457 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330774 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 16:40:14.229457 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330777 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 16:40:14.229457 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330779 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 16:40:14.229457 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330782 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 16:40:14.229457 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330784 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 16:40:14.229457 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330786 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 16:40:14.229457 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330789 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 16:40:14.229457 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330792 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 16:40:14.229457 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330794 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 16:40:14.229998 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330797 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 16:40:14.229998 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330799 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 16:40:14.229998 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330802 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 16:40:14.229998 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330810 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 16:40:14.229998 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330813 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 16:40:14.229998 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330816 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 16:40:14.229998 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330818 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 16:40:14.229998 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330820 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 16:40:14.229998 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330823 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 16:40:14.229998 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330825 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 16:40:14.229998 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330829 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 16:40:14.229998 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330833 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 16:40:14.229998 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330836 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 16:40:14.229998 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330838 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 16:40:14.229998 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330841 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 16:40:14.229998 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330843 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 16:40:14.229998 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330847 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 16:40:14.229998 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330850 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 16:40:14.229998 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330854 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 16:40:14.230535 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330857 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 16:40:14.230535 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330860 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 16:40:14.230535 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330862 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 16:40:14.230535 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330865 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 16:40:14.230535 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330869 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 16:40:14.230535 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330872 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 16:40:14.230535 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330875 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 16:40:14.230535 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330878 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 16:40:14.230535 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330881 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 16:40:14.230535 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330883 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 16:40:14.230535 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330886 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 16:40:14.230535 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330888 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 16:40:14.230535 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330891 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 16:40:14.230535 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330893 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 16:40:14.230535 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330896 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 16:40:14.230535 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330898 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 16:40:14.230535 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330901 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 16:40:14.230535 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330904 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 16:40:14.230535 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330907 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 16:40:14.230535 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.330910 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 16:40:14.231074 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.331685 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 16:40:14.231074 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.338544 2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 15 16:40:14.231074 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.338558 2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 15 16:40:14.231074 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.338574 2559 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 15 16:40:14.231074 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.338584 2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 15 16:40:14.231074 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338637 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 16:40:14.231074 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338642 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 16:40:14.231074 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338645 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 16:40:14.231074 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338648 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 16:40:14.231074 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338651 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 16:40:14.231074 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338653 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 16:40:14.231074 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338656 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 16:40:14.231074 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338659 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 16:40:14.231074 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338661 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 16:40:14.231495 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338664 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 16:40:14.231495 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338667 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 16:40:14.231495 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338669 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 16:40:14.231495 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338672 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 16:40:14.231495 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338675 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 16:40:14.231495 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338677 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 16:40:14.231495 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338680 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 16:40:14.231495 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338684 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 16:40:14.231495 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338687 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 16:40:14.231495 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338690 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 16:40:14.231495 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338693 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 16:40:14.231495 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338696 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 16:40:14.231495 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338699 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 16:40:14.231495 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338701 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 16:40:14.231495 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338704 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 16:40:14.231495 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338707 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 16:40:14.231495 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338710 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 16:40:14.231495 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338712 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 16:40:14.231495 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338715 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 16:40:14.231495 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338717 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 16:40:14.232040 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338721 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 16:40:14.232040 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338723 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 16:40:14.232040 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338726 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 16:40:14.232040 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338728 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 16:40:14.232040 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338730 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 16:40:14.232040 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338733 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 16:40:14.232040 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338735 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 16:40:14.232040 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338738 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 16:40:14.232040 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338740 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 16:40:14.232040 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338742 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 16:40:14.232040 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338746 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 16:40:14.232040 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338750 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 16:40:14.232040 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338753 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 16:40:14.232040 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338756 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 16:40:14.232040 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338759 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 16:40:14.232040 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338762 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 16:40:14.232040 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338765 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 16:40:14.232040 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338769 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 16:40:14.232040 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338772 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 16:40:14.232737 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338775 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 16:40:14.232737 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338777 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 16:40:14.232737 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338780 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 16:40:14.232737 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338782 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 16:40:14.232737 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338785 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 16:40:14.232737 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338787 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 16:40:14.232737 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338791 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 16:40:14.232737 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338793 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 16:40:14.232737 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338796 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 16:40:14.232737 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338799 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 16:40:14.232737 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338801 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 16:40:14.232737 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338804 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 16:40:14.232737 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338806 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 16:40:14.232737 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338808 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 16:40:14.232737 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338812 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 16:40:14.232737 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338815 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 16:40:14.232737 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338817 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 16:40:14.232737 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338821 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 16:40:14.232737 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338824 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 16:40:14.232737 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338827 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 16:40:14.233348 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338830 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 16:40:14.233348 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338832 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 16:40:14.233348 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338835 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 16:40:14.233348 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338837 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 16:40:14.233348 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338840 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 15 16:40:14.233348 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338843 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 16:40:14.233348 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338846 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 16:40:14.233348 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338849 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 16:40:14.233348 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338851 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 16:40:14.233348 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338853 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 16:40:14.233348 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338856 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 16:40:14.233348 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338859 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 16:40:14.233348 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338861 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 16:40:14.233348 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338864 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 16:40:14.233348 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338866 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 16:40:14.233348 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338868 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 16:40:14.233348 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338871 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 16:40:14.233348 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338873 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 16:40:14.233348 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338876 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 16:40:14.233348 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338878 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 16:40:14.233959 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338880 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 16:40:14.233959 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338883 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 16:40:14.233959 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338885 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 16:40:14.233959 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338888 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 16:40:14.233959 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338890 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 16:40:14.233959 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338893 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 16:40:14.233959 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338895 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 16:40:14.233959 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338903 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 16:40:14.233959 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338906 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 16:40:14.233959 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338910 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 16:40:14.233959 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.338913 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 16:40:14.233959 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.338918 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 16:40:14.233959 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339030 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 16:40:14.233959 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339035 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 16:40:14.233959 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339038 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 16:40:14.234364 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339041 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 16:40:14.234364 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339044 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 16:40:14.234364 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339048 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 16:40:14.234364 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339050 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 16:40:14.234364 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339053 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 16:40:14.234364 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339055 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 16:40:14.234364 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339058 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 16:40:14.234364 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339060 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 16:40:14.234364 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339063 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 16:40:14.234364 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339065 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 16:40:14.234364 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339068 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 16:40:14.234364 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339070 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 16:40:14.234364 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339073 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 16:40:14.234364 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339075 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 16:40:14.234364 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339078 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 16:40:14.234364 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339080 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 16:40:14.234364 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339083 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 16:40:14.234364 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339085 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 16:40:14.234364 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339088 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 16:40:14.234364 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339090 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 16:40:14.234967 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339093 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 16:40:14.234967 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339095 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 16:40:14.234967 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339097 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 16:40:14.234967 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339100 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 16:40:14.234967 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339102 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 16:40:14.234967 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339107 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 16:40:14.234967 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339112 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 16:40:14.234967 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339116 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 16:40:14.234967 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339119 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 16:40:14.234967 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339121 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 16:40:14.234967 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339124 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 16:40:14.234967 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339127 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 16:40:14.234967 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339130 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 16:40:14.234967 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339132 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 16:40:14.234967 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339136 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 16:40:14.234967 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339139 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 16:40:14.234967 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339141 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 16:40:14.234967 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339144 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 16:40:14.234967 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339146 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 16:40:14.235543 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339149 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 16:40:14.235543 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339151 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 16:40:14.235543 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339154 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 16:40:14.235543 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339156 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 16:40:14.235543 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339159 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 16:40:14.235543 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339163 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 16:40:14.235543 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339166 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 16:40:14.235543 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339169 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 16:40:14.235543 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339171 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 16:40:14.235543 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339174 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 16:40:14.235543 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339176 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 16:40:14.235543 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339179 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 16:40:14.235543 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339181 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 16:40:14.235543 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339184 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 16:40:14.235543 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339187 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 16:40:14.235543 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339190 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 16:40:14.235543 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339192 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 16:40:14.235543 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339195 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 16:40:14.235543 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339198 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 16:40:14.235543 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339202 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 16:40:14.236098 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339204 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 16:40:14.236098 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339207 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 16:40:14.236098 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339209 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 16:40:14.236098 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339211 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 16:40:14.236098 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339214 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 16:40:14.236098 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339216 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 16:40:14.236098 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339219 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 16:40:14.236098 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339223 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 16:40:14.236098 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339225 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 16:40:14.236098 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339228 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 16:40:14.236098 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339230 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 16:40:14.236098 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339233 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 16:40:14.236098 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339235 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 16:40:14.236098 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339238 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 16:40:14.236098 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339240 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 16:40:14.236098 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339243 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 16:40:14.236098 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339245 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 15 16:40:14.236098 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339248 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 16:40:14.236098 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339250 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 16:40:14.236098 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339253 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 16:40:14.236622 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339255 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 16:40:14.236622 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339257 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 16:40:14.236622 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339260 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 16:40:14.236622 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339262 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 16:40:14.236622 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339265 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 16:40:14.236622 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339267 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 16:40:14.236622 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339270 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 16:40:14.236622 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339272 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 16:40:14.236622 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339275 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 16:40:14.236622 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339277 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 16:40:14.236622 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339279 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 16:40:14.236622 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339283 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 16:40:14.236622 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339286 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 16:40:14.236622 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339288 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 16:40:14.236622 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339291 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 16:40:14.236622 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339293 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 16:40:14.236622 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:12.339296 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 16:40:14.237229 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.339300 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 16:40:14.237229 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.339412 2559 server.go:962] "Client rotation is on, will bootstrap in background" Jul 15 16:40:14.237229 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.341344 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 15 16:40:14.237229 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.342824 2559 server.go:1019] "Starting client certificate rotation" Jul 15 16:40:14.237229 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.342919 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 16:40:14.237229 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.342955 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 16:40:14.237229 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.345679 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 16:40:14.237229 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.349568 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 16:40:14.237229 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.360268 2559 log.go:25] "Validated CRI v1 runtime API" Jul 15 16:40:14.237229 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.363031 2559 log.go:25] "Validated CRI v1 image API" Jul 15 16:40:14.237229 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.363793 2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 15 16:40:14.237229 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.366199 2559 fs.go:135] Filesystem UUIDs: map[179b3a20-f1b6-4911-9bd4-b14672287be4:/dev/nvme0n1p3 397e3525-1f2b-4d50-ab86-4c7132ef9a17:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 15 16:40:14.237563 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.366212 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 15 16:40:14.237667 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.372275 2559 manager.go:216] Machine: {Timestamp:2026-07-15 16:40:12.370910835 +0000 UTC m=+0.378388372 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3201089 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b765dfa3791f090c82a0087136253 SystemUUID:ec2b765d-fa37-91f0-90c8-2a0087136253 BootID:ab1562a6-ea80-43dd-af09-acc6334359a9 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:9a:71:10:d3:4f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:9a:71:10:d3:4f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f2:06:e3:91:2b:35 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 15 16:40:14.237667 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.372383 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 15 16:40:14.237667 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.372452 2559 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 15 16:40:14.237667 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.374691 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 16:40:14.237667 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.375659 2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 15 16:40:14.237667 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.375681 2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-162.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 15 16:40:14.237667 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.376384 2559 topology_manager.go:138] "Creating topology manager with none policy" Jul 15 16:40:14.469280 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.376395 2559 container_manager_linux.go:309] "Creating device plugin manager" Jul 15 16:40:14.469280 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.376405 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 16:40:14.469280 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.376423 2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 16:40:14.469280 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.377801 2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 15 16:40:14.469280 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.380986 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 15 16:40:14.469280 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.381138 2559 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 15 16:40:14.469280 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.381167 2559 kubelet.go:486] "Attempting to sync node with API server" Jul 15 16:40:14.469280 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.381179 2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 15 16:40:14.469280 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.381193 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 15 16:40:14.469280 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.381203 2559 kubelet.go:398] "Adding apiserver pod source" Jul 15 16:40:14.469280 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.381218 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 15 16:40:14.469280 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.381530 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 16:40:14.469280 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.381544 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 16:40:14.469280 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.383949 2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 15 16:40:14.469280 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.385297 2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 15 16:40:14.469280 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.385323 2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 15 16:40:14.469280 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.385977 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 15 16:40:14.469280 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.385990 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 15 16:40:14.469280 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.385995 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 15 16:40:14.469280 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.386000 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 15 16:40:14.469280 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.386008 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 15 16:40:14.469280 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.386013 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 15 16:40:14.469280 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.386140 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 15 16:40:14.469280 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.386146 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 15 16:40:14.469280 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.386152 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 15 16:40:14.469280 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.386157 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 15 16:40:14.469280 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.386165 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 15 16:40:14.469280 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.386173 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 15 16:40:14.469280 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.387064 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 15 16:40:14.469280 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.387070 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 15 16:40:14.469280 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.389952 2559 server.go:1268] "Started kubelet" Jul 15 16:40:14.469280 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.390254 2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 15 16:40:14.469280 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.390314 2559 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 15 16:40:14.469280 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.396457 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 15 16:40:14.469280 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.396660 2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 15 16:40:14.469280 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.398704 2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-162.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 15 16:40:14.469280 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:12.398813 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-162.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 15 16:40:14.469280 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:12.398960 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 15 16:40:14.469280 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.399781 2559 server.go:310] "Adding debug handlers to kubelet server" Jul 15 16:40:14.470977 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:12.402754 2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 15 16:40:14.470977 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.406703 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fpw25" Jul 15 16:40:14.470977 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.408159 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 15 16:40:14.470977 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.408166 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 15 16:40:14.470977 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:12.408235 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-162.ec2.internal\" not found" Jul 15 16:40:14.470977 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.408861 2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 15 16:40:14.470977 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.408861 2559 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 15 16:40:14.470977 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.408886 2559 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 15 16:40:14.470977 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.408988 2559 reconstruct.go:97] "Volume reconstruction finished" Jul 15 16:40:14.470977 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.408996 2559 reconciler.go:29] "Reconciler: start to sync state" Jul 15 16:40:14.470977 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.409215 2559 factory.go:55] Registering systemd factory Jul 15 16:40:14.470977 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.409226 2559 factory.go:223] Registration of the systemd container factory successfully Jul 15 16:40:14.470977 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:12.407995 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-162.ec2.internal.18c284115656087c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-162.ec2.internal,UID:ip-10-0-132-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-162.ec2.internal,},FirstTimestamp:2026-07-15 16:40:12.389927036 +0000 UTC m=+0.397404569,LastTimestamp:2026-07-15 16:40:12.389927036 +0000 UTC m=+0.397404569,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-162.ec2.internal,}" Jul 15 16:40:14.470977 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.409445 2559 factory.go:153] Registering CRI-O factory Jul 15 16:40:14.470977 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.409454 2559 factory.go:223] Registration of the crio container factory successfully Jul 15 16:40:14.470977 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.409501 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 15 16:40:14.470977 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.409517 2559 factory.go:103] Registering Raw factory Jul 15 16:40:14.470977 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.409530 2559 manager.go:1196] Started watching for new ooms in manager Jul 15 16:40:14.470977 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.409864 2559 manager.go:349] Starting recovery of all containers Jul 15 16:40:14.470977 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.415799 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fpw25" Jul 15 16:40:14.470977 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.416467 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 15 16:40:14.470977 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.419176 2559 manager.go:354] Recovery completed Jul 15 16:40:14.470977 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:12.420237 2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-162.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 15 16:40:14.470977 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:12.420930 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 15 16:40:14.470977 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.424789 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 16:40:14.470977 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.426448 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-162.ec2.internal" event="NodeHasSufficientMemory" Jul 15 16:40:14.470977 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.426480 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-162.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 16:40:14.470977 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.426494 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-162.ec2.internal" event="NodeHasSufficientPID" Jul 15 16:40:14.470977 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.427097 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 15 16:40:14.470977 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.427109 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 15 16:40:14.470977 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.427127 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 15 16:40:14.470977 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.427110 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 16:40:14.472704 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.428151 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-162.ec2.internal" event="NodeHasSufficientMemory" Jul 15 16:40:14.472704 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.428178 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-162.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 16:40:14.472704 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.428192 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-162.ec2.internal" event="NodeHasSufficientPID" Jul 15 16:40:14.472704 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.428200 2559 policy_none.go:49] "None policy: Start" Jul 15 16:40:14.472704 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.428214 2559 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 15 16:40:14.472704 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.428225 2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 15 16:40:14.472704 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.429354 2559 policy_none.go:47] "Start" Jul 15 16:40:14.472704 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.469891 2559 manager.go:337] "Starting Device Plugin manager" Jul 15 16:40:14.472704 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:12.470054 2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 15 16:40:14.472704 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.470067 2559 server.go:87] "Starting device plugin registration server" Jul 15 16:40:14.472704 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.470464 2559 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 15 16:40:14.472704 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.470477 2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 15 16:40:14.472704 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.470586 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 15 16:40:14.472704 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.470675 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 15 16:40:14.472704 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:12.470689 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 15 16:40:14.472704 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:12.471068 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 15 16:40:14.472704 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:12.471113 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-162.ec2.internal\" not found" Jul 15 16:40:14.472704 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.151180 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 16:40:14.472704 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.152176 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-162.ec2.internal" event="NodeHasSufficientMemory" Jul 15 16:40:14.472704 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.152201 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-162.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 16:40:14.472704 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.152213 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-162.ec2.internal" event="NodeHasSufficientPID" Jul 15 16:40:14.472704 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.152236 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-162.ec2.internal" Jul 15 16:40:14.472704 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.160585 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-162.ec2.internal" Jul 15 16:40:14.472704 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:14.160606 2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-162.ec2.internal\": node \"ip-10-0-132-162.ec2.internal\" not found" Jul 15 16:40:14.472704 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.166099 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 15 16:40:14.472704 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.166131 2559 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 15 16:40:14.472704 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.166148 2559 kubelet.go:2448] "Starting kubelet main sync loop" Jul 15 16:40:14.472704 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:14.166174 2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 15 16:40:14.472704 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.168369 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 16:40:14.472704 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:14.174645 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-162.ec2.internal\" not found" Jul 15 16:40:14.472704 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.266890 2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-162.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-162.ec2.internal"] Jul 15 16:40:14.472704 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.266952 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 16:40:14.472704 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.268376 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-162.ec2.internal" event="NodeHasSufficientMemory" Jul 15 16:40:14.472704 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.268402 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-162.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 16:40:14.472704 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.268412 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-162.ec2.internal" event="NodeHasSufficientPID" Jul 15 16:40:14.472704 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.269555 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 16:40:14.472704 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.269695 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-162.ec2.internal" Jul 15 16:40:14.472704 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.269719 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 16:40:14.473744 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.270214 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-162.ec2.internal" event="NodeHasSufficientMemory" Jul 15 16:40:14.473744 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.270239 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-162.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 16:40:14.473744 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.270253 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-162.ec2.internal" event="NodeHasSufficientPID" Jul 15 16:40:14.473744 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.270218 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-162.ec2.internal" event="NodeHasSufficientMemory" Jul 15 16:40:14.473744 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.270299 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-162.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 16:40:14.473744 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.270308 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-162.ec2.internal" event="NodeHasSufficientPID" Jul 15 16:40:14.473744 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.271426 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-162.ec2.internal" Jul 15 16:40:14.473744 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.271451 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 16:40:14.473744 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.272072 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-162.ec2.internal" event="NodeHasSufficientMemory" Jul 15 16:40:14.473744 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.272093 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-162.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 16:40:14.473744 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.272107 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-162.ec2.internal" event="NodeHasSufficientPID" Jul 15 16:40:14.473744 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:14.274689 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-162.ec2.internal\" not found" Jul 15 16:40:14.473744 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.293209 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9a6c4718c4d2bba356c5dbe44fb455e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-162.ec2.internal\" (UID: \"9a6c4718c4d2bba356c5dbe44fb455e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-162.ec2.internal" Jul 15 16:40:14.473744 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.293230 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a6c4718c4d2bba356c5dbe44fb455e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-162.ec2.internal\" (UID: \"9a6c4718c4d2bba356c5dbe44fb455e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-162.ec2.internal" Jul 15 16:40:14.473744 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.293247 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0819db2e07dd6ab94870584aab4ec920-config\") pod \"kube-apiserver-proxy-ip-10-0-132-162.ec2.internal\" (UID: \"0819db2e07dd6ab94870584aab4ec920\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-162.ec2.internal" Jul 15 16:40:14.473744 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:14.297367 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-162.ec2.internal\" not found" node="ip-10-0-132-162.ec2.internal" Jul 15 16:40:14.473744 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:14.301707 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-162.ec2.internal\" not found" node="ip-10-0-132-162.ec2.internal" Jul 15 16:40:14.473744 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:14.374964 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-162.ec2.internal\" not found" Jul 15 16:40:14.473744 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.394222 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9a6c4718c4d2bba356c5dbe44fb455e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-162.ec2.internal\" (UID: \"9a6c4718c4d2bba356c5dbe44fb455e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-162.ec2.internal" Jul 15 16:40:14.473744 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.394245 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a6c4718c4d2bba356c5dbe44fb455e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-162.ec2.internal\" (UID: \"9a6c4718c4d2bba356c5dbe44fb455e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-162.ec2.internal" Jul 15 16:40:14.473744 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.394264 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0819db2e07dd6ab94870584aab4ec920-config\") pod \"kube-apiserver-proxy-ip-10-0-132-162.ec2.internal\" (UID: \"0819db2e07dd6ab94870584aab4ec920\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-162.ec2.internal" Jul 15 16:40:14.474318 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.394300 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0819db2e07dd6ab94870584aab4ec920-config\") pod \"kube-apiserver-proxy-ip-10-0-132-162.ec2.internal\" (UID: \"0819db2e07dd6ab94870584aab4ec920\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-162.ec2.internal" Jul 15 16:40:14.474318 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.394329 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a6c4718c4d2bba356c5dbe44fb455e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-162.ec2.internal\" (UID: \"9a6c4718c4d2bba356c5dbe44fb455e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-162.ec2.internal" Jul 15 16:40:14.474318 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.394329 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9a6c4718c4d2bba356c5dbe44fb455e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-162.ec2.internal\" (UID: \"9a6c4718c4d2bba356c5dbe44fb455e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-162.ec2.internal" Jul 15 16:40:14.648006 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:14.475483 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-162.ec2.internal\" not found" Jul 15 16:40:14.648006 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:14.575950 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-162.ec2.internal\" not found" Jul 15 16:40:14.648006 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.599464 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-162.ec2.internal" Jul 15 16:40:14.648006 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.604467 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-162.ec2.internal" Jul 15 16:40:14.855994 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:14.676366 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-162.ec2.internal\" not found" Jul 15 16:40:14.855994 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:14.776820 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-162.ec2.internal\" not found" Jul 15 16:40:15.085189 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:14.877354 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-162.ec2.internal\" not found" Jul 15 16:40:15.085189 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.922796 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 15 16:40:15.085189 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.922929 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 15 16:40:15.085189 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:14.977783 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-162.ec2.internal\" not found" Jul 15 16:40:15.085189 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.987474 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 16:40:15.085189 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.989298 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 15 16:40:15.085189 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:14.989298 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-162.ec2.internal" Jul 15 16:40:15.085189 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.001291 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 16:35:13 +0000 UTC" deadline="2028-04-11 05:45:22.916997842 +0000 UTC" Jul 15 16:40:15.085189 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.001313 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15253h5m7.915687574s" Jul 15 16:40:15.085189 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.003494 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 16:40:15.085189 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.005608 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 16:40:15.085189 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.005889 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-162.ec2.internal" Jul 15 16:40:15.085189 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.013983 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 16:40:15.085189 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.023920 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7p6sv" Jul 15 16:40:15.085189 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.031663 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7p6sv" Jul 15 16:40:15.215824 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:15.210204 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0819db2e07dd6ab94870584aab4ec920.slice/crio-e16dc9d137ff0174436be000a16b82d97362b244731b1cd907e487200a171b10 WatchSource:0}: Error finding container e16dc9d137ff0174436be000a16b82d97362b244731b1cd907e487200a171b10: Status 404 returned error can't find the container with id e16dc9d137ff0174436be000a16b82d97362b244731b1cd907e487200a171b10 Jul 15 16:40:15.218244 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.218165 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 16:40:15.435017 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:15.246019 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a6c4718c4d2bba356c5dbe44fb455e4.slice/crio-3bf620527e07d9245f393358001fc8b45e77801fb5d1f80aaa010f16802c3e22 WatchSource:0}: Error finding container 3bf620527e07d9245f393358001fc8b45e77801fb5d1f80aaa010f16802c3e22: Status 404 returned error can't find the container with id 3bf620527e07d9245f393358001fc8b45e77801fb5d1f80aaa010f16802c3e22 Jul 15 16:40:15.681572 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.455623 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 16:40:15.681572 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.589968 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 16:40:16.094670 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.962891 2559 apiserver.go:52] "Watching apiserver" Jul 15 16:40:16.094670 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.969407 2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 15 16:40:16.094670 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.971491 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkbqd","openshift-dns/node-resolver-54dr5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-162.ec2.internal","openshift-multus/multus-additional-cni-plugins-cjrnr","openshift-multus/multus-f4xlb","openshift-multus/network-metrics-daemon-cp4kd","openshift-network-diagnostics/network-check-target-wqnw5","openshift-network-operator/iptables-alerter-fm4kh","kube-system/global-pull-secret-syncer-8kzck","kube-system/konnectivity-agent-bwv27","kube-system/kube-apiserver-proxy-ip-10-0-132-162.ec2.internal","openshift-cluster-node-tuning-operator/tuned-pr9jm","openshift-image-registry/node-ca-zrwsm","openshift-ovn-kubernetes/ovnkube-node-cxsr7"] Jul 15 16:40:16.094670 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.974428 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqnw5" Jul 15 16:40:16.094670 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:15.974509 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqnw5" podUID="f0c2df6c-3310-45cb-bc73-ae2693ee0761" Jul 15 16:40:16.094670 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.975497 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zrwsm" Jul 15 16:40:16.094670 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.976776 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cjrnr" Jul 15 16:40:16.094670 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.977469 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 15 16:40:16.094670 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.977674 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 15 16:40:16.094670 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.977736 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gqtq7\"" Jul 15 16:40:16.094670 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.977915 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.094670 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.977964 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 15 16:40:16.094670 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.978802 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 15 16:40:16.094670 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.978990 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 15 16:40:16.094670 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.979196 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cp4kd" Jul 15 16:40:16.094670 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:15.979244 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cp4kd" podUID="07a4919e-5119-4287-8068-6fbcea6161de" Jul 15 16:40:16.094670 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.979348 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 15 16:40:16.094670 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.979357 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 15 16:40:16.094670 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.979545 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 15 16:40:16.094670 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.979977 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-m9722\"" Jul 15 16:40:16.094670 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.979977 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 15 16:40:16.094670 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.980192 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7hswm\"" Jul 15 16:40:16.094670 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.980516 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8kzck" Jul 15 16:40:16.094670 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:15.980566 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8kzck" podUID="0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e" Jul 15 16:40:16.096285 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.981760 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkbqd" Jul 15 16:40:16.096285 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.982807 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-54dr5" Jul 15 16:40:16.096285 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.984071 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bwv27" Jul 15 16:40:16.096285 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.985541 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 15 16:40:16.096285 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.985651 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 15 16:40:16.096285 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.985669 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tvjfp\"" Jul 15 16:40:16.096285 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.985703 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 15 16:40:16.096285 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.985781 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.096285 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.985843 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9mstl\"" Jul 15 16:40:16.096285 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.985786 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 15 16:40:16.096285 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.986239 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 15 16:40:16.096285 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.986271 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 15 16:40:16.096285 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.986354 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-k7478\"" Jul 15 16:40:16.096285 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.986384 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 15 16:40:16.096285 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.987468 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.096285 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.988209 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 15 16:40:16.096285 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.988401 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 15 16:40:16.096285 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.988435 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 15 16:40:16.096285 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.988438 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-m6pvw\"" Jul 15 16:40:16.096285 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.988507 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 15 16:40:16.096285 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.988548 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 15 16:40:16.096285 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.988557 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 15 16:40:16.096285 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.988710 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fm4kh" Jul 15 16:40:16.096285 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.989735 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 15 16:40:16.096285 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.989766 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9xlmj\"" Jul 15 16:40:16.096285 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.989929 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 15 16:40:16.096285 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.991791 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 15 16:40:16.096285 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.992126 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cb2js\"" Jul 15 16:40:16.096285 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.992224 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 15 16:40:16.096285 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.992406 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 15 16:40:16.096285 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:15.992471 2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 15 16:40:16.097313 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.003657 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stszm\" (UniqueName: \"kubernetes.io/projected/3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace-kube-api-access-stszm\") pod \"aws-ebs-csi-driver-node-zkbqd\" (UID: \"3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkbqd" Jul 15 16:40:16.097313 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.003684 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8b3d30ed-a165-4ada-b6f0-9678f6846518-run\") pod \"tuned-pr9jm\" (UID: \"8b3d30ed-a165-4ada-b6f0-9678f6846518\") " pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.097313 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.003701 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-run-systemd\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.097313 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.003716 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-env-overrides\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.097313 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.003764 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctmlk\" (UniqueName: \"kubernetes.io/projected/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-kube-api-access-ctmlk\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.097313 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.003787 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e7f78480-9e9a-488a-9cfa-ba14ad74e3e8-cnibin\") pod \"multus-additional-cni-plugins-cjrnr\" (UID: \"e7f78480-9e9a-488a-9cfa-ba14ad74e3e8\") " pod="openshift-multus/multus-additional-cni-plugins-cjrnr" Jul 15 16:40:16.097313 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.003809 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace-socket-dir\") pod \"aws-ebs-csi-driver-node-zkbqd\" (UID: \"3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkbqd" Jul 15 16:40:16.097313 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.003841 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e471bdf5-0615-42d5-821a-21fb696e6412-multus-daemon-config\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.097313 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.003862 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-ovn-node-metrics-cert\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.097313 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.003878 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8b3d30ed-a165-4ada-b6f0-9678f6846518-etc-systemd\") pod \"tuned-pr9jm\" (UID: \"8b3d30ed-a165-4ada-b6f0-9678f6846518\") " pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.097313 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.003914 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xd7p\" (UniqueName: \"kubernetes.io/projected/303815d9-d13a-40d0-a668-cbb2a070be2b-kube-api-access-7xd7p\") pod \"iptables-alerter-fm4kh\" (UID: \"303815d9-d13a-40d0-a668-cbb2a070be2b\") " pod="openshift-network-operator/iptables-alerter-fm4kh" Jul 15 16:40:16.097313 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.003968 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgn2z\" (UniqueName: \"kubernetes.io/projected/07a4919e-5119-4287-8068-6fbcea6161de-kube-api-access-fgn2z\") pod \"network-metrics-daemon-cp4kd\" (UID: \"07a4919e-5119-4287-8068-6fbcea6161de\") " pod="openshift-multus/network-metrics-daemon-cp4kd" Jul 15 16:40:16.097313 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004003 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-host-run-netns\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.097794 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004031 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-ovnkube-script-lib\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.097794 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004057 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e7f78480-9e9a-488a-9cfa-ba14ad74e3e8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cjrnr\" (UID: \"e7f78480-9e9a-488a-9cfa-ba14ad74e3e8\") " pod="openshift-multus/multus-additional-cni-plugins-cjrnr" Jul 15 16:40:16.097794 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004084 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5695f6d9-f75a-4b9c-9417-babb852ef469-host\") pod \"node-ca-zrwsm\" (UID: \"5695f6d9-f75a-4b9c-9417-babb852ef469\") " pod="openshift-image-registry/node-ca-zrwsm" Jul 15 16:40:16.097794 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004108 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e7f78480-9e9a-488a-9cfa-ba14ad74e3e8-os-release\") pod \"multus-additional-cni-plugins-cjrnr\" (UID: \"e7f78480-9e9a-488a-9cfa-ba14ad74e3e8\") " pod="openshift-multus/multus-additional-cni-plugins-cjrnr" Jul 15 16:40:16.097794 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004132 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/303815d9-d13a-40d0-a668-cbb2a070be2b-iptables-alerter-script\") pod \"iptables-alerter-fm4kh\" (UID: \"303815d9-d13a-40d0-a668-cbb2a070be2b\") " pod="openshift-network-operator/iptables-alerter-fm4kh" Jul 15 16:40:16.097794 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004154 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e471bdf5-0615-42d5-821a-21fb696e6412-host-var-lib-cni-bin\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.097794 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004187 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-run-openvswitch\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.097794 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004208 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8qsd\" (UniqueName: \"kubernetes.io/projected/e471bdf5-0615-42d5-821a-21fb696e6412-kube-api-access-q8qsd\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.097794 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004224 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7f78480-9e9a-488a-9cfa-ba14ad74e3e8-system-cni-dir\") pod \"multus-additional-cni-plugins-cjrnr\" (UID: \"e7f78480-9e9a-488a-9cfa-ba14ad74e3e8\") " pod="openshift-multus/multus-additional-cni-plugins-cjrnr" Jul 15 16:40:16.097794 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004243 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mlsd\" (UniqueName: \"kubernetes.io/projected/e7f78480-9e9a-488a-9cfa-ba14ad74e3e8-kube-api-access-4mlsd\") pod \"multus-additional-cni-plugins-cjrnr\" (UID: \"e7f78480-9e9a-488a-9cfa-ba14ad74e3e8\") " pod="openshift-multus/multus-additional-cni-plugins-cjrnr" Jul 15 16:40:16.097794 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004262 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace-etc-selinux\") pod \"aws-ebs-csi-driver-node-zkbqd\" (UID: \"3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkbqd" Jul 15 16:40:16.097794 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004276 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace-sys-fs\") pod \"aws-ebs-csi-driver-node-zkbqd\" (UID: \"3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkbqd" Jul 15 16:40:16.097794 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004291 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-host-cni-netd\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.098271 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004308 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zkbqd\" (UID: \"3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkbqd" Jul 15 16:40:16.098271 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004336 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8b3d30ed-a165-4ada-b6f0-9678f6846518-etc-tuned\") pod \"tuned-pr9jm\" (UID: \"8b3d30ed-a165-4ada-b6f0-9678f6846518\") " pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.098271 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004361 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/303815d9-d13a-40d0-a668-cbb2a070be2b-host-slash\") pod \"iptables-alerter-fm4kh\" (UID: \"303815d9-d13a-40d0-a668-cbb2a070be2b\") " pod="openshift-network-operator/iptables-alerter-fm4kh" Jul 15 16:40:16.098271 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004394 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e471bdf5-0615-42d5-821a-21fb696e6412-cnibin\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.098271 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004412 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e-kubelet-config\") pod \"global-pull-secret-syncer-8kzck\" (UID: \"0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e\") " pod="kube-system/global-pull-secret-syncer-8kzck" Jul 15 16:40:16.098271 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004427 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6ebc4f77-e864-4fb8-b9d6-5e5b6c91fd9a-konnectivity-ca\") pod \"konnectivity-agent-bwv27\" (UID: \"6ebc4f77-e864-4fb8-b9d6-5e5b6c91fd9a\") " pod="kube-system/konnectivity-agent-bwv27" Jul 15 16:40:16.098271 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004443 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-host-cni-bin\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.098271 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004459 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e7f78480-9e9a-488a-9cfa-ba14ad74e3e8-cni-binary-copy\") pod \"multus-additional-cni-plugins-cjrnr\" (UID: \"e7f78480-9e9a-488a-9cfa-ba14ad74e3e8\") " pod="openshift-multus/multus-additional-cni-plugins-cjrnr" Jul 15 16:40:16.098271 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004474 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace-device-dir\") pod \"aws-ebs-csi-driver-node-zkbqd\" (UID: \"3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkbqd" Jul 15 16:40:16.098271 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004520 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8b3d30ed-a165-4ada-b6f0-9678f6846518-etc-sysconfig\") pod \"tuned-pr9jm\" (UID: \"8b3d30ed-a165-4ada-b6f0-9678f6846518\") " pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.098271 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004548 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e471bdf5-0615-42d5-821a-21fb696e6412-host-var-lib-kubelet\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.098271 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004567 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e471bdf5-0615-42d5-821a-21fb696e6412-hostroot\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.098271 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004589 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e471bdf5-0615-42d5-821a-21fb696e6412-multus-conf-dir\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.098271 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004611 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-node-log\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.098836 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004631 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-log-socket\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.098836 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004648 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e7f78480-9e9a-488a-9cfa-ba14ad74e3e8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cjrnr\" (UID: \"e7f78480-9e9a-488a-9cfa-ba14ad74e3e8\") " pod="openshift-multus/multus-additional-cni-plugins-cjrnr" Jul 15 16:40:16.098836 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004671 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5695f6d9-f75a-4b9c-9417-babb852ef469-serviceca\") pod \"node-ca-zrwsm\" (UID: \"5695f6d9-f75a-4b9c-9417-babb852ef469\") " pod="openshift-image-registry/node-ca-zrwsm" Jul 15 16:40:16.098836 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004689 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9d77\" (UniqueName: \"kubernetes.io/projected/5695f6d9-f75a-4b9c-9417-babb852ef469-kube-api-access-p9d77\") pod \"node-ca-zrwsm\" (UID: \"5695f6d9-f75a-4b9c-9417-babb852ef469\") " pod="openshift-image-registry/node-ca-zrwsm" Jul 15 16:40:16.098836 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004702 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b3d30ed-a165-4ada-b6f0-9678f6846518-sys\") pod \"tuned-pr9jm\" (UID: \"8b3d30ed-a165-4ada-b6f0-9678f6846518\") " pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.098836 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004716 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b3d30ed-a165-4ada-b6f0-9678f6846518-var-lib-kubelet\") pod \"tuned-pr9jm\" (UID: \"8b3d30ed-a165-4ada-b6f0-9678f6846518\") " pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.098836 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004731 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07a4919e-5119-4287-8068-6fbcea6161de-metrics-certs\") pod \"network-metrics-daemon-cp4kd\" (UID: \"07a4919e-5119-4287-8068-6fbcea6161de\") " pod="openshift-multus/network-metrics-daemon-cp4kd" Jul 15 16:40:16.098836 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004797 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-run-ovn\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.098836 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004811 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e471bdf5-0615-42d5-821a-21fb696e6412-host-run-netns\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.098836 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004826 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e7f78480-9e9a-488a-9cfa-ba14ad74e3e8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cjrnr\" (UID: \"e7f78480-9e9a-488a-9cfa-ba14ad74e3e8\") " pod="openshift-multus/multus-additional-cni-plugins-cjrnr" Jul 15 16:40:16.098836 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004858 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b3d30ed-a165-4ada-b6f0-9678f6846518-host\") pod \"tuned-pr9jm\" (UID: \"8b3d30ed-a165-4ada-b6f0-9678f6846518\") " pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.098836 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004898 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b3d30ed-a165-4ada-b6f0-9678f6846518-tmp\") pod \"tuned-pr9jm\" (UID: \"8b3d30ed-a165-4ada-b6f0-9678f6846518\") " pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.098836 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004923 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d782k\" (UniqueName: \"kubernetes.io/projected/4de0f0e6-c52c-439f-b547-d7449edde627-kube-api-access-d782k\") pod \"node-resolver-54dr5\" (UID: \"4de0f0e6-c52c-439f-b547-d7449edde627\") " pod="openshift-dns/node-resolver-54dr5" Jul 15 16:40:16.098836 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004946 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-host-slash\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.099484 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004969 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-host-run-ovn-kubernetes\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.099484 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.004996 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace-registration-dir\") pod \"aws-ebs-csi-driver-node-zkbqd\" (UID: \"3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkbqd" Jul 15 16:40:16.099484 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.005017 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8b3d30ed-a165-4ada-b6f0-9678f6846518-lib-modules\") pod \"tuned-pr9jm\" (UID: \"8b3d30ed-a165-4ada-b6f0-9678f6846518\") " pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.099484 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.005038 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmgf8\" (UniqueName: \"kubernetes.io/projected/8b3d30ed-a165-4ada-b6f0-9678f6846518-kube-api-access-cmgf8\") pod \"tuned-pr9jm\" (UID: \"8b3d30ed-a165-4ada-b6f0-9678f6846518\") " pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.099484 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.005060 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e471bdf5-0615-42d5-821a-21fb696e6412-system-cni-dir\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.099484 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.005080 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e471bdf5-0615-42d5-821a-21fb696e6412-multus-cni-dir\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.099484 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.005102 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e471bdf5-0615-42d5-821a-21fb696e6412-os-release\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.099484 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.005127 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e471bdf5-0615-42d5-821a-21fb696e6412-multus-socket-dir-parent\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.099484 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.005149 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4de0f0e6-c52c-439f-b547-d7449edde627-tmp-dir\") pod \"node-resolver-54dr5\" (UID: \"4de0f0e6-c52c-439f-b547-d7449edde627\") " pod="openshift-dns/node-resolver-54dr5" Jul 15 16:40:16.099484 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.005172 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e471bdf5-0615-42d5-821a-21fb696e6412-host-var-lib-cni-multus\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.099484 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.005195 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8b3d30ed-a165-4ada-b6f0-9678f6846518-etc-sysctl-d\") pod \"tuned-pr9jm\" (UID: \"8b3d30ed-a165-4ada-b6f0-9678f6846518\") " pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.099484 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.005219 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8b3d30ed-a165-4ada-b6f0-9678f6846518-etc-sysctl-conf\") pod \"tuned-pr9jm\" (UID: \"8b3d30ed-a165-4ada-b6f0-9678f6846518\") " pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.099484 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.005239 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e471bdf5-0615-42d5-821a-21fb696e6412-host-run-k8s-cni-cncf-io\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.099484 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.005261 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e-dbus\") pod \"global-pull-secret-syncer-8kzck\" (UID: \"0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e\") " pod="kube-system/global-pull-secret-syncer-8kzck" Jul 15 16:40:16.100048 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.005282 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4de0f0e6-c52c-439f-b547-d7449edde627-hosts-file\") pod \"node-resolver-54dr5\" (UID: \"4de0f0e6-c52c-439f-b547-d7449edde627\") " pod="openshift-dns/node-resolver-54dr5" Jul 15 16:40:16.100048 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.005304 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6ebc4f77-e864-4fb8-b9d6-5e5b6c91fd9a-agent-certs\") pod \"konnectivity-agent-bwv27\" (UID: \"6ebc4f77-e864-4fb8-b9d6-5e5b6c91fd9a\") " pod="kube-system/konnectivity-agent-bwv27" Jul 15 16:40:16.100048 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.005327 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e471bdf5-0615-42d5-821a-21fb696e6412-cni-binary-copy\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.100048 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.005355 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-host-kubelet\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.100048 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.005384 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-ovnkube-config\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.100048 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.005401 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e471bdf5-0615-42d5-821a-21fb696e6412-etc-kubernetes\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.100048 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.005417 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn7nq\" (UniqueName: \"kubernetes.io/projected/f0c2df6c-3310-45cb-bc73-ae2693ee0761-kube-api-access-sn7nq\") pod \"network-check-target-wqnw5\" (UID: \"f0c2df6c-3310-45cb-bc73-ae2693ee0761\") " pod="openshift-network-diagnostics/network-check-target-wqnw5" Jul 15 16:40:16.100048 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.005432 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8b3d30ed-a165-4ada-b6f0-9678f6846518-etc-modprobe-d\") pod \"tuned-pr9jm\" (UID: \"8b3d30ed-a165-4ada-b6f0-9678f6846518\") " pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.100048 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.005457 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e471bdf5-0615-42d5-821a-21fb696e6412-host-run-multus-certs\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.100048 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.005481 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e-original-pull-secret\") pod \"global-pull-secret-syncer-8kzck\" (UID: \"0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e\") " pod="kube-system/global-pull-secret-syncer-8kzck" Jul 15 16:40:16.100048 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.005500 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-systemd-units\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.100048 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.005522 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-etc-openvswitch\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.100048 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.005539 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b3d30ed-a165-4ada-b6f0-9678f6846518-etc-kubernetes\") pod \"tuned-pr9jm\" (UID: \"8b3d30ed-a165-4ada-b6f0-9678f6846518\") " pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.100048 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.005554 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-var-lib-openvswitch\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.100572 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.005576 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.100572 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.033436 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 16:35:15 +0000 UTC" deadline="2028-03-25 06:51:01.613576332 +0000 UTC" Jul 15 16:40:16.100572 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.033466 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14846h10m45.580112731s" Jul 15 16:40:16.259274 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106304 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e7f78480-9e9a-488a-9cfa-ba14ad74e3e8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cjrnr\" (UID: \"e7f78480-9e9a-488a-9cfa-ba14ad74e3e8\") " pod="openshift-multus/multus-additional-cni-plugins-cjrnr" Jul 15 16:40:16.259274 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106326 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b3d30ed-a165-4ada-b6f0-9678f6846518-host\") pod \"tuned-pr9jm\" (UID: \"8b3d30ed-a165-4ada-b6f0-9678f6846518\") " pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.259274 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106339 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b3d30ed-a165-4ada-b6f0-9678f6846518-tmp\") pod \"tuned-pr9jm\" (UID: \"8b3d30ed-a165-4ada-b6f0-9678f6846518\") " pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.259274 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106352 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d782k\" (UniqueName: \"kubernetes.io/projected/4de0f0e6-c52c-439f-b547-d7449edde627-kube-api-access-d782k\") pod \"node-resolver-54dr5\" (UID: \"4de0f0e6-c52c-439f-b547-d7449edde627\") " pod="openshift-dns/node-resolver-54dr5" Jul 15 16:40:16.259274 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106366 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-host-slash\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.259274 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106380 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-host-run-ovn-kubernetes\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.259274 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106399 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace-registration-dir\") pod \"aws-ebs-csi-driver-node-zkbqd\" (UID: \"3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkbqd" Jul 15 16:40:16.259274 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106409 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b3d30ed-a165-4ada-b6f0-9678f6846518-host\") pod \"tuned-pr9jm\" (UID: \"8b3d30ed-a165-4ada-b6f0-9678f6846518\") " pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.259274 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106450 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace-registration-dir\") pod \"aws-ebs-csi-driver-node-zkbqd\" (UID: \"3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkbqd" Jul 15 16:40:16.259274 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106448 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-host-slash\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.259274 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106473 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8b3d30ed-a165-4ada-b6f0-9678f6846518-lib-modules\") pod \"tuned-pr9jm\" (UID: \"8b3d30ed-a165-4ada-b6f0-9678f6846518\") " pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.259274 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106513 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmgf8\" (UniqueName: \"kubernetes.io/projected/8b3d30ed-a165-4ada-b6f0-9678f6846518-kube-api-access-cmgf8\") pod \"tuned-pr9jm\" (UID: \"8b3d30ed-a165-4ada-b6f0-9678f6846518\") " pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.259274 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106536 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e471bdf5-0615-42d5-821a-21fb696e6412-system-cni-dir\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.259274 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106477 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-host-run-ovn-kubernetes\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.260133 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106541 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e7f78480-9e9a-488a-9cfa-ba14ad74e3e8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cjrnr\" (UID: \"e7f78480-9e9a-488a-9cfa-ba14ad74e3e8\") " pod="openshift-multus/multus-additional-cni-plugins-cjrnr" Jul 15 16:40:16.260133 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106567 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e471bdf5-0615-42d5-821a-21fb696e6412-multus-cni-dir\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.260133 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106592 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e471bdf5-0615-42d5-821a-21fb696e6412-os-release\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.260133 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106609 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e471bdf5-0615-42d5-821a-21fb696e6412-system-cni-dir\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.260133 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106616 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e471bdf5-0615-42d5-821a-21fb696e6412-multus-socket-dir-parent\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.260133 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106653 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8b3d30ed-a165-4ada-b6f0-9678f6846518-lib-modules\") pod \"tuned-pr9jm\" (UID: \"8b3d30ed-a165-4ada-b6f0-9678f6846518\") " pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.260133 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106667 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e471bdf5-0615-42d5-821a-21fb696e6412-multus-socket-dir-parent\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.260133 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106663 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e471bdf5-0615-42d5-821a-21fb696e6412-os-release\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.260133 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106683 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4de0f0e6-c52c-439f-b547-d7449edde627-tmp-dir\") pod \"node-resolver-54dr5\" (UID: \"4de0f0e6-c52c-439f-b547-d7449edde627\") " pod="openshift-dns/node-resolver-54dr5" Jul 15 16:40:16.260133 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106693 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e471bdf5-0615-42d5-821a-21fb696e6412-multus-cni-dir\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.260133 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106682 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 15 16:40:16.260133 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106715 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e471bdf5-0615-42d5-821a-21fb696e6412-host-var-lib-cni-multus\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.260133 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106740 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8b3d30ed-a165-4ada-b6f0-9678f6846518-etc-sysctl-d\") pod \"tuned-pr9jm\" (UID: \"8b3d30ed-a165-4ada-b6f0-9678f6846518\") " pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.260133 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106776 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8b3d30ed-a165-4ada-b6f0-9678f6846518-etc-sysctl-conf\") pod \"tuned-pr9jm\" (UID: \"8b3d30ed-a165-4ada-b6f0-9678f6846518\") " pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.260133 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106790 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e471bdf5-0615-42d5-821a-21fb696e6412-host-run-k8s-cni-cncf-io\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.261624 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106791 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e471bdf5-0615-42d5-821a-21fb696e6412-host-var-lib-cni-multus\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.261624 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106807 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e-dbus\") pod \"global-pull-secret-syncer-8kzck\" (UID: \"0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e\") " pod="kube-system/global-pull-secret-syncer-8kzck" Jul 15 16:40:16.261624 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106821 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4de0f0e6-c52c-439f-b547-d7449edde627-hosts-file\") pod \"node-resolver-54dr5\" (UID: \"4de0f0e6-c52c-439f-b547-d7449edde627\") " pod="openshift-dns/node-resolver-54dr5" Jul 15 16:40:16.261624 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106838 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6ebc4f77-e864-4fb8-b9d6-5e5b6c91fd9a-agent-certs\") pod \"konnectivity-agent-bwv27\" (UID: \"6ebc4f77-e864-4fb8-b9d6-5e5b6c91fd9a\") " pod="kube-system/konnectivity-agent-bwv27" Jul 15 16:40:16.261624 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106847 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8b3d30ed-a165-4ada-b6f0-9678f6846518-etc-sysctl-d\") pod \"tuned-pr9jm\" (UID: \"8b3d30ed-a165-4ada-b6f0-9678f6846518\") " pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.261624 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106856 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e471bdf5-0615-42d5-821a-21fb696e6412-cni-binary-copy\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.261624 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106885 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e471bdf5-0615-42d5-821a-21fb696e6412-host-run-k8s-cni-cncf-io\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.261624 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106898 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8b3d30ed-a165-4ada-b6f0-9678f6846518-etc-sysctl-conf\") pod \"tuned-pr9jm\" (UID: \"8b3d30ed-a165-4ada-b6f0-9678f6846518\") " pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.261624 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106890 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-host-kubelet\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.261624 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106923 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-host-kubelet\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.261624 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106902 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4de0f0e6-c52c-439f-b547-d7449edde627-hosts-file\") pod \"node-resolver-54dr5\" (UID: \"4de0f0e6-c52c-439f-b547-d7449edde627\") " pod="openshift-dns/node-resolver-54dr5" Jul 15 16:40:16.261624 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106888 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e-dbus\") pod \"global-pull-secret-syncer-8kzck\" (UID: \"0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e\") " pod="kube-system/global-pull-secret-syncer-8kzck" Jul 15 16:40:16.261624 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106945 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-ovnkube-config\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.261624 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106963 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e471bdf5-0615-42d5-821a-21fb696e6412-etc-kubernetes\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.261624 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106979 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn7nq\" (UniqueName: \"kubernetes.io/projected/f0c2df6c-3310-45cb-bc73-ae2693ee0761-kube-api-access-sn7nq\") pod \"network-check-target-wqnw5\" (UID: \"f0c2df6c-3310-45cb-bc73-ae2693ee0761\") " pod="openshift-network-diagnostics/network-check-target-wqnw5" Jul 15 16:40:16.262434 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.106997 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4de0f0e6-c52c-439f-b547-d7449edde627-tmp-dir\") pod \"node-resolver-54dr5\" (UID: \"4de0f0e6-c52c-439f-b547-d7449edde627\") " pod="openshift-dns/node-resolver-54dr5" Jul 15 16:40:16.262434 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.107002 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8b3d30ed-a165-4ada-b6f0-9678f6846518-etc-modprobe-d\") pod \"tuned-pr9jm\" (UID: \"8b3d30ed-a165-4ada-b6f0-9678f6846518\") " pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.262434 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.107035 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e471bdf5-0615-42d5-821a-21fb696e6412-etc-kubernetes\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.262434 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.107053 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e471bdf5-0615-42d5-821a-21fb696e6412-host-run-multus-certs\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.262434 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.107082 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8b3d30ed-a165-4ada-b6f0-9678f6846518-etc-modprobe-d\") pod \"tuned-pr9jm\" (UID: \"8b3d30ed-a165-4ada-b6f0-9678f6846518\") " pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.262434 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.107084 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e-original-pull-secret\") pod \"global-pull-secret-syncer-8kzck\" (UID: \"0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e\") " pod="kube-system/global-pull-secret-syncer-8kzck" Jul 15 16:40:16.262434 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.107084 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e471bdf5-0615-42d5-821a-21fb696e6412-host-run-multus-certs\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.262434 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.107115 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-systemd-units\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.262434 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.107144 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-etc-openvswitch\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.262434 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.107172 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b3d30ed-a165-4ada-b6f0-9678f6846518-etc-kubernetes\") pod \"tuned-pr9jm\" (UID: \"8b3d30ed-a165-4ada-b6f0-9678f6846518\") " pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.262434 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.107201 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-var-lib-openvswitch\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.262434 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.107231 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.262434 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.107257 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-var-lib-openvswitch\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.262434 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.107262 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stszm\" (UniqueName: \"kubernetes.io/projected/3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace-kube-api-access-stszm\") pod \"aws-ebs-csi-driver-node-zkbqd\" (UID: \"3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkbqd" Jul 15 16:40:16.263313 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.107292 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b3d30ed-a165-4ada-b6f0-9678f6846518-etc-kubernetes\") pod \"tuned-pr9jm\" (UID: \"8b3d30ed-a165-4ada-b6f0-9678f6846518\") " pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.263313 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.107291 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8b3d30ed-a165-4ada-b6f0-9678f6846518-run\") pod \"tuned-pr9jm\" (UID: \"8b3d30ed-a165-4ada-b6f0-9678f6846518\") " pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.263313 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.107316 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-run-systemd\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.263313 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.107330 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-env-overrides\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.263313 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.107342 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8b3d30ed-a165-4ada-b6f0-9678f6846518-run\") pod \"tuned-pr9jm\" (UID: \"8b3d30ed-a165-4ada-b6f0-9678f6846518\") " pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.263313 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.107344 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctmlk\" (UniqueName: \"kubernetes.io/projected/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-kube-api-access-ctmlk\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.263313 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.107387 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e7f78480-9e9a-488a-9cfa-ba14ad74e3e8-cnibin\") pod \"multus-additional-cni-plugins-cjrnr\" (UID: \"e7f78480-9e9a-488a-9cfa-ba14ad74e3e8\") " pod="openshift-multus/multus-additional-cni-plugins-cjrnr" Jul 15 16:40:16.263313 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.107418 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace-socket-dir\") pod \"aws-ebs-csi-driver-node-zkbqd\" (UID: \"3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkbqd" Jul 15 16:40:16.263313 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.107451 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e471bdf5-0615-42d5-821a-21fb696e6412-multus-daemon-config\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.263313 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.107498 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-ovn-node-metrics-cert\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.263313 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.107520 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8b3d30ed-a165-4ada-b6f0-9678f6846518-etc-systemd\") pod \"tuned-pr9jm\" (UID: \"8b3d30ed-a165-4ada-b6f0-9678f6846518\") " pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.263313 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.107560 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xd7p\" (UniqueName: \"kubernetes.io/projected/303815d9-d13a-40d0-a668-cbb2a070be2b-kube-api-access-7xd7p\") pod \"iptables-alerter-fm4kh\" (UID: \"303815d9-d13a-40d0-a668-cbb2a070be2b\") " pod="openshift-network-operator/iptables-alerter-fm4kh" Jul 15 16:40:16.263313 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:16.107573 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 16:40:16.263313 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.107583 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgn2z\" (UniqueName: \"kubernetes.io/projected/07a4919e-5119-4287-8068-6fbcea6161de-kube-api-access-fgn2z\") pod \"network-metrics-daemon-cp4kd\" (UID: \"07a4919e-5119-4287-8068-6fbcea6161de\") " pod="openshift-multus/network-metrics-daemon-cp4kd" Jul 15 16:40:16.263313 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.107611 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-host-run-netns\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.264100 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.107617 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-run-systemd\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.264100 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:16.107634 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e-original-pull-secret podName:0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e nodeName:}" failed. No retries permitted until 2026-07-15 16:40:16.607613583 +0000 UTC m=+3.034705664 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e-original-pull-secret") pod "global-pull-secret-syncer-8kzck" (UID: "0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e") : object "kube-system"/"original-pull-secret" not registered Jul 15 16:40:16.264100 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.107652 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-host-run-netns\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.264100 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.107665 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-ovnkube-script-lib\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.264100 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.107696 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e7f78480-9e9a-488a-9cfa-ba14ad74e3e8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cjrnr\" (UID: \"e7f78480-9e9a-488a-9cfa-ba14ad74e3e8\") " pod="openshift-multus/multus-additional-cni-plugins-cjrnr" Jul 15 16:40:16.264100 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.107721 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5695f6d9-f75a-4b9c-9417-babb852ef469-host\") pod \"node-ca-zrwsm\" (UID: \"5695f6d9-f75a-4b9c-9417-babb852ef469\") " pod="openshift-image-registry/node-ca-zrwsm" Jul 15 16:40:16.264100 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.107743 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e7f78480-9e9a-488a-9cfa-ba14ad74e3e8-os-release\") pod \"multus-additional-cni-plugins-cjrnr\" (UID: \"e7f78480-9e9a-488a-9cfa-ba14ad74e3e8\") " pod="openshift-multus/multus-additional-cni-plugins-cjrnr" Jul 15 16:40:16.264100 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.107782 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/303815d9-d13a-40d0-a668-cbb2a070be2b-iptables-alerter-script\") pod \"iptables-alerter-fm4kh\" (UID: \"303815d9-d13a-40d0-a668-cbb2a070be2b\") " pod="openshift-network-operator/iptables-alerter-fm4kh" Jul 15 16:40:16.264100 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.107805 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e471bdf5-0615-42d5-821a-21fb696e6412-host-var-lib-cni-bin\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.264100 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.107819 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e471bdf5-0615-42d5-821a-21fb696e6412-cni-binary-copy\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.264100 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.107831 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-run-openvswitch\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.264100 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.107835 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-ovnkube-config\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.264100 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.107202 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-systemd-units\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.264100 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.107855 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8qsd\" (UniqueName: \"kubernetes.io/projected/e471bdf5-0615-42d5-821a-21fb696e6412-kube-api-access-q8qsd\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.265037 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.107236 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-etc-openvswitch\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.265037 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.107975 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-env-overrides\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.265037 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.108040 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8b3d30ed-a165-4ada-b6f0-9678f6846518-etc-systemd\") pod \"tuned-pr9jm\" (UID: \"8b3d30ed-a165-4ada-b6f0-9678f6846518\") " pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.265037 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.108083 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5695f6d9-f75a-4b9c-9417-babb852ef469-host\") pod \"node-ca-zrwsm\" (UID: \"5695f6d9-f75a-4b9c-9417-babb852ef469\") " pod="openshift-image-registry/node-ca-zrwsm" Jul 15 16:40:16.265037 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.108163 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-ovnkube-script-lib\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.265037 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.108181 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e7f78480-9e9a-488a-9cfa-ba14ad74e3e8-os-release\") pod \"multus-additional-cni-plugins-cjrnr\" (UID: \"e7f78480-9e9a-488a-9cfa-ba14ad74e3e8\") " pod="openshift-multus/multus-additional-cni-plugins-cjrnr" Jul 15 16:40:16.265037 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.108202 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7f78480-9e9a-488a-9cfa-ba14ad74e3e8-system-cni-dir\") pod \"multus-additional-cni-plugins-cjrnr\" (UID: \"e7f78480-9e9a-488a-9cfa-ba14ad74e3e8\") " pod="openshift-multus/multus-additional-cni-plugins-cjrnr" Jul 15 16:40:16.265037 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.108227 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mlsd\" (UniqueName: \"kubernetes.io/projected/e7f78480-9e9a-488a-9cfa-ba14ad74e3e8-kube-api-access-4mlsd\") pod \"multus-additional-cni-plugins-cjrnr\" (UID: \"e7f78480-9e9a-488a-9cfa-ba14ad74e3e8\") " pod="openshift-multus/multus-additional-cni-plugins-cjrnr" Jul 15 16:40:16.265037 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.108252 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace-etc-selinux\") pod \"aws-ebs-csi-driver-node-zkbqd\" (UID: \"3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkbqd" Jul 15 16:40:16.265037 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.108275 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace-sys-fs\") pod \"aws-ebs-csi-driver-node-zkbqd\" (UID: \"3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkbqd" Jul 15 16:40:16.265037 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.108300 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-host-cni-netd\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.265037 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.108303 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e471bdf5-0615-42d5-821a-21fb696e6412-host-var-lib-cni-bin\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.265037 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.108323 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zkbqd\" (UID: \"3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkbqd" Jul 15 16:40:16.265037 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.108347 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8b3d30ed-a165-4ada-b6f0-9678f6846518-etc-tuned\") pod \"tuned-pr9jm\" (UID: \"8b3d30ed-a165-4ada-b6f0-9678f6846518\") " pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.265732 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.108354 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-run-openvswitch\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.265732 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.108394 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/303815d9-d13a-40d0-a668-cbb2a070be2b-iptables-alerter-script\") pod \"iptables-alerter-fm4kh\" (UID: \"303815d9-d13a-40d0-a668-cbb2a070be2b\") " pod="openshift-network-operator/iptables-alerter-fm4kh" Jul 15 16:40:16.265732 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.108403 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/303815d9-d13a-40d0-a668-cbb2a070be2b-host-slash\") pod \"iptables-alerter-fm4kh\" (UID: \"303815d9-d13a-40d0-a668-cbb2a070be2b\") " pod="openshift-network-operator/iptables-alerter-fm4kh" Jul 15 16:40:16.265732 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.108435 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e471bdf5-0615-42d5-821a-21fb696e6412-cnibin\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.265732 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.108446 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/303815d9-d13a-40d0-a668-cbb2a070be2b-host-slash\") pod \"iptables-alerter-fm4kh\" (UID: \"303815d9-d13a-40d0-a668-cbb2a070be2b\") " pod="openshift-network-operator/iptables-alerter-fm4kh" Jul 15 16:40:16.265732 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.108457 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace-etc-selinux\") pod \"aws-ebs-csi-driver-node-zkbqd\" (UID: \"3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkbqd" Jul 15 16:40:16.265732 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.108462 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e-kubelet-config\") pod \"global-pull-secret-syncer-8kzck\" (UID: \"0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e\") " pod="kube-system/global-pull-secret-syncer-8kzck" Jul 15 16:40:16.265732 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.108448 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace-socket-dir\") pod \"aws-ebs-csi-driver-node-zkbqd\" (UID: \"3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkbqd" Jul 15 16:40:16.265732 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.108229 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.265732 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.108502 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6ebc4f77-e864-4fb8-b9d6-5e5b6c91fd9a-konnectivity-ca\") pod \"konnectivity-agent-bwv27\" (UID: \"6ebc4f77-e864-4fb8-b9d6-5e5b6c91fd9a\") " pod="kube-system/konnectivity-agent-bwv27" Jul 15 16:40:16.265732 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.108513 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7f78480-9e9a-488a-9cfa-ba14ad74e3e8-system-cni-dir\") pod \"multus-additional-cni-plugins-cjrnr\" (UID: \"e7f78480-9e9a-488a-9cfa-ba14ad74e3e8\") " pod="openshift-multus/multus-additional-cni-plugins-cjrnr" Jul 15 16:40:16.265732 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.108525 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-host-cni-bin\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.265732 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.108542 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e-kubelet-config\") pod \"global-pull-secret-syncer-8kzck\" (UID: \"0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e\") " pod="kube-system/global-pull-secret-syncer-8kzck" Jul 15 16:40:16.265732 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.108547 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e7f78480-9e9a-488a-9cfa-ba14ad74e3e8-cni-binary-copy\") pod \"multus-additional-cni-plugins-cjrnr\" (UID: \"e7f78480-9e9a-488a-9cfa-ba14ad74e3e8\") " pod="openshift-multus/multus-additional-cni-plugins-cjrnr" Jul 15 16:40:16.266697 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.108562 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e7f78480-9e9a-488a-9cfa-ba14ad74e3e8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cjrnr\" (UID: \"e7f78480-9e9a-488a-9cfa-ba14ad74e3e8\") " pod="openshift-multus/multus-additional-cni-plugins-cjrnr" Jul 15 16:40:16.266697 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.108571 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e471bdf5-0615-42d5-821a-21fb696e6412-cnibin\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.266697 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.108568 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace-device-dir\") pod \"aws-ebs-csi-driver-node-zkbqd\" (UID: \"3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkbqd" Jul 15 16:40:16.266697 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.108612 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8b3d30ed-a165-4ada-b6f0-9678f6846518-etc-sysconfig\") pod \"tuned-pr9jm\" (UID: \"8b3d30ed-a165-4ada-b6f0-9678f6846518\") " pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.266697 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.108614 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-host-cni-bin\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.266697 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.108625 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e471bdf5-0615-42d5-821a-21fb696e6412-host-var-lib-kubelet\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.266697 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.108631 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace-device-dir\") pod \"aws-ebs-csi-driver-node-zkbqd\" (UID: \"3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkbqd" Jul 15 16:40:16.266697 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.108639 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e471bdf5-0615-42d5-821a-21fb696e6412-hostroot\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.266697 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.108645 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-host-cni-netd\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.266697 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.108654 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e471bdf5-0615-42d5-821a-21fb696e6412-multus-conf-dir\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.266697 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.108680 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zkbqd\" (UID: \"3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkbqd" Jul 15 16:40:16.266697 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.108971 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8b3d30ed-a165-4ada-b6f0-9678f6846518-etc-sysconfig\") pod \"tuned-pr9jm\" (UID: \"8b3d30ed-a165-4ada-b6f0-9678f6846518\") " pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.266697 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.109055 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e7f78480-9e9a-488a-9cfa-ba14ad74e3e8-cni-binary-copy\") pod \"multus-additional-cni-plugins-cjrnr\" (UID: \"e7f78480-9e9a-488a-9cfa-ba14ad74e3e8\") " pod="openshift-multus/multus-additional-cni-plugins-cjrnr" Jul 15 16:40:16.266697 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.109085 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6ebc4f77-e864-4fb8-b9d6-5e5b6c91fd9a-konnectivity-ca\") pod \"konnectivity-agent-bwv27\" (UID: \"6ebc4f77-e864-4fb8-b9d6-5e5b6c91fd9a\") " pod="kube-system/konnectivity-agent-bwv27" Jul 15 16:40:16.266697 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.109096 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e471bdf5-0615-42d5-821a-21fb696e6412-multus-conf-dir\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.267503 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.109132 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e471bdf5-0615-42d5-821a-21fb696e6412-host-var-lib-kubelet\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.267503 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.109176 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e471bdf5-0615-42d5-821a-21fb696e6412-hostroot\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.267503 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.109225 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e7f78480-9e9a-488a-9cfa-ba14ad74e3e8-cnibin\") pod \"multus-additional-cni-plugins-cjrnr\" (UID: \"e7f78480-9e9a-488a-9cfa-ba14ad74e3e8\") " pod="openshift-multus/multus-additional-cni-plugins-cjrnr" Jul 15 16:40:16.267503 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.109582 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e471bdf5-0615-42d5-821a-21fb696e6412-multus-daemon-config\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.267503 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.110858 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-ovn-node-metrics-cert\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.267503 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.110888 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6ebc4f77-e864-4fb8-b9d6-5e5b6c91fd9a-agent-certs\") pod \"konnectivity-agent-bwv27\" (UID: \"6ebc4f77-e864-4fb8-b9d6-5e5b6c91fd9a\") " pod="kube-system/konnectivity-agent-bwv27" Jul 15 16:40:16.267503 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.111053 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b3d30ed-a165-4ada-b6f0-9678f6846518-tmp\") pod \"tuned-pr9jm\" (UID: \"8b3d30ed-a165-4ada-b6f0-9678f6846518\") " pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.267503 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.111376 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8b3d30ed-a165-4ada-b6f0-9678f6846518-etc-tuned\") pod \"tuned-pr9jm\" (UID: \"8b3d30ed-a165-4ada-b6f0-9678f6846518\") " pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.267503 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.112452 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace-sys-fs\") pod \"aws-ebs-csi-driver-node-zkbqd\" (UID: \"3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkbqd" Jul 15 16:40:16.267503 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.112457 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-node-log\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.267503 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.112505 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-node-log\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.267503 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.112505 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-log-socket\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.267503 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.112537 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-log-socket\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.267503 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.112539 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e7f78480-9e9a-488a-9cfa-ba14ad74e3e8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cjrnr\" (UID: \"e7f78480-9e9a-488a-9cfa-ba14ad74e3e8\") " pod="openshift-multus/multus-additional-cni-plugins-cjrnr" Jul 15 16:40:16.267503 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.112571 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5695f6d9-f75a-4b9c-9417-babb852ef469-serviceca\") pod \"node-ca-zrwsm\" (UID: \"5695f6d9-f75a-4b9c-9417-babb852ef469\") " pod="openshift-image-registry/node-ca-zrwsm" Jul 15 16:40:16.269053 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.112596 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9d77\" (UniqueName: \"kubernetes.io/projected/5695f6d9-f75a-4b9c-9417-babb852ef469-kube-api-access-p9d77\") pod \"node-ca-zrwsm\" (UID: \"5695f6d9-f75a-4b9c-9417-babb852ef469\") " pod="openshift-image-registry/node-ca-zrwsm" Jul 15 16:40:16.269053 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.112618 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b3d30ed-a165-4ada-b6f0-9678f6846518-sys\") pod \"tuned-pr9jm\" (UID: \"8b3d30ed-a165-4ada-b6f0-9678f6846518\") " pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.269053 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.112640 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b3d30ed-a165-4ada-b6f0-9678f6846518-var-lib-kubelet\") pod \"tuned-pr9jm\" (UID: \"8b3d30ed-a165-4ada-b6f0-9678f6846518\") " pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.269053 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.112667 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07a4919e-5119-4287-8068-6fbcea6161de-metrics-certs\") pod \"network-metrics-daemon-cp4kd\" (UID: \"07a4919e-5119-4287-8068-6fbcea6161de\") " pod="openshift-multus/network-metrics-daemon-cp4kd" Jul 15 16:40:16.269053 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.112695 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-run-ovn\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.269053 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.112719 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e471bdf5-0615-42d5-821a-21fb696e6412-host-run-netns\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.269053 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.112734 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b3d30ed-a165-4ada-b6f0-9678f6846518-sys\") pod \"tuned-pr9jm\" (UID: \"8b3d30ed-a165-4ada-b6f0-9678f6846518\") " pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.269053 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.112742 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b3d30ed-a165-4ada-b6f0-9678f6846518-var-lib-kubelet\") pod \"tuned-pr9jm\" (UID: \"8b3d30ed-a165-4ada-b6f0-9678f6846518\") " pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.269053 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.112800 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-run-ovn\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.269053 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.112805 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e471bdf5-0615-42d5-821a-21fb696e6412-host-run-netns\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.269053 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:16.112829 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 16:40:16.269053 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:16.112877 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07a4919e-5119-4287-8068-6fbcea6161de-metrics-certs podName:07a4919e-5119-4287-8068-6fbcea6161de nodeName:}" failed. No retries permitted until 2026-07-15 16:40:16.612865067 +0000 UTC m=+3.039957128 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07a4919e-5119-4287-8068-6fbcea6161de-metrics-certs") pod "network-metrics-daemon-cp4kd" (UID: "07a4919e-5119-4287-8068-6fbcea6161de") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 16:40:16.269053 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.112976 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5695f6d9-f75a-4b9c-9417-babb852ef469-serviceca\") pod \"node-ca-zrwsm\" (UID: \"5695f6d9-f75a-4b9c-9417-babb852ef469\") " pod="openshift-image-registry/node-ca-zrwsm" Jul 15 16:40:16.269053 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.112980 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e7f78480-9e9a-488a-9cfa-ba14ad74e3e8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cjrnr\" (UID: \"e7f78480-9e9a-488a-9cfa-ba14ad74e3e8\") " pod="openshift-multus/multus-additional-cni-plugins-cjrnr" Jul 15 16:40:16.269053 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:16.118318 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 16:40:16.270195 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:16.118353 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 16:40:16.270195 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:16.118372 2559 projected.go:196] Error preparing data for projected volume kube-api-access-sn7nq for pod openshift-network-diagnostics/network-check-target-wqnw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 16:40:16.270195 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:16.118438 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0c2df6c-3310-45cb-bc73-ae2693ee0761-kube-api-access-sn7nq podName:f0c2df6c-3310-45cb-bc73-ae2693ee0761 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:16.618422834 +0000 UTC m=+3.045514916 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-sn7nq" (UniqueName: "kubernetes.io/projected/f0c2df6c-3310-45cb-bc73-ae2693ee0761-kube-api-access-sn7nq") pod "network-check-target-wqnw5" (UID: "f0c2df6c-3310-45cb-bc73-ae2693ee0761") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 16:40:16.270195 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.118546 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d782k\" (UniqueName: \"kubernetes.io/projected/4de0f0e6-c52c-439f-b547-d7449edde627-kube-api-access-d782k\") pod \"node-resolver-54dr5\" (UID: \"4de0f0e6-c52c-439f-b547-d7449edde627\") " pod="openshift-dns/node-resolver-54dr5" Jul 15 16:40:16.270195 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.120535 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stszm\" (UniqueName: \"kubernetes.io/projected/3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace-kube-api-access-stszm\") pod \"aws-ebs-csi-driver-node-zkbqd\" (UID: \"3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkbqd" Jul 15 16:40:16.270195 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.120602 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgn2z\" (UniqueName: \"kubernetes.io/projected/07a4919e-5119-4287-8068-6fbcea6161de-kube-api-access-fgn2z\") pod \"network-metrics-daemon-cp4kd\" (UID: \"07a4919e-5119-4287-8068-6fbcea6161de\") " pod="openshift-multus/network-metrics-daemon-cp4kd" Jul 15 16:40:16.270195 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.121279 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xd7p\" (UniqueName: \"kubernetes.io/projected/303815d9-d13a-40d0-a668-cbb2a070be2b-kube-api-access-7xd7p\") pod \"iptables-alerter-fm4kh\" (UID: \"303815d9-d13a-40d0-a668-cbb2a070be2b\") " pod="openshift-network-operator/iptables-alerter-fm4kh" Jul 15 16:40:16.270195 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.121869 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctmlk\" (UniqueName: \"kubernetes.io/projected/1e30c2c6-c7eb-42ca-add5-239c71eafd0d-kube-api-access-ctmlk\") pod \"ovnkube-node-cxsr7\" (UID: \"1e30c2c6-c7eb-42ca-add5-239c71eafd0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.270195 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.122583 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmgf8\" (UniqueName: \"kubernetes.io/projected/8b3d30ed-a165-4ada-b6f0-9678f6846518-kube-api-access-cmgf8\") pod \"tuned-pr9jm\" (UID: \"8b3d30ed-a165-4ada-b6f0-9678f6846518\") " pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.270195 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.123964 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mlsd\" (UniqueName: \"kubernetes.io/projected/e7f78480-9e9a-488a-9cfa-ba14ad74e3e8-kube-api-access-4mlsd\") pod \"multus-additional-cni-plugins-cjrnr\" (UID: \"e7f78480-9e9a-488a-9cfa-ba14ad74e3e8\") " pod="openshift-multus/multus-additional-cni-plugins-cjrnr" Jul 15 16:40:16.270195 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.124050 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8qsd\" (UniqueName: \"kubernetes.io/projected/e471bdf5-0615-42d5-821a-21fb696e6412-kube-api-access-q8qsd\") pod \"multus-f4xlb\" (UID: \"e471bdf5-0615-42d5-821a-21fb696e6412\") " pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.270195 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.124084 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9d77\" (UniqueName: \"kubernetes.io/projected/5695f6d9-f75a-4b9c-9417-babb852ef469-kube-api-access-p9d77\") pod \"node-ca-zrwsm\" (UID: \"5695f6d9-f75a-4b9c-9417-babb852ef469\") " pod="openshift-image-registry/node-ca-zrwsm" Jul 15 16:40:16.270195 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.171425 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-162.ec2.internal" event={"ID":"9a6c4718c4d2bba356c5dbe44fb455e4","Type":"ContainerStarted","Data":"3bf620527e07d9245f393358001fc8b45e77801fb5d1f80aaa010f16802c3e22"} Jul 15 16:40:16.270195 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.172745 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-162.ec2.internal" event={"ID":"0819db2e07dd6ab94870584aab4ec920","Type":"ContainerStarted","Data":"e16dc9d137ff0174436be000a16b82d97362b244731b1cd907e487200a171b10"} Jul 15 16:40:16.365627 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.288688 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zrwsm" Jul 15 16:40:16.365627 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.297078 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cjrnr" Jul 15 16:40:16.365627 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:16.299541 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5695f6d9_f75a_4b9c_9417_babb852ef469.slice/crio-7721bda9c48553e8ed7cef74275a8b303e2f38a9eff1f4664df8eb11b0b88c7c WatchSource:0}: Error finding container 7721bda9c48553e8ed7cef74275a8b303e2f38a9eff1f4664df8eb11b0b88c7c: Status 404 returned error can't find the container with id 7721bda9c48553e8ed7cef74275a8b303e2f38a9eff1f4664df8eb11b0b88c7c Jul 15 16:40:16.365627 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.303517 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f4xlb" Jul 15 16:40:16.365627 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.307217 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkbqd" Jul 15 16:40:16.365627 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.311743 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-54dr5" Jul 15 16:40:16.365627 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.318149 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bwv27" Jul 15 16:40:16.365627 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.323046 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:16.365627 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.327815 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" Jul 15 16:40:16.365627 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:16.330228 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4de0f0e6_c52c_439f_b547_d7449edde627.slice/crio-0192f2a217808d064147ca2d687777f74f8204cc7226520d3e47acfadbd19954 WatchSource:0}: Error finding container 0192f2a217808d064147ca2d687777f74f8204cc7226520d3e47acfadbd19954: Status 404 returned error can't find the container with id 0192f2a217808d064147ca2d687777f74f8204cc7226520d3e47acfadbd19954 Jul 15 16:40:16.365627 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.333078 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fm4kh" Jul 15 16:40:16.365627 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:16.338205 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a92d4ca_de0a_45c5_a1e6_ec34e3f6eace.slice/crio-22a42cd88c3d78f51904c2186553287d476bfb492cb21fc536924743a87dce81 WatchSource:0}: Error finding container 22a42cd88c3d78f51904c2186553287d476bfb492cb21fc536924743a87dce81: Status 404 returned error can't find the container with id 22a42cd88c3d78f51904c2186553287d476bfb492cb21fc536924743a87dce81 Jul 15 16:40:16.372702 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.372488 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 16:40:16.700087 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.616823 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e-original-pull-secret\") pod \"global-pull-secret-syncer-8kzck\" (UID: \"0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e\") " pod="kube-system/global-pull-secret-syncer-8kzck" Jul 15 16:40:16.700087 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.616882 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07a4919e-5119-4287-8068-6fbcea6161de-metrics-certs\") pod \"network-metrics-daemon-cp4kd\" (UID: \"07a4919e-5119-4287-8068-6fbcea6161de\") " pod="openshift-multus/network-metrics-daemon-cp4kd" Jul 15 16:40:16.700087 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:16.616937 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 16:40:16.700087 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:16.616964 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 16:40:16.700087 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:16.617001 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e-original-pull-secret podName:0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e nodeName:}" failed. No retries permitted until 2026-07-15 16:40:17.616983542 +0000 UTC m=+4.044075615 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e-original-pull-secret") pod "global-pull-secret-syncer-8kzck" (UID: "0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e") : object "kube-system"/"original-pull-secret" not registered Jul 15 16:40:16.700087 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:16.617017 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07a4919e-5119-4287-8068-6fbcea6161de-metrics-certs podName:07a4919e-5119-4287-8068-6fbcea6161de nodeName:}" failed. No retries permitted until 2026-07-15 16:40:17.617008746 +0000 UTC m=+4.044100813 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07a4919e-5119-4287-8068-6fbcea6161de-metrics-certs") pod "network-metrics-daemon-cp4kd" (UID: "07a4919e-5119-4287-8068-6fbcea6161de") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 16:40:16.717323 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:16.717294 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn7nq\" (UniqueName: \"kubernetes.io/projected/f0c2df6c-3310-45cb-bc73-ae2693ee0761-kube-api-access-sn7nq\") pod \"network-check-target-wqnw5\" (UID: \"f0c2df6c-3310-45cb-bc73-ae2693ee0761\") " pod="openshift-network-diagnostics/network-check-target-wqnw5" Jul 15 16:40:16.717481 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:16.717464 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 16:40:16.717555 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:16.717488 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 16:40:16.717555 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:16.717500 2559 projected.go:196] Error preparing data for projected volume kube-api-access-sn7nq for pod openshift-network-diagnostics/network-check-target-wqnw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 16:40:16.717654 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:16.717556 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0c2df6c-3310-45cb-bc73-ae2693ee0761-kube-api-access-sn7nq podName:f0c2df6c-3310-45cb-bc73-ae2693ee0761 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:17.717539617 +0000 UTC m=+4.144631682 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-sn7nq" (UniqueName: "kubernetes.io/projected/f0c2df6c-3310-45cb-bc73-ae2693ee0761-kube-api-access-sn7nq") pod "network-check-target-wqnw5" (UID: "f0c2df6c-3310-45cb-bc73-ae2693ee0761") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 16:40:17.034677 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:17.034564 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 16:35:15 +0000 UTC" deadline="2027-12-15 11:53:12.232042142 +0000 UTC" Jul 15 16:40:17.034677 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:17.034622 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12427h12m55.197424063s" Jul 15 16:40:17.166950 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:17.166897 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cp4kd" Jul 15 16:40:17.167455 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:17.167148 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cp4kd" podUID="07a4919e-5119-4287-8068-6fbcea6161de" Jul 15 16:40:17.175384 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:17.175357 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fm4kh" event={"ID":"303815d9-d13a-40d0-a668-cbb2a070be2b","Type":"ContainerStarted","Data":"8c8a445460ea7773daddfcf7021d388d68f7523f4d23231652fbcadbbcadd578"} Jul 15 16:40:17.176587 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:17.176562 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" event={"ID":"8b3d30ed-a165-4ada-b6f0-9678f6846518","Type":"ContainerStarted","Data":"7ff2cc5492caf84ac8ab3634870b0012ada20fe172f6116d1cf7cc832ddadadd"} Jul 15 16:40:17.177790 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:17.177763 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" event={"ID":"1e30c2c6-c7eb-42ca-add5-239c71eafd0d","Type":"ContainerStarted","Data":"9b155036ca647639a6e76b738d0c9ce445a65ebcabcbb01a215f764ee8250d3b"} Jul 15 16:40:17.179229 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:17.179192 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bwv27" event={"ID":"6ebc4f77-e864-4fb8-b9d6-5e5b6c91fd9a","Type":"ContainerStarted","Data":"f875661414eae71be333728e47a7db31c3a6d4b255156b8f896bd94141ff34d4"} Jul 15 16:40:17.180405 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:17.180380 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkbqd" event={"ID":"3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace","Type":"ContainerStarted","Data":"22a42cd88c3d78f51904c2186553287d476bfb492cb21fc536924743a87dce81"} Jul 15 16:40:17.181518 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:17.181495 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-54dr5" event={"ID":"4de0f0e6-c52c-439f-b547-d7449edde627","Type":"ContainerStarted","Data":"0192f2a217808d064147ca2d687777f74f8204cc7226520d3e47acfadbd19954"} Jul 15 16:40:17.182764 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:17.182722 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f4xlb" event={"ID":"e471bdf5-0615-42d5-821a-21fb696e6412","Type":"ContainerStarted","Data":"d27d7326011504667cbcb893401d040737a9808e975bcf3d2e9c7280b1f84943"} Jul 15 16:40:17.184119 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:17.184076 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cjrnr" event={"ID":"e7f78480-9e9a-488a-9cfa-ba14ad74e3e8","Type":"ContainerStarted","Data":"74f16e28449a1140202edf9a02c37061424a3f8eccf46100b84489987de31c16"} Jul 15 16:40:17.185972 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:17.185937 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zrwsm" event={"ID":"5695f6d9-f75a-4b9c-9417-babb852ef469","Type":"ContainerStarted","Data":"7721bda9c48553e8ed7cef74275a8b303e2f38a9eff1f4664df8eb11b0b88c7c"} Jul 15 16:40:17.637494 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:17.637458 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e-original-pull-secret\") pod \"global-pull-secret-syncer-8kzck\" (UID: \"0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e\") " pod="kube-system/global-pull-secret-syncer-8kzck" Jul 15 16:40:17.637664 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:17.637522 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07a4919e-5119-4287-8068-6fbcea6161de-metrics-certs\") pod \"network-metrics-daemon-cp4kd\" (UID: \"07a4919e-5119-4287-8068-6fbcea6161de\") " pod="openshift-multus/network-metrics-daemon-cp4kd" Jul 15 16:40:17.637664 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:17.637633 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 16:40:17.637798 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:17.637690 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07a4919e-5119-4287-8068-6fbcea6161de-metrics-certs podName:07a4919e-5119-4287-8068-6fbcea6161de nodeName:}" failed. No retries permitted until 2026-07-15 16:40:19.637671956 +0000 UTC m=+6.064764020 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07a4919e-5119-4287-8068-6fbcea6161de-metrics-certs") pod "network-metrics-daemon-cp4kd" (UID: "07a4919e-5119-4287-8068-6fbcea6161de") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 16:40:17.637905 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:17.637881 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 16:40:17.637967 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:17.637960 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e-original-pull-secret podName:0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e nodeName:}" failed. No retries permitted until 2026-07-15 16:40:19.637940382 +0000 UTC m=+6.065032447 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e-original-pull-secret") pod "global-pull-secret-syncer-8kzck" (UID: "0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e") : object "kube-system"/"original-pull-secret" not registered Jul 15 16:40:17.738422 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:17.737796 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn7nq\" (UniqueName: \"kubernetes.io/projected/f0c2df6c-3310-45cb-bc73-ae2693ee0761-kube-api-access-sn7nq\") pod \"network-check-target-wqnw5\" (UID: \"f0c2df6c-3310-45cb-bc73-ae2693ee0761\") " pod="openshift-network-diagnostics/network-check-target-wqnw5" Jul 15 16:40:17.738422 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:17.738020 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 16:40:17.738422 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:17.738039 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 16:40:17.738422 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:17.738050 2559 projected.go:196] Error preparing data for projected volume kube-api-access-sn7nq for pod openshift-network-diagnostics/network-check-target-wqnw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 16:40:17.738422 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:17.738101 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0c2df6c-3310-45cb-bc73-ae2693ee0761-kube-api-access-sn7nq podName:f0c2df6c-3310-45cb-bc73-ae2693ee0761 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:19.738085122 +0000 UTC m=+6.165177187 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-sn7nq" (UniqueName: "kubernetes.io/projected/f0c2df6c-3310-45cb-bc73-ae2693ee0761-kube-api-access-sn7nq") pod "network-check-target-wqnw5" (UID: "f0c2df6c-3310-45cb-bc73-ae2693ee0761") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 16:40:18.167692 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:18.167622 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8kzck" Jul 15 16:40:18.168113 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:18.167805 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8kzck" podUID="0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e" Jul 15 16:40:18.168296 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:18.168278 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqnw5" Jul 15 16:40:18.168422 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:18.168400 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqnw5" podUID="f0c2df6c-3310-45cb-bc73-ae2693ee0761" Jul 15 16:40:19.167094 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:19.167064 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cp4kd" Jul 15 16:40:19.167280 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:19.167194 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cp4kd" podUID="07a4919e-5119-4287-8068-6fbcea6161de" Jul 15 16:40:19.655772 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:19.655172 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e-original-pull-secret\") pod \"global-pull-secret-syncer-8kzck\" (UID: \"0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e\") " pod="kube-system/global-pull-secret-syncer-8kzck" Jul 15 16:40:19.655772 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:19.655248 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07a4919e-5119-4287-8068-6fbcea6161de-metrics-certs\") pod \"network-metrics-daemon-cp4kd\" (UID: \"07a4919e-5119-4287-8068-6fbcea6161de\") " pod="openshift-multus/network-metrics-daemon-cp4kd" Jul 15 16:40:19.655772 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:19.655334 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 16:40:19.655772 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:19.655362 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 16:40:19.655772 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:19.655396 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e-original-pull-secret podName:0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e nodeName:}" failed. No retries permitted until 2026-07-15 16:40:23.655383423 +0000 UTC m=+10.082475488 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e-original-pull-secret") pod "global-pull-secret-syncer-8kzck" (UID: "0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e") : object "kube-system"/"original-pull-secret" not registered Jul 15 16:40:19.655772 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:19.655411 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07a4919e-5119-4287-8068-6fbcea6161de-metrics-certs podName:07a4919e-5119-4287-8068-6fbcea6161de nodeName:}" failed. No retries permitted until 2026-07-15 16:40:23.65540463 +0000 UTC m=+10.082496695 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07a4919e-5119-4287-8068-6fbcea6161de-metrics-certs") pod "network-metrics-daemon-cp4kd" (UID: "07a4919e-5119-4287-8068-6fbcea6161de") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 16:40:19.755839 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:19.755806 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn7nq\" (UniqueName: \"kubernetes.io/projected/f0c2df6c-3310-45cb-bc73-ae2693ee0761-kube-api-access-sn7nq\") pod \"network-check-target-wqnw5\" (UID: \"f0c2df6c-3310-45cb-bc73-ae2693ee0761\") " pod="openshift-network-diagnostics/network-check-target-wqnw5" Jul 15 16:40:19.755982 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:19.755954 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 16:40:19.755982 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:19.755981 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 16:40:19.756080 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:19.755996 2559 projected.go:196] Error preparing data for projected volume kube-api-access-sn7nq for pod openshift-network-diagnostics/network-check-target-wqnw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 16:40:19.756080 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:19.756057 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0c2df6c-3310-45cb-bc73-ae2693ee0761-kube-api-access-sn7nq podName:f0c2df6c-3310-45cb-bc73-ae2693ee0761 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:23.756039941 +0000 UTC m=+10.183132016 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-sn7nq" (UniqueName: "kubernetes.io/projected/f0c2df6c-3310-45cb-bc73-ae2693ee0761-kube-api-access-sn7nq") pod "network-check-target-wqnw5" (UID: "f0c2df6c-3310-45cb-bc73-ae2693ee0761") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 16:40:20.168342 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:20.167838 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8kzck" Jul 15 16:40:20.168342 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:20.167967 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8kzck" podUID="0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e" Jul 15 16:40:20.168806 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:20.168637 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqnw5" Jul 15 16:40:20.168806 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:20.168738 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqnw5" podUID="f0c2df6c-3310-45cb-bc73-ae2693ee0761" Jul 15 16:40:21.166935 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:21.166858 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cp4kd" Jul 15 16:40:21.167354 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:21.167004 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cp4kd" podUID="07a4919e-5119-4287-8068-6fbcea6161de" Jul 15 16:40:22.168403 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:22.167915 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqnw5" Jul 15 16:40:22.168403 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:22.168019 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqnw5" podUID="f0c2df6c-3310-45cb-bc73-ae2693ee0761" Jul 15 16:40:22.168403 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:22.168064 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8kzck" Jul 15 16:40:22.168403 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:22.168104 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8kzck" podUID="0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e" Jul 15 16:40:23.167067 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:23.167035 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cp4kd" Jul 15 16:40:23.167240 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:23.167173 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cp4kd" podUID="07a4919e-5119-4287-8068-6fbcea6161de" Jul 15 16:40:23.689993 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:23.689956 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07a4919e-5119-4287-8068-6fbcea6161de-metrics-certs\") pod \"network-metrics-daemon-cp4kd\" (UID: \"07a4919e-5119-4287-8068-6fbcea6161de\") " pod="openshift-multus/network-metrics-daemon-cp4kd" Jul 15 16:40:23.690322 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:23.690039 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e-original-pull-secret\") pod \"global-pull-secret-syncer-8kzck\" (UID: \"0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e\") " pod="kube-system/global-pull-secret-syncer-8kzck" Jul 15 16:40:23.690322 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:23.690172 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 16:40:23.690322 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:23.690222 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e-original-pull-secret podName:0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e nodeName:}" failed. No retries permitted until 2026-07-15 16:40:31.690206254 +0000 UTC m=+18.117298330 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e-original-pull-secret") pod "global-pull-secret-syncer-8kzck" (UID: "0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e") : object "kube-system"/"original-pull-secret" not registered Jul 15 16:40:23.690574 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:23.690556 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 16:40:23.690621 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:23.690611 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07a4919e-5119-4287-8068-6fbcea6161de-metrics-certs podName:07a4919e-5119-4287-8068-6fbcea6161de nodeName:}" failed. No retries permitted until 2026-07-15 16:40:31.690598163 +0000 UTC m=+18.117690225 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07a4919e-5119-4287-8068-6fbcea6161de-metrics-certs") pod "network-metrics-daemon-cp4kd" (UID: "07a4919e-5119-4287-8068-6fbcea6161de") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 16:40:23.791039 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:23.791003 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn7nq\" (UniqueName: \"kubernetes.io/projected/f0c2df6c-3310-45cb-bc73-ae2693ee0761-kube-api-access-sn7nq\") pod \"network-check-target-wqnw5\" (UID: \"f0c2df6c-3310-45cb-bc73-ae2693ee0761\") " pod="openshift-network-diagnostics/network-check-target-wqnw5" Jul 15 16:40:23.791194 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:23.791169 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 16:40:23.791251 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:23.791197 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 16:40:23.791251 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:23.791210 2559 projected.go:196] Error preparing data for projected volume kube-api-access-sn7nq for pod openshift-network-diagnostics/network-check-target-wqnw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 16:40:23.791356 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:23.791270 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0c2df6c-3310-45cb-bc73-ae2693ee0761-kube-api-access-sn7nq podName:f0c2df6c-3310-45cb-bc73-ae2693ee0761 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:31.791251162 +0000 UTC m=+18.218343241 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-sn7nq" (UniqueName: "kubernetes.io/projected/f0c2df6c-3310-45cb-bc73-ae2693ee0761-kube-api-access-sn7nq") pod "network-check-target-wqnw5" (UID: "f0c2df6c-3310-45cb-bc73-ae2693ee0761") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 16:40:24.168424 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:24.167854 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8kzck" Jul 15 16:40:24.168424 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:24.167960 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8kzck" podUID="0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e" Jul 15 16:40:24.168424 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:24.168297 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqnw5" Jul 15 16:40:24.168424 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:24.168379 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqnw5" podUID="f0c2df6c-3310-45cb-bc73-ae2693ee0761" Jul 15 16:40:25.167303 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:25.167264 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cp4kd" Jul 15 16:40:25.167720 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:25.167405 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cp4kd" podUID="07a4919e-5119-4287-8068-6fbcea6161de" Jul 15 16:40:26.166616 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:26.166581 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqnw5" Jul 15 16:40:26.166812 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:26.166717 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqnw5" podUID="f0c2df6c-3310-45cb-bc73-ae2693ee0761" Jul 15 16:40:26.166876 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:26.166581 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8kzck" Jul 15 16:40:26.170061 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:26.168063 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8kzck" podUID="0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e" Jul 15 16:40:27.166653 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:27.166622 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cp4kd" Jul 15 16:40:27.166841 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:27.166732 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cp4kd" podUID="07a4919e-5119-4287-8068-6fbcea6161de" Jul 15 16:40:28.167203 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:28.167175 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8kzck" Jul 15 16:40:28.167605 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:28.167299 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8kzck" podUID="0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e" Jul 15 16:40:28.167605 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:28.167328 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqnw5" Jul 15 16:40:28.167605 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:28.167396 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqnw5" podUID="f0c2df6c-3310-45cb-bc73-ae2693ee0761" Jul 15 16:40:29.166711 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:29.166679 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cp4kd" Jul 15 16:40:29.166872 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:29.166821 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cp4kd" podUID="07a4919e-5119-4287-8068-6fbcea6161de" Jul 15 16:40:30.166987 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:30.166956 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqnw5" Jul 15 16:40:30.166987 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:30.166970 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8kzck" Jul 15 16:40:30.167472 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:30.167082 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqnw5" podUID="f0c2df6c-3310-45cb-bc73-ae2693ee0761" Jul 15 16:40:30.167472 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:30.167219 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8kzck" podUID="0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e" Jul 15 16:40:31.166990 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:31.166908 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cp4kd" Jul 15 16:40:31.167182 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:31.167035 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cp4kd" podUID="07a4919e-5119-4287-8068-6fbcea6161de" Jul 15 16:40:31.749651 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:31.749610 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07a4919e-5119-4287-8068-6fbcea6161de-metrics-certs\") pod \"network-metrics-daemon-cp4kd\" (UID: \"07a4919e-5119-4287-8068-6fbcea6161de\") " pod="openshift-multus/network-metrics-daemon-cp4kd" Jul 15 16:40:31.749950 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:31.749682 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e-original-pull-secret\") pod \"global-pull-secret-syncer-8kzck\" (UID: \"0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e\") " pod="kube-system/global-pull-secret-syncer-8kzck" Jul 15 16:40:31.749950 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:31.749790 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 16:40:31.749950 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:31.749840 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e-original-pull-secret podName:0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e nodeName:}" failed. No retries permitted until 2026-07-15 16:40:47.74982383 +0000 UTC m=+34.176915891 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e-original-pull-secret") pod "global-pull-secret-syncer-8kzck" (UID: "0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e") : object "kube-system"/"original-pull-secret" not registered Jul 15 16:40:31.749950 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:31.749787 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 16:40:31.749950 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:31.749930 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07a4919e-5119-4287-8068-6fbcea6161de-metrics-certs podName:07a4919e-5119-4287-8068-6fbcea6161de nodeName:}" failed. No retries permitted until 2026-07-15 16:40:47.74991022 +0000 UTC m=+34.177002295 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07a4919e-5119-4287-8068-6fbcea6161de-metrics-certs") pod "network-metrics-daemon-cp4kd" (UID: "07a4919e-5119-4287-8068-6fbcea6161de") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 16:40:31.850692 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:31.850656 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn7nq\" (UniqueName: \"kubernetes.io/projected/f0c2df6c-3310-45cb-bc73-ae2693ee0761-kube-api-access-sn7nq\") pod \"network-check-target-wqnw5\" (UID: \"f0c2df6c-3310-45cb-bc73-ae2693ee0761\") " pod="openshift-network-diagnostics/network-check-target-wqnw5" Jul 15 16:40:31.850870 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:31.850815 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 16:40:31.850870 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:31.850835 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 16:40:31.850870 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:31.850848 2559 projected.go:196] Error preparing data for projected volume kube-api-access-sn7nq for pod openshift-network-diagnostics/network-check-target-wqnw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 16:40:31.851013 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:31.850907 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0c2df6c-3310-45cb-bc73-ae2693ee0761-kube-api-access-sn7nq podName:f0c2df6c-3310-45cb-bc73-ae2693ee0761 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:47.850891588 +0000 UTC m=+34.277983650 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-sn7nq" (UniqueName: "kubernetes.io/projected/f0c2df6c-3310-45cb-bc73-ae2693ee0761-kube-api-access-sn7nq") pod "network-check-target-wqnw5" (UID: "f0c2df6c-3310-45cb-bc73-ae2693ee0761") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 16:40:32.166714 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:32.166626 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqnw5" Jul 15 16:40:32.166895 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:32.166778 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqnw5" podUID="f0c2df6c-3310-45cb-bc73-ae2693ee0761" Jul 15 16:40:32.166895 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:32.166815 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8kzck" Jul 15 16:40:32.167010 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:32.166903 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8kzck" podUID="0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e" Jul 15 16:40:33.166438 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:33.166407 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cp4kd" Jul 15 16:40:33.166904 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:33.166536 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cp4kd" podUID="07a4919e-5119-4287-8068-6fbcea6161de" Jul 15 16:40:34.168534 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:34.168492 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8kzck" Jul 15 16:40:34.168983 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:34.168789 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8kzck" podUID="0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e" Jul 15 16:40:34.169280 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:34.169262 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqnw5" Jul 15 16:40:34.169414 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:34.169395 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqnw5" podUID="f0c2df6c-3310-45cb-bc73-ae2693ee0761" Jul 15 16:40:35.166616 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:35.166585 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cp4kd" Jul 15 16:40:35.166788 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:35.166691 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cp4kd" podUID="07a4919e-5119-4287-8068-6fbcea6161de" Jul 15 16:40:35.236978 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:35.236429 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" event={"ID":"1e30c2c6-c7eb-42ca-add5-239c71eafd0d","Type":"ContainerStarted","Data":"d3fc0f402e20e19441f96bc7cab60eef744214464f802c3c304e46aeba89b2dc"} Jul 15 16:40:35.243105 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:35.242790 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-162.ec2.internal" event={"ID":"0819db2e07dd6ab94870584aab4ec920","Type":"ContainerStarted","Data":"ce4429b3527da401ddb836691c56353940474790f1c924af8b800f6c7e95d376"} Jul 15 16:40:35.246124 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:35.246034 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" event={"ID":"8b3d30ed-a165-4ada-b6f0-9678f6846518","Type":"ContainerStarted","Data":"5be843e86fb8dd123da5744c32ec5ebe658c67431524448512a8a57da8ad2d91"} Jul 15 16:40:35.258005 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:35.257954 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-162.ec2.internal" podStartSLOduration=20.257938079 podStartE2EDuration="20.257938079s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:40:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:40:35.257561008 +0000 UTC m=+21.684653091" watchObservedRunningTime="2026-07-15 16:40:35.257938079 +0000 UTC m=+21.685030162" Jul 15 16:40:35.274901 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:35.273988 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pr9jm" podStartSLOduration=2.807755121 podStartE2EDuration="21.273964319s" totalImagesPullingTime="18.466209198s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:40:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:40:35.272836429 +0000 UTC m=+21.699928506" watchObservedRunningTime="2026-07-15 16:40:35.273964319 +0000 UTC m=+21.701056403" Jul 15 16:40:36.167204 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:36.166963 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8kzck" Jul 15 16:40:36.167204 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:36.167096 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8kzck" podUID="0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e" Jul 15 16:40:36.167204 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:36.166976 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqnw5" Jul 15 16:40:36.167453 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:36.167313 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqnw5" podUID="f0c2df6c-3310-45cb-bc73-ae2693ee0761" Jul 15 16:40:36.249276 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:36.249248 2559 generic.go:356] "Generic (PLEG): container finished" podID="9a6c4718c4d2bba356c5dbe44fb455e4" containerID="68b6532cb3b0b23ddc3eaba3d044ef972f2830bf82e17d3141e1132e3907580c" exitCode=0 Jul 15 16:40:36.250058 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:36.249319 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-162.ec2.internal" event={"ID":"9a6c4718c4d2bba356c5dbe44fb455e4","Type":"ContainerDied","Data":"68b6532cb3b0b23ddc3eaba3d044ef972f2830bf82e17d3141e1132e3907580c"} Jul 15 16:40:36.250950 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:36.250918 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fm4kh" event={"ID":"303815d9-d13a-40d0-a668-cbb2a070be2b","Type":"ContainerStarted","Data":"e639f6a112848bf673198bc1fee96c34d8b6dc763ad6d89b050dd58800c88384"} Jul 15 16:40:36.253987 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:36.253969 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxsr7_1e30c2c6-c7eb-42ca-add5-239c71eafd0d/ovn-acl-logging/0.log" Jul 15 16:40:36.254332 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:36.254310 2559 generic.go:356] "Generic (PLEG): container finished" podID="1e30c2c6-c7eb-42ca-add5-239c71eafd0d" containerID="29ce8003ced5af81ddc39e29878b42d3fedd5b449f31c4c6c1520ce7aa71fc1a" exitCode=1 Jul 15 16:40:36.254440 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:36.254374 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" event={"ID":"1e30c2c6-c7eb-42ca-add5-239c71eafd0d","Type":"ContainerStarted","Data":"ca36f4dbb1c7f348175fa28085ef7efe72baa55daaf12270708b5f1512eb4009"} Jul 15 16:40:36.254440 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:36.254437 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" event={"ID":"1e30c2c6-c7eb-42ca-add5-239c71eafd0d","Type":"ContainerStarted","Data":"8b778cf133e2ca74d5d59163cc31bb48869805af4e4e8500563bedcf4f82ebc3"} Jul 15 16:40:36.254539 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:36.254477 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" event={"ID":"1e30c2c6-c7eb-42ca-add5-239c71eafd0d","Type":"ContainerStarted","Data":"ec2011b183ff485e7d5387a7c44915dd8d5ff4ec4724db06351b9c5e271455ae"} Jul 15 16:40:36.254539 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:36.254525 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" event={"ID":"1e30c2c6-c7eb-42ca-add5-239c71eafd0d","Type":"ContainerStarted","Data":"7bf2dabe3d4a2ca5033a9dd42b5f1d38b3dfd13eaa5552b50cc406db6bf23f56"} Jul 15 16:40:36.254602 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:36.254561 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" event={"ID":"1e30c2c6-c7eb-42ca-add5-239c71eafd0d","Type":"ContainerDied","Data":"29ce8003ced5af81ddc39e29878b42d3fedd5b449f31c4c6c1520ce7aa71fc1a"} Jul 15 16:40:36.255914 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:36.255874 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bwv27" event={"ID":"6ebc4f77-e864-4fb8-b9d6-5e5b6c91fd9a","Type":"ContainerStarted","Data":"6861f616f28a805563d2b1bff877c1c9ed477ef38fef55e52c234841179fa696"} Jul 15 16:40:36.257302 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:36.257285 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkbqd" event={"ID":"3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace","Type":"ContainerStarted","Data":"f15bc80c812d7fa21392f54dce0af55a4e7f29adde4c2d4b5455ecd58df87739"} Jul 15 16:40:36.258700 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:36.258677 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-54dr5" event={"ID":"4de0f0e6-c52c-439f-b547-d7449edde627","Type":"ContainerStarted","Data":"fd7445bd03d741a0773c787bfbe69528c7c4c28eab65273ffe157dd3c5bec2f3"} Jul 15 16:40:36.260188 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:36.260168 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f4xlb" event={"ID":"e471bdf5-0615-42d5-821a-21fb696e6412","Type":"ContainerStarted","Data":"394873501d1e82069bef111df0dc315f53ff22e8e531b00e34a8b32557329bd2"} Jul 15 16:40:36.261688 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:36.261668 2559 generic.go:356] "Generic (PLEG): container finished" podID="e7f78480-9e9a-488a-9cfa-ba14ad74e3e8" containerID="9c9e4b047588f0e975aeb17b4e876212d4849b0ad60791b795ccfbd295b5ee9d" exitCode=0 Jul 15 16:40:36.261789 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:36.261732 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cjrnr" event={"ID":"e7f78480-9e9a-488a-9cfa-ba14ad74e3e8","Type":"ContainerDied","Data":"9c9e4b047588f0e975aeb17b4e876212d4849b0ad60791b795ccfbd295b5ee9d"} Jul 15 16:40:36.263416 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:36.263386 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zrwsm" event={"ID":"5695f6d9-f75a-4b9c-9417-babb852ef469","Type":"ContainerStarted","Data":"aa70c96d65a84933aaab3ecd03a33a0286eb06d9e7c6317645ca84c986ddcc24"} Jul 15 16:40:36.280186 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:36.280148 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-f4xlb" podStartSLOduration=3.410499506 podStartE2EDuration="22.280136105s" totalImagesPullingTime="18.869636599s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:40:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:40:36.279509357 +0000 UTC m=+22.706601441" watchObservedRunningTime="2026-07-15 16:40:36.280136105 +0000 UTC m=+22.707228187" Jul 15 16:40:36.294257 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:36.294150 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bwv27" podStartSLOduration=8.295758832 podStartE2EDuration="22.294133811s" totalImagesPullingTime="13.998374979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:40:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:40:36.293506552 +0000 UTC m=+22.720598635" watchObservedRunningTime="2026-07-15 16:40:36.294133811 +0000 UTC m=+22.721225894" Jul 15 16:40:36.307277 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:36.307245 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zrwsm" podStartSLOduration=3.8219895790000002 podStartE2EDuration="22.307231769s" totalImagesPullingTime="18.48524219s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:40:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:40:36.307141597 +0000 UTC m=+22.734233681" watchObservedRunningTime="2026-07-15 16:40:36.307231769 +0000 UTC m=+22.734323852" Jul 15 16:40:36.364906 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:36.364858 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-54dr5" podStartSLOduration=3.897048362 podStartE2EDuration="22.364839351s" totalImagesPullingTime="18.467790989s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:40:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:40:36.345917599 +0000 UTC m=+22.773009682" watchObservedRunningTime="2026-07-15 16:40:36.364839351 +0000 UTC m=+22.791931433" Jul 15 16:40:36.365163 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:36.365138 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fm4kh" podStartSLOduration=3.899827803 podStartE2EDuration="22.365130491s" totalImagesPullingTime="18.465302688s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:40:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:40:36.364642488 +0000 UTC m=+22.791734571" watchObservedRunningTime="2026-07-15 16:40:36.365130491 +0000 UTC m=+22.792222574" Jul 15 16:40:36.699903 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:36.699877 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 15 16:40:37.068744 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:37.068608 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T16:40:36.699899862Z","UUID":"fdde3743-5519-4cb5-95b0-6d16842c3a93","Handler":null,"Name":"","Endpoint":""} Jul 15 16:40:37.070139 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:37.070114 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 15 16:40:37.070261 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:37.070154 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 15 16:40:37.167115 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:37.167088 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cp4kd" Jul 15 16:40:37.167248 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:37.167208 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cp4kd" podUID="07a4919e-5119-4287-8068-6fbcea6161de" Jul 15 16:40:37.267763 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:37.267707 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkbqd" event={"ID":"3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace","Type":"ContainerStarted","Data":"3e9907ac851fe738345607dad1c29cf09e939bd01c70a3161b261e13978a21c1"} Jul 15 16:40:37.269766 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:37.269722 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-162.ec2.internal" event={"ID":"9a6c4718c4d2bba356c5dbe44fb455e4","Type":"ContainerStarted","Data":"6b65578d582d8abdba6c970cc6cc5a81169395cd278040718ed6dbccc9367337"} Jul 15 16:40:38.166689 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:38.166664 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqnw5" Jul 15 16:40:38.166822 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:38.166669 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8kzck" Jul 15 16:40:38.166822 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:38.166805 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqnw5" podUID="f0c2df6c-3310-45cb-bc73-ae2693ee0761" Jul 15 16:40:38.166930 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:38.166847 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8kzck" podUID="0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e" Jul 15 16:40:38.276260 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:38.276233 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxsr7_1e30c2c6-c7eb-42ca-add5-239c71eafd0d/ovn-acl-logging/0.log" Jul 15 16:40:38.276704 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:38.276673 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" event={"ID":"1e30c2c6-c7eb-42ca-add5-239c71eafd0d","Type":"ContainerStarted","Data":"cc0d9e6193e6a91ff106ac888bfb0b699a3f3470802094cd3f0d064ea9056a96"} Jul 15 16:40:38.279107 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:38.279078 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkbqd" event={"ID":"3a92d4ca-de0a-45c5-a1e6-ec34e3f6eace","Type":"ContainerStarted","Data":"83294e8fd0ffd2ddb50c22f33fde7e04fada9fd4f1943ec250534d4c54a3dceb"} Jul 15 16:40:38.298046 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:38.298003 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-162.ec2.internal" podStartSLOduration=24.297986008 podStartE2EDuration="24.297986008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:40:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:40:37.288403634 +0000 UTC m=+23.715495718" watchObservedRunningTime="2026-07-15 16:40:38.297986008 +0000 UTC m=+24.725078092" Jul 15 16:40:38.298667 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:38.298631 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkbqd" podStartSLOduration=3.308355717 podStartE2EDuration="24.298621433s" totalImagesPullingTime="20.990265716s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:40:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:40:38.297966283 +0000 UTC m=+24.725058403" watchObservedRunningTime="2026-07-15 16:40:38.298621433 +0000 UTC m=+24.725713515" Jul 15 16:40:38.988769 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:38.988704 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bwv27" Jul 15 16:40:38.989502 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:38.989476 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bwv27" Jul 15 16:40:39.167000 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:39.166965 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cp4kd" Jul 15 16:40:39.167183 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:39.167109 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cp4kd" podUID="07a4919e-5119-4287-8068-6fbcea6161de" Jul 15 16:40:39.281522 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:39.281440 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bwv27" Jul 15 16:40:39.282050 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:39.282033 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bwv27" Jul 15 16:40:40.167350 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:40.167317 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqnw5" Jul 15 16:40:40.167526 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:40.167357 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8kzck" Jul 15 16:40:40.167526 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:40.167446 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqnw5" podUID="f0c2df6c-3310-45cb-bc73-ae2693ee0761" Jul 15 16:40:40.167640 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:40.167572 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8kzck" podUID="0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e" Jul 15 16:40:41.166626 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:41.166467 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cp4kd" Jul 15 16:40:41.167291 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:41.166699 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cp4kd" podUID="07a4919e-5119-4287-8068-6fbcea6161de" Jul 15 16:40:41.288138 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:41.288115 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxsr7_1e30c2c6-c7eb-42ca-add5-239c71eafd0d/ovn-acl-logging/0.log" Jul 15 16:40:41.288515 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:41.288491 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" event={"ID":"1e30c2c6-c7eb-42ca-add5-239c71eafd0d","Type":"ContainerStarted","Data":"3e90f5f69fba172aa1c62437aa38217b285a43dcae5ad168f66a784dca7920d0"} Jul 15 16:40:41.288734 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:41.288708 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:41.288866 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:41.288796 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:41.288941 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:41.288924 2559 scope.go:117] "RemoveContainer" containerID="29ce8003ced5af81ddc39e29878b42d3fedd5b449f31c4c6c1520ce7aa71fc1a" Jul 15 16:40:41.290435 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:41.290410 2559 generic.go:356] "Generic (PLEG): container finished" podID="e7f78480-9e9a-488a-9cfa-ba14ad74e3e8" containerID="f3d9269b681d312db45bf73c6048ea31a19c7a86209417dfd434945a2b5b78d2" exitCode=0 Jul 15 16:40:41.290538 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:41.290490 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cjrnr" event={"ID":"e7f78480-9e9a-488a-9cfa-ba14ad74e3e8","Type":"ContainerDied","Data":"f3d9269b681d312db45bf73c6048ea31a19c7a86209417dfd434945a2b5b78d2"} Jul 15 16:40:41.304224 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:41.304207 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:42.166663 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:42.166631 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8kzck" Jul 15 16:40:42.167037 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:42.166744 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8kzck" podUID="0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e" Jul 15 16:40:42.167037 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:42.166805 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqnw5" Jul 15 16:40:42.167037 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:42.166909 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqnw5" podUID="f0c2df6c-3310-45cb-bc73-ae2693ee0761" Jul 15 16:40:42.295888 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:42.295839 2559 generic.go:356] "Generic (PLEG): container finished" podID="e7f78480-9e9a-488a-9cfa-ba14ad74e3e8" containerID="a8141b299448840ed61d083f71232c32e089052e1975643565a540d1605babd8" exitCode=0 Jul 15 16:40:42.296428 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:42.295950 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cjrnr" event={"ID":"e7f78480-9e9a-488a-9cfa-ba14ad74e3e8","Type":"ContainerDied","Data":"a8141b299448840ed61d083f71232c32e089052e1975643565a540d1605babd8"} Jul 15 16:40:42.302251 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:42.302228 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxsr7_1e30c2c6-c7eb-42ca-add5-239c71eafd0d/ovn-acl-logging/0.log" Jul 15 16:40:42.302627 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:42.302610 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" event={"ID":"1e30c2c6-c7eb-42ca-add5-239c71eafd0d","Type":"ContainerStarted","Data":"cdf92c273430af2288de5beece710c16ab97d46ad3fb71de24fff76cb8090cae"} Jul 15 16:40:42.302947 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:42.302927 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:42.307795 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:42.307744 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8kzck"] Jul 15 16:40:42.307868 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:42.307841 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8kzck" Jul 15 16:40:42.307964 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:42.307925 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8kzck" podUID="0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e" Jul 15 16:40:42.311196 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:42.310999 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wqnw5"] Jul 15 16:40:42.311285 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:42.311216 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqnw5" Jul 15 16:40:42.311340 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:42.311286 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqnw5" podUID="f0c2df6c-3310-45cb-bc73-ae2693ee0761" Jul 15 16:40:42.311657 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:42.311632 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cp4kd"] Jul 15 16:40:42.311780 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:42.311737 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cp4kd" Jul 15 16:40:42.311879 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:42.311861 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cp4kd" podUID="07a4919e-5119-4287-8068-6fbcea6161de" Jul 15 16:40:42.319122 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:42.319103 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:40:42.339900 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:42.339863 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" podStartSLOduration=9.619479568 podStartE2EDuration="28.339851602s" totalImagesPullingTime="18.720372034s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:40:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:40:42.339633462 +0000 UTC m=+28.766725567" watchObservedRunningTime="2026-07-15 16:40:42.339851602 +0000 UTC m=+28.766943684" Jul 15 16:40:44.167715 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:44.167682 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cp4kd" Jul 15 16:40:44.168064 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:44.167789 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cp4kd" podUID="07a4919e-5119-4287-8068-6fbcea6161de" Jul 15 16:40:44.168064 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:44.167891 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqnw5" Jul 15 16:40:44.168064 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:44.167912 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8kzck" Jul 15 16:40:44.168064 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:44.168001 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqnw5" podUID="f0c2df6c-3310-45cb-bc73-ae2693ee0761" Jul 15 16:40:44.168202 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:44.168093 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8kzck" podUID="0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e" Jul 15 16:40:44.309080 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:44.309051 2559 generic.go:356] "Generic (PLEG): container finished" podID="e7f78480-9e9a-488a-9cfa-ba14ad74e3e8" containerID="28831b46eb50be832bbf444e3a240d2f7252bb4b9f7e9818dd965fa4f7916b62" exitCode=0 Jul 15 16:40:44.309219 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:44.309132 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cjrnr" event={"ID":"e7f78480-9e9a-488a-9cfa-ba14ad74e3e8","Type":"ContainerDied","Data":"28831b46eb50be832bbf444e3a240d2f7252bb4b9f7e9818dd965fa4f7916b62"} Jul 15 16:40:46.166545 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:46.166516 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqnw5" Jul 15 16:40:46.167062 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:46.166516 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cp4kd" Jul 15 16:40:46.167062 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:46.166615 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqnw5" podUID="f0c2df6c-3310-45cb-bc73-ae2693ee0761" Jul 15 16:40:46.167062 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:46.166717 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cp4kd" podUID="07a4919e-5119-4287-8068-6fbcea6161de" Jul 15 16:40:46.167062 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:46.166529 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8kzck" Jul 15 16:40:46.167062 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:46.166823 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8kzck" podUID="0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e" Jul 15 16:40:47.763671 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:47.763643 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07a4919e-5119-4287-8068-6fbcea6161de-metrics-certs\") pod \"network-metrics-daemon-cp4kd\" (UID: \"07a4919e-5119-4287-8068-6fbcea6161de\") " pod="openshift-multus/network-metrics-daemon-cp4kd" Jul 15 16:40:47.764002 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:47.763686 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e-original-pull-secret\") pod \"global-pull-secret-syncer-8kzck\" (UID: \"0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e\") " pod="kube-system/global-pull-secret-syncer-8kzck" Jul 15 16:40:47.764002 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:47.763791 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 16:40:47.764002 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:47.763828 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 16:40:47.764002 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:47.763846 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07a4919e-5119-4287-8068-6fbcea6161de-metrics-certs podName:07a4919e-5119-4287-8068-6fbcea6161de nodeName:}" failed. No retries permitted until 2026-07-15 16:41:19.763830127 +0000 UTC m=+66.190922188 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07a4919e-5119-4287-8068-6fbcea6161de-metrics-certs") pod "network-metrics-daemon-cp4kd" (UID: "07a4919e-5119-4287-8068-6fbcea6161de") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 16:40:47.764002 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:47.763873 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e-original-pull-secret podName:0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e nodeName:}" failed. No retries permitted until 2026-07-15 16:41:19.763859348 +0000 UTC m=+66.190951413 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e-original-pull-secret") pod "global-pull-secret-syncer-8kzck" (UID: "0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e") : object "kube-system"/"original-pull-secret" not registered Jul 15 16:40:47.864051 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:47.863985 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn7nq\" (UniqueName: \"kubernetes.io/projected/f0c2df6c-3310-45cb-bc73-ae2693ee0761-kube-api-access-sn7nq\") pod \"network-check-target-wqnw5\" (UID: \"f0c2df6c-3310-45cb-bc73-ae2693ee0761\") " pod="openshift-network-diagnostics/network-check-target-wqnw5" Jul 15 16:40:47.864147 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:47.864090 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 16:40:47.864147 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:47.864104 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 16:40:47.864147 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:47.864113 2559 projected.go:196] Error preparing data for projected volume kube-api-access-sn7nq for pod openshift-network-diagnostics/network-check-target-wqnw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 16:40:47.864243 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:47.864156 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0c2df6c-3310-45cb-bc73-ae2693ee0761-kube-api-access-sn7nq podName:f0c2df6c-3310-45cb-bc73-ae2693ee0761 nodeName:}" failed. No retries permitted until 2026-07-15 16:41:19.864141629 +0000 UTC m=+66.291233707 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-sn7nq" (UniqueName: "kubernetes.io/projected/f0c2df6c-3310-45cb-bc73-ae2693ee0761-kube-api-access-sn7nq") pod "network-check-target-wqnw5" (UID: "f0c2df6c-3310-45cb-bc73-ae2693ee0761") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 16:40:47.907856 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:47.907832 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-162.ec2.internal" event="NodeReady" Jul 15 16:40:47.907950 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:47.907917 2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 15 16:40:47.951174 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:47.951152 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nqjzl"] Jul 15 16:40:47.953398 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:47.953381 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nqjzl" Jul 15 16:40:47.953769 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:47.953737 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-tp2cw"] Jul 15 16:40:47.955515 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:47.955501 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tp2cw" Jul 15 16:40:47.955864 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:47.955846 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 15 16:40:47.955946 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:47.955877 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 15 16:40:47.956007 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:47.955957 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6gzkx\"" Jul 15 16:40:47.957566 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:47.957547 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 15 16:40:47.957647 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:47.957584 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-554wc\"" Jul 15 16:40:47.957647 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:47.957622 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 15 16:40:47.957946 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:47.957933 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 15 16:40:47.964877 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:47.964377 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nqjzl"] Jul 15 16:40:47.967698 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:47.967679 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tp2cw"] Jul 15 16:40:48.066243 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:48.066220 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vp4r\" (UniqueName: \"kubernetes.io/projected/ebf98561-bc05-4673-939a-5dedebfefff1-kube-api-access-2vp4r\") pod \"ingress-canary-tp2cw\" (UID: \"ebf98561-bc05-4673-939a-5dedebfefff1\") " pod="openshift-ingress-canary/ingress-canary-tp2cw" Jul 15 16:40:48.066349 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:48.066262 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a0eef5ad-3412-4990-b896-87e4444303d1-config-volume\") pod \"dns-default-nqjzl\" (UID: \"a0eef5ad-3412-4990-b896-87e4444303d1\") " pod="openshift-dns/dns-default-nqjzl" Jul 15 16:40:48.066349 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:48.066284 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0eef5ad-3412-4990-b896-87e4444303d1-metrics-tls\") pod \"dns-default-nqjzl\" (UID: \"a0eef5ad-3412-4990-b896-87e4444303d1\") " pod="openshift-dns/dns-default-nqjzl" Jul 15 16:40:48.066349 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:48.066307 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h56pq\" (UniqueName: \"kubernetes.io/projected/a0eef5ad-3412-4990-b896-87e4444303d1-kube-api-access-h56pq\") pod \"dns-default-nqjzl\" (UID: \"a0eef5ad-3412-4990-b896-87e4444303d1\") " pod="openshift-dns/dns-default-nqjzl" Jul 15 16:40:48.066488 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:48.066353 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ebf98561-bc05-4673-939a-5dedebfefff1-cert\") pod \"ingress-canary-tp2cw\" (UID: \"ebf98561-bc05-4673-939a-5dedebfefff1\") " pod="openshift-ingress-canary/ingress-canary-tp2cw" Jul 15 16:40:48.066488 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:48.066383 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0eef5ad-3412-4990-b896-87e4444303d1-tmp-dir\") pod \"dns-default-nqjzl\" (UID: \"a0eef5ad-3412-4990-b896-87e4444303d1\") " pod="openshift-dns/dns-default-nqjzl" Jul 15 16:40:48.166810 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:48.166785 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cp4kd" Jul 15 16:40:48.166902 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:48.166830 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0eef5ad-3412-4990-b896-87e4444303d1-tmp-dir\") pod \"dns-default-nqjzl\" (UID: \"a0eef5ad-3412-4990-b896-87e4444303d1\") " pod="openshift-dns/dns-default-nqjzl" Jul 15 16:40:48.166902 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:48.166790 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqnw5" Jul 15 16:40:48.166902 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:48.166796 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8kzck" Jul 15 16:40:48.167055 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:48.166989 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vp4r\" (UniqueName: \"kubernetes.io/projected/ebf98561-bc05-4673-939a-5dedebfefff1-kube-api-access-2vp4r\") pod \"ingress-canary-tp2cw\" (UID: \"ebf98561-bc05-4673-939a-5dedebfefff1\") " pod="openshift-ingress-canary/ingress-canary-tp2cw" Jul 15 16:40:48.167055 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:48.167029 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a0eef5ad-3412-4990-b896-87e4444303d1-config-volume\") pod \"dns-default-nqjzl\" (UID: \"a0eef5ad-3412-4990-b896-87e4444303d1\") " pod="openshift-dns/dns-default-nqjzl" Jul 15 16:40:48.167152 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:48.167055 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0eef5ad-3412-4990-b896-87e4444303d1-metrics-tls\") pod \"dns-default-nqjzl\" (UID: \"a0eef5ad-3412-4990-b896-87e4444303d1\") " pod="openshift-dns/dns-default-nqjzl" Jul 15 16:40:48.167152 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:48.167077 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h56pq\" (UniqueName: \"kubernetes.io/projected/a0eef5ad-3412-4990-b896-87e4444303d1-kube-api-access-h56pq\") pod \"dns-default-nqjzl\" (UID: \"a0eef5ad-3412-4990-b896-87e4444303d1\") " pod="openshift-dns/dns-default-nqjzl" Jul 15 16:40:48.167152 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:48.167146 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ebf98561-bc05-4673-939a-5dedebfefff1-cert\") pod \"ingress-canary-tp2cw\" (UID: \"ebf98561-bc05-4673-939a-5dedebfefff1\") " pod="openshift-ingress-canary/ingress-canary-tp2cw" Jul 15 16:40:48.167291 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:48.167162 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0eef5ad-3412-4990-b896-87e4444303d1-tmp-dir\") pod \"dns-default-nqjzl\" (UID: \"a0eef5ad-3412-4990-b896-87e4444303d1\") " pod="openshift-dns/dns-default-nqjzl" Jul 15 16:40:48.167291 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:48.167259 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 16:40:48.167381 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:48.167311 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0eef5ad-3412-4990-b896-87e4444303d1-metrics-tls podName:a0eef5ad-3412-4990-b896-87e4444303d1 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:48.66729116 +0000 UTC m=+35.094383241 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0eef5ad-3412-4990-b896-87e4444303d1-metrics-tls") pod "dns-default-nqjzl" (UID: "a0eef5ad-3412-4990-b896-87e4444303d1") : secret "dns-default-metrics-tls" not found Jul 15 16:40:48.167805 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:48.167787 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a0eef5ad-3412-4990-b896-87e4444303d1-config-volume\") pod \"dns-default-nqjzl\" (UID: \"a0eef5ad-3412-4990-b896-87e4444303d1\") " pod="openshift-dns/dns-default-nqjzl" Jul 15 16:40:48.169938 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:48.169762 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 16:40:48.169938 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:48.169842 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 16:40:48.169938 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:48.169921 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 16:40:48.170119 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:48.169989 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5p9xs\"" Jul 15 16:40:48.170119 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:48.170115 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nlftd\"" Jul 15 16:40:48.170202 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:48.170186 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 16:40:48.171700 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:48.171683 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ebf98561-bc05-4673-939a-5dedebfefff1-cert\") pod \"ingress-canary-tp2cw\" (UID: \"ebf98561-bc05-4673-939a-5dedebfefff1\") " pod="openshift-ingress-canary/ingress-canary-tp2cw" Jul 15 16:40:48.176179 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:48.176151 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vp4r\" (UniqueName: \"kubernetes.io/projected/ebf98561-bc05-4673-939a-5dedebfefff1-kube-api-access-2vp4r\") pod \"ingress-canary-tp2cw\" (UID: \"ebf98561-bc05-4673-939a-5dedebfefff1\") " pod="openshift-ingress-canary/ingress-canary-tp2cw" Jul 15 16:40:48.176273 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:48.176237 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h56pq\" (UniqueName: \"kubernetes.io/projected/a0eef5ad-3412-4990-b896-87e4444303d1-kube-api-access-h56pq\") pod \"dns-default-nqjzl\" (UID: \"a0eef5ad-3412-4990-b896-87e4444303d1\") " pod="openshift-dns/dns-default-nqjzl" Jul 15 16:40:48.269841 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:48.269822 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tp2cw" Jul 15 16:40:48.393628 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:48.393481 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tp2cw"] Jul 15 16:40:48.396820 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:40:48.396795 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebf98561_bc05_4673_939a_5dedebfefff1.slice/crio-83c084f9edadf1f2f3148e63da5c968f0be780dfbcac437d3b15cebc42fffb91 WatchSource:0}: Error finding container 83c084f9edadf1f2f3148e63da5c968f0be780dfbcac437d3b15cebc42fffb91: Status 404 returned error can't find the container with id 83c084f9edadf1f2f3148e63da5c968f0be780dfbcac437d3b15cebc42fffb91 Jul 15 16:40:48.670214 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:48.670179 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0eef5ad-3412-4990-b896-87e4444303d1-metrics-tls\") pod \"dns-default-nqjzl\" (UID: \"a0eef5ad-3412-4990-b896-87e4444303d1\") " pod="openshift-dns/dns-default-nqjzl" Jul 15 16:40:48.670356 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:48.670316 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 16:40:48.670399 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:48.670384 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0eef5ad-3412-4990-b896-87e4444303d1-metrics-tls podName:a0eef5ad-3412-4990-b896-87e4444303d1 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:49.670369072 +0000 UTC m=+36.097461133 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0eef5ad-3412-4990-b896-87e4444303d1-metrics-tls") pod "dns-default-nqjzl" (UID: "a0eef5ad-3412-4990-b896-87e4444303d1") : secret "dns-default-metrics-tls" not found Jul 15 16:40:49.320462 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:49.320417 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tp2cw" event={"ID":"ebf98561-bc05-4673-939a-5dedebfefff1","Type":"ContainerStarted","Data":"83c084f9edadf1f2f3148e63da5c968f0be780dfbcac437d3b15cebc42fffb91"} Jul 15 16:40:49.678206 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:49.678164 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0eef5ad-3412-4990-b896-87e4444303d1-metrics-tls\") pod \"dns-default-nqjzl\" (UID: \"a0eef5ad-3412-4990-b896-87e4444303d1\") " pod="openshift-dns/dns-default-nqjzl" Jul 15 16:40:49.678359 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:49.678319 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 16:40:49.678434 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:49.678386 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0eef5ad-3412-4990-b896-87e4444303d1-metrics-tls podName:a0eef5ad-3412-4990-b896-87e4444303d1 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:51.678364661 +0000 UTC m=+38.105456725 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0eef5ad-3412-4990-b896-87e4444303d1-metrics-tls") pod "dns-default-nqjzl" (UID: "a0eef5ad-3412-4990-b896-87e4444303d1") : secret "dns-default-metrics-tls" not found Jul 15 16:40:51.327208 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:51.327176 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tp2cw" event={"ID":"ebf98561-bc05-4673-939a-5dedebfefff1","Type":"ContainerStarted","Data":"09e8b3787ac1d2490759456ccfe07068a3aae7e49df1f4b2b05f4eb444365532"} Jul 15 16:40:51.343060 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:51.343020 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-tp2cw" podStartSLOduration=2.039198909 podStartE2EDuration="4.343005781s" totalImagesPullingTime="2.303806872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:40:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:40:51.341650849 +0000 UTC m=+37.768742932" watchObservedRunningTime="2026-07-15 16:40:51.343005781 +0000 UTC m=+37.770097880" Jul 15 16:40:51.695332 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:51.695292 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0eef5ad-3412-4990-b896-87e4444303d1-metrics-tls\") pod \"dns-default-nqjzl\" (UID: \"a0eef5ad-3412-4990-b896-87e4444303d1\") " pod="openshift-dns/dns-default-nqjzl" Jul 15 16:40:51.695486 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:51.695448 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 16:40:51.695530 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:51.695523 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0eef5ad-3412-4990-b896-87e4444303d1-metrics-tls podName:a0eef5ad-3412-4990-b896-87e4444303d1 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:55.695506372 +0000 UTC m=+42.122598433 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0eef5ad-3412-4990-b896-87e4444303d1-metrics-tls") pod "dns-default-nqjzl" (UID: "a0eef5ad-3412-4990-b896-87e4444303d1") : secret "dns-default-metrics-tls" not found Jul 15 16:40:53.334049 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:53.333851 2559 generic.go:356] "Generic (PLEG): container finished" podID="e7f78480-9e9a-488a-9cfa-ba14ad74e3e8" containerID="ebdf29cf96e038552776370b28bb68b967fbd71a3c5c31b2b40778e64a74d598" exitCode=0 Jul 15 16:40:53.334049 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:53.333933 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cjrnr" event={"ID":"e7f78480-9e9a-488a-9cfa-ba14ad74e3e8","Type":"ContainerDied","Data":"ebdf29cf96e038552776370b28bb68b967fbd71a3c5c31b2b40778e64a74d598"} Jul 15 16:40:54.339053 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:54.339016 2559 generic.go:356] "Generic (PLEG): container finished" podID="e7f78480-9e9a-488a-9cfa-ba14ad74e3e8" containerID="1b628aae8cf879b4c12062a993f832ae8b8f87f6e66b9f360614b4d0c994fffa" exitCode=0 Jul 15 16:40:54.339450 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:54.339063 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cjrnr" event={"ID":"e7f78480-9e9a-488a-9cfa-ba14ad74e3e8","Type":"ContainerDied","Data":"1b628aae8cf879b4c12062a993f832ae8b8f87f6e66b9f360614b4d0c994fffa"} Jul 15 16:40:55.344257 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:55.344223 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cjrnr" event={"ID":"e7f78480-9e9a-488a-9cfa-ba14ad74e3e8","Type":"ContainerStarted","Data":"ceb5291c52cfb8d4bf611bf2a4619cac1bc4aa40096bf48eaa97f4650b3ae6cb"} Jul 15 16:40:55.382814 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:55.382766 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cjrnr" podStartSLOduration=8.021029057 podStartE2EDuration="41.382733907s" totalImagesPullingTime="33.36170485s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:40:14 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:40:55.378450183 +0000 UTC m=+41.805542266" watchObservedRunningTime="2026-07-15 16:40:55.382733907 +0000 UTC m=+41.809825990" Jul 15 16:40:55.720904 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:40:55.720872 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0eef5ad-3412-4990-b896-87e4444303d1-metrics-tls\") pod \"dns-default-nqjzl\" (UID: \"a0eef5ad-3412-4990-b896-87e4444303d1\") " pod="openshift-dns/dns-default-nqjzl" Jul 15 16:40:55.721027 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:55.721015 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 16:40:55.721079 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:40:55.721069 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0eef5ad-3412-4990-b896-87e4444303d1-metrics-tls podName:a0eef5ad-3412-4990-b896-87e4444303d1 nodeName:}" failed. No retries permitted until 2026-07-15 16:41:03.721055402 +0000 UTC m=+50.148147467 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0eef5ad-3412-4990-b896-87e4444303d1-metrics-tls") pod "dns-default-nqjzl" (UID: "a0eef5ad-3412-4990-b896-87e4444303d1") : secret "dns-default-metrics-tls" not found Jul 15 16:41:03.773961 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:41:03.773919 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0eef5ad-3412-4990-b896-87e4444303d1-metrics-tls\") pod \"dns-default-nqjzl\" (UID: \"a0eef5ad-3412-4990-b896-87e4444303d1\") " pod="openshift-dns/dns-default-nqjzl" Jul 15 16:41:03.774592 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:41:03.774108 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 16:41:03.774592 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:41:03.774196 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0eef5ad-3412-4990-b896-87e4444303d1-metrics-tls podName:a0eef5ad-3412-4990-b896-87e4444303d1 nodeName:}" failed. No retries permitted until 2026-07-15 16:41:19.774174075 +0000 UTC m=+66.201266137 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0eef5ad-3412-4990-b896-87e4444303d1-metrics-tls") pod "dns-default-nqjzl" (UID: "a0eef5ad-3412-4990-b896-87e4444303d1") : secret "dns-default-metrics-tls" not found Jul 15 16:41:14.328342 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:41:14.328319 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cxsr7" Jul 15 16:41:19.779385 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:41:19.779348 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07a4919e-5119-4287-8068-6fbcea6161de-metrics-certs\") pod \"network-metrics-daemon-cp4kd\" (UID: \"07a4919e-5119-4287-8068-6fbcea6161de\") " pod="openshift-multus/network-metrics-daemon-cp4kd" Jul 15 16:41:19.779874 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:41:19.779393 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0eef5ad-3412-4990-b896-87e4444303d1-metrics-tls\") pod \"dns-default-nqjzl\" (UID: \"a0eef5ad-3412-4990-b896-87e4444303d1\") " pod="openshift-dns/dns-default-nqjzl" Jul 15 16:41:19.779874 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:41:19.779424 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e-original-pull-secret\") pod \"global-pull-secret-syncer-8kzck\" (UID: \"0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e\") " pod="kube-system/global-pull-secret-syncer-8kzck" Jul 15 16:41:19.779874 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:41:19.779510 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 16:41:19.779874 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:41:19.779583 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0eef5ad-3412-4990-b896-87e4444303d1-metrics-tls podName:a0eef5ad-3412-4990-b896-87e4444303d1 nodeName:}" failed. No retries permitted until 2026-07-15 16:41:51.779565081 +0000 UTC m=+98.206657148 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0eef5ad-3412-4990-b896-87e4444303d1-metrics-tls") pod "dns-default-nqjzl" (UID: "a0eef5ad-3412-4990-b896-87e4444303d1") : secret "dns-default-metrics-tls" not found Jul 15 16:41:19.782254 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:41:19.782233 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 16:41:19.782359 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:41:19.782342 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 16:41:19.790511 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:41:19.790493 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 15 16:41:19.790616 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:41:19.790561 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07a4919e-5119-4287-8068-6fbcea6161de-metrics-certs podName:07a4919e-5119-4287-8068-6fbcea6161de nodeName:}" failed. No retries permitted until 2026-07-15 16:42:23.790542955 +0000 UTC m=+130.217635030 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07a4919e-5119-4287-8068-6fbcea6161de-metrics-certs") pod "network-metrics-daemon-cp4kd" (UID: "07a4919e-5119-4287-8068-6fbcea6161de") : secret "metrics-daemon-secret" not found Jul 15 16:41:19.794122 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:41:19.794101 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e-original-pull-secret\") pod \"global-pull-secret-syncer-8kzck\" (UID: \"0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e\") " pod="kube-system/global-pull-secret-syncer-8kzck" Jul 15 16:41:19.879987 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:41:19.879955 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn7nq\" (UniqueName: \"kubernetes.io/projected/f0c2df6c-3310-45cb-bc73-ae2693ee0761-kube-api-access-sn7nq\") pod \"network-check-target-wqnw5\" (UID: \"f0c2df6c-3310-45cb-bc73-ae2693ee0761\") " pod="openshift-network-diagnostics/network-check-target-wqnw5" Jul 15 16:41:19.882126 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:41:19.882111 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 16:41:19.892650 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:41:19.892630 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 16:41:19.903525 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:41:19.903506 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn7nq\" (UniqueName: \"kubernetes.io/projected/f0c2df6c-3310-45cb-bc73-ae2693ee0761-kube-api-access-sn7nq\") pod \"network-check-target-wqnw5\" (UID: \"f0c2df6c-3310-45cb-bc73-ae2693ee0761\") " pod="openshift-network-diagnostics/network-check-target-wqnw5" Jul 15 16:41:19.993205 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:41:19.993185 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nlftd\"" Jul 15 16:41:19.994861 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:41:19.994848 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8kzck" Jul 15 16:41:20.001070 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:41:20.001052 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqnw5" Jul 15 16:41:20.139919 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:41:20.139893 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wqnw5"] Jul 15 16:41:20.142773 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:41:20.142734 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0c2df6c_3310_45cb_bc73_ae2693ee0761.slice/crio-45ef539af64fa1ea5c71def15074bcbfbb17e0b5b75c4bd4c70e82ccfc54b3c6 WatchSource:0}: Error finding container 45ef539af64fa1ea5c71def15074bcbfbb17e0b5b75c4bd4c70e82ccfc54b3c6: Status 404 returned error can't find the container with id 45ef539af64fa1ea5c71def15074bcbfbb17e0b5b75c4bd4c70e82ccfc54b3c6 Jul 15 16:41:20.151025 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:41:20.151005 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8kzck"] Jul 15 16:41:20.153690 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:41:20.153666 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dcb64c6_1cc0_4bb8_b0eb_f97eb952dd0e.slice/crio-f1b2530055b7166a201e1974944a5b0bdd09f46fff92a06c38869cf638fe774e WatchSource:0}: Error finding container f1b2530055b7166a201e1974944a5b0bdd09f46fff92a06c38869cf638fe774e: Status 404 returned error can't find the container with id f1b2530055b7166a201e1974944a5b0bdd09f46fff92a06c38869cf638fe774e Jul 15 16:41:20.398520 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:41:20.398465 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wqnw5" event={"ID":"f0c2df6c-3310-45cb-bc73-ae2693ee0761","Type":"ContainerStarted","Data":"45ef539af64fa1ea5c71def15074bcbfbb17e0b5b75c4bd4c70e82ccfc54b3c6"} Jul 15 16:41:20.399416 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:41:20.399398 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8kzck" event={"ID":"0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e","Type":"ContainerStarted","Data":"f1b2530055b7166a201e1974944a5b0bdd09f46fff92a06c38869cf638fe774e"} Jul 15 16:41:25.414521 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:41:25.414484 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wqnw5" event={"ID":"f0c2df6c-3310-45cb-bc73-ae2693ee0761","Type":"ContainerStarted","Data":"924886c1a32e784a4d0b1688a10d55b72d3e11d6cd1b9cffcb73d24e7e8ba16c"} Jul 15 16:41:25.414974 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:41:25.414576 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wqnw5" Jul 15 16:41:25.415912 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:41:25.415889 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8kzck" event={"ID":"0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e","Type":"ContainerStarted","Data":"e4f06fcc6ffbabfbb84413451c14e908e3999397a75a33c502e0a3e9fcfd12b0"} Jul 15 16:41:25.431154 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:41:25.431117 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wqnw5" podStartSLOduration=67.048142205 podStartE2EDuration="1m11.431105419s" totalImagesPullingTime="4.382963214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:40:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:41:25.429366228 +0000 UTC m=+71.856458310" watchObservedRunningTime="2026-07-15 16:41:25.431105419 +0000 UTC m=+71.858197480" Jul 15 16:41:25.443566 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:41:25.443530 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8kzck" podStartSLOduration=67.06789208 podStartE2EDuration="1m11.44352013s" totalImagesPullingTime="4.37562805s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:40:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:41:25.443288916 +0000 UTC m=+71.870381001" watchObservedRunningTime="2026-07-15 16:41:25.44352013 +0000 UTC m=+71.870612212" Jul 15 16:41:51.790362 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:41:51.790242 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0eef5ad-3412-4990-b896-87e4444303d1-metrics-tls\") pod \"dns-default-nqjzl\" (UID: \"a0eef5ad-3412-4990-b896-87e4444303d1\") " pod="openshift-dns/dns-default-nqjzl" Jul 15 16:41:51.790863 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:41:51.790369 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 16:41:51.790863 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:41:51.790440 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0eef5ad-3412-4990-b896-87e4444303d1-metrics-tls podName:a0eef5ad-3412-4990-b896-87e4444303d1 nodeName:}" failed. No retries permitted until 2026-07-15 16:42:55.790423303 +0000 UTC m=+162.217515365 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0eef5ad-3412-4990-b896-87e4444303d1-metrics-tls") pod "dns-default-nqjzl" (UID: "a0eef5ad-3412-4990-b896-87e4444303d1") : secret "dns-default-metrics-tls" not found Jul 15 16:41:56.421092 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:41:56.421062 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wqnw5" Jul 15 16:42:23.887500 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:23.887447 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07a4919e-5119-4287-8068-6fbcea6161de-metrics-certs\") pod \"network-metrics-daemon-cp4kd\" (UID: \"07a4919e-5119-4287-8068-6fbcea6161de\") " pod="openshift-multus/network-metrics-daemon-cp4kd" Jul 15 16:42:23.888002 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:42:23.887604 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 15 16:42:23.888002 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:42:23.887672 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07a4919e-5119-4287-8068-6fbcea6161de-metrics-certs podName:07a4919e-5119-4287-8068-6fbcea6161de nodeName:}" failed. No retries permitted until 2026-07-15 16:44:25.887655507 +0000 UTC m=+252.314747568 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07a4919e-5119-4287-8068-6fbcea6161de-metrics-certs") pod "network-metrics-daemon-cp4kd" (UID: "07a4919e-5119-4287-8068-6fbcea6161de") : secret "metrics-daemon-secret" not found Jul 15 16:42:50.963290 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:42:50.963250 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-nqjzl" podUID="a0eef5ad-3412-4990-b896-87e4444303d1" Jul 15 16:42:51.171418 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.171385 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l5kln"] Jul 15 16:42:51.173239 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.173218 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l5kln" Jul 15 16:42:51.174379 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.174360 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-zjt5q"] Jul 15 16:42:51.176032 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.176016 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-vcxdn"] Jul 15 16:42:51.176147 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.176126 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-qmrt4\"" Jul 15 16:42:51.176209 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.176132 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-zjt5q" Jul 15 16:42:51.176209 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.176195 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 15 16:42:51.176549 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.176533 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 15 16:42:51.176611 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.176602 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 15 16:42:51.176771 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.176742 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 15 16:42:51.177847 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.177832 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-vcxdn" Jul 15 16:42:51.179487 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.179469 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 15 16:42:51.179487 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.179467 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 15 16:42:51.179631 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.179487 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-fvz5s\"" Jul 15 16:42:51.180078 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.180057 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 15 16:42:51.180480 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.180059 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 15 16:42:51.180480 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.180062 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 15 16:42:51.180480 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.180292 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-2jdgf\"" Jul 15 16:42:51.180480 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.180398 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 15 16:42:51.183824 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.183808 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l5kln"] Jul 15 16:42:51.184989 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:42:51.184966 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-cp4kd" podUID="07a4919e-5119-4287-8068-6fbcea6161de" Jul 15 16:42:51.186016 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.185999 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 15 16:42:51.190473 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.190453 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-zjt5q"] Jul 15 16:42:51.199292 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.199272 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-vcxdn"] Jul 15 16:42:51.264147 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.264094 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-pxvb5"] Jul 15 16:42:51.266032 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.266018 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-pxvb5" Jul 15 16:42:51.268117 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.268090 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/575cb646-78bd-48f5-9c49-797005605c40-serving-cert\") pod \"service-ca-operator-7695fc6c8c-l5kln\" (UID: \"575cb646-78bd-48f5-9c49-797005605c40\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l5kln" Jul 15 16:42:51.268220 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.268158 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/268a4cb9-c310-4681-91a6-efe9692f8327-config\") pod \"console-operator-7866497494-vcxdn\" (UID: \"268a4cb9-c310-4681-91a6-efe9692f8327\") " pod="openshift-console-operator/console-operator-7866497494-vcxdn" Jul 15 16:42:51.268220 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.268185 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/268a4cb9-c310-4681-91a6-efe9692f8327-serving-cert\") pod \"console-operator-7866497494-vcxdn\" (UID: \"268a4cb9-c310-4681-91a6-efe9692f8327\") " pod="openshift-console-operator/console-operator-7866497494-vcxdn" Jul 15 16:42:51.268220 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.268214 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rffdb\" (UniqueName: \"kubernetes.io/projected/575cb646-78bd-48f5-9c49-797005605c40-kube-api-access-rffdb\") pod \"service-ca-operator-7695fc6c8c-l5kln\" (UID: \"575cb646-78bd-48f5-9c49-797005605c40\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l5kln" Jul 15 16:42:51.268392 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.268256 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrpfc\" (UniqueName: \"kubernetes.io/projected/752e487f-d91a-4af1-ba20-00ae3a06e305-kube-api-access-xrpfc\") pod \"volume-data-source-validator-78495597f6-zjt5q\" (UID: \"752e487f-d91a-4af1-ba20-00ae3a06e305\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-zjt5q" Jul 15 16:42:51.268392 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.268296 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h47f\" (UniqueName: \"kubernetes.io/projected/268a4cb9-c310-4681-91a6-efe9692f8327-kube-api-access-9h47f\") pod \"console-operator-7866497494-vcxdn\" (UID: \"268a4cb9-c310-4681-91a6-efe9692f8327\") " pod="openshift-console-operator/console-operator-7866497494-vcxdn" Jul 15 16:42:51.268392 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.268353 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/268a4cb9-c310-4681-91a6-efe9692f8327-trusted-ca\") pod \"console-operator-7866497494-vcxdn\" (UID: \"268a4cb9-c310-4681-91a6-efe9692f8327\") " pod="openshift-console-operator/console-operator-7866497494-vcxdn" Jul 15 16:42:51.268392 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.268387 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/575cb646-78bd-48f5-9c49-797005605c40-config\") pod \"service-ca-operator-7695fc6c8c-l5kln\" (UID: \"575cb646-78bd-48f5-9c49-797005605c40\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l5kln" Jul 15 16:42:51.269083 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.269062 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-qxzzs\"" Jul 15 16:42:51.269767 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.269731 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-q46z2"] Jul 15 16:42:51.271537 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.271520 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-prhd2"] Jul 15 16:42:51.271648 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.271631 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-q46z2" Jul 15 16:42:51.273515 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.273497 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-prhd2" Jul 15 16:42:51.275004 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.274987 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 15 16:42:51.275097 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.275038 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 15 16:42:51.275167 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.275134 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-x28tv\"" Jul 15 16:42:51.277221 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.277204 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 15 16:42:51.277773 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.277741 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 15 16:42:51.279064 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.279045 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 15 16:42:51.279436 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.279418 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 15 16:42:51.279565 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.279551 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 15 16:42:51.279768 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.279727 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 15 16:42:51.279882 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.279869 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-zqqmp\"" Jul 15 16:42:51.294386 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.294339 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-q46z2"] Jul 15 16:42:51.295083 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.295065 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-prhd2"] Jul 15 16:42:51.316437 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.316414 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-pxvb5"] Jul 15 16:42:51.361615 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.361589 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-wzjfl"] Jul 15 16:42:51.366041 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.366017 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-wzjfl" Jul 15 16:42:51.368566 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.368539 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 15 16:42:51.368684 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.368566 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 15 16:42:51.368684 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.368585 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-s7w4d\"" Jul 15 16:42:51.368813 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.368714 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/efda2baa-1340-49e7-ba0d-3f3765e3ebda-tmp\") pod \"insights-operator-68d9dd94cf-q46z2\" (UID: \"efda2baa-1340-49e7-ba0d-3f3765e3ebda\") " pod="openshift-insights/insights-operator-68d9dd94cf-q46z2" Jul 15 16:42:51.368813 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.368736 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efda2baa-1340-49e7-ba0d-3f3765e3ebda-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-q46z2\" (UID: \"efda2baa-1340-49e7-ba0d-3f3765e3ebda\") " pod="openshift-insights/insights-operator-68d9dd94cf-q46z2" Jul 15 16:42:51.368813 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.368784 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/268a4cb9-c310-4681-91a6-efe9692f8327-config\") pod \"console-operator-7866497494-vcxdn\" (UID: \"268a4cb9-c310-4681-91a6-efe9692f8327\") " pod="openshift-console-operator/console-operator-7866497494-vcxdn" Jul 15 16:42:51.368813 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.368807 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/268a4cb9-c310-4681-91a6-efe9692f8327-serving-cert\") pod \"console-operator-7866497494-vcxdn\" (UID: \"268a4cb9-c310-4681-91a6-efe9692f8327\") " pod="openshift-console-operator/console-operator-7866497494-vcxdn" Jul 15 16:42:51.368945 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.368827 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/efda2baa-1340-49e7-ba0d-3f3765e3ebda-snapshots\") pod \"insights-operator-68d9dd94cf-q46z2\" (UID: \"efda2baa-1340-49e7-ba0d-3f3765e3ebda\") " pod="openshift-insights/insights-operator-68d9dd94cf-q46z2" Jul 15 16:42:51.368945 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.368883 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd25g\" (UniqueName: \"kubernetes.io/projected/efda2baa-1340-49e7-ba0d-3f3765e3ebda-kube-api-access-dd25g\") pod \"insights-operator-68d9dd94cf-q46z2\" (UID: \"efda2baa-1340-49e7-ba0d-3f3765e3ebda\") " pod="openshift-insights/insights-operator-68d9dd94cf-q46z2" Jul 15 16:42:51.368945 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.368911 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rffdb\" (UniqueName: \"kubernetes.io/projected/575cb646-78bd-48f5-9c49-797005605c40-kube-api-access-rffdb\") pod \"service-ca-operator-7695fc6c8c-l5kln\" (UID: \"575cb646-78bd-48f5-9c49-797005605c40\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l5kln" Jul 15 16:42:51.368945 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.368937 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrpfc\" (UniqueName: \"kubernetes.io/projected/752e487f-d91a-4af1-ba20-00ae3a06e305-kube-api-access-xrpfc\") pod \"volume-data-source-validator-78495597f6-zjt5q\" (UID: \"752e487f-d91a-4af1-ba20-00ae3a06e305\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-zjt5q" Jul 15 16:42:51.369120 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.368952 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9h47f\" (UniqueName: \"kubernetes.io/projected/268a4cb9-c310-4681-91a6-efe9692f8327-kube-api-access-9h47f\") pod \"console-operator-7866497494-vcxdn\" (UID: \"268a4cb9-c310-4681-91a6-efe9692f8327\") " pod="openshift-console-operator/console-operator-7866497494-vcxdn" Jul 15 16:42:51.369120 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.368969 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/efda2baa-1340-49e7-ba0d-3f3765e3ebda-serving-cert\") pod \"insights-operator-68d9dd94cf-q46z2\" (UID: \"efda2baa-1340-49e7-ba0d-3f3765e3ebda\") " pod="openshift-insights/insights-operator-68d9dd94cf-q46z2" Jul 15 16:42:51.369120 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.368996 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/268a4cb9-c310-4681-91a6-efe9692f8327-trusted-ca\") pod \"console-operator-7866497494-vcxdn\" (UID: \"268a4cb9-c310-4681-91a6-efe9692f8327\") " pod="openshift-console-operator/console-operator-7866497494-vcxdn" Jul 15 16:42:51.369120 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.369020 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmbcg\" (UniqueName: \"kubernetes.io/projected/eb96ca78-5732-42a1-a9e1-0142af0faea7-kube-api-access-fmbcg\") pod \"cluster-samples-operator-65db858894-prhd2\" (UID: \"eb96ca78-5732-42a1-a9e1-0142af0faea7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-prhd2" Jul 15 16:42:51.369120 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.369048 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efda2baa-1340-49e7-ba0d-3f3765e3ebda-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-q46z2\" (UID: \"efda2baa-1340-49e7-ba0d-3f3765e3ebda\") " pod="openshift-insights/insights-operator-68d9dd94cf-q46z2" Jul 15 16:42:51.369120 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.369077 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/575cb646-78bd-48f5-9c49-797005605c40-config\") pod \"service-ca-operator-7695fc6c8c-l5kln\" (UID: \"575cb646-78bd-48f5-9c49-797005605c40\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l5kln" Jul 15 16:42:51.369435 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.369123 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjdck\" (UniqueName: \"kubernetes.io/projected/72151350-256b-41f4-a03e-50297adfd668-kube-api-access-vjdck\") pod \"network-check-source-869dcfcdcd-pxvb5\" (UID: \"72151350-256b-41f4-a03e-50297adfd668\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-pxvb5" Jul 15 16:42:51.369435 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.369154 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/575cb646-78bd-48f5-9c49-797005605c40-serving-cert\") pod \"service-ca-operator-7695fc6c8c-l5kln\" (UID: \"575cb646-78bd-48f5-9c49-797005605c40\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l5kln" Jul 15 16:42:51.369435 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.369177 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb96ca78-5732-42a1-a9e1-0142af0faea7-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-prhd2\" (UID: \"eb96ca78-5732-42a1-a9e1-0142af0faea7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-prhd2" Jul 15 16:42:51.369577 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.369500 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/268a4cb9-c310-4681-91a6-efe9692f8327-config\") pod \"console-operator-7866497494-vcxdn\" (UID: \"268a4cb9-c310-4681-91a6-efe9692f8327\") " pod="openshift-console-operator/console-operator-7866497494-vcxdn" Jul 15 16:42:51.369772 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.369699 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/575cb646-78bd-48f5-9c49-797005605c40-config\") pod \"service-ca-operator-7695fc6c8c-l5kln\" (UID: \"575cb646-78bd-48f5-9c49-797005605c40\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l5kln" Jul 15 16:42:51.370070 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.370049 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/268a4cb9-c310-4681-91a6-efe9692f8327-trusted-ca\") pod \"console-operator-7866497494-vcxdn\" (UID: \"268a4cb9-c310-4681-91a6-efe9692f8327\") " pod="openshift-console-operator/console-operator-7866497494-vcxdn" Jul 15 16:42:51.371305 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.371285 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/575cb646-78bd-48f5-9c49-797005605c40-serving-cert\") pod \"service-ca-operator-7695fc6c8c-l5kln\" (UID: \"575cb646-78bd-48f5-9c49-797005605c40\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l5kln" Jul 15 16:42:51.371640 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.371618 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/268a4cb9-c310-4681-91a6-efe9692f8327-serving-cert\") pod \"console-operator-7866497494-vcxdn\" (UID: \"268a4cb9-c310-4681-91a6-efe9692f8327\") " pod="openshift-console-operator/console-operator-7866497494-vcxdn" Jul 15 16:42:51.372433 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.372415 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-wzjfl"] Jul 15 16:42:51.387328 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.387304 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h47f\" (UniqueName: \"kubernetes.io/projected/268a4cb9-c310-4681-91a6-efe9692f8327-kube-api-access-9h47f\") pod \"console-operator-7866497494-vcxdn\" (UID: \"268a4cb9-c310-4681-91a6-efe9692f8327\") " pod="openshift-console-operator/console-operator-7866497494-vcxdn" Jul 15 16:42:51.387532 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.387516 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rffdb\" (UniqueName: \"kubernetes.io/projected/575cb646-78bd-48f5-9c49-797005605c40-kube-api-access-rffdb\") pod \"service-ca-operator-7695fc6c8c-l5kln\" (UID: \"575cb646-78bd-48f5-9c49-797005605c40\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l5kln" Jul 15 16:42:51.388032 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.388016 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrpfc\" (UniqueName: \"kubernetes.io/projected/752e487f-d91a-4af1-ba20-00ae3a06e305-kube-api-access-xrpfc\") pod \"volume-data-source-validator-78495597f6-zjt5q\" (UID: \"752e487f-d91a-4af1-ba20-00ae3a06e305\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-zjt5q" Jul 15 16:42:51.469507 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.469486 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/efda2baa-1340-49e7-ba0d-3f3765e3ebda-serving-cert\") pod \"insights-operator-68d9dd94cf-q46z2\" (UID: \"efda2baa-1340-49e7-ba0d-3f3765e3ebda\") " pod="openshift-insights/insights-operator-68d9dd94cf-q46z2" Jul 15 16:42:51.469622 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.469517 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmbcg\" (UniqueName: \"kubernetes.io/projected/eb96ca78-5732-42a1-a9e1-0142af0faea7-kube-api-access-fmbcg\") pod \"cluster-samples-operator-65db858894-prhd2\" (UID: \"eb96ca78-5732-42a1-a9e1-0142af0faea7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-prhd2" Jul 15 16:42:51.469622 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.469536 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efda2baa-1340-49e7-ba0d-3f3765e3ebda-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-q46z2\" (UID: \"efda2baa-1340-49e7-ba0d-3f3765e3ebda\") " pod="openshift-insights/insights-operator-68d9dd94cf-q46z2" Jul 15 16:42:51.469699 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.469671 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjdck\" (UniqueName: \"kubernetes.io/projected/72151350-256b-41f4-a03e-50297adfd668-kube-api-access-vjdck\") pod \"network-check-source-869dcfcdcd-pxvb5\" (UID: \"72151350-256b-41f4-a03e-50297adfd668\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-pxvb5" Jul 15 16:42:51.469731 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.469704 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb96ca78-5732-42a1-a9e1-0142af0faea7-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-prhd2\" (UID: \"eb96ca78-5732-42a1-a9e1-0142af0faea7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-prhd2" Jul 15 16:42:51.469799 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.469768 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/efda2baa-1340-49e7-ba0d-3f3765e3ebda-tmp\") pod \"insights-operator-68d9dd94cf-q46z2\" (UID: \"efda2baa-1340-49e7-ba0d-3f3765e3ebda\") " pod="openshift-insights/insights-operator-68d9dd94cf-q46z2" Jul 15 16:42:51.469799 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.469793 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efda2baa-1340-49e7-ba0d-3f3765e3ebda-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-q46z2\" (UID: \"efda2baa-1340-49e7-ba0d-3f3765e3ebda\") " pod="openshift-insights/insights-operator-68d9dd94cf-q46z2" Jul 15 16:42:51.469897 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.469831 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3-nginx-conf\") pod \"networking-console-plugin-6cf856758c-wzjfl\" (UID: \"a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wzjfl" Jul 15 16:42:51.469897 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:42:51.469852 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 16:42:51.469897 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.469858 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wzjfl\" (UID: \"a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wzjfl" Jul 15 16:42:51.470030 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:42:51.469979 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb96ca78-5732-42a1-a9e1-0142af0faea7-samples-operator-tls podName:eb96ca78-5732-42a1-a9e1-0142af0faea7 nodeName:}" failed. No retries permitted until 2026-07-15 16:42:51.969952197 +0000 UTC m=+158.397044261 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/eb96ca78-5732-42a1-a9e1-0142af0faea7-samples-operator-tls") pod "cluster-samples-operator-65db858894-prhd2" (UID: "eb96ca78-5732-42a1-a9e1-0142af0faea7") : secret "samples-operator-tls" not found Jul 15 16:42:51.470092 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.470066 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/efda2baa-1340-49e7-ba0d-3f3765e3ebda-snapshots\") pod \"insights-operator-68d9dd94cf-q46z2\" (UID: \"efda2baa-1340-49e7-ba0d-3f3765e3ebda\") " pod="openshift-insights/insights-operator-68d9dd94cf-q46z2" Jul 15 16:42:51.470144 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.470097 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd25g\" (UniqueName: \"kubernetes.io/projected/efda2baa-1340-49e7-ba0d-3f3765e3ebda-kube-api-access-dd25g\") pod \"insights-operator-68d9dd94cf-q46z2\" (UID: \"efda2baa-1340-49e7-ba0d-3f3765e3ebda\") " pod="openshift-insights/insights-operator-68d9dd94cf-q46z2" Jul 15 16:42:51.470144 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.470119 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efda2baa-1340-49e7-ba0d-3f3765e3ebda-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-q46z2\" (UID: \"efda2baa-1340-49e7-ba0d-3f3765e3ebda\") " pod="openshift-insights/insights-operator-68d9dd94cf-q46z2" Jul 15 16:42:51.470144 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.470068 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/efda2baa-1340-49e7-ba0d-3f3765e3ebda-tmp\") pod \"insights-operator-68d9dd94cf-q46z2\" (UID: \"efda2baa-1340-49e7-ba0d-3f3765e3ebda\") " pod="openshift-insights/insights-operator-68d9dd94cf-q46z2" Jul 15 16:42:51.470450 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.470430 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efda2baa-1340-49e7-ba0d-3f3765e3ebda-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-q46z2\" (UID: \"efda2baa-1340-49e7-ba0d-3f3765e3ebda\") " pod="openshift-insights/insights-operator-68d9dd94cf-q46z2" Jul 15 16:42:51.470614 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.470592 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/efda2baa-1340-49e7-ba0d-3f3765e3ebda-snapshots\") pod \"insights-operator-68d9dd94cf-q46z2\" (UID: \"efda2baa-1340-49e7-ba0d-3f3765e3ebda\") " pod="openshift-insights/insights-operator-68d9dd94cf-q46z2" Jul 15 16:42:51.471685 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.471666 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/efda2baa-1340-49e7-ba0d-3f3765e3ebda-serving-cert\") pod \"insights-operator-68d9dd94cf-q46z2\" (UID: \"efda2baa-1340-49e7-ba0d-3f3765e3ebda\") " pod="openshift-insights/insights-operator-68d9dd94cf-q46z2" Jul 15 16:42:51.478241 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.478219 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmbcg\" (UniqueName: \"kubernetes.io/projected/eb96ca78-5732-42a1-a9e1-0142af0faea7-kube-api-access-fmbcg\") pod \"cluster-samples-operator-65db858894-prhd2\" (UID: \"eb96ca78-5732-42a1-a9e1-0142af0faea7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-prhd2" Jul 15 16:42:51.478521 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.478499 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd25g\" (UniqueName: \"kubernetes.io/projected/efda2baa-1340-49e7-ba0d-3f3765e3ebda-kube-api-access-dd25g\") pod \"insights-operator-68d9dd94cf-q46z2\" (UID: \"efda2baa-1340-49e7-ba0d-3f3765e3ebda\") " pod="openshift-insights/insights-operator-68d9dd94cf-q46z2" Jul 15 16:42:51.478588 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.478525 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjdck\" (UniqueName: \"kubernetes.io/projected/72151350-256b-41f4-a03e-50297adfd668-kube-api-access-vjdck\") pod \"network-check-source-869dcfcdcd-pxvb5\" (UID: \"72151350-256b-41f4-a03e-50297adfd668\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-pxvb5" Jul 15 16:42:51.484126 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.484108 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l5kln" Jul 15 16:42:51.492029 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.492011 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-zjt5q" Jul 15 16:42:51.496946 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.496924 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-vcxdn" Jul 15 16:42:51.570816 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.570786 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3-nginx-conf\") pod \"networking-console-plugin-6cf856758c-wzjfl\" (UID: \"a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wzjfl" Jul 15 16:42:51.570973 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.570824 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wzjfl\" (UID: \"a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wzjfl" Jul 15 16:42:51.571020 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:42:51.570991 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 16:42:51.571118 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:42:51.571105 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3-networking-console-plugin-cert podName:a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3 nodeName:}" failed. No retries permitted until 2026-07-15 16:42:52.071083141 +0000 UTC m=+158.498175216 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-wzjfl" (UID: "a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3") : secret "networking-console-plugin-cert" not found Jul 15 16:42:51.571492 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.571476 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3-nginx-conf\") pod \"networking-console-plugin-6cf856758c-wzjfl\" (UID: \"a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wzjfl" Jul 15 16:42:51.575815 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.574913 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-pxvb5" Jul 15 16:42:51.581991 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.581976 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-q46z2" Jul 15 16:42:51.615004 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.613565 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nqjzl" Jul 15 16:42:51.628696 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.628607 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l5kln"] Jul 15 16:42:51.634101 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:42:51.634074 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod575cb646_78bd_48f5_9c49_797005605c40.slice/crio-76828734309ae489b59cf19851b06bb0757d723485cae4458daa71ae3dbf4eb1 WatchSource:0}: Error finding container 76828734309ae489b59cf19851b06bb0757d723485cae4458daa71ae3dbf4eb1: Status 404 returned error can't find the container with id 76828734309ae489b59cf19851b06bb0757d723485cae4458daa71ae3dbf4eb1 Jul 15 16:42:51.649905 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.649452 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-zjt5q"] Jul 15 16:42:51.652117 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:42:51.652072 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod752e487f_d91a_4af1_ba20_00ae3a06e305.slice/crio-d81065ae2b04efea2ad655154f9770b0ebe5fc2f5bddf54043b365de42ec28d2 WatchSource:0}: Error finding container d81065ae2b04efea2ad655154f9770b0ebe5fc2f5bddf54043b365de42ec28d2: Status 404 returned error can't find the container with id d81065ae2b04efea2ad655154f9770b0ebe5fc2f5bddf54043b365de42ec28d2 Jul 15 16:42:51.665968 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.665929 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-vcxdn"] Jul 15 16:42:51.670432 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:42:51.670400 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod268a4cb9_c310_4681_91a6_efe9692f8327.slice/crio-6b3197c6b9523ad9aed948d326949090a059848c482731417b87d1021f639c68 WatchSource:0}: Error finding container 6b3197c6b9523ad9aed948d326949090a059848c482731417b87d1021f639c68: Status 404 returned error can't find the container with id 6b3197c6b9523ad9aed948d326949090a059848c482731417b87d1021f639c68 Jul 15 16:42:51.720721 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.720689 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-pxvb5"] Jul 15 16:42:51.723255 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:42:51.723228 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72151350_256b_41f4_a03e_50297adfd668.slice/crio-918d8364c3085a934735f8c274e56f7528be514d0468eb29befdd5639ba6472b WatchSource:0}: Error finding container 918d8364c3085a934735f8c274e56f7528be514d0468eb29befdd5639ba6472b: Status 404 returned error can't find the container with id 918d8364c3085a934735f8c274e56f7528be514d0468eb29befdd5639ba6472b Jul 15 16:42:51.734641 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.734621 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-q46z2"] Jul 15 16:42:51.736690 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:42:51.736668 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefda2baa_1340_49e7_ba0d_3f3765e3ebda.slice/crio-ae3f7098d7bc4f3cd05b7a5cf8437680e4a2adf706b06e2f7aa9063d1ca10570 WatchSource:0}: Error finding container ae3f7098d7bc4f3cd05b7a5cf8437680e4a2adf706b06e2f7aa9063d1ca10570: Status 404 returned error can't find the container with id ae3f7098d7bc4f3cd05b7a5cf8437680e4a2adf706b06e2f7aa9063d1ca10570 Jul 15 16:42:51.974125 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:51.974088 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb96ca78-5732-42a1-a9e1-0142af0faea7-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-prhd2\" (UID: \"eb96ca78-5732-42a1-a9e1-0142af0faea7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-prhd2" Jul 15 16:42:51.974480 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:42:51.974238 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 16:42:51.974480 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:42:51.974302 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb96ca78-5732-42a1-a9e1-0142af0faea7-samples-operator-tls podName:eb96ca78-5732-42a1-a9e1-0142af0faea7 nodeName:}" failed. No retries permitted until 2026-07-15 16:42:52.974285873 +0000 UTC m=+159.401377934 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/eb96ca78-5732-42a1-a9e1-0142af0faea7-samples-operator-tls") pod "cluster-samples-operator-65db858894-prhd2" (UID: "eb96ca78-5732-42a1-a9e1-0142af0faea7") : secret "samples-operator-tls" not found Jul 15 16:42:52.074788 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:52.074730 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wzjfl\" (UID: \"a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wzjfl" Jul 15 16:42:52.074947 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:42:52.074887 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 16:42:52.075000 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:42:52.074969 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3-networking-console-plugin-cert podName:a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3 nodeName:}" failed. No retries permitted until 2026-07-15 16:42:53.074948152 +0000 UTC m=+159.502040213 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-wzjfl" (UID: "a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3") : secret "networking-console-plugin-cert" not found Jul 15 16:42:52.619101 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:52.619063 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-pxvb5" event={"ID":"72151350-256b-41f4-a03e-50297adfd668","Type":"ContainerStarted","Data":"497bfcceab600a92c3b69aa5e83ae60b1f8a54ef1972b3797a251546cac425e4"} Jul 15 16:42:52.619261 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:52.619120 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-pxvb5" event={"ID":"72151350-256b-41f4-a03e-50297adfd668","Type":"ContainerStarted","Data":"918d8364c3085a934735f8c274e56f7528be514d0468eb29befdd5639ba6472b"} Jul 15 16:42:52.620577 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:52.620513 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-zjt5q" event={"ID":"752e487f-d91a-4af1-ba20-00ae3a06e305","Type":"ContainerStarted","Data":"d81065ae2b04efea2ad655154f9770b0ebe5fc2f5bddf54043b365de42ec28d2"} Jul 15 16:42:52.621917 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:52.621805 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l5kln" event={"ID":"575cb646-78bd-48f5-9c49-797005605c40","Type":"ContainerStarted","Data":"76828734309ae489b59cf19851b06bb0757d723485cae4458daa71ae3dbf4eb1"} Jul 15 16:42:52.623506 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:52.623479 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-vcxdn" event={"ID":"268a4cb9-c310-4681-91a6-efe9692f8327","Type":"ContainerStarted","Data":"6b3197c6b9523ad9aed948d326949090a059848c482731417b87d1021f639c68"} Jul 15 16:42:52.624832 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:52.624776 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-q46z2" event={"ID":"efda2baa-1340-49e7-ba0d-3f3765e3ebda","Type":"ContainerStarted","Data":"ae3f7098d7bc4f3cd05b7a5cf8437680e4a2adf706b06e2f7aa9063d1ca10570"} Jul 15 16:42:52.634670 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:52.634622 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-pxvb5" podStartSLOduration=1.6346049649999999 podStartE2EDuration="1.634604965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:42:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:42:52.634123239 +0000 UTC m=+159.061215350" watchObservedRunningTime="2026-07-15 16:42:52.634604965 +0000 UTC m=+159.061697029" Jul 15 16:42:52.982617 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:52.982581 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb96ca78-5732-42a1-a9e1-0142af0faea7-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-prhd2\" (UID: \"eb96ca78-5732-42a1-a9e1-0142af0faea7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-prhd2" Jul 15 16:42:52.983087 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:42:52.982851 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 16:42:52.983087 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:42:52.982919 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb96ca78-5732-42a1-a9e1-0142af0faea7-samples-operator-tls podName:eb96ca78-5732-42a1-a9e1-0142af0faea7 nodeName:}" failed. No retries permitted until 2026-07-15 16:42:54.982898481 +0000 UTC m=+161.409990543 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/eb96ca78-5732-42a1-a9e1-0142af0faea7-samples-operator-tls") pod "cluster-samples-operator-65db858894-prhd2" (UID: "eb96ca78-5732-42a1-a9e1-0142af0faea7") : secret "samples-operator-tls" not found Jul 15 16:42:53.083601 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:53.083564 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wzjfl\" (UID: \"a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wzjfl" Jul 15 16:42:53.083771 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:42:53.083666 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 16:42:53.083771 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:42:53.083727 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3-networking-console-plugin-cert podName:a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3 nodeName:}" failed. No retries permitted until 2026-07-15 16:42:55.083710663 +0000 UTC m=+161.510802724 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-wzjfl" (UID: "a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3") : secret "networking-console-plugin-cert" not found Jul 15 16:42:53.629613 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:53.629578 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-zjt5q" event={"ID":"752e487f-d91a-4af1-ba20-00ae3a06e305","Type":"ContainerStarted","Data":"07b969c5c6d03ba8b686f2de29371e031d7302e1e7356ac8cabd311d084845c9"} Jul 15 16:42:53.644886 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:53.644830 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-zjt5q" podStartSLOduration=1.303913406 podStartE2EDuration="2.644808966s" totalImagesPullingTime="1.34089556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:42:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:42:53.64438365 +0000 UTC m=+160.071475734" watchObservedRunningTime="2026-07-15 16:42:53.644808966 +0000 UTC m=+160.071901051" Jul 15 16:42:55.001016 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:55.000985 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb96ca78-5732-42a1-a9e1-0142af0faea7-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-prhd2\" (UID: \"eb96ca78-5732-42a1-a9e1-0142af0faea7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-prhd2" Jul 15 16:42:55.001266 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:42:55.001156 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 16:42:55.001266 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:42:55.001231 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb96ca78-5732-42a1-a9e1-0142af0faea7-samples-operator-tls podName:eb96ca78-5732-42a1-a9e1-0142af0faea7 nodeName:}" failed. No retries permitted until 2026-07-15 16:42:59.001210996 +0000 UTC m=+165.428303083 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/eb96ca78-5732-42a1-a9e1-0142af0faea7-samples-operator-tls") pod "cluster-samples-operator-65db858894-prhd2" (UID: "eb96ca78-5732-42a1-a9e1-0142af0faea7") : secret "samples-operator-tls" not found Jul 15 16:42:55.101973 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:55.101904 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wzjfl\" (UID: \"a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wzjfl" Jul 15 16:42:55.102087 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:42:55.102027 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 16:42:55.102142 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:42:55.102098 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3-networking-console-plugin-cert podName:a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3 nodeName:}" failed. No retries permitted until 2026-07-15 16:42:59.102077384 +0000 UTC m=+165.529169461 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-wzjfl" (UID: "a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3") : secret "networking-console-plugin-cert" not found Jul 15 16:42:55.112935 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:55.112910 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-5mxzd"] Jul 15 16:42:55.115320 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:55.115304 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-5mxzd" Jul 15 16:42:55.117635 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:55.117614 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 15 16:42:55.117725 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:55.117661 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-kjwfc\"" Jul 15 16:42:55.117725 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:55.117676 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 15 16:42:55.123535 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:55.123501 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-5mxzd"] Jul 15 16:42:55.202268 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:55.202228 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vzn2\" (UniqueName: \"kubernetes.io/projected/06b2d24a-a0c0-420e-bd18-263111cdbde2-kube-api-access-7vzn2\") pod \"migrator-7f59b54f6c-5mxzd\" (UID: \"06b2d24a-a0c0-420e-bd18-263111cdbde2\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-5mxzd" Jul 15 16:42:55.303292 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:55.303257 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vzn2\" (UniqueName: \"kubernetes.io/projected/06b2d24a-a0c0-420e-bd18-263111cdbde2-kube-api-access-7vzn2\") pod \"migrator-7f59b54f6c-5mxzd\" (UID: \"06b2d24a-a0c0-420e-bd18-263111cdbde2\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-5mxzd" Jul 15 16:42:55.311250 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:55.311220 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vzn2\" (UniqueName: \"kubernetes.io/projected/06b2d24a-a0c0-420e-bd18-263111cdbde2-kube-api-access-7vzn2\") pod \"migrator-7f59b54f6c-5mxzd\" (UID: \"06b2d24a-a0c0-420e-bd18-263111cdbde2\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-5mxzd" Jul 15 16:42:55.424453 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:55.424428 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-5mxzd" Jul 15 16:42:55.547570 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:55.547546 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-5mxzd"] Jul 15 16:42:55.549629 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:42:55.549605 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06b2d24a_a0c0_420e_bd18_263111cdbde2.slice/crio-88f89b5cb713357dd59c4024fb5fe52a739c5b51dcea6f7a4dbbd12036c66117 WatchSource:0}: Error finding container 88f89b5cb713357dd59c4024fb5fe52a739c5b51dcea6f7a4dbbd12036c66117: Status 404 returned error can't find the container with id 88f89b5cb713357dd59c4024fb5fe52a739c5b51dcea6f7a4dbbd12036c66117 Jul 15 16:42:55.637380 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:55.637346 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-q46z2" event={"ID":"efda2baa-1340-49e7-ba0d-3f3765e3ebda","Type":"ContainerStarted","Data":"1a04f71a3c69fd888210c7ff25d3dab09345ba80eb2df948cbb516511d19cbab"} Jul 15 16:42:55.638852 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:55.638815 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l5kln" event={"ID":"575cb646-78bd-48f5-9c49-797005605c40","Type":"ContainerStarted","Data":"7252c0270ee79888634b0fcf761b235419b6d17c8c92afe47636a4a3117e408c"} Jul 15 16:42:55.639979 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:55.639949 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-5mxzd" event={"ID":"06b2d24a-a0c0-420e-bd18-263111cdbde2","Type":"ContainerStarted","Data":"88f89b5cb713357dd59c4024fb5fe52a739c5b51dcea6f7a4dbbd12036c66117"} Jul 15 16:42:55.641565 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:55.641541 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vcxdn_268a4cb9-c310-4681-91a6-efe9692f8327/console-operator/0.log" Jul 15 16:42:55.641658 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:55.641578 2559 generic.go:356] "Generic (PLEG): container finished" podID="268a4cb9-c310-4681-91a6-efe9692f8327" containerID="45e92041d179b98ea0f1ca1a31437b8420e2b791935c2d311cefd1b2d760323e" exitCode=255 Jul 15 16:42:55.641658 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:55.641607 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-vcxdn" event={"ID":"268a4cb9-c310-4681-91a6-efe9692f8327","Type":"ContainerDied","Data":"45e92041d179b98ea0f1ca1a31437b8420e2b791935c2d311cefd1b2d760323e"} Jul 15 16:42:55.641848 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:55.641835 2559 scope.go:117] "RemoveContainer" containerID="45e92041d179b98ea0f1ca1a31437b8420e2b791935c2d311cefd1b2d760323e" Jul 15 16:42:55.653294 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:55.653253 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-q46z2" podStartSLOduration=1.539343613 podStartE2EDuration="4.653238151s" totalImagesPullingTime="3.113894538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:42:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:42:55.652897298 +0000 UTC m=+162.079989383" watchObservedRunningTime="2026-07-15 16:42:55.653238151 +0000 UTC m=+162.080330234" Jul 15 16:42:55.667714 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:55.667677 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l5kln" podStartSLOduration=1.45404651 podStartE2EDuration="4.667663917s" totalImagesPullingTime="3.213617407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:42:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:42:55.666686132 +0000 UTC m=+162.093778216" watchObservedRunningTime="2026-07-15 16:42:55.667663917 +0000 UTC m=+162.094756000" Jul 15 16:42:55.806232 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:55.806204 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0eef5ad-3412-4990-b896-87e4444303d1-metrics-tls\") pod \"dns-default-nqjzl\" (UID: \"a0eef5ad-3412-4990-b896-87e4444303d1\") " pod="openshift-dns/dns-default-nqjzl" Jul 15 16:42:55.806367 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:42:55.806346 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 16:42:55.806419 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:42:55.806409 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0eef5ad-3412-4990-b896-87e4444303d1-metrics-tls podName:a0eef5ad-3412-4990-b896-87e4444303d1 nodeName:}" failed. No retries permitted until 2026-07-15 16:44:57.806393028 +0000 UTC m=+284.233485090 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0eef5ad-3412-4990-b896-87e4444303d1-metrics-tls") pod "dns-default-nqjzl" (UID: "a0eef5ad-3412-4990-b896-87e4444303d1") : secret "dns-default-metrics-tls" not found Jul 15 16:42:56.385725 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:56.385358 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nt78r"] Jul 15 16:42:56.388390 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:56.388336 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nt78r" Jul 15 16:42:56.390983 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:56.390959 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 15 16:42:56.391096 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:56.390982 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 15 16:42:56.391156 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:56.390959 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-r79jc\"" Jul 15 16:42:56.401719 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:56.401658 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nt78r"] Jul 15 16:42:56.512546 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:56.512505 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/925c9c99-eb8f-43a8-ad1f-489e63fb358e-data-volume\") pod \"insights-runtime-extractor-nt78r\" (UID: \"925c9c99-eb8f-43a8-ad1f-489e63fb358e\") " pod="openshift-insights/insights-runtime-extractor-nt78r" Jul 15 16:42:56.512710 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:56.512570 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/925c9c99-eb8f-43a8-ad1f-489e63fb358e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nt78r\" (UID: \"925c9c99-eb8f-43a8-ad1f-489e63fb358e\") " pod="openshift-insights/insights-runtime-extractor-nt78r" Jul 15 16:42:56.512710 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:56.512596 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhlpb\" (UniqueName: \"kubernetes.io/projected/925c9c99-eb8f-43a8-ad1f-489e63fb358e-kube-api-access-mhlpb\") pod \"insights-runtime-extractor-nt78r\" (UID: \"925c9c99-eb8f-43a8-ad1f-489e63fb358e\") " pod="openshift-insights/insights-runtime-extractor-nt78r" Jul 15 16:42:56.512848 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:56.512772 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/925c9c99-eb8f-43a8-ad1f-489e63fb358e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nt78r\" (UID: \"925c9c99-eb8f-43a8-ad1f-489e63fb358e\") " pod="openshift-insights/insights-runtime-extractor-nt78r" Jul 15 16:42:56.512899 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:56.512859 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/925c9c99-eb8f-43a8-ad1f-489e63fb358e-crio-socket\") pod \"insights-runtime-extractor-nt78r\" (UID: \"925c9c99-eb8f-43a8-ad1f-489e63fb358e\") " pod="openshift-insights/insights-runtime-extractor-nt78r" Jul 15 16:42:56.614043 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:56.614023 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/925c9c99-eb8f-43a8-ad1f-489e63fb358e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nt78r\" (UID: \"925c9c99-eb8f-43a8-ad1f-489e63fb358e\") " pod="openshift-insights/insights-runtime-extractor-nt78r" Jul 15 16:42:56.614115 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:56.614055 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhlpb\" (UniqueName: \"kubernetes.io/projected/925c9c99-eb8f-43a8-ad1f-489e63fb358e-kube-api-access-mhlpb\") pod \"insights-runtime-extractor-nt78r\" (UID: \"925c9c99-eb8f-43a8-ad1f-489e63fb358e\") " pod="openshift-insights/insights-runtime-extractor-nt78r" Jul 15 16:42:56.614115 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:56.614106 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/925c9c99-eb8f-43a8-ad1f-489e63fb358e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nt78r\" (UID: \"925c9c99-eb8f-43a8-ad1f-489e63fb358e\") " pod="openshift-insights/insights-runtime-extractor-nt78r" Jul 15 16:42:56.614195 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:56.614162 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/925c9c99-eb8f-43a8-ad1f-489e63fb358e-crio-socket\") pod \"insights-runtime-extractor-nt78r\" (UID: \"925c9c99-eb8f-43a8-ad1f-489e63fb358e\") " pod="openshift-insights/insights-runtime-extractor-nt78r" Jul 15 16:42:56.614195 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:42:56.614165 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 16:42:56.614284 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:42:56.614219 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/925c9c99-eb8f-43a8-ad1f-489e63fb358e-insights-runtime-extractor-tls podName:925c9c99-eb8f-43a8-ad1f-489e63fb358e nodeName:}" failed. No retries permitted until 2026-07-15 16:42:57.114201537 +0000 UTC m=+163.541293604 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/925c9c99-eb8f-43a8-ad1f-489e63fb358e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nt78r" (UID: "925c9c99-eb8f-43a8-ad1f-489e63fb358e") : secret "insights-runtime-extractor-tls" not found Jul 15 16:42:56.614284 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:56.614229 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/925c9c99-eb8f-43a8-ad1f-489e63fb358e-crio-socket\") pod \"insights-runtime-extractor-nt78r\" (UID: \"925c9c99-eb8f-43a8-ad1f-489e63fb358e\") " pod="openshift-insights/insights-runtime-extractor-nt78r" Jul 15 16:42:56.614284 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:42:56.614229 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 16:42:56.614408 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:56.614280 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/925c9c99-eb8f-43a8-ad1f-489e63fb358e-data-volume\") pod \"insights-runtime-extractor-nt78r\" (UID: \"925c9c99-eb8f-43a8-ad1f-489e63fb358e\") " pod="openshift-insights/insights-runtime-extractor-nt78r" Jul 15 16:42:56.614408 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:42:56.614301 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/925c9c99-eb8f-43a8-ad1f-489e63fb358e-kube-rbac-proxy-cm podName:925c9c99-eb8f-43a8-ad1f-489e63fb358e nodeName:}" failed. No retries permitted until 2026-07-15 16:42:57.114288628 +0000 UTC m=+163.541380708 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/925c9c99-eb8f-43a8-ad1f-489e63fb358e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nt78r" (UID: "925c9c99-eb8f-43a8-ad1f-489e63fb358e") : configmap "kube-rbac-proxy" not found Jul 15 16:42:56.614537 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:56.614517 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/925c9c99-eb8f-43a8-ad1f-489e63fb358e-data-volume\") pod \"insights-runtime-extractor-nt78r\" (UID: \"925c9c99-eb8f-43a8-ad1f-489e63fb358e\") " pod="openshift-insights/insights-runtime-extractor-nt78r" Jul 15 16:42:56.624107 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:56.624083 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhlpb\" (UniqueName: \"kubernetes.io/projected/925c9c99-eb8f-43a8-ad1f-489e63fb358e-kube-api-access-mhlpb\") pod \"insights-runtime-extractor-nt78r\" (UID: \"925c9c99-eb8f-43a8-ad1f-489e63fb358e\") " pod="openshift-insights/insights-runtime-extractor-nt78r" Jul 15 16:42:56.646232 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:56.646212 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vcxdn_268a4cb9-c310-4681-91a6-efe9692f8327/console-operator/1.log" Jul 15 16:42:56.646588 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:56.646573 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vcxdn_268a4cb9-c310-4681-91a6-efe9692f8327/console-operator/0.log" Jul 15 16:42:56.646662 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:56.646608 2559 generic.go:356] "Generic (PLEG): container finished" podID="268a4cb9-c310-4681-91a6-efe9692f8327" containerID="a0e10f7f90495a26bf20e5fe67801529b00ea090429bc70a6c4576bd97b4b176" exitCode=255 Jul 15 16:42:56.646717 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:56.646694 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-vcxdn" event={"ID":"268a4cb9-c310-4681-91a6-efe9692f8327","Type":"ContainerDied","Data":"a0e10f7f90495a26bf20e5fe67801529b00ea090429bc70a6c4576bd97b4b176"} Jul 15 16:42:56.646809 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:56.646794 2559 scope.go:117] "RemoveContainer" containerID="45e92041d179b98ea0f1ca1a31437b8420e2b791935c2d311cefd1b2d760323e" Jul 15 16:42:56.647044 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:56.647015 2559 scope.go:117] "RemoveContainer" containerID="a0e10f7f90495a26bf20e5fe67801529b00ea090429bc70a6c4576bd97b4b176" Jul 15 16:42:56.647229 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:42:56.647210 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-vcxdn_openshift-console-operator(268a4cb9-c310-4681-91a6-efe9692f8327)\"" pod="openshift-console-operator/console-operator-7866497494-vcxdn" podUID="268a4cb9-c310-4681-91a6-efe9692f8327" Jul 15 16:42:57.118793 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:57.118768 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/925c9c99-eb8f-43a8-ad1f-489e63fb358e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nt78r\" (UID: \"925c9c99-eb8f-43a8-ad1f-489e63fb358e\") " pod="openshift-insights/insights-runtime-extractor-nt78r" Jul 15 16:42:57.118957 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:42:57.118814 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 16:42:57.118957 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:57.118840 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/925c9c99-eb8f-43a8-ad1f-489e63fb358e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nt78r\" (UID: \"925c9c99-eb8f-43a8-ad1f-489e63fb358e\") " pod="openshift-insights/insights-runtime-extractor-nt78r" Jul 15 16:42:57.118957 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:42:57.118869 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/925c9c99-eb8f-43a8-ad1f-489e63fb358e-kube-rbac-proxy-cm podName:925c9c99-eb8f-43a8-ad1f-489e63fb358e nodeName:}" failed. No retries permitted until 2026-07-15 16:42:58.118854697 +0000 UTC m=+164.545946762 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/925c9c99-eb8f-43a8-ad1f-489e63fb358e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nt78r" (UID: "925c9c99-eb8f-43a8-ad1f-489e63fb358e") : configmap "kube-rbac-proxy" not found Jul 15 16:42:57.118957 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:42:57.118912 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 16:42:57.118957 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:42:57.118956 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/925c9c99-eb8f-43a8-ad1f-489e63fb358e-insights-runtime-extractor-tls podName:925c9c99-eb8f-43a8-ad1f-489e63fb358e nodeName:}" failed. No retries permitted until 2026-07-15 16:42:58.118942025 +0000 UTC m=+164.546034087 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/925c9c99-eb8f-43a8-ad1f-489e63fb358e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nt78r" (UID: "925c9c99-eb8f-43a8-ad1f-489e63fb358e") : secret "insights-runtime-extractor-tls" not found Jul 15 16:42:57.652475 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:57.652436 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-5mxzd" event={"ID":"06b2d24a-a0c0-420e-bd18-263111cdbde2","Type":"ContainerStarted","Data":"febff6fd0a8363fffb5fa4df8ab4fe4ad7a3d214da4be25de7e9f63f82d923cb"} Jul 15 16:42:57.652924 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:57.652506 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-5mxzd" event={"ID":"06b2d24a-a0c0-420e-bd18-263111cdbde2","Type":"ContainerStarted","Data":"e384d63b5e92e9ceee781b6c650c95a1da3a87807161795fd707163cf234cc6e"} Jul 15 16:42:57.653841 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:57.653824 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vcxdn_268a4cb9-c310-4681-91a6-efe9692f8327/console-operator/1.log" Jul 15 16:42:57.654168 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:57.654152 2559 scope.go:117] "RemoveContainer" containerID="a0e10f7f90495a26bf20e5fe67801529b00ea090429bc70a6c4576bd97b4b176" Jul 15 16:42:57.654344 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:42:57.654324 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-vcxdn_openshift-console-operator(268a4cb9-c310-4681-91a6-efe9692f8327)\"" pod="openshift-console-operator/console-operator-7866497494-vcxdn" podUID="268a4cb9-c310-4681-91a6-efe9692f8327" Jul 15 16:42:57.668894 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:57.668841 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-5mxzd" podStartSLOduration=1.615132738 podStartE2EDuration="2.668827623s" totalImagesPullingTime="1.053694885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:42:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:42:57.668257256 +0000 UTC m=+164.095349365" watchObservedRunningTime="2026-07-15 16:42:57.668827623 +0000 UTC m=+164.095919703" Jul 15 16:42:58.126548 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:58.126512 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/925c9c99-eb8f-43a8-ad1f-489e63fb358e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nt78r\" (UID: \"925c9c99-eb8f-43a8-ad1f-489e63fb358e\") " pod="openshift-insights/insights-runtime-extractor-nt78r" Jul 15 16:42:58.126769 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:58.126581 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/925c9c99-eb8f-43a8-ad1f-489e63fb358e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nt78r\" (UID: \"925c9c99-eb8f-43a8-ad1f-489e63fb358e\") " pod="openshift-insights/insights-runtime-extractor-nt78r" Jul 15 16:42:58.126769 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:42:58.126658 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 16:42:58.126769 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:42:58.126719 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/925c9c99-eb8f-43a8-ad1f-489e63fb358e-insights-runtime-extractor-tls podName:925c9c99-eb8f-43a8-ad1f-489e63fb358e nodeName:}" failed. No retries permitted until 2026-07-15 16:43:00.126705721 +0000 UTC m=+166.553797785 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/925c9c99-eb8f-43a8-ad1f-489e63fb358e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nt78r" (UID: "925c9c99-eb8f-43a8-ad1f-489e63fb358e") : secret "insights-runtime-extractor-tls" not found Jul 15 16:42:58.126769 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:42:58.126666 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 16:42:58.126940 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:42:58.126817 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/925c9c99-eb8f-43a8-ad1f-489e63fb358e-kube-rbac-proxy-cm podName:925c9c99-eb8f-43a8-ad1f-489e63fb358e nodeName:}" failed. No retries permitted until 2026-07-15 16:43:00.126799943 +0000 UTC m=+166.553892021 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/925c9c99-eb8f-43a8-ad1f-489e63fb358e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nt78r" (UID: "925c9c99-eb8f-43a8-ad1f-489e63fb358e") : configmap "kube-rbac-proxy" not found Jul 15 16:42:58.179047 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:58.179018 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-kcxtn"] Jul 15 16:42:58.181322 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:58.181305 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-kcxtn" Jul 15 16:42:58.183652 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:58.183631 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 15 16:42:58.183768 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:58.183707 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 15 16:42:58.184588 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:58.184573 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-mpgsg\"" Jul 15 16:42:58.184588 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:58.184589 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 15 16:42:58.184718 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:58.184669 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 15 16:42:58.190476 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:58.190456 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-kcxtn"] Jul 15 16:42:58.328267 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:58.328238 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgc89\" (UniqueName: \"kubernetes.io/projected/86bf0a14-68d3-4a41-bb9a-f59b4738e6c2-kube-api-access-sgc89\") pod \"service-ca-79f68b9f4f-kcxtn\" (UID: \"86bf0a14-68d3-4a41-bb9a-f59b4738e6c2\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kcxtn" Jul 15 16:42:58.328430 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:58.328295 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/86bf0a14-68d3-4a41-bb9a-f59b4738e6c2-signing-cabundle\") pod \"service-ca-79f68b9f4f-kcxtn\" (UID: \"86bf0a14-68d3-4a41-bb9a-f59b4738e6c2\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kcxtn" Jul 15 16:42:58.328430 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:58.328354 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/86bf0a14-68d3-4a41-bb9a-f59b4738e6c2-signing-key\") pod \"service-ca-79f68b9f4f-kcxtn\" (UID: \"86bf0a14-68d3-4a41-bb9a-f59b4738e6c2\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kcxtn" Jul 15 16:42:58.428698 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:58.428669 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/86bf0a14-68d3-4a41-bb9a-f59b4738e6c2-signing-cabundle\") pod \"service-ca-79f68b9f4f-kcxtn\" (UID: \"86bf0a14-68d3-4a41-bb9a-f59b4738e6c2\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kcxtn" Jul 15 16:42:58.428841 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:58.428712 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/86bf0a14-68d3-4a41-bb9a-f59b4738e6c2-signing-key\") pod \"service-ca-79f68b9f4f-kcxtn\" (UID: \"86bf0a14-68d3-4a41-bb9a-f59b4738e6c2\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kcxtn" Jul 15 16:42:58.428881 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:58.428831 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgc89\" (UniqueName: \"kubernetes.io/projected/86bf0a14-68d3-4a41-bb9a-f59b4738e6c2-kube-api-access-sgc89\") pod \"service-ca-79f68b9f4f-kcxtn\" (UID: \"86bf0a14-68d3-4a41-bb9a-f59b4738e6c2\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kcxtn" Jul 15 16:42:58.429489 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:58.429472 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/86bf0a14-68d3-4a41-bb9a-f59b4738e6c2-signing-cabundle\") pod \"service-ca-79f68b9f4f-kcxtn\" (UID: \"86bf0a14-68d3-4a41-bb9a-f59b4738e6c2\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kcxtn" Jul 15 16:42:58.431149 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:58.431133 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/86bf0a14-68d3-4a41-bb9a-f59b4738e6c2-signing-key\") pod \"service-ca-79f68b9f4f-kcxtn\" (UID: \"86bf0a14-68d3-4a41-bb9a-f59b4738e6c2\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kcxtn" Jul 15 16:42:58.437400 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:58.437380 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgc89\" (UniqueName: \"kubernetes.io/projected/86bf0a14-68d3-4a41-bb9a-f59b4738e6c2-kube-api-access-sgc89\") pod \"service-ca-79f68b9f4f-kcxtn\" (UID: \"86bf0a14-68d3-4a41-bb9a-f59b4738e6c2\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kcxtn" Jul 15 16:42:58.490254 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:58.490224 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-kcxtn" Jul 15 16:42:58.610330 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:58.610302 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-kcxtn"] Jul 15 16:42:58.613243 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:42:58.613218 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86bf0a14_68d3_4a41_bb9a_f59b4738e6c2.slice/crio-ec61cdfe80866652bb8128eac797b520d2049e7636dcdb3ce9fd9d5c18e3a2d7 WatchSource:0}: Error finding container ec61cdfe80866652bb8128eac797b520d2049e7636dcdb3ce9fd9d5c18e3a2d7: Status 404 returned error can't find the container with id ec61cdfe80866652bb8128eac797b520d2049e7636dcdb3ce9fd9d5c18e3a2d7 Jul 15 16:42:58.657667 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:58.657641 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-kcxtn" event={"ID":"86bf0a14-68d3-4a41-bb9a-f59b4738e6c2","Type":"ContainerStarted","Data":"ec61cdfe80866652bb8128eac797b520d2049e7636dcdb3ce9fd9d5c18e3a2d7"} Jul 15 16:42:58.991034 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:58.991007 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-54dr5_4de0f0e6-c52c-439f-b547-d7449edde627/dns-node-resolver/0.log" Jul 15 16:42:59.033834 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:59.033807 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb96ca78-5732-42a1-a9e1-0142af0faea7-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-prhd2\" (UID: \"eb96ca78-5732-42a1-a9e1-0142af0faea7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-prhd2" Jul 15 16:42:59.033982 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:42:59.033949 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 16:42:59.034042 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:42:59.034011 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb96ca78-5732-42a1-a9e1-0142af0faea7-samples-operator-tls podName:eb96ca78-5732-42a1-a9e1-0142af0faea7 nodeName:}" failed. No retries permitted until 2026-07-15 16:43:07.03399565 +0000 UTC m=+173.461087716 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/eb96ca78-5732-42a1-a9e1-0142af0faea7-samples-operator-tls") pod "cluster-samples-operator-65db858894-prhd2" (UID: "eb96ca78-5732-42a1-a9e1-0142af0faea7") : secret "samples-operator-tls" not found Jul 15 16:42:59.134293 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:59.134263 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wzjfl\" (UID: \"a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wzjfl" Jul 15 16:42:59.134432 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:42:59.134405 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 16:42:59.134487 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:42:59.134463 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3-networking-console-plugin-cert podName:a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3 nodeName:}" failed. No retries permitted until 2026-07-15 16:43:07.134445245 +0000 UTC m=+173.561537323 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-wzjfl" (UID: "a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3") : secret "networking-console-plugin-cert" not found Jul 15 16:42:59.662039 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:59.662004 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-kcxtn" event={"ID":"86bf0a14-68d3-4a41-bb9a-f59b4738e6c2","Type":"ContainerStarted","Data":"2be18b5b0edf0f4779f01d5d961a7ab2cc1dd4411c9b4f8f76fc2b2d3f6559b8"} Jul 15 16:42:59.679003 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:42:59.678955 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-kcxtn" podStartSLOduration=1.6789377829999999 podStartE2EDuration="1.678937783s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:42:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:42:59.678487377 +0000 UTC m=+166.105579459" watchObservedRunningTime="2026-07-15 16:42:59.678937783 +0000 UTC m=+166.106029869" Jul 15 16:43:00.141921 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:00.141831 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/925c9c99-eb8f-43a8-ad1f-489e63fb358e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nt78r\" (UID: \"925c9c99-eb8f-43a8-ad1f-489e63fb358e\") " pod="openshift-insights/insights-runtime-extractor-nt78r" Jul 15 16:43:00.141921 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:00.141888 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/925c9c99-eb8f-43a8-ad1f-489e63fb358e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nt78r\" (UID: \"925c9c99-eb8f-43a8-ad1f-489e63fb358e\") " pod="openshift-insights/insights-runtime-extractor-nt78r" Jul 15 16:43:00.142105 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:43:00.141965 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 16:43:00.142105 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:43:00.141982 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 16:43:00.142105 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:43:00.142018 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/925c9c99-eb8f-43a8-ad1f-489e63fb358e-kube-rbac-proxy-cm podName:925c9c99-eb8f-43a8-ad1f-489e63fb358e nodeName:}" failed. No retries permitted until 2026-07-15 16:43:04.142004268 +0000 UTC m=+170.569096329 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/925c9c99-eb8f-43a8-ad1f-489e63fb358e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nt78r" (UID: "925c9c99-eb8f-43a8-ad1f-489e63fb358e") : configmap "kube-rbac-proxy" not found Jul 15 16:43:00.142105 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:43:00.142036 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/925c9c99-eb8f-43a8-ad1f-489e63fb358e-insights-runtime-extractor-tls podName:925c9c99-eb8f-43a8-ad1f-489e63fb358e nodeName:}" failed. No retries permitted until 2026-07-15 16:43:04.142023614 +0000 UTC m=+170.569115675 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/925c9c99-eb8f-43a8-ad1f-489e63fb358e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nt78r" (UID: "925c9c99-eb8f-43a8-ad1f-489e63fb358e") : secret "insights-runtime-extractor-tls" not found Jul 15 16:43:00.386305 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:00.386279 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zrwsm_5695f6d9-f75a-4b9c-9417-babb852ef469/node-ca/0.log" Jul 15 16:43:01.187055 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:01.187028 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tp2cw_ebf98561-bc05-4673-939a-5dedebfefff1/serve-healthcheck-canary/0.log" Jul 15 16:43:01.387945 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:01.387914 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-5mxzd_06b2d24a-a0c0-420e-bd18-263111cdbde2/migrator/0.log" Jul 15 16:43:01.497098 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:01.497006 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-vcxdn" Jul 15 16:43:01.497098 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:01.497077 2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-vcxdn" Jul 15 16:43:01.497505 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:01.497492 2559 scope.go:117] "RemoveContainer" containerID="a0e10f7f90495a26bf20e5fe67801529b00ea090429bc70a6c4576bd97b4b176" Jul 15 16:43:01.497687 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:43:01.497665 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-vcxdn_openshift-console-operator(268a4cb9-c310-4681-91a6-efe9692f8327)\"" pod="openshift-console-operator/console-operator-7866497494-vcxdn" podUID="268a4cb9-c310-4681-91a6-efe9692f8327" Jul 15 16:43:01.586643 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:01.586613 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-5mxzd_06b2d24a-a0c0-420e-bd18-263111cdbde2/graceful-termination/0.log" Jul 15 16:43:04.168670 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:04.168632 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cp4kd" Jul 15 16:43:04.175665 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:04.175636 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/925c9c99-eb8f-43a8-ad1f-489e63fb358e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nt78r\" (UID: \"925c9c99-eb8f-43a8-ad1f-489e63fb358e\") " pod="openshift-insights/insights-runtime-extractor-nt78r" Jul 15 16:43:04.175800 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:04.175704 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/925c9c99-eb8f-43a8-ad1f-489e63fb358e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nt78r\" (UID: \"925c9c99-eb8f-43a8-ad1f-489e63fb358e\") " pod="openshift-insights/insights-runtime-extractor-nt78r" Jul 15 16:43:04.175800 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:43:04.175771 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 16:43:04.175869 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:43:04.175802 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 16:43:04.175869 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:43:04.175829 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/925c9c99-eb8f-43a8-ad1f-489e63fb358e-kube-rbac-proxy-cm podName:925c9c99-eb8f-43a8-ad1f-489e63fb358e nodeName:}" failed. No retries permitted until 2026-07-15 16:43:12.175814854 +0000 UTC m=+178.602906917 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/925c9c99-eb8f-43a8-ad1f-489e63fb358e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nt78r" (UID: "925c9c99-eb8f-43a8-ad1f-489e63fb358e") : configmap "kube-rbac-proxy" not found Jul 15 16:43:04.175869 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:43:04.175843 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/925c9c99-eb8f-43a8-ad1f-489e63fb358e-insights-runtime-extractor-tls podName:925c9c99-eb8f-43a8-ad1f-489e63fb358e nodeName:}" failed. No retries permitted until 2026-07-15 16:43:12.1758373 +0000 UTC m=+178.602929364 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/925c9c99-eb8f-43a8-ad1f-489e63fb358e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nt78r" (UID: "925c9c99-eb8f-43a8-ad1f-489e63fb358e") : secret "insights-runtime-extractor-tls" not found Jul 15 16:43:07.099595 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:07.099514 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb96ca78-5732-42a1-a9e1-0142af0faea7-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-prhd2\" (UID: \"eb96ca78-5732-42a1-a9e1-0142af0faea7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-prhd2" Jul 15 16:43:07.101907 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:07.101884 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb96ca78-5732-42a1-a9e1-0142af0faea7-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-prhd2\" (UID: \"eb96ca78-5732-42a1-a9e1-0142af0faea7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-prhd2" Jul 15 16:43:07.186699 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:07.186669 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-prhd2" Jul 15 16:43:07.199910 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:07.199885 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wzjfl\" (UID: \"a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wzjfl" Jul 15 16:43:07.200021 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:43:07.199981 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 16:43:07.200059 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:43:07.200033 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3-networking-console-plugin-cert podName:a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3 nodeName:}" failed. No retries permitted until 2026-07-15 16:43:23.200019491 +0000 UTC m=+189.627111552 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-wzjfl" (UID: "a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3") : secret "networking-console-plugin-cert" not found Jul 15 16:43:07.312579 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:07.312489 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-prhd2"] Jul 15 16:43:07.688431 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:07.688396 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-prhd2" event={"ID":"eb96ca78-5732-42a1-a9e1-0142af0faea7","Type":"ContainerStarted","Data":"9fa2a979d808036566f0c128ebff104d906616627b9cebbfe13fb8db12149989"} Jul 15 16:43:12.239875 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:12.239840 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/925c9c99-eb8f-43a8-ad1f-489e63fb358e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nt78r\" (UID: \"925c9c99-eb8f-43a8-ad1f-489e63fb358e\") " pod="openshift-insights/insights-runtime-extractor-nt78r" Jul 15 16:43:12.240215 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:12.239893 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/925c9c99-eb8f-43a8-ad1f-489e63fb358e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nt78r\" (UID: \"925c9c99-eb8f-43a8-ad1f-489e63fb358e\") " pod="openshift-insights/insights-runtime-extractor-nt78r" Jul 15 16:43:12.240362 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:12.240346 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/925c9c99-eb8f-43a8-ad1f-489e63fb358e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nt78r\" (UID: \"925c9c99-eb8f-43a8-ad1f-489e63fb358e\") " pod="openshift-insights/insights-runtime-extractor-nt78r" Jul 15 16:43:12.242037 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:12.242011 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/925c9c99-eb8f-43a8-ad1f-489e63fb358e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nt78r\" (UID: \"925c9c99-eb8f-43a8-ad1f-489e63fb358e\") " pod="openshift-insights/insights-runtime-extractor-nt78r" Jul 15 16:43:12.300001 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:12.299980 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nt78r" Jul 15 16:43:12.421457 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:12.421442 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nt78r"] Jul 15 16:43:12.423807 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:43:12.423781 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod925c9c99_eb8f_43a8_ad1f_489e63fb358e.slice/crio-e51c2ab274146224591b98faf25c591b17f7c1bf45e5723057a7cbebfaf56cfb WatchSource:0}: Error finding container e51c2ab274146224591b98faf25c591b17f7c1bf45e5723057a7cbebfaf56cfb: Status 404 returned error can't find the container with id e51c2ab274146224591b98faf25c591b17f7c1bf45e5723057a7cbebfaf56cfb Jul 15 16:43:12.705410 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:12.705375 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nt78r" event={"ID":"925c9c99-eb8f-43a8-ad1f-489e63fb358e","Type":"ContainerStarted","Data":"e51c2ab274146224591b98faf25c591b17f7c1bf45e5723057a7cbebfaf56cfb"} Jul 15 16:43:12.706786 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:12.706765 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-prhd2" event={"ID":"eb96ca78-5732-42a1-a9e1-0142af0faea7","Type":"ContainerStarted","Data":"af9085ba905bb7b8b0ae32e5bedc61907021528e5fd0a948f4c849bc7e74fa10"} Jul 15 16:43:12.706880 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:12.706812 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-prhd2" event={"ID":"eb96ca78-5732-42a1-a9e1-0142af0faea7","Type":"ContainerStarted","Data":"54fc07aecc2ff28c4dbfa3f310cdf13573f6d23ab668f3d2ad637043c08494c3"} Jul 15 16:43:12.723177 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:12.723139 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-prhd2" podStartSLOduration=17.272912965 podStartE2EDuration="21.723126975s" totalImagesPullingTime="4.45021401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:42:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:43:12.722696889 +0000 UTC m=+179.149788974" watchObservedRunningTime="2026-07-15 16:43:12.723126975 +0000 UTC m=+179.150219057" Jul 15 16:43:13.167207 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:13.167007 2559 scope.go:117] "RemoveContainer" containerID="a0e10f7f90495a26bf20e5fe67801529b00ea090429bc70a6c4576bd97b4b176" Jul 15 16:43:13.712505 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:13.712474 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vcxdn_268a4cb9-c310-4681-91a6-efe9692f8327/console-operator/2.log" Jul 15 16:43:13.712977 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:13.712962 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vcxdn_268a4cb9-c310-4681-91a6-efe9692f8327/console-operator/1.log" Jul 15 16:43:13.713022 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:13.712995 2559 generic.go:356] "Generic (PLEG): container finished" podID="268a4cb9-c310-4681-91a6-efe9692f8327" containerID="ae636f3297fc6ac5ed49731fa059d109bcda4bb6964d2bbd43d207306303d818" exitCode=255 Jul 15 16:43:13.713111 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:13.713074 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-vcxdn" event={"ID":"268a4cb9-c310-4681-91a6-efe9692f8327","Type":"ContainerDied","Data":"ae636f3297fc6ac5ed49731fa059d109bcda4bb6964d2bbd43d207306303d818"} Jul 15 16:43:13.713232 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:13.713152 2559 scope.go:117] "RemoveContainer" containerID="a0e10f7f90495a26bf20e5fe67801529b00ea090429bc70a6c4576bd97b4b176" Jul 15 16:43:13.713545 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:13.713523 2559 scope.go:117] "RemoveContainer" containerID="ae636f3297fc6ac5ed49731fa059d109bcda4bb6964d2bbd43d207306303d818" Jul 15 16:43:13.713723 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:43:13.713696 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-vcxdn_openshift-console-operator(268a4cb9-c310-4681-91a6-efe9692f8327)\"" pod="openshift-console-operator/console-operator-7866497494-vcxdn" podUID="268a4cb9-c310-4681-91a6-efe9692f8327" Jul 15 16:43:14.719229 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:14.719203 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vcxdn_268a4cb9-c310-4681-91a6-efe9692f8327/console-operator/2.log" Jul 15 16:43:17.731064 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:17.731030 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nt78r" event={"ID":"925c9c99-eb8f-43a8-ad1f-489e63fb358e","Type":"ContainerStarted","Data":"1edc161ff973785ac417461bc7fc7c28d2108d74e810623a08a423cc0977117b"} Jul 15 16:43:21.497838 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:21.497804 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-vcxdn" Jul 15 16:43:21.498210 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:21.497867 2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-vcxdn" Jul 15 16:43:21.498284 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:21.498229 2559 scope.go:117] "RemoveContainer" containerID="ae636f3297fc6ac5ed49731fa059d109bcda4bb6964d2bbd43d207306303d818" Jul 15 16:43:21.498413 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:43:21.498388 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-vcxdn_openshift-console-operator(268a4cb9-c310-4681-91a6-efe9692f8327)\"" pod="openshift-console-operator/console-operator-7866497494-vcxdn" podUID="268a4cb9-c310-4681-91a6-efe9692f8327" Jul 15 16:43:23.225653 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:23.225620 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wzjfl\" (UID: \"a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wzjfl" Jul 15 16:43:23.227812 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:23.227784 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wzjfl\" (UID: \"a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wzjfl" Jul 15 16:43:23.482590 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:23.482519 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-s7w4d\"" Jul 15 16:43:23.490620 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:23.490600 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-wzjfl" Jul 15 16:43:23.631608 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:23.631582 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-wzjfl"] Jul 15 16:43:23.635911 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:43:23.635885 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9e89c3e_e71a_4e4a_9f37_e4db39bb80c3.slice/crio-d5439b18bb7eea90a6bdaa6084ce09f707368a53365c79fc4a7fac61c5d1af2d WatchSource:0}: Error finding container d5439b18bb7eea90a6bdaa6084ce09f707368a53365c79fc4a7fac61c5d1af2d: Status 404 returned error can't find the container with id d5439b18bb7eea90a6bdaa6084ce09f707368a53365c79fc4a7fac61c5d1af2d Jul 15 16:43:23.751508 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:23.751436 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-wzjfl" event={"ID":"a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3","Type":"ContainerStarted","Data":"d5439b18bb7eea90a6bdaa6084ce09f707368a53365c79fc4a7fac61c5d1af2d"} Jul 15 16:43:23.753467 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:23.753441 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nt78r" event={"ID":"925c9c99-eb8f-43a8-ad1f-489e63fb358e","Type":"ContainerStarted","Data":"8845b4367c9b6488207406a078b485bf0281a78b160526bdc9422cac8525b562"} Jul 15 16:43:26.763897 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:26.763870 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nt78r" event={"ID":"925c9c99-eb8f-43a8-ad1f-489e63fb358e","Type":"ContainerStarted","Data":"9af865ed05684a0d042570e10dd71aad78ccd8b78ba32d398f64bc4c6596f6ad"} Jul 15 16:43:26.765242 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:26.765224 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-wzjfl" event={"ID":"a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3","Type":"ContainerStarted","Data":"c2951291b73f9b5000cd891028082f0ae609fe63098fdfaa30856838574b8d0e"} Jul 15 16:43:26.782390 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:26.782313 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nt78r" podStartSLOduration=16.782762954 podStartE2EDuration="30.782300429s" totalImagesPullingTime="13.999537475s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:42:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:43:26.781707773 +0000 UTC m=+193.208799858" watchObservedRunningTime="2026-07-15 16:43:26.782300429 +0000 UTC m=+193.209392530" Jul 15 16:43:28.914741 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:28.914683 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-wzjfl" podStartSLOduration=35.034699093 podStartE2EDuration="37.914667897s" totalImagesPullingTime="2.879968804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:42:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:43:26.798690358 +0000 UTC m=+193.225782440" watchObservedRunningTime="2026-07-15 16:43:28.914667897 +0000 UTC m=+195.341759987" Jul 15 16:43:28.915825 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:28.915804 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-pgzj7"] Jul 15 16:43:28.949945 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:28.949920 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-pgzj7"] Jul 15 16:43:28.950048 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:28.950029 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-pgzj7" Jul 15 16:43:28.952964 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:28.952941 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 15 16:43:28.953200 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:28.953184 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-pv6qd\"" Jul 15 16:43:28.970047 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:28.970023 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/877406f9-6c0a-44cb-90a0-fb910f72e845-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-pgzj7\" (UID: \"877406f9-6c0a-44cb-90a0-fb910f72e845\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-pgzj7" Jul 15 16:43:29.070324 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:29.070295 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/877406f9-6c0a-44cb-90a0-fb910f72e845-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-pgzj7\" (UID: \"877406f9-6c0a-44cb-90a0-fb910f72e845\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-pgzj7" Jul 15 16:43:29.072608 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:29.072588 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/877406f9-6c0a-44cb-90a0-fb910f72e845-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-pgzj7\" (UID: \"877406f9-6c0a-44cb-90a0-fb910f72e845\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-pgzj7" Jul 15 16:43:29.259699 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:29.259650 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-pgzj7" Jul 15 16:43:29.389260 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:29.389227 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-pgzj7"] Jul 15 16:43:29.391948 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:43:29.391922 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod877406f9_6c0a_44cb_90a0_fb910f72e845.slice/crio-21dec349e16c3846eb66ef1059960af73cb4e31a163582ce86ed48d7178386e9 WatchSource:0}: Error finding container 21dec349e16c3846eb66ef1059960af73cb4e31a163582ce86ed48d7178386e9: Status 404 returned error can't find the container with id 21dec349e16c3846eb66ef1059960af73cb4e31a163582ce86ed48d7178386e9 Jul 15 16:43:29.775816 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:29.775787 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-pgzj7" event={"ID":"877406f9-6c0a-44cb-90a0-fb910f72e845","Type":"ContainerStarted","Data":"21dec349e16c3846eb66ef1059960af73cb4e31a163582ce86ed48d7178386e9"} Jul 15 16:43:30.780399 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:30.780323 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-pgzj7" event={"ID":"877406f9-6c0a-44cb-90a0-fb910f72e845","Type":"ContainerStarted","Data":"3610e58050806310e673d31438d98118dac72f981234da7c1168545c9bac0a89"} Jul 15 16:43:30.780817 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:30.780531 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-pgzj7" Jul 15 16:43:30.785004 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:30.784983 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-pgzj7" Jul 15 16:43:30.796064 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:30.796027 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-pgzj7" podStartSLOduration=1.736543335 podStartE2EDuration="2.796014283s" totalImagesPullingTime="1.059470948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:43:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:43:30.795429036 +0000 UTC m=+197.222521120" watchObservedRunningTime="2026-07-15 16:43:30.796014283 +0000 UTC m=+197.223106365" Jul 15 16:43:30.971634 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:30.971607 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-nk25g"] Jul 15 16:43:30.973707 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:30.973691 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-nk25g" Jul 15 16:43:30.976460 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:30.976431 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 15 16:43:30.976594 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:30.976469 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 15 16:43:30.976594 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:30.976531 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 15 16:43:30.976594 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:30.976563 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 15 16:43:30.976845 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:30.976826 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 15 16:43:30.976942 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:30.976923 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-pxf2l\"" Jul 15 16:43:30.984076 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:30.984056 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-nk25g"] Jul 15 16:43:31.085147 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:31.085092 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2b17740b-019e-4b4c-9fcb-e84f2facf4ce-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-nk25g\" (UID: \"2b17740b-019e-4b4c-9fcb-e84f2facf4ce\") " pod="openshift-monitoring/prometheus-operator-64785b6675-nk25g" Jul 15 16:43:31.085147 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:31.085119 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjr82\" (UniqueName: \"kubernetes.io/projected/2b17740b-019e-4b4c-9fcb-e84f2facf4ce-kube-api-access-vjr82\") pod \"prometheus-operator-64785b6675-nk25g\" (UID: \"2b17740b-019e-4b4c-9fcb-e84f2facf4ce\") " pod="openshift-monitoring/prometheus-operator-64785b6675-nk25g" Jul 15 16:43:31.085263 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:31.085146 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b17740b-019e-4b4c-9fcb-e84f2facf4ce-metrics-client-ca\") pod \"prometheus-operator-64785b6675-nk25g\" (UID: \"2b17740b-019e-4b4c-9fcb-e84f2facf4ce\") " pod="openshift-monitoring/prometheus-operator-64785b6675-nk25g" Jul 15 16:43:31.085263 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:31.085222 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2b17740b-019e-4b4c-9fcb-e84f2facf4ce-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-nk25g\" (UID: \"2b17740b-019e-4b4c-9fcb-e84f2facf4ce\") " pod="openshift-monitoring/prometheus-operator-64785b6675-nk25g" Jul 15 16:43:31.185585 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:31.185564 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2b17740b-019e-4b4c-9fcb-e84f2facf4ce-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-nk25g\" (UID: \"2b17740b-019e-4b4c-9fcb-e84f2facf4ce\") " pod="openshift-monitoring/prometheus-operator-64785b6675-nk25g" Jul 15 16:43:31.185664 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:31.185587 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjr82\" (UniqueName: \"kubernetes.io/projected/2b17740b-019e-4b4c-9fcb-e84f2facf4ce-kube-api-access-vjr82\") pod \"prometheus-operator-64785b6675-nk25g\" (UID: \"2b17740b-019e-4b4c-9fcb-e84f2facf4ce\") " pod="openshift-monitoring/prometheus-operator-64785b6675-nk25g" Jul 15 16:43:31.185664 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:31.185610 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b17740b-019e-4b4c-9fcb-e84f2facf4ce-metrics-client-ca\") pod \"prometheus-operator-64785b6675-nk25g\" (UID: \"2b17740b-019e-4b4c-9fcb-e84f2facf4ce\") " pod="openshift-monitoring/prometheus-operator-64785b6675-nk25g" Jul 15 16:43:31.185726 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:31.185659 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2b17740b-019e-4b4c-9fcb-e84f2facf4ce-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-nk25g\" (UID: \"2b17740b-019e-4b4c-9fcb-e84f2facf4ce\") " pod="openshift-monitoring/prometheus-operator-64785b6675-nk25g" Jul 15 16:43:31.186408 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:31.186387 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b17740b-019e-4b4c-9fcb-e84f2facf4ce-metrics-client-ca\") pod \"prometheus-operator-64785b6675-nk25g\" (UID: \"2b17740b-019e-4b4c-9fcb-e84f2facf4ce\") " pod="openshift-monitoring/prometheus-operator-64785b6675-nk25g" Jul 15 16:43:31.187910 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:31.187891 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2b17740b-019e-4b4c-9fcb-e84f2facf4ce-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-nk25g\" (UID: \"2b17740b-019e-4b4c-9fcb-e84f2facf4ce\") " pod="openshift-monitoring/prometheus-operator-64785b6675-nk25g" Jul 15 16:43:31.188105 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:31.188090 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2b17740b-019e-4b4c-9fcb-e84f2facf4ce-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-nk25g\" (UID: \"2b17740b-019e-4b4c-9fcb-e84f2facf4ce\") " pod="openshift-monitoring/prometheus-operator-64785b6675-nk25g" Jul 15 16:43:31.195138 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:31.195116 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjr82\" (UniqueName: \"kubernetes.io/projected/2b17740b-019e-4b4c-9fcb-e84f2facf4ce-kube-api-access-vjr82\") pod \"prometheus-operator-64785b6675-nk25g\" (UID: \"2b17740b-019e-4b4c-9fcb-e84f2facf4ce\") " pod="openshift-monitoring/prometheus-operator-64785b6675-nk25g" Jul 15 16:43:31.283212 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:31.283184 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-nk25g" Jul 15 16:43:31.400298 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:31.400268 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-nk25g"] Jul 15 16:43:31.403440 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:43:31.403411 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b17740b_019e_4b4c_9fcb_e84f2facf4ce.slice/crio-ae9b84c7e8200f24ccdebb9288522aae634a3acf3d776fab07c90f55b68944d6 WatchSource:0}: Error finding container ae9b84c7e8200f24ccdebb9288522aae634a3acf3d776fab07c90f55b68944d6: Status 404 returned error can't find the container with id ae9b84c7e8200f24ccdebb9288522aae634a3acf3d776fab07c90f55b68944d6 Jul 15 16:43:31.784919 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:31.784886 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-nk25g" event={"ID":"2b17740b-019e-4b4c-9fcb-e84f2facf4ce","Type":"ContainerStarted","Data":"ae9b84c7e8200f24ccdebb9288522aae634a3acf3d776fab07c90f55b68944d6"} Jul 15 16:43:34.794769 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:34.794656 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-nk25g" event={"ID":"2b17740b-019e-4b4c-9fcb-e84f2facf4ce","Type":"ContainerStarted","Data":"cd9e6a456405ab2f40586a889d223e19f8d7c88e4829f09618b72b8e6bcc5811"} Jul 15 16:43:34.794769 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:34.794714 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-nk25g" event={"ID":"2b17740b-019e-4b4c-9fcb-e84f2facf4ce","Type":"ContainerStarted","Data":"df5bfb3f610d5acc481689e92201865767860e34bbdca86a406428057a68f369"} Jul 15 16:43:34.813962 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:34.813916 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-nk25g" podStartSLOduration=1.695575985 podStartE2EDuration="4.813902326s" totalImagesPullingTime="3.118326341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:43:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:43:34.811996092 +0000 UTC m=+201.239088176" watchObservedRunningTime="2026-07-15 16:43:34.813902326 +0000 UTC m=+201.240994436" Jul 15 16:43:36.167114 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.167087 2559 scope.go:117] "RemoveContainer" containerID="ae636f3297fc6ac5ed49731fa059d109bcda4bb6964d2bbd43d207306303d818" Jul 15 16:43:36.299019 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.298981 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-wvb5d"] Jul 15 16:43:36.301716 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.301690 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wvb5d" Jul 15 16:43:36.304579 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.304523 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 15 16:43:36.304718 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.304695 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-7gv8d\"" Jul 15 16:43:36.304795 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.304743 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 15 16:43:36.313955 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.313935 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-sgrd6"] Jul 15 16:43:36.316335 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.316313 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-wvb5d"] Jul 15 16:43:36.316466 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.316446 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-sgrd6" Jul 15 16:43:36.319300 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.319149 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 15 16:43:36.319300 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.319166 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 15 16:43:36.319482 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.319465 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 15 16:43:36.319684 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.319663 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-2clqz\"" Jul 15 16:43:36.322024 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.321978 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2748021c-88bb-4663-bdd3-a58eb99055b7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-wvb5d\" (UID: \"2748021c-88bb-4663-bdd3-a58eb99055b7\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wvb5d" Jul 15 16:43:36.322134 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.322039 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mpng\" (UniqueName: \"kubernetes.io/projected/2748021c-88bb-4663-bdd3-a58eb99055b7-kube-api-access-8mpng\") pod \"openshift-state-metrics-84bd68b896-wvb5d\" (UID: \"2748021c-88bb-4663-bdd3-a58eb99055b7\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wvb5d" Jul 15 16:43:36.322134 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.322091 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2748021c-88bb-4663-bdd3-a58eb99055b7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-wvb5d\" (UID: \"2748021c-88bb-4663-bdd3-a58eb99055b7\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wvb5d" Jul 15 16:43:36.322235 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.322142 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2748021c-88bb-4663-bdd3-a58eb99055b7-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-wvb5d\" (UID: \"2748021c-88bb-4663-bdd3-a58eb99055b7\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wvb5d" Jul 15 16:43:36.329608 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.329586 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-sgrd6"] Jul 15 16:43:36.332258 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.332238 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-l6ddv"] Jul 15 16:43:36.343530 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.343010 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l6ddv" Jul 15 16:43:36.346195 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.346170 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 15 16:43:36.346318 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.346300 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 15 16:43:36.346412 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.346396 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 15 16:43:36.346464 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.346311 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6zrvq\"" Jul 15 16:43:36.423080 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.423017 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/89319841-337a-497d-b21a-2fb3b88cb5c5-node-exporter-wtmp\") pod \"node-exporter-l6ddv\" (UID: \"89319841-337a-497d-b21a-2fb3b88cb5c5\") " pod="openshift-monitoring/node-exporter-l6ddv" Jul 15 16:43:36.423080 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.423053 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8lwl\" (UniqueName: \"kubernetes.io/projected/4c86b83a-9e88-40fe-bd48-de0cd484b746-kube-api-access-p8lwl\") pod \"kube-state-metrics-785778ff74-sgrd6\" (UID: \"4c86b83a-9e88-40fe-bd48-de0cd484b746\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sgrd6" Jul 15 16:43:36.423230 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.423085 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/89319841-337a-497d-b21a-2fb3b88cb5c5-node-exporter-accelerators-collector-config\") pod \"node-exporter-l6ddv\" (UID: \"89319841-337a-497d-b21a-2fb3b88cb5c5\") " pod="openshift-monitoring/node-exporter-l6ddv" Jul 15 16:43:36.423230 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.423146 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c86b83a-9e88-40fe-bd48-de0cd484b746-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-sgrd6\" (UID: \"4c86b83a-9e88-40fe-bd48-de0cd484b746\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sgrd6" Jul 15 16:43:36.423230 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.423195 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/89319841-337a-497d-b21a-2fb3b88cb5c5-node-exporter-tls\") pod \"node-exporter-l6ddv\" (UID: \"89319841-337a-497d-b21a-2fb3b88cb5c5\") " pod="openshift-monitoring/node-exporter-l6ddv" Jul 15 16:43:36.423230 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.423217 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c86b83a-9e88-40fe-bd48-de0cd484b746-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-sgrd6\" (UID: \"4c86b83a-9e88-40fe-bd48-de0cd484b746\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sgrd6" Jul 15 16:43:36.423385 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.423242 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4c86b83a-9e88-40fe-bd48-de0cd484b746-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-sgrd6\" (UID: \"4c86b83a-9e88-40fe-bd48-de0cd484b746\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sgrd6" Jul 15 16:43:36.423385 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.423278 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89319841-337a-497d-b21a-2fb3b88cb5c5-sys\") pod \"node-exporter-l6ddv\" (UID: \"89319841-337a-497d-b21a-2fb3b88cb5c5\") " pod="openshift-monitoring/node-exporter-l6ddv" Jul 15 16:43:36.423385 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.423300 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4c86b83a-9e88-40fe-bd48-de0cd484b746-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-sgrd6\" (UID: \"4c86b83a-9e88-40fe-bd48-de0cd484b746\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sgrd6" Jul 15 16:43:36.423385 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.423329 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2748021c-88bb-4663-bdd3-a58eb99055b7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-wvb5d\" (UID: \"2748021c-88bb-4663-bdd3-a58eb99055b7\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wvb5d" Jul 15 16:43:36.423385 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.423353 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/89319841-337a-497d-b21a-2fb3b88cb5c5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l6ddv\" (UID: \"89319841-337a-497d-b21a-2fb3b88cb5c5\") " pod="openshift-monitoring/node-exporter-l6ddv" Jul 15 16:43:36.423385 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.423374 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smgqk\" (UniqueName: \"kubernetes.io/projected/89319841-337a-497d-b21a-2fb3b88cb5c5-kube-api-access-smgqk\") pod \"node-exporter-l6ddv\" (UID: \"89319841-337a-497d-b21a-2fb3b88cb5c5\") " pod="openshift-monitoring/node-exporter-l6ddv" Jul 15 16:43:36.423586 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.423395 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4c86b83a-9e88-40fe-bd48-de0cd484b746-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-sgrd6\" (UID: \"4c86b83a-9e88-40fe-bd48-de0cd484b746\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sgrd6" Jul 15 16:43:36.423586 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.423567 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89319841-337a-497d-b21a-2fb3b88cb5c5-metrics-client-ca\") pod \"node-exporter-l6ddv\" (UID: \"89319841-337a-497d-b21a-2fb3b88cb5c5\") " pod="openshift-monitoring/node-exporter-l6ddv" Jul 15 16:43:36.423669 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.423594 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mpng\" (UniqueName: \"kubernetes.io/projected/2748021c-88bb-4663-bdd3-a58eb99055b7-kube-api-access-8mpng\") pod \"openshift-state-metrics-84bd68b896-wvb5d\" (UID: \"2748021c-88bb-4663-bdd3-a58eb99055b7\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wvb5d" Jul 15 16:43:36.423669 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.423621 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/89319841-337a-497d-b21a-2fb3b88cb5c5-root\") pod \"node-exporter-l6ddv\" (UID: \"89319841-337a-497d-b21a-2fb3b88cb5c5\") " pod="openshift-monitoring/node-exporter-l6ddv" Jul 15 16:43:36.423669 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.423642 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/89319841-337a-497d-b21a-2fb3b88cb5c5-node-exporter-textfile\") pod \"node-exporter-l6ddv\" (UID: \"89319841-337a-497d-b21a-2fb3b88cb5c5\") " pod="openshift-monitoring/node-exporter-l6ddv" Jul 15 16:43:36.423828 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.423676 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2748021c-88bb-4663-bdd3-a58eb99055b7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-wvb5d\" (UID: \"2748021c-88bb-4663-bdd3-a58eb99055b7\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wvb5d" Jul 15 16:43:36.423828 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.423721 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2748021c-88bb-4663-bdd3-a58eb99055b7-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-wvb5d\" (UID: \"2748021c-88bb-4663-bdd3-a58eb99055b7\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wvb5d" Jul 15 16:43:36.424395 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.424374 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2748021c-88bb-4663-bdd3-a58eb99055b7-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-wvb5d\" (UID: \"2748021c-88bb-4663-bdd3-a58eb99055b7\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wvb5d" Jul 15 16:43:36.425936 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.425905 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2748021c-88bb-4663-bdd3-a58eb99055b7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-wvb5d\" (UID: \"2748021c-88bb-4663-bdd3-a58eb99055b7\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wvb5d" Jul 15 16:43:36.426228 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.426195 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2748021c-88bb-4663-bdd3-a58eb99055b7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-wvb5d\" (UID: \"2748021c-88bb-4663-bdd3-a58eb99055b7\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wvb5d" Jul 15 16:43:36.432588 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.432569 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mpng\" (UniqueName: \"kubernetes.io/projected/2748021c-88bb-4663-bdd3-a58eb99055b7-kube-api-access-8mpng\") pod \"openshift-state-metrics-84bd68b896-wvb5d\" (UID: \"2748021c-88bb-4663-bdd3-a58eb99055b7\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wvb5d" Jul 15 16:43:36.524647 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.524625 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89319841-337a-497d-b21a-2fb3b88cb5c5-metrics-client-ca\") pod \"node-exporter-l6ddv\" (UID: \"89319841-337a-497d-b21a-2fb3b88cb5c5\") " pod="openshift-monitoring/node-exporter-l6ddv" Jul 15 16:43:36.524762 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.524664 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/89319841-337a-497d-b21a-2fb3b88cb5c5-root\") pod \"node-exporter-l6ddv\" (UID: \"89319841-337a-497d-b21a-2fb3b88cb5c5\") " pod="openshift-monitoring/node-exporter-l6ddv" Jul 15 16:43:36.524762 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.524687 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/89319841-337a-497d-b21a-2fb3b88cb5c5-node-exporter-textfile\") pod \"node-exporter-l6ddv\" (UID: \"89319841-337a-497d-b21a-2fb3b88cb5c5\") " pod="openshift-monitoring/node-exporter-l6ddv" Jul 15 16:43:36.524762 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.524732 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/89319841-337a-497d-b21a-2fb3b88cb5c5-node-exporter-wtmp\") pod \"node-exporter-l6ddv\" (UID: \"89319841-337a-497d-b21a-2fb3b88cb5c5\") " pod="openshift-monitoring/node-exporter-l6ddv" Jul 15 16:43:36.524925 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.524772 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8lwl\" (UniqueName: \"kubernetes.io/projected/4c86b83a-9e88-40fe-bd48-de0cd484b746-kube-api-access-p8lwl\") pod \"kube-state-metrics-785778ff74-sgrd6\" (UID: \"4c86b83a-9e88-40fe-bd48-de0cd484b746\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sgrd6" Jul 15 16:43:36.524925 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.524804 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/89319841-337a-497d-b21a-2fb3b88cb5c5-node-exporter-accelerators-collector-config\") pod \"node-exporter-l6ddv\" (UID: \"89319841-337a-497d-b21a-2fb3b88cb5c5\") " pod="openshift-monitoring/node-exporter-l6ddv" Jul 15 16:43:36.524925 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.524842 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c86b83a-9e88-40fe-bd48-de0cd484b746-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-sgrd6\" (UID: \"4c86b83a-9e88-40fe-bd48-de0cd484b746\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sgrd6" Jul 15 16:43:36.524925 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.524876 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/89319841-337a-497d-b21a-2fb3b88cb5c5-node-exporter-wtmp\") pod \"node-exporter-l6ddv\" (UID: \"89319841-337a-497d-b21a-2fb3b88cb5c5\") " pod="openshift-monitoring/node-exporter-l6ddv" Jul 15 16:43:36.524925 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.524881 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/89319841-337a-497d-b21a-2fb3b88cb5c5-node-exporter-tls\") pod \"node-exporter-l6ddv\" (UID: \"89319841-337a-497d-b21a-2fb3b88cb5c5\") " pod="openshift-monitoring/node-exporter-l6ddv" Jul 15 16:43:36.525171 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.524927 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c86b83a-9e88-40fe-bd48-de0cd484b746-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-sgrd6\" (UID: \"4c86b83a-9e88-40fe-bd48-de0cd484b746\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sgrd6" Jul 15 16:43:36.525171 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:43:36.524958 2559 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 15 16:43:36.525171 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:43:36.525008 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89319841-337a-497d-b21a-2fb3b88cb5c5-node-exporter-tls podName:89319841-337a-497d-b21a-2fb3b88cb5c5 nodeName:}" failed. No retries permitted until 2026-07-15 16:43:37.024990982 +0000 UTC m=+203.452083047 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/89319841-337a-497d-b21a-2fb3b88cb5c5-node-exporter-tls") pod "node-exporter-l6ddv" (UID: "89319841-337a-497d-b21a-2fb3b88cb5c5") : secret "node-exporter-tls" not found Jul 15 16:43:36.525171 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.524955 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4c86b83a-9e88-40fe-bd48-de0cd484b746-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-sgrd6\" (UID: \"4c86b83a-9e88-40fe-bd48-de0cd484b746\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sgrd6" Jul 15 16:43:36.525367 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.525207 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89319841-337a-497d-b21a-2fb3b88cb5c5-sys\") pod \"node-exporter-l6ddv\" (UID: \"89319841-337a-497d-b21a-2fb3b88cb5c5\") " pod="openshift-monitoring/node-exporter-l6ddv" Jul 15 16:43:36.525367 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.525234 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4c86b83a-9e88-40fe-bd48-de0cd484b746-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-sgrd6\" (UID: \"4c86b83a-9e88-40fe-bd48-de0cd484b746\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sgrd6" Jul 15 16:43:36.525367 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.525240 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89319841-337a-497d-b21a-2fb3b88cb5c5-metrics-client-ca\") pod \"node-exporter-l6ddv\" (UID: \"89319841-337a-497d-b21a-2fb3b88cb5c5\") " pod="openshift-monitoring/node-exporter-l6ddv" Jul 15 16:43:36.525367 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.525261 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/89319841-337a-497d-b21a-2fb3b88cb5c5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l6ddv\" (UID: \"89319841-337a-497d-b21a-2fb3b88cb5c5\") " pod="openshift-monitoring/node-exporter-l6ddv" Jul 15 16:43:36.525367 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.525287 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smgqk\" (UniqueName: \"kubernetes.io/projected/89319841-337a-497d-b21a-2fb3b88cb5c5-kube-api-access-smgqk\") pod \"node-exporter-l6ddv\" (UID: \"89319841-337a-497d-b21a-2fb3b88cb5c5\") " pod="openshift-monitoring/node-exporter-l6ddv" Jul 15 16:43:36.525367 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:43:36.525307 2559 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 15 16:43:36.525367 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.525312 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4c86b83a-9e88-40fe-bd48-de0cd484b746-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-sgrd6\" (UID: \"4c86b83a-9e88-40fe-bd48-de0cd484b746\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sgrd6" Jul 15 16:43:36.525367 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:43:36.525358 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c86b83a-9e88-40fe-bd48-de0cd484b746-kube-state-metrics-tls podName:4c86b83a-9e88-40fe-bd48-de0cd484b746 nodeName:}" failed. No retries permitted until 2026-07-15 16:43:37.025341223 +0000 UTC m=+203.452433289 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/4c86b83a-9e88-40fe-bd48-de0cd484b746-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-sgrd6" (UID: "4c86b83a-9e88-40fe-bd48-de0cd484b746") : secret "kube-state-metrics-tls" not found Jul 15 16:43:36.525721 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.525663 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4c86b83a-9e88-40fe-bd48-de0cd484b746-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-sgrd6\" (UID: \"4c86b83a-9e88-40fe-bd48-de0cd484b746\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sgrd6" Jul 15 16:43:36.525721 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.524771 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/89319841-337a-497d-b21a-2fb3b88cb5c5-root\") pod \"node-exporter-l6ddv\" (UID: \"89319841-337a-497d-b21a-2fb3b88cb5c5\") " pod="openshift-monitoring/node-exporter-l6ddv" Jul 15 16:43:36.525721 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.525691 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/89319841-337a-497d-b21a-2fb3b88cb5c5-node-exporter-accelerators-collector-config\") pod \"node-exporter-l6ddv\" (UID: \"89319841-337a-497d-b21a-2fb3b88cb5c5\") " pod="openshift-monitoring/node-exporter-l6ddv" Jul 15 16:43:36.525878 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.525774 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89319841-337a-497d-b21a-2fb3b88cb5c5-sys\") pod \"node-exporter-l6ddv\" (UID: \"89319841-337a-497d-b21a-2fb3b88cb5c5\") " pod="openshift-monitoring/node-exporter-l6ddv" Jul 15 16:43:36.526182 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.525946 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c86b83a-9e88-40fe-bd48-de0cd484b746-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-sgrd6\" (UID: \"4c86b83a-9e88-40fe-bd48-de0cd484b746\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sgrd6" Jul 15 16:43:36.526182 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.526158 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/89319841-337a-497d-b21a-2fb3b88cb5c5-node-exporter-textfile\") pod \"node-exporter-l6ddv\" (UID: \"89319841-337a-497d-b21a-2fb3b88cb5c5\") " pod="openshift-monitoring/node-exporter-l6ddv" Jul 15 16:43:36.526361 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.526329 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4c86b83a-9e88-40fe-bd48-de0cd484b746-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-sgrd6\" (UID: \"4c86b83a-9e88-40fe-bd48-de0cd484b746\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sgrd6" Jul 15 16:43:36.527444 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.527422 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4c86b83a-9e88-40fe-bd48-de0cd484b746-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-sgrd6\" (UID: \"4c86b83a-9e88-40fe-bd48-de0cd484b746\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sgrd6" Jul 15 16:43:36.527843 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.527817 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/89319841-337a-497d-b21a-2fb3b88cb5c5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l6ddv\" (UID: \"89319841-337a-497d-b21a-2fb3b88cb5c5\") " pod="openshift-monitoring/node-exporter-l6ddv" Jul 15 16:43:36.543078 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.543049 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smgqk\" (UniqueName: \"kubernetes.io/projected/89319841-337a-497d-b21a-2fb3b88cb5c5-kube-api-access-smgqk\") pod \"node-exporter-l6ddv\" (UID: \"89319841-337a-497d-b21a-2fb3b88cb5c5\") " pod="openshift-monitoring/node-exporter-l6ddv" Jul 15 16:43:36.544069 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.544046 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8lwl\" (UniqueName: \"kubernetes.io/projected/4c86b83a-9e88-40fe-bd48-de0cd484b746-kube-api-access-p8lwl\") pod \"kube-state-metrics-785778ff74-sgrd6\" (UID: \"4c86b83a-9e88-40fe-bd48-de0cd484b746\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sgrd6" Jul 15 16:43:36.615397 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.615373 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wvb5d" Jul 15 16:43:36.774019 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.773989 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-wvb5d"] Jul 15 16:43:36.776846 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:43:36.776817 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2748021c_88bb_4663_bdd3_a58eb99055b7.slice/crio-d9f6bd01d13715c0c3e6093b08a822db6997225c5c5bf69f167273b96e99fa9c WatchSource:0}: Error finding container d9f6bd01d13715c0c3e6093b08a822db6997225c5c5bf69f167273b96e99fa9c: Status 404 returned error can't find the container with id d9f6bd01d13715c0c3e6093b08a822db6997225c5c5bf69f167273b96e99fa9c Jul 15 16:43:36.802611 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.802582 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wvb5d" event={"ID":"2748021c-88bb-4663-bdd3-a58eb99055b7","Type":"ContainerStarted","Data":"d9f6bd01d13715c0c3e6093b08a822db6997225c5c5bf69f167273b96e99fa9c"} Jul 15 16:43:36.804325 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.804309 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vcxdn_268a4cb9-c310-4681-91a6-efe9692f8327/console-operator/2.log" Jul 15 16:43:36.804407 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.804360 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-vcxdn" event={"ID":"268a4cb9-c310-4681-91a6-efe9692f8327","Type":"ContainerStarted","Data":"e4ee4c1e0497fca09701fcc9ea951d13309d4c96f086ff56a39ba1997d73cb9c"} Jul 15 16:43:36.804661 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.804646 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-vcxdn" Jul 15 16:43:36.809124 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.809102 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-vcxdn" Jul 15 16:43:36.841954 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:36.841907 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-vcxdn" podStartSLOduration=42.658966117 podStartE2EDuration="45.841886724s" totalImagesPullingTime="3.182920607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:42:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:43:36.840451047 +0000 UTC m=+203.267543154" watchObservedRunningTime="2026-07-15 16:43:36.841886724 +0000 UTC m=+203.268978808" Jul 15 16:43:37.030182 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.030106 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/89319841-337a-497d-b21a-2fb3b88cb5c5-node-exporter-tls\") pod \"node-exporter-l6ddv\" (UID: \"89319841-337a-497d-b21a-2fb3b88cb5c5\") " pod="openshift-monitoring/node-exporter-l6ddv" Jul 15 16:43:37.030182 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.030138 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c86b83a-9e88-40fe-bd48-de0cd484b746-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-sgrd6\" (UID: \"4c86b83a-9e88-40fe-bd48-de0cd484b746\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sgrd6" Jul 15 16:43:37.032514 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.032488 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/89319841-337a-497d-b21a-2fb3b88cb5c5-node-exporter-tls\") pod \"node-exporter-l6ddv\" (UID: \"89319841-337a-497d-b21a-2fb3b88cb5c5\") " pod="openshift-monitoring/node-exporter-l6ddv" Jul 15 16:43:37.032620 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.032603 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c86b83a-9e88-40fe-bd48-de0cd484b746-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-sgrd6\" (UID: \"4c86b83a-9e88-40fe-bd48-de0cd484b746\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sgrd6" Jul 15 16:43:37.227040 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.227014 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-sgrd6" Jul 15 16:43:37.252698 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.252668 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l6ddv" Jul 15 16:43:37.265699 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:43:37.264555 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89319841_337a_497d_b21a_2fb3b88cb5c5.slice/crio-57df2d9a236559477788f8d758d38c6eb38b8145bf91a03135246ada7f989125 WatchSource:0}: Error finding container 57df2d9a236559477788f8d758d38c6eb38b8145bf91a03135246ada7f989125: Status 404 returned error can't find the container with id 57df2d9a236559477788f8d758d38c6eb38b8145bf91a03135246ada7f989125 Jul 15 16:43:37.375265 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.375232 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-sgrd6"] Jul 15 16:43:37.377978 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:43:37.377947 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c86b83a_9e88_40fe_bd48_de0cd484b746.slice/crio-d3d9a63362d3cf31f7c396ad9fb597ecf48966b56e49edbff5b74cf3bd66e7b8 WatchSource:0}: Error finding container d3d9a63362d3cf31f7c396ad9fb597ecf48966b56e49edbff5b74cf3bd66e7b8: Status 404 returned error can't find the container with id d3d9a63362d3cf31f7c396ad9fb597ecf48966b56e49edbff5b74cf3bd66e7b8 Jul 15 16:43:37.403849 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.403819 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 16:43:37.407666 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.407641 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:43:37.411047 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.411024 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 15 16:43:37.411323 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.411302 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 15 16:43:37.411573 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.411546 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-x6kfw\"" Jul 15 16:43:37.411658 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.411546 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 15 16:43:37.412073 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.411957 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 15 16:43:37.412181 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.412162 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 15 16:43:37.412261 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.412172 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 15 16:43:37.412402 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.412369 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 15 16:43:37.412509 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.412497 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 15 16:43:37.412633 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.412607 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 15 16:43:37.425185 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.425164 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 16:43:37.433963 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.433941 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3dcf2227-5799-473b-bc53-79c3deb1f352-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:43:37.434066 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.433989 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dcf2227-5799-473b-bc53-79c3deb1f352-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:43:37.434066 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.434045 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3dcf2227-5799-473b-bc53-79c3deb1f352-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:43:37.434151 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.434071 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3dcf2227-5799-473b-bc53-79c3deb1f352-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:43:37.434151 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.434105 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3dcf2227-5799-473b-bc53-79c3deb1f352-config-out\") pod \"alertmanager-main-0\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:43:37.434246 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.434163 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qj56\" (UniqueName: \"kubernetes.io/projected/3dcf2227-5799-473b-bc53-79c3deb1f352-kube-api-access-5qj56\") pod \"alertmanager-main-0\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:43:37.434246 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.434211 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3dcf2227-5799-473b-bc53-79c3deb1f352-config-volume\") pod \"alertmanager-main-0\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:43:37.434316 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.434242 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3dcf2227-5799-473b-bc53-79c3deb1f352-web-config\") pod \"alertmanager-main-0\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:43:37.434362 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.434338 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3dcf2227-5799-473b-bc53-79c3deb1f352-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:43:37.434413 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.434380 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3dcf2227-5799-473b-bc53-79c3deb1f352-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:43:37.434413 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.434407 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3dcf2227-5799-473b-bc53-79c3deb1f352-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:43:37.434482 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.434456 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3dcf2227-5799-473b-bc53-79c3deb1f352-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:43:37.434550 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.434529 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3dcf2227-5799-473b-bc53-79c3deb1f352-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:43:37.535794 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.535759 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3dcf2227-5799-473b-bc53-79c3deb1f352-config-volume\") pod \"alertmanager-main-0\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:43:37.535966 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.535807 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3dcf2227-5799-473b-bc53-79c3deb1f352-web-config\") pod \"alertmanager-main-0\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:43:37.535966 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.535854 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3dcf2227-5799-473b-bc53-79c3deb1f352-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:43:37.535966 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.535881 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3dcf2227-5799-473b-bc53-79c3deb1f352-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:43:37.535966 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.535905 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3dcf2227-5799-473b-bc53-79c3deb1f352-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:43:37.535966 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.535951 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3dcf2227-5799-473b-bc53-79c3deb1f352-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:43:37.536245 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.536003 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3dcf2227-5799-473b-bc53-79c3deb1f352-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:43:37.536245 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.536028 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3dcf2227-5799-473b-bc53-79c3deb1f352-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:43:37.536245 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.536052 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dcf2227-5799-473b-bc53-79c3deb1f352-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:43:37.536245 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.536080 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3dcf2227-5799-473b-bc53-79c3deb1f352-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:43:37.536245 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.536104 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3dcf2227-5799-473b-bc53-79c3deb1f352-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:43:37.536245 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.536130 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3dcf2227-5799-473b-bc53-79c3deb1f352-config-out\") pod \"alertmanager-main-0\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:43:37.536245 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.536168 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qj56\" (UniqueName: \"kubernetes.io/projected/3dcf2227-5799-473b-bc53-79c3deb1f352-kube-api-access-5qj56\") pod \"alertmanager-main-0\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:43:37.536608 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.536463 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3dcf2227-5799-473b-bc53-79c3deb1f352-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:43:37.537357 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.537329 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dcf2227-5799-473b-bc53-79c3deb1f352-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:43:37.538731 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.538384 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3dcf2227-5799-473b-bc53-79c3deb1f352-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:43:37.539405 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.539157 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3dcf2227-5799-473b-bc53-79c3deb1f352-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:43:37.539405 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.539359 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3dcf2227-5799-473b-bc53-79c3deb1f352-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:43:37.539601 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.539583 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3dcf2227-5799-473b-bc53-79c3deb1f352-config-volume\") pod \"alertmanager-main-0\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:43:37.539983 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.539962 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3dcf2227-5799-473b-bc53-79c3deb1f352-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:43:37.540063 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.539975 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3dcf2227-5799-473b-bc53-79c3deb1f352-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:43:37.540224 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.540206 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3dcf2227-5799-473b-bc53-79c3deb1f352-config-out\") pod \"alertmanager-main-0\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:43:37.540789 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.540765 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3dcf2227-5799-473b-bc53-79c3deb1f352-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:43:37.541202 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.541179 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3dcf2227-5799-473b-bc53-79c3deb1f352-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:43:37.541695 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.541674 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3dcf2227-5799-473b-bc53-79c3deb1f352-web-config\") pod \"alertmanager-main-0\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:43:37.547896 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.547867 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qj56\" (UniqueName: \"kubernetes.io/projected/3dcf2227-5799-473b-bc53-79c3deb1f352-kube-api-access-5qj56\") pod \"alertmanager-main-0\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:43:37.720632 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.720603 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:43:37.811211 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.811168 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l6ddv" event={"ID":"89319841-337a-497d-b21a-2fb3b88cb5c5","Type":"ContainerStarted","Data":"57df2d9a236559477788f8d758d38c6eb38b8145bf91a03135246ada7f989125"} Jul 15 16:43:37.815043 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.814511 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wvb5d" event={"ID":"2748021c-88bb-4663-bdd3-a58eb99055b7","Type":"ContainerStarted","Data":"6cd54b25d1e082242b71c350652a6d66591fae556abe54c8a815841cf96bc504"} Jul 15 16:43:37.815043 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.814573 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wvb5d" event={"ID":"2748021c-88bb-4663-bdd3-a58eb99055b7","Type":"ContainerStarted","Data":"3824913c6814997c696a34811722d7f1943a5bc17856483f7809b22131d6b4ce"} Jul 15 16:43:37.815043 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.814601 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wvb5d" event={"ID":"2748021c-88bb-4663-bdd3-a58eb99055b7","Type":"ContainerStarted","Data":"cb4fb4c75b8bb4e65e47e6c1114ef3d132fc322a631753281559c663c16f04e6"} Jul 15 16:43:37.816263 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.816058 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-sgrd6" event={"ID":"4c86b83a-9e88-40fe-bd48-de0cd484b746","Type":"ContainerStarted","Data":"d3d9a63362d3cf31f7c396ad9fb597ecf48966b56e49edbff5b74cf3bd66e7b8"} Jul 15 16:43:37.837723 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.837669 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wvb5d" podStartSLOduration=1.007097414 podStartE2EDuration="1.837645075s" totalImagesPullingTime="830.547661ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:43:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:43:37.831404651 +0000 UTC m=+204.258496763" watchObservedRunningTime="2026-07-15 16:43:37.837645075 +0000 UTC m=+204.264737159" Jul 15 16:43:37.869328 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:37.869261 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 16:43:37.871504 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:43:37.871474 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dcf2227_5799_473b_bc53_79c3deb1f352.slice/crio-19b2b7c70b8b5ff08eac5e65e3f12cc2bc781f998a6a38478d59dbf4b38c1a30 WatchSource:0}: Error finding container 19b2b7c70b8b5ff08eac5e65e3f12cc2bc781f998a6a38478d59dbf4b38c1a30: Status 404 returned error can't find the container with id 19b2b7c70b8b5ff08eac5e65e3f12cc2bc781f998a6a38478d59dbf4b38c1a30 Jul 15 16:43:38.822862 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:38.822729 2559 generic.go:356] "Generic (PLEG): container finished" podID="89319841-337a-497d-b21a-2fb3b88cb5c5" containerID="bf1f0923ac3e5044ee6c6e73f1727f4fee6d64abec018887f98a3784ce8ffe86" exitCode=0 Jul 15 16:43:38.822862 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:38.822789 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l6ddv" event={"ID":"89319841-337a-497d-b21a-2fb3b88cb5c5","Type":"ContainerDied","Data":"bf1f0923ac3e5044ee6c6e73f1727f4fee6d64abec018887f98a3784ce8ffe86"} Jul 15 16:43:38.824644 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:38.824614 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3dcf2227-5799-473b-bc53-79c3deb1f352","Type":"ContainerStarted","Data":"19b2b7c70b8b5ff08eac5e65e3f12cc2bc781f998a6a38478d59dbf4b38c1a30"} Jul 15 16:43:39.830560 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:39.830523 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l6ddv" event={"ID":"89319841-337a-497d-b21a-2fb3b88cb5c5","Type":"ContainerStarted","Data":"8833057a649b26b93663cfffee77eaa025909536422e6d4936d71cc7af543005"} Jul 15 16:43:39.830999 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:39.830585 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l6ddv" event={"ID":"89319841-337a-497d-b21a-2fb3b88cb5c5","Type":"ContainerStarted","Data":"f66e660f940dc223abf7fd985f761eb8d148f1aa97ecc1a890088750b098243f"} Jul 15 16:43:39.832176 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:39.832153 2559 generic.go:356] "Generic (PLEG): container finished" podID="3dcf2227-5799-473b-bc53-79c3deb1f352" containerID="e67ea91eef5a6565d9e54decd27f2b41f4eaefeb3fcbb0f970f9854d7b31272f" exitCode=0 Jul 15 16:43:39.832502 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:39.832202 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3dcf2227-5799-473b-bc53-79c3deb1f352","Type":"ContainerDied","Data":"e67ea91eef5a6565d9e54decd27f2b41f4eaefeb3fcbb0f970f9854d7b31272f"} Jul 15 16:43:39.836065 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:39.836041 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-sgrd6" event={"ID":"4c86b83a-9e88-40fe-bd48-de0cd484b746","Type":"ContainerStarted","Data":"ca97b533809ae32c2a9705a8573cc57b082dc8dce67a3dfd64435d1a70ad9a9c"} Jul 15 16:43:39.836151 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:39.836094 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-sgrd6" event={"ID":"4c86b83a-9e88-40fe-bd48-de0cd484b746","Type":"ContainerStarted","Data":"cd4295b0975f991f76442eb5e81d34de1a1ed16e34b9aa69ac3b1185d5c86ff8"} Jul 15 16:43:39.836151 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:39.836125 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-sgrd6" event={"ID":"4c86b83a-9e88-40fe-bd48-de0cd484b746","Type":"ContainerStarted","Data":"8b52998838c66fd4b882ed13a3ab7bd58508a6630a3d6a8467aee003e5bdea00"} Jul 15 16:43:39.851214 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:39.851165 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-l6ddv" podStartSLOduration=2.801940271 podStartE2EDuration="3.851147061s" totalImagesPullingTime="985.644114ms" totalInitContainerRuntime="63.562676ms" isStatefulPod=true podCreationTimestamp="2026-07-15 16:43:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:43:39.849448984 +0000 UTC m=+206.276541068" watchObservedRunningTime="2026-07-15 16:43:39.851147061 +0000 UTC m=+206.278239145" Jul 15 16:43:39.868064 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:39.868017 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-sgrd6" podStartSLOduration=1.846265407 podStartE2EDuration="3.868003052s" totalImagesPullingTime="2.021737645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:43:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:43:39.86741385 +0000 UTC m=+206.294505933" watchObservedRunningTime="2026-07-15 16:43:39.868003052 +0000 UTC m=+206.295095136" Jul 15 16:43:41.085528 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:41.085507 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-ftbvc"] Jul 15 16:43:41.087667 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:41.087649 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-ftbvc" Jul 15 16:43:41.090148 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:41.090108 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 15 16:43:41.090361 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:41.090337 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-p79zq\"" Jul 15 16:43:41.096045 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:41.096022 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-ftbvc"] Jul 15 16:43:41.170118 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:41.170096 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs6rc\" (UniqueName: \"kubernetes.io/projected/b77182b9-ad00-4a6e-8166-d93b24cd4969-kube-api-access-gs6rc\") pod \"monitoring-plugin-5f68df7f58-ftbvc\" (UID: \"b77182b9-ad00-4a6e-8166-d93b24cd4969\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-ftbvc" Jul 15 16:43:41.170241 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:41.170152 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b77182b9-ad00-4a6e-8166-d93b24cd4969-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-ftbvc\" (UID: \"b77182b9-ad00-4a6e-8166-d93b24cd4969\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-ftbvc" Jul 15 16:43:41.272768 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:41.271035 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b77182b9-ad00-4a6e-8166-d93b24cd4969-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-ftbvc\" (UID: \"b77182b9-ad00-4a6e-8166-d93b24cd4969\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-ftbvc" Jul 15 16:43:41.272768 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:41.271136 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs6rc\" (UniqueName: \"kubernetes.io/projected/b77182b9-ad00-4a6e-8166-d93b24cd4969-kube-api-access-gs6rc\") pod \"monitoring-plugin-5f68df7f58-ftbvc\" (UID: \"b77182b9-ad00-4a6e-8166-d93b24cd4969\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-ftbvc" Jul 15 16:43:41.272768 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:43:41.271492 2559 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 15 16:43:41.272768 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:43:41.271545 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b77182b9-ad00-4a6e-8166-d93b24cd4969-monitoring-plugin-cert podName:b77182b9-ad00-4a6e-8166-d93b24cd4969 nodeName:}" failed. No retries permitted until 2026-07-15 16:43:41.771526182 +0000 UTC m=+208.198618256 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/b77182b9-ad00-4a6e-8166-d93b24cd4969-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-ftbvc" (UID: "b77182b9-ad00-4a6e-8166-d93b24cd4969") : secret "monitoring-plugin-cert" not found Jul 15 16:43:41.281082 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:41.281060 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs6rc\" (UniqueName: \"kubernetes.io/projected/b77182b9-ad00-4a6e-8166-d93b24cd4969-kube-api-access-gs6rc\") pod \"monitoring-plugin-5f68df7f58-ftbvc\" (UID: \"b77182b9-ad00-4a6e-8166-d93b24cd4969\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-ftbvc" Jul 15 16:43:41.775722 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:41.775690 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b77182b9-ad00-4a6e-8166-d93b24cd4969-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-ftbvc\" (UID: \"b77182b9-ad00-4a6e-8166-d93b24cd4969\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-ftbvc" Jul 15 16:43:41.777932 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:41.777905 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b77182b9-ad00-4a6e-8166-d93b24cd4969-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-ftbvc\" (UID: \"b77182b9-ad00-4a6e-8166-d93b24cd4969\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-ftbvc" Jul 15 16:43:41.846881 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:41.846850 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3dcf2227-5799-473b-bc53-79c3deb1f352","Type":"ContainerStarted","Data":"02f85118d2f082e70faf8dc35b3856eb537b6428b76d88d9f8b66c9b7cfa2258"} Jul 15 16:43:41.847004 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:41.846910 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3dcf2227-5799-473b-bc53-79c3deb1f352","Type":"ContainerStarted","Data":"ddc736d36179cb2daf3b2c2769e57244b662c2609ed2e71afa613f41dcac21fc"} Jul 15 16:43:41.847004 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:41.846935 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3dcf2227-5799-473b-bc53-79c3deb1f352","Type":"ContainerStarted","Data":"2619320d2feea0be2fd7ecef3884bfe87a29bbed226a7b45622169d81bc1dfd4"} Jul 15 16:43:41.847004 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:41.846958 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3dcf2227-5799-473b-bc53-79c3deb1f352","Type":"ContainerStarted","Data":"27917a1123fb340c64f367a3237d464d45b0d7d29d41620139659d039714219f"} Jul 15 16:43:41.847004 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:41.846979 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3dcf2227-5799-473b-bc53-79c3deb1f352","Type":"ContainerStarted","Data":"9376f25c0c774d217cb82057600f2b06c743c51cc62998c2f1480ad3bd92f3b4"} Jul 15 16:43:42.018443 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:42.018415 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-ftbvc" Jul 15 16:43:42.173555 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:42.173528 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-ftbvc"] Jul 15 16:43:42.223434 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:43:42.223405 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb77182b9_ad00_4a6e_8166_d93b24cd4969.slice/crio-cbe8f837130b052d05d84cb3d74f5cf97bd1363d7a4161afed824f25364e940b WatchSource:0}: Error finding container cbe8f837130b052d05d84cb3d74f5cf97bd1363d7a4161afed824f25364e940b: Status 404 returned error can't find the container with id cbe8f837130b052d05d84cb3d74f5cf97bd1363d7a4161afed824f25364e940b Jul 15 16:43:42.855610 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:42.855578 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3dcf2227-5799-473b-bc53-79c3deb1f352","Type":"ContainerStarted","Data":"f32740a568cca1fe08f5393b880d15758bfe2789d52a8242dcb8e3f4d8f1dd45"} Jul 15 16:43:42.856813 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:42.856785 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-ftbvc" event={"ID":"b77182b9-ad00-4a6e-8166-d93b24cd4969","Type":"ContainerStarted","Data":"cbe8f837130b052d05d84cb3d74f5cf97bd1363d7a4161afed824f25364e940b"} Jul 15 16:43:42.884599 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:42.884522 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.209333447 podStartE2EDuration="5.884498336s" totalImagesPullingTime="3.655361478s" totalInitContainerRuntime="19.803411ms" isStatefulPod=false podCreationTimestamp="2026-07-15 16:43:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:43:42.880914068 +0000 UTC m=+209.308006151" watchObservedRunningTime="2026-07-15 16:43:42.884498336 +0000 UTC m=+209.311590420" Jul 15 16:43:46.005705 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:46.005674 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cb75775c9-x2lwt"] Jul 15 16:43:46.038389 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:46.038363 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cb75775c9-x2lwt"] Jul 15 16:43:46.038519 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:46.038455 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb75775c9-x2lwt" Jul 15 16:43:46.041710 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:46.041686 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 15 16:43:46.042063 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:46.041693 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 15 16:43:46.042063 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:46.041771 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 15 16:43:46.042063 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:46.041769 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 15 16:43:46.042063 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:46.041769 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-879ps\"" Jul 15 16:43:46.042628 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:46.042610 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 15 16:43:46.042729 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:46.042653 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 15 16:43:46.042729 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:46.042701 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 15 16:43:46.114469 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:46.114445 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/72e8609c-6276-4d8d-b9d9-e1d9408fca7f-console-serving-cert\") pod \"console-5cb75775c9-x2lwt\" (UID: \"72e8609c-6276-4d8d-b9d9-e1d9408fca7f\") " pod="openshift-console/console-5cb75775c9-x2lwt" Jul 15 16:43:46.114567 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:46.114473 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/72e8609c-6276-4d8d-b9d9-e1d9408fca7f-service-ca\") pod \"console-5cb75775c9-x2lwt\" (UID: \"72e8609c-6276-4d8d-b9d9-e1d9408fca7f\") " pod="openshift-console/console-5cb75775c9-x2lwt" Jul 15 16:43:46.114567 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:46.114493 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/72e8609c-6276-4d8d-b9d9-e1d9408fca7f-console-oauth-config\") pod \"console-5cb75775c9-x2lwt\" (UID: \"72e8609c-6276-4d8d-b9d9-e1d9408fca7f\") " pod="openshift-console/console-5cb75775c9-x2lwt" Jul 15 16:43:46.114567 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:46.114512 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4c65\" (UniqueName: \"kubernetes.io/projected/72e8609c-6276-4d8d-b9d9-e1d9408fca7f-kube-api-access-d4c65\") pod \"console-5cb75775c9-x2lwt\" (UID: \"72e8609c-6276-4d8d-b9d9-e1d9408fca7f\") " pod="openshift-console/console-5cb75775c9-x2lwt" Jul 15 16:43:46.114663 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:46.114598 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/72e8609c-6276-4d8d-b9d9-e1d9408fca7f-oauth-serving-cert\") pod \"console-5cb75775c9-x2lwt\" (UID: \"72e8609c-6276-4d8d-b9d9-e1d9408fca7f\") " pod="openshift-console/console-5cb75775c9-x2lwt" Jul 15 16:43:46.114663 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:46.114636 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/72e8609c-6276-4d8d-b9d9-e1d9408fca7f-console-config\") pod \"console-5cb75775c9-x2lwt\" (UID: \"72e8609c-6276-4d8d-b9d9-e1d9408fca7f\") " pod="openshift-console/console-5cb75775c9-x2lwt" Jul 15 16:43:46.215018 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:46.214995 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/72e8609c-6276-4d8d-b9d9-e1d9408fca7f-console-config\") pod \"console-5cb75775c9-x2lwt\" (UID: \"72e8609c-6276-4d8d-b9d9-e1d9408fca7f\") " pod="openshift-console/console-5cb75775c9-x2lwt" Jul 15 16:43:46.215183 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:46.215112 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/72e8609c-6276-4d8d-b9d9-e1d9408fca7f-console-serving-cert\") pod \"console-5cb75775c9-x2lwt\" (UID: \"72e8609c-6276-4d8d-b9d9-e1d9408fca7f\") " pod="openshift-console/console-5cb75775c9-x2lwt" Jul 15 16:43:46.215183 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:46.215145 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/72e8609c-6276-4d8d-b9d9-e1d9408fca7f-service-ca\") pod \"console-5cb75775c9-x2lwt\" (UID: \"72e8609c-6276-4d8d-b9d9-e1d9408fca7f\") " pod="openshift-console/console-5cb75775c9-x2lwt" Jul 15 16:43:46.215183 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:46.215175 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/72e8609c-6276-4d8d-b9d9-e1d9408fca7f-console-oauth-config\") pod \"console-5cb75775c9-x2lwt\" (UID: \"72e8609c-6276-4d8d-b9d9-e1d9408fca7f\") " pod="openshift-console/console-5cb75775c9-x2lwt" Jul 15 16:43:46.215330 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:46.215204 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4c65\" (UniqueName: \"kubernetes.io/projected/72e8609c-6276-4d8d-b9d9-e1d9408fca7f-kube-api-access-d4c65\") pod \"console-5cb75775c9-x2lwt\" (UID: \"72e8609c-6276-4d8d-b9d9-e1d9408fca7f\") " pod="openshift-console/console-5cb75775c9-x2lwt" Jul 15 16:43:46.215330 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:46.215252 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/72e8609c-6276-4d8d-b9d9-e1d9408fca7f-oauth-serving-cert\") pod \"console-5cb75775c9-x2lwt\" (UID: \"72e8609c-6276-4d8d-b9d9-e1d9408fca7f\") " pod="openshift-console/console-5cb75775c9-x2lwt" Jul 15 16:43:46.215875 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:46.215850 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/72e8609c-6276-4d8d-b9d9-e1d9408fca7f-console-config\") pod \"console-5cb75775c9-x2lwt\" (UID: \"72e8609c-6276-4d8d-b9d9-e1d9408fca7f\") " pod="openshift-console/console-5cb75775c9-x2lwt" Jul 15 16:43:46.216069 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:46.215930 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/72e8609c-6276-4d8d-b9d9-e1d9408fca7f-service-ca\") pod \"console-5cb75775c9-x2lwt\" (UID: \"72e8609c-6276-4d8d-b9d9-e1d9408fca7f\") " pod="openshift-console/console-5cb75775c9-x2lwt" Jul 15 16:43:46.216069 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:46.215980 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/72e8609c-6276-4d8d-b9d9-e1d9408fca7f-oauth-serving-cert\") pod \"console-5cb75775c9-x2lwt\" (UID: \"72e8609c-6276-4d8d-b9d9-e1d9408fca7f\") " pod="openshift-console/console-5cb75775c9-x2lwt" Jul 15 16:43:46.217601 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:46.217582 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/72e8609c-6276-4d8d-b9d9-e1d9408fca7f-console-oauth-config\") pod \"console-5cb75775c9-x2lwt\" (UID: \"72e8609c-6276-4d8d-b9d9-e1d9408fca7f\") " pod="openshift-console/console-5cb75775c9-x2lwt" Jul 15 16:43:46.217703 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:46.217627 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/72e8609c-6276-4d8d-b9d9-e1d9408fca7f-console-serving-cert\") pod \"console-5cb75775c9-x2lwt\" (UID: \"72e8609c-6276-4d8d-b9d9-e1d9408fca7f\") " pod="openshift-console/console-5cb75775c9-x2lwt" Jul 15 16:43:46.223317 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:46.223297 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4c65\" (UniqueName: \"kubernetes.io/projected/72e8609c-6276-4d8d-b9d9-e1d9408fca7f-kube-api-access-d4c65\") pod \"console-5cb75775c9-x2lwt\" (UID: \"72e8609c-6276-4d8d-b9d9-e1d9408fca7f\") " pod="openshift-console/console-5cb75775c9-x2lwt" Jul 15 16:43:46.348090 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:46.348027 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb75775c9-x2lwt" Jul 15 16:43:46.492217 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:46.492126 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cb75775c9-x2lwt"] Jul 15 16:43:46.494612 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:43:46.494587 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72e8609c_6276_4d8d_b9d9_e1d9408fca7f.slice/crio-2f12999df8dbd95a5d57d4867379a4a880f7c7cbca0d4cec4d5b15b758df0a67 WatchSource:0}: Error finding container 2f12999df8dbd95a5d57d4867379a4a880f7c7cbca0d4cec4d5b15b758df0a67: Status 404 returned error can't find the container with id 2f12999df8dbd95a5d57d4867379a4a880f7c7cbca0d4cec4d5b15b758df0a67 Jul 15 16:43:46.872762 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:46.872728 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb75775c9-x2lwt" event={"ID":"72e8609c-6276-4d8d-b9d9-e1d9408fca7f","Type":"ContainerStarted","Data":"2f12999df8dbd95a5d57d4867379a4a880f7c7cbca0d4cec4d5b15b758df0a67"} Jul 15 16:43:46.874216 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:46.874188 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-ftbvc" event={"ID":"b77182b9-ad00-4a6e-8166-d93b24cd4969","Type":"ContainerStarted","Data":"ebe7ff1a914537e106a478e5a947987e590a781f9516dae8d40a4fd62f432c3f"} Jul 15 16:43:46.874414 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:46.874399 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-ftbvc" Jul 15 16:43:46.878850 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:46.878829 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-ftbvc" Jul 15 16:43:46.890636 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:46.890567 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-ftbvc" podStartSLOduration=1.988908243 podStartE2EDuration="5.890554676s" totalImagesPullingTime="3.901646433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:43:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:43:46.889616364 +0000 UTC m=+213.316708447" watchObservedRunningTime="2026-07-15 16:43:46.890554676 +0000 UTC m=+213.317646801" Jul 15 16:43:48.204307 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:48.204281 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d799b4fd5-c29mv"] Jul 15 16:43:48.317724 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:48.317699 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d799b4fd5-c29mv"] Jul 15 16:43:48.317877 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:48.317808 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d799b4fd5-c29mv" Jul 15 16:43:48.326959 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:48.326941 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 15 16:43:48.435188 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:48.435154 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lprc\" (UniqueName: \"kubernetes.io/projected/67ced135-59cc-483e-a334-9ea24133d481-kube-api-access-4lprc\") pod \"console-6d799b4fd5-c29mv\" (UID: \"67ced135-59cc-483e-a334-9ea24133d481\") " pod="openshift-console/console-6d799b4fd5-c29mv" Jul 15 16:43:48.435347 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:48.435221 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/67ced135-59cc-483e-a334-9ea24133d481-console-serving-cert\") pod \"console-6d799b4fd5-c29mv\" (UID: \"67ced135-59cc-483e-a334-9ea24133d481\") " pod="openshift-console/console-6d799b4fd5-c29mv" Jul 15 16:43:48.435347 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:48.435248 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/67ced135-59cc-483e-a334-9ea24133d481-console-oauth-config\") pod \"console-6d799b4fd5-c29mv\" (UID: \"67ced135-59cc-483e-a334-9ea24133d481\") " pod="openshift-console/console-6d799b4fd5-c29mv" Jul 15 16:43:48.435347 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:48.435274 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/67ced135-59cc-483e-a334-9ea24133d481-service-ca\") pod \"console-6d799b4fd5-c29mv\" (UID: \"67ced135-59cc-483e-a334-9ea24133d481\") " pod="openshift-console/console-6d799b4fd5-c29mv" Jul 15 16:43:48.435347 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:48.435292 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/67ced135-59cc-483e-a334-9ea24133d481-console-config\") pod \"console-6d799b4fd5-c29mv\" (UID: \"67ced135-59cc-483e-a334-9ea24133d481\") " pod="openshift-console/console-6d799b4fd5-c29mv" Jul 15 16:43:48.435347 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:48.435318 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67ced135-59cc-483e-a334-9ea24133d481-trusted-ca-bundle\") pod \"console-6d799b4fd5-c29mv\" (UID: \"67ced135-59cc-483e-a334-9ea24133d481\") " pod="openshift-console/console-6d799b4fd5-c29mv" Jul 15 16:43:48.435347 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:48.435340 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/67ced135-59cc-483e-a334-9ea24133d481-oauth-serving-cert\") pod \"console-6d799b4fd5-c29mv\" (UID: \"67ced135-59cc-483e-a334-9ea24133d481\") " pod="openshift-console/console-6d799b4fd5-c29mv" Jul 15 16:43:48.536860 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:48.536775 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lprc\" (UniqueName: \"kubernetes.io/projected/67ced135-59cc-483e-a334-9ea24133d481-kube-api-access-4lprc\") pod \"console-6d799b4fd5-c29mv\" (UID: \"67ced135-59cc-483e-a334-9ea24133d481\") " pod="openshift-console/console-6d799b4fd5-c29mv" Jul 15 16:43:48.536860 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:48.536841 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/67ced135-59cc-483e-a334-9ea24133d481-console-serving-cert\") pod \"console-6d799b4fd5-c29mv\" (UID: \"67ced135-59cc-483e-a334-9ea24133d481\") " pod="openshift-console/console-6d799b4fd5-c29mv" Jul 15 16:43:48.537077 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:48.536866 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/67ced135-59cc-483e-a334-9ea24133d481-console-oauth-config\") pod \"console-6d799b4fd5-c29mv\" (UID: \"67ced135-59cc-483e-a334-9ea24133d481\") " pod="openshift-console/console-6d799b4fd5-c29mv" Jul 15 16:43:48.537077 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:48.536905 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/67ced135-59cc-483e-a334-9ea24133d481-service-ca\") pod \"console-6d799b4fd5-c29mv\" (UID: \"67ced135-59cc-483e-a334-9ea24133d481\") " pod="openshift-console/console-6d799b4fd5-c29mv" Jul 15 16:43:48.537077 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:48.536981 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/67ced135-59cc-483e-a334-9ea24133d481-console-config\") pod \"console-6d799b4fd5-c29mv\" (UID: \"67ced135-59cc-483e-a334-9ea24133d481\") " pod="openshift-console/console-6d799b4fd5-c29mv" Jul 15 16:43:48.537077 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:48.537023 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67ced135-59cc-483e-a334-9ea24133d481-trusted-ca-bundle\") pod \"console-6d799b4fd5-c29mv\" (UID: \"67ced135-59cc-483e-a334-9ea24133d481\") " pod="openshift-console/console-6d799b4fd5-c29mv" Jul 15 16:43:48.537077 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:48.537052 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/67ced135-59cc-483e-a334-9ea24133d481-oauth-serving-cert\") pod \"console-6d799b4fd5-c29mv\" (UID: \"67ced135-59cc-483e-a334-9ea24133d481\") " pod="openshift-console/console-6d799b4fd5-c29mv" Jul 15 16:43:48.537707 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:48.537678 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/67ced135-59cc-483e-a334-9ea24133d481-service-ca\") pod \"console-6d799b4fd5-c29mv\" (UID: \"67ced135-59cc-483e-a334-9ea24133d481\") " pod="openshift-console/console-6d799b4fd5-c29mv" Jul 15 16:43:48.537832 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:48.537733 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/67ced135-59cc-483e-a334-9ea24133d481-console-config\") pod \"console-6d799b4fd5-c29mv\" (UID: \"67ced135-59cc-483e-a334-9ea24133d481\") " pod="openshift-console/console-6d799b4fd5-c29mv" Jul 15 16:43:48.537887 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:48.537830 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/67ced135-59cc-483e-a334-9ea24133d481-oauth-serving-cert\") pod \"console-6d799b4fd5-c29mv\" (UID: \"67ced135-59cc-483e-a334-9ea24133d481\") " pod="openshift-console/console-6d799b4fd5-c29mv" Jul 15 16:43:48.538401 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:48.538378 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67ced135-59cc-483e-a334-9ea24133d481-trusted-ca-bundle\") pod \"console-6d799b4fd5-c29mv\" (UID: \"67ced135-59cc-483e-a334-9ea24133d481\") " pod="openshift-console/console-6d799b4fd5-c29mv" Jul 15 16:43:48.539431 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:48.539413 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/67ced135-59cc-483e-a334-9ea24133d481-console-oauth-config\") pod \"console-6d799b4fd5-c29mv\" (UID: \"67ced135-59cc-483e-a334-9ea24133d481\") " pod="openshift-console/console-6d799b4fd5-c29mv" Jul 15 16:43:48.539656 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:48.539636 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/67ced135-59cc-483e-a334-9ea24133d481-console-serving-cert\") pod \"console-6d799b4fd5-c29mv\" (UID: \"67ced135-59cc-483e-a334-9ea24133d481\") " pod="openshift-console/console-6d799b4fd5-c29mv" Jul 15 16:43:48.545605 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:48.545586 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lprc\" (UniqueName: \"kubernetes.io/projected/67ced135-59cc-483e-a334-9ea24133d481-kube-api-access-4lprc\") pod \"console-6d799b4fd5-c29mv\" (UID: \"67ced135-59cc-483e-a334-9ea24133d481\") " pod="openshift-console/console-6d799b4fd5-c29mv" Jul 15 16:43:48.627858 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:48.627834 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d799b4fd5-c29mv" Jul 15 16:43:48.781335 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:48.781313 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d799b4fd5-c29mv"] Jul 15 16:43:48.783508 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:43:48.783482 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67ced135_59cc_483e_a334_9ea24133d481.slice/crio-2f9d307db9f7095631bae76fa1c229b5652b7ef2286d3438145b37f2cb379679 WatchSource:0}: Error finding container 2f9d307db9f7095631bae76fa1c229b5652b7ef2286d3438145b37f2cb379679: Status 404 returned error can't find the container with id 2f9d307db9f7095631bae76fa1c229b5652b7ef2286d3438145b37f2cb379679 Jul 15 16:43:48.883938 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:48.883913 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d799b4fd5-c29mv" event={"ID":"67ced135-59cc-483e-a334-9ea24133d481","Type":"ContainerStarted","Data":"2f9d307db9f7095631bae76fa1c229b5652b7ef2286d3438145b37f2cb379679"} Jul 15 16:43:51.900452 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:51.900418 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb75775c9-x2lwt" event={"ID":"72e8609c-6276-4d8d-b9d9-e1d9408fca7f","Type":"ContainerStarted","Data":"7813d52efc8698b44470ac3b242ac263b9cdaefe044932bbf175654ed749ff48"} Jul 15 16:43:51.902146 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:51.902120 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d799b4fd5-c29mv" event={"ID":"67ced135-59cc-483e-a334-9ea24133d481","Type":"ContainerStarted","Data":"2fa45038fc8de800aa8083cf763c8fb2af33d043ee242fca237f4a2cc367579f"} Jul 15 16:43:51.922731 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:51.922686 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cb75775c9-x2lwt" podStartSLOduration=1.660185291 podStartE2EDuration="6.922671614s" totalImagesPullingTime="5.262486323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:43:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:43:51.922037199 +0000 UTC m=+218.349129299" watchObservedRunningTime="2026-07-15 16:43:51.922671614 +0000 UTC m=+218.349763698" Jul 15 16:43:51.947971 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:51.947926 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d799b4fd5-c29mv" podStartSLOduration=0.980993535 podStartE2EDuration="3.947912216s" totalImagesPullingTime="2.966918681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:43:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:43:51.946545693 +0000 UTC m=+218.373637777" watchObservedRunningTime="2026-07-15 16:43:51.947912216 +0000 UTC m=+218.375004299" Jul 15 16:43:56.348325 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:56.348292 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cb75775c9-x2lwt" Jul 15 16:43:56.348807 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:56.348357 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cb75775c9-x2lwt" Jul 15 16:43:56.349377 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:56.349354 2559 patch_prober.go:28] interesting pod/console-5cb75775c9-x2lwt container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.24:8443/health\": dial tcp 10.133.0.24:8443: connect: connection refused" start-of-body= Jul 15 16:43:56.349481 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:56.349394 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5cb75775c9-x2lwt" podUID="72e8609c-6276-4d8d-b9d9-e1d9408fca7f" containerName="console" probeResult="failure" output="Get \"https://10.133.0.24:8443/health\": dial tcp 10.133.0.24:8443: connect: connection refused" Jul 15 16:43:58.628932 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:58.628891 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d799b4fd5-c29mv" Jul 15 16:43:58.629346 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:58.628950 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d799b4fd5-c29mv" Jul 15 16:43:58.630206 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:58.630183 2559 patch_prober.go:28] interesting pod/console-6d799b4fd5-c29mv container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.25:8443/health\": dial tcp 10.133.0.25:8443: connect: connection refused" start-of-body= Jul 15 16:43:58.630291 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:43:58.630240 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6d799b4fd5-c29mv" podUID="67ced135-59cc-483e-a334-9ea24133d481" containerName="console" probeResult="failure" output="Get \"https://10.133.0.25:8443/health\": dial tcp 10.133.0.25:8443: connect: connection refused" Jul 15 16:44:05.956062 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:05.956028 2559 generic.go:356] "Generic (PLEG): container finished" podID="575cb646-78bd-48f5-9c49-797005605c40" containerID="7252c0270ee79888634b0fcf761b235419b6d17c8c92afe47636a4a3117e408c" exitCode=0 Jul 15 16:44:05.956505 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:05.956104 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l5kln" event={"ID":"575cb646-78bd-48f5-9c49-797005605c40","Type":"ContainerDied","Data":"7252c0270ee79888634b0fcf761b235419b6d17c8c92afe47636a4a3117e408c"} Jul 15 16:44:05.956505 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:05.956483 2559 scope.go:117] "RemoveContainer" containerID="7252c0270ee79888634b0fcf761b235419b6d17c8c92afe47636a4a3117e408c" Jul 15 16:44:06.348463 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:06.348378 2559 patch_prober.go:28] interesting pod/console-5cb75775c9-x2lwt container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.24:8443/health\": dial tcp 10.133.0.24:8443: connect: connection refused" start-of-body= Jul 15 16:44:06.348463 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:06.348438 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5cb75775c9-x2lwt" podUID="72e8609c-6276-4d8d-b9d9-e1d9408fca7f" containerName="console" probeResult="failure" output="Get \"https://10.133.0.24:8443/health\": dial tcp 10.133.0.24:8443: connect: connection refused" Jul 15 16:44:06.961815 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:06.961780 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l5kln" event={"ID":"575cb646-78bd-48f5-9c49-797005605c40","Type":"ContainerStarted","Data":"78040aa727c94f7d62d6c7545adb02b2fdf4fa5c5f0ff501814e5d1b3cae5342"} Jul 15 16:44:08.628509 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:08.628476 2559 patch_prober.go:28] interesting pod/console-6d799b4fd5-c29mv container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.25:8443/health\": dial tcp 10.133.0.25:8443: connect: connection refused" start-of-body= Jul 15 16:44:08.628906 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:08.628525 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6d799b4fd5-c29mv" podUID="67ced135-59cc-483e-a334-9ea24133d481" containerName="console" probeResult="failure" output="Get \"https://10.133.0.25:8443/health\": dial tcp 10.133.0.25:8443: connect: connection refused" Jul 15 16:44:16.348726 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:16.348688 2559 patch_prober.go:28] interesting pod/console-5cb75775c9-x2lwt container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.24:8443/health\": dial tcp 10.133.0.24:8443: connect: connection refused" start-of-body= Jul 15 16:44:16.349088 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:16.348742 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5cb75775c9-x2lwt" podUID="72e8609c-6276-4d8d-b9d9-e1d9408fca7f" containerName="console" probeResult="failure" output="Get \"https://10.133.0.24:8443/health\": dial tcp 10.133.0.24:8443: connect: connection refused" Jul 15 16:44:18.629024 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:18.628988 2559 patch_prober.go:28] interesting pod/console-6d799b4fd5-c29mv container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.25:8443/health\": dial tcp 10.133.0.25:8443: connect: connection refused" start-of-body= Jul 15 16:44:18.629374 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:18.629043 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6d799b4fd5-c29mv" podUID="67ced135-59cc-483e-a334-9ea24133d481" containerName="console" probeResult="failure" output="Get \"https://10.133.0.25:8443/health\": dial tcp 10.133.0.25:8443: connect: connection refused" Jul 15 16:44:21.022480 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:21.022449 2559 generic.go:356] "Generic (PLEG): container finished" podID="efda2baa-1340-49e7-ba0d-3f3765e3ebda" containerID="1a04f71a3c69fd888210c7ff25d3dab09345ba80eb2df948cbb516511d19cbab" exitCode=0 Jul 15 16:44:21.022932 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:21.022526 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-q46z2" event={"ID":"efda2baa-1340-49e7-ba0d-3f3765e3ebda","Type":"ContainerDied","Data":"1a04f71a3c69fd888210c7ff25d3dab09345ba80eb2df948cbb516511d19cbab"} Jul 15 16:44:21.022932 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:21.022905 2559 scope.go:117] "RemoveContainer" containerID="1a04f71a3c69fd888210c7ff25d3dab09345ba80eb2df948cbb516511d19cbab" Jul 15 16:44:22.028370 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:22.028337 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-q46z2" event={"ID":"efda2baa-1340-49e7-ba0d-3f3765e3ebda","Type":"ContainerStarted","Data":"6109e95481bcfb656bc5afa90a6951cc6e6334dd467c278b3c05873ae019fd20"} Jul 15 16:44:24.105719 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:24.105690 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3dcf2227-5799-473b-bc53-79c3deb1f352/init-config-reloader/0.log" Jul 15 16:44:24.305715 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:24.305691 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3dcf2227-5799-473b-bc53-79c3deb1f352/alertmanager/0.log" Jul 15 16:44:24.510076 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:24.510055 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3dcf2227-5799-473b-bc53-79c3deb1f352/config-reloader/0.log" Jul 15 16:44:24.705913 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:24.705878 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3dcf2227-5799-473b-bc53-79c3deb1f352/kube-rbac-proxy-web/0.log" Jul 15 16:44:24.905922 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:24.905828 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3dcf2227-5799-473b-bc53-79c3deb1f352/kube-rbac-proxy/0.log" Jul 15 16:44:25.105848 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:25.105816 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3dcf2227-5799-473b-bc53-79c3deb1f352/kube-rbac-proxy-metric/0.log" Jul 15 16:44:25.305760 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:25.305731 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3dcf2227-5799-473b-bc53-79c3deb1f352/prom-label-proxy/0.log" Jul 15 16:44:25.706918 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:25.706893 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-sgrd6_4c86b83a-9e88-40fe-bd48-de0cd484b746/kube-state-metrics/0.log" Jul 15 16:44:25.905448 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:25.905421 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-sgrd6_4c86b83a-9e88-40fe-bd48-de0cd484b746/kube-rbac-proxy-main/0.log" Jul 15 16:44:25.938284 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:25.938257 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07a4919e-5119-4287-8068-6fbcea6161de-metrics-certs\") pod \"network-metrics-daemon-cp4kd\" (UID: \"07a4919e-5119-4287-8068-6fbcea6161de\") " pod="openshift-multus/network-metrics-daemon-cp4kd" Jul 15 16:44:25.940709 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:25.940688 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07a4919e-5119-4287-8068-6fbcea6161de-metrics-certs\") pod \"network-metrics-daemon-cp4kd\" (UID: \"07a4919e-5119-4287-8068-6fbcea6161de\") " pod="openshift-multus/network-metrics-daemon-cp4kd" Jul 15 16:44:26.072475 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:26.072411 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5p9xs\"" Jul 15 16:44:26.080479 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:26.080463 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cp4kd" Jul 15 16:44:26.105194 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:26.105174 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-sgrd6_4c86b83a-9e88-40fe-bd48-de0cd484b746/kube-rbac-proxy-self/0.log" Jul 15 16:44:26.205022 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:26.205000 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cp4kd"] Jul 15 16:44:26.207253 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:44:26.207229 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07a4919e_5119_4287_8068_6fbcea6161de.slice/crio-7e672f2da113cbfbba5045a8d7af71a66d01f89c06e36afe1c42f0efaeaaeccc WatchSource:0}: Error finding container 7e672f2da113cbfbba5045a8d7af71a66d01f89c06e36afe1c42f0efaeaaeccc: Status 404 returned error can't find the container with id 7e672f2da113cbfbba5045a8d7af71a66d01f89c06e36afe1c42f0efaeaaeccc Jul 15 16:44:26.348370 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:26.348307 2559 patch_prober.go:28] interesting pod/console-5cb75775c9-x2lwt container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.24:8443/health\": dial tcp 10.133.0.24:8443: connect: connection refused" start-of-body= Jul 15 16:44:26.348370 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:26.348358 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5cb75775c9-x2lwt" podUID="72e8609c-6276-4d8d-b9d9-e1d9408fca7f" containerName="console" probeResult="failure" output="Get \"https://10.133.0.24:8443/health\": dial tcp 10.133.0.24:8443: connect: connection refused" Jul 15 16:44:26.505542 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:26.505511 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-ftbvc_b77182b9-ad00-4a6e-8166-d93b24cd4969/monitoring-plugin/0.log" Jul 15 16:44:27.048422 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:27.048388 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cp4kd" event={"ID":"07a4919e-5119-4287-8068-6fbcea6161de","Type":"ContainerStarted","Data":"7e672f2da113cbfbba5045a8d7af71a66d01f89c06e36afe1c42f0efaeaaeccc"} Jul 15 16:44:27.905038 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:27.905014 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l6ddv_89319841-337a-497d-b21a-2fb3b88cb5c5/init-textfile/0.log" Jul 15 16:44:28.106020 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:28.105994 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l6ddv_89319841-337a-497d-b21a-2fb3b88cb5c5/node-exporter/0.log" Jul 15 16:44:28.305409 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:28.305387 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l6ddv_89319841-337a-497d-b21a-2fb3b88cb5c5/kube-rbac-proxy/0.log" Jul 15 16:44:28.505187 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:28.505152 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-wvb5d_2748021c-88bb-4663-bdd3-a58eb99055b7/kube-rbac-proxy-main/0.log" Jul 15 16:44:28.628994 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:28.628929 2559 patch_prober.go:28] interesting pod/console-6d799b4fd5-c29mv container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.25:8443/health\": dial tcp 10.133.0.25:8443: connect: connection refused" start-of-body= Jul 15 16:44:28.628994 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:28.628971 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6d799b4fd5-c29mv" podUID="67ced135-59cc-483e-a334-9ea24133d481" containerName="console" probeResult="failure" output="Get \"https://10.133.0.25:8443/health\": dial tcp 10.133.0.25:8443: connect: connection refused" Jul 15 16:44:28.707382 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:28.707357 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-wvb5d_2748021c-88bb-4663-bdd3-a58eb99055b7/kube-rbac-proxy-self/0.log" Jul 15 16:44:28.905795 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:28.905712 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-wvb5d_2748021c-88bb-4663-bdd3-a58eb99055b7/openshift-state-metrics/0.log" Jul 15 16:44:30.506174 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:30.506118 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-nk25g_2b17740b-019e-4b4c-9fcb-e84f2facf4ce/prometheus-operator/0.log" Jul 15 16:44:30.705686 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:30.705665 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-nk25g_2b17740b-019e-4b4c-9fcb-e84f2facf4ce/kube-rbac-proxy/0.log" Jul 15 16:44:30.905869 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:30.905807 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-pgzj7_877406f9-6c0a-44cb-90a0-fb910f72e845/prometheus-operator-admission-webhook/0.log" Jul 15 16:44:31.066604 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:31.066577 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cp4kd" event={"ID":"07a4919e-5119-4287-8068-6fbcea6161de","Type":"ContainerStarted","Data":"569a194eaebacfd0240bea9c29e7ea453a59c9b1e50ab1e9e514feed47e5a9c7"} Jul 15 16:44:31.066787 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:31.066631 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cp4kd" event={"ID":"07a4919e-5119-4287-8068-6fbcea6161de","Type":"ContainerStarted","Data":"a67f198416624bbbf11761045e71d070bcc4b07c06705b8d745ed98105115c7d"} Jul 15 16:44:31.083663 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:31.083621 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cp4kd" podStartSLOduration=253.125862585 podStartE2EDuration="4m17.083607563s" totalImagesPullingTime="3.957744978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:40:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:44:31.081449433 +0000 UTC m=+257.508541515" watchObservedRunningTime="2026-07-15 16:44:31.083607563 +0000 UTC m=+257.510699646" Jul 15 16:44:32.306078 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:32.306038 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-wzjfl_a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3/networking-console-plugin/0.log" Jul 15 16:44:32.507853 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:32.507825 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vcxdn_268a4cb9-c310-4681-91a6-efe9692f8327/console-operator/2.log" Jul 15 16:44:32.707325 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:32.707294 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vcxdn_268a4cb9-c310-4681-91a6-efe9692f8327/console-operator/3.log" Jul 15 16:44:32.905561 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:32.905535 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5cb75775c9-x2lwt_72e8609c-6276-4d8d-b9d9-e1d9408fca7f/console/0.log" Jul 15 16:44:33.105985 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:33.105909 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6d799b4fd5-c29mv_67ced135-59cc-483e-a334-9ea24133d481/console/0.log" Jul 15 16:44:34.705320 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:34.705296 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-54dr5_4de0f0e6-c52c-439f-b547-d7449edde627/dns-node-resolver/0.log" Jul 15 16:44:36.105929 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:36.105868 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zrwsm_5695f6d9-f75a-4b9c-9417-babb852ef469/node-ca/0.log" Jul 15 16:44:36.348711 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:36.348682 2559 patch_prober.go:28] interesting pod/console-5cb75775c9-x2lwt container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.24:8443/health\": dial tcp 10.133.0.24:8443: connect: connection refused" start-of-body= Jul 15 16:44:36.348868 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:36.348724 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5cb75775c9-x2lwt" podUID="72e8609c-6276-4d8d-b9d9-e1d9408fca7f" containerName="console" probeResult="failure" output="Get \"https://10.133.0.24:8443/health\": dial tcp 10.133.0.24:8443: connect: connection refused" Jul 15 16:44:36.906529 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:36.906492 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tp2cw_ebf98561-bc05-4673-939a-5dedebfefff1/serve-healthcheck-canary/0.log" Jul 15 16:44:38.628849 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:38.628815 2559 patch_prober.go:28] interesting pod/console-6d799b4fd5-c29mv container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.25:8443/health\": dial tcp 10.133.0.25:8443: connect: connection refused" start-of-body= Jul 15 16:44:38.629318 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:38.628866 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6d799b4fd5-c29mv" podUID="67ced135-59cc-483e-a334-9ea24133d481" containerName="console" probeResult="failure" output="Get \"https://10.133.0.25:8443/health\": dial tcp 10.133.0.25:8443: connect: connection refused" Jul 15 16:44:46.348733 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:46.348697 2559 patch_prober.go:28] interesting pod/console-5cb75775c9-x2lwt container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.24:8443/health\": dial tcp 10.133.0.24:8443: connect: connection refused" start-of-body= Jul 15 16:44:46.349109 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:46.348768 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5cb75775c9-x2lwt" podUID="72e8609c-6276-4d8d-b9d9-e1d9408fca7f" containerName="console" probeResult="failure" output="Get \"https://10.133.0.24:8443/health\": dial tcp 10.133.0.24:8443: connect: connection refused" Jul 15 16:44:48.628530 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:48.628495 2559 patch_prober.go:28] interesting pod/console-6d799b4fd5-c29mv container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.25:8443/health\": dial tcp 10.133.0.25:8443: connect: connection refused" start-of-body= Jul 15 16:44:48.628900 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:48.628549 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6d799b4fd5-c29mv" podUID="67ced135-59cc-483e-a334-9ea24133d481" containerName="console" probeResult="failure" output="Get \"https://10.133.0.25:8443/health\": dial tcp 10.133.0.25:8443: connect: connection refused" Jul 15 16:44:54.614907 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:44:54.614865 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-nqjzl" podUID="a0eef5ad-3412-4990-b896-87e4444303d1" Jul 15 16:44:55.166114 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:55.166085 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nqjzl" Jul 15 16:44:56.349112 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:56.349072 2559 patch_prober.go:28] interesting pod/console-5cb75775c9-x2lwt container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.24:8443/health\": dial tcp 10.133.0.24:8443: connect: connection refused" start-of-body= Jul 15 16:44:56.349474 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:56.349154 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5cb75775c9-x2lwt" podUID="72e8609c-6276-4d8d-b9d9-e1d9408fca7f" containerName="console" probeResult="failure" output="Get \"https://10.133.0.24:8443/health\": dial tcp 10.133.0.24:8443: connect: connection refused" Jul 15 16:44:56.550042 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:56.550003 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 16:44:57.173874 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:57.173831 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3dcf2227-5799-473b-bc53-79c3deb1f352" containerName="alertmanager" containerID="cri-o://9376f25c0c774d217cb82057600f2b06c743c51cc62998c2f1480ad3bd92f3b4" gracePeriod=120 Jul 15 16:44:57.174059 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:57.173889 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3dcf2227-5799-473b-bc53-79c3deb1f352" containerName="kube-rbac-proxy-metric" containerID="cri-o://02f85118d2f082e70faf8dc35b3856eb537b6428b76d88d9f8b66c9b7cfa2258" gracePeriod=120 Jul 15 16:44:57.174059 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:57.173914 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3dcf2227-5799-473b-bc53-79c3deb1f352" containerName="config-reloader" containerID="cri-o://27917a1123fb340c64f367a3237d464d45b0d7d29d41620139659d039714219f" gracePeriod=120 Jul 15 16:44:57.174059 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:57.173931 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3dcf2227-5799-473b-bc53-79c3deb1f352" containerName="prom-label-proxy" containerID="cri-o://f32740a568cca1fe08f5393b880d15758bfe2789d52a8242dcb8e3f4d8f1dd45" gracePeriod=120 Jul 15 16:44:57.174059 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:57.173935 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3dcf2227-5799-473b-bc53-79c3deb1f352" containerName="kube-rbac-proxy" containerID="cri-o://ddc736d36179cb2daf3b2c2769e57244b662c2609ed2e71afa613f41dcac21fc" gracePeriod=120 Jul 15 16:44:57.174059 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:57.173902 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3dcf2227-5799-473b-bc53-79c3deb1f352" containerName="kube-rbac-proxy-web" containerID="cri-o://2619320d2feea0be2fd7ecef3884bfe87a29bbed226a7b45622169d81bc1dfd4" gracePeriod=120 Jul 15 16:44:57.890257 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:57.890218 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0eef5ad-3412-4990-b896-87e4444303d1-metrics-tls\") pod \"dns-default-nqjzl\" (UID: \"a0eef5ad-3412-4990-b896-87e4444303d1\") " pod="openshift-dns/dns-default-nqjzl" Jul 15 16:44:57.892541 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:57.892517 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0eef5ad-3412-4990-b896-87e4444303d1-metrics-tls\") pod \"dns-default-nqjzl\" (UID: \"a0eef5ad-3412-4990-b896-87e4444303d1\") " pod="openshift-dns/dns-default-nqjzl" Jul 15 16:44:58.169496 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.169469 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6gzkx\"" Jul 15 16:44:58.177050 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.177024 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nqjzl" Jul 15 16:44:58.181495 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.181471 2559 generic.go:356] "Generic (PLEG): container finished" podID="3dcf2227-5799-473b-bc53-79c3deb1f352" containerID="f32740a568cca1fe08f5393b880d15758bfe2789d52a8242dcb8e3f4d8f1dd45" exitCode=0 Jul 15 16:44:58.181495 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.181493 2559 generic.go:356] "Generic (PLEG): container finished" podID="3dcf2227-5799-473b-bc53-79c3deb1f352" containerID="ddc736d36179cb2daf3b2c2769e57244b662c2609ed2e71afa613f41dcac21fc" exitCode=0 Jul 15 16:44:58.181636 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.181505 2559 generic.go:356] "Generic (PLEG): container finished" podID="3dcf2227-5799-473b-bc53-79c3deb1f352" containerID="27917a1123fb340c64f367a3237d464d45b0d7d29d41620139659d039714219f" exitCode=0 Jul 15 16:44:58.181636 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.181514 2559 generic.go:356] "Generic (PLEG): container finished" podID="3dcf2227-5799-473b-bc53-79c3deb1f352" containerID="9376f25c0c774d217cb82057600f2b06c743c51cc62998c2f1480ad3bd92f3b4" exitCode=0 Jul 15 16:44:58.181636 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.181552 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3dcf2227-5799-473b-bc53-79c3deb1f352","Type":"ContainerDied","Data":"f32740a568cca1fe08f5393b880d15758bfe2789d52a8242dcb8e3f4d8f1dd45"} Jul 15 16:44:58.181727 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.181636 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3dcf2227-5799-473b-bc53-79c3deb1f352","Type":"ContainerDied","Data":"ddc736d36179cb2daf3b2c2769e57244b662c2609ed2e71afa613f41dcac21fc"} Jul 15 16:44:58.181727 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.181680 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3dcf2227-5799-473b-bc53-79c3deb1f352","Type":"ContainerDied","Data":"27917a1123fb340c64f367a3237d464d45b0d7d29d41620139659d039714219f"} Jul 15 16:44:58.181727 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.181721 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3dcf2227-5799-473b-bc53-79c3deb1f352","Type":"ContainerDied","Data":"9376f25c0c774d217cb82057600f2b06c743c51cc62998c2f1480ad3bd92f3b4"} Jul 15 16:44:58.308583 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.308560 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nqjzl"] Jul 15 16:44:58.319864 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:44:58.319831 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0eef5ad_3412_4990_b896_87e4444303d1.slice/crio-31de70c283b8c31b3e45cb47ed4d45c5bf6a86c230f976d4a9311e3b8ad90fee WatchSource:0}: Error finding container 31de70c283b8c31b3e45cb47ed4d45c5bf6a86c230f976d4a9311e3b8ad90fee: Status 404 returned error can't find the container with id 31de70c283b8c31b3e45cb47ed4d45c5bf6a86c230f976d4a9311e3b8ad90fee Jul 15 16:44:58.409764 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.409729 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:58.494367 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.494293 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3dcf2227-5799-473b-bc53-79c3deb1f352-secret-alertmanager-main-tls\") pod \"3dcf2227-5799-473b-bc53-79c3deb1f352\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " Jul 15 16:44:58.494367 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.494334 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3dcf2227-5799-473b-bc53-79c3deb1f352-secret-alertmanager-kube-rbac-proxy\") pod \"3dcf2227-5799-473b-bc53-79c3deb1f352\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " Jul 15 16:44:58.494367 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.494368 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dcf2227-5799-473b-bc53-79c3deb1f352-alertmanager-trusted-ca-bundle\") pod \"3dcf2227-5799-473b-bc53-79c3deb1f352\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " Jul 15 16:44:58.494562 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.494542 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3dcf2227-5799-473b-bc53-79c3deb1f352-metrics-client-ca\") pod \"3dcf2227-5799-473b-bc53-79c3deb1f352\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " Jul 15 16:44:58.494614 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.494599 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3dcf2227-5799-473b-bc53-79c3deb1f352-tls-assets\") pod \"3dcf2227-5799-473b-bc53-79c3deb1f352\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " Jul 15 16:44:58.494651 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.494627 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3dcf2227-5799-473b-bc53-79c3deb1f352-config-out\") pod \"3dcf2227-5799-473b-bc53-79c3deb1f352\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " Jul 15 16:44:58.494692 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.494656 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3dcf2227-5799-473b-bc53-79c3deb1f352-web-config\") pod \"3dcf2227-5799-473b-bc53-79c3deb1f352\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " Jul 15 16:44:58.494692 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.494675 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3dcf2227-5799-473b-bc53-79c3deb1f352-secret-alertmanager-kube-rbac-proxy-web\") pod \"3dcf2227-5799-473b-bc53-79c3deb1f352\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " Jul 15 16:44:58.494811 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.494702 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3dcf2227-5799-473b-bc53-79c3deb1f352-alertmanager-main-db\") pod \"3dcf2227-5799-473b-bc53-79c3deb1f352\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " Jul 15 16:44:58.494811 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.494745 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qj56\" (UniqueName: \"kubernetes.io/projected/3dcf2227-5799-473b-bc53-79c3deb1f352-kube-api-access-5qj56\") pod \"3dcf2227-5799-473b-bc53-79c3deb1f352\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " Jul 15 16:44:58.494811 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.494789 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3dcf2227-5799-473b-bc53-79c3deb1f352-cluster-tls-config\") pod \"3dcf2227-5799-473b-bc53-79c3deb1f352\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " Jul 15 16:44:58.494957 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.494807 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3dcf2227-5799-473b-bc53-79c3deb1f352-secret-alertmanager-kube-rbac-proxy-metric\") pod \"3dcf2227-5799-473b-bc53-79c3deb1f352\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " Jul 15 16:44:58.494957 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.494851 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3dcf2227-5799-473b-bc53-79c3deb1f352-config-volume\") pod \"3dcf2227-5799-473b-bc53-79c3deb1f352\" (UID: \"3dcf2227-5799-473b-bc53-79c3deb1f352\") " Jul 15 16:44:58.494957 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.494926 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3dcf2227-5799-473b-bc53-79c3deb1f352-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "3dcf2227-5799-473b-bc53-79c3deb1f352" (UID: "3dcf2227-5799-473b-bc53-79c3deb1f352"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:44:58.495105 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.495072 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3dcf2227-5799-473b-bc53-79c3deb1f352-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "3dcf2227-5799-473b-bc53-79c3deb1f352" (UID: "3dcf2227-5799-473b-bc53-79c3deb1f352"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:44:58.495458 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.495164 2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dcf2227-5799-473b-bc53-79c3deb1f352-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:44:58.495458 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.495187 2559 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3dcf2227-5799-473b-bc53-79c3deb1f352-metrics-client-ca\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:44:58.495627 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.495500 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dcf2227-5799-473b-bc53-79c3deb1f352-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "3dcf2227-5799-473b-bc53-79c3deb1f352" (UID: "3dcf2227-5799-473b-bc53-79c3deb1f352"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 16:44:58.497962 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.497094 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3dcf2227-5799-473b-bc53-79c3deb1f352-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "3dcf2227-5799-473b-bc53-79c3deb1f352" (UID: "3dcf2227-5799-473b-bc53-79c3deb1f352"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 16:44:58.497962 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.497494 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3dcf2227-5799-473b-bc53-79c3deb1f352-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "3dcf2227-5799-473b-bc53-79c3deb1f352" (UID: "3dcf2227-5799-473b-bc53-79c3deb1f352"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 16:44:58.498193 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.498164 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dcf2227-5799-473b-bc53-79c3deb1f352-config-out" (OuterVolumeSpecName: "config-out") pod "3dcf2227-5799-473b-bc53-79c3deb1f352" (UID: "3dcf2227-5799-473b-bc53-79c3deb1f352"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 16:44:58.498674 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.498601 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dcf2227-5799-473b-bc53-79c3deb1f352-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3dcf2227-5799-473b-bc53-79c3deb1f352" (UID: "3dcf2227-5799-473b-bc53-79c3deb1f352"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 16:44:58.498826 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.498700 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3dcf2227-5799-473b-bc53-79c3deb1f352-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "3dcf2227-5799-473b-bc53-79c3deb1f352" (UID: "3dcf2227-5799-473b-bc53-79c3deb1f352"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 16:44:58.498826 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.498713 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3dcf2227-5799-473b-bc53-79c3deb1f352-config-volume" (OuterVolumeSpecName: "config-volume") pod "3dcf2227-5799-473b-bc53-79c3deb1f352" (UID: "3dcf2227-5799-473b-bc53-79c3deb1f352"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 16:44:58.498956 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.498844 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3dcf2227-5799-473b-bc53-79c3deb1f352-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "3dcf2227-5799-473b-bc53-79c3deb1f352" (UID: "3dcf2227-5799-473b-bc53-79c3deb1f352"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 16:44:58.499704 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.499684 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dcf2227-5799-473b-bc53-79c3deb1f352-kube-api-access-5qj56" (OuterVolumeSpecName: "kube-api-access-5qj56") pod "3dcf2227-5799-473b-bc53-79c3deb1f352" (UID: "3dcf2227-5799-473b-bc53-79c3deb1f352"). InnerVolumeSpecName "kube-api-access-5qj56". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 16:44:58.502215 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.502196 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3dcf2227-5799-473b-bc53-79c3deb1f352-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "3dcf2227-5799-473b-bc53-79c3deb1f352" (UID: "3dcf2227-5799-473b-bc53-79c3deb1f352"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 16:44:58.508568 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.508545 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3dcf2227-5799-473b-bc53-79c3deb1f352-web-config" (OuterVolumeSpecName: "web-config") pod "3dcf2227-5799-473b-bc53-79c3deb1f352" (UID: "3dcf2227-5799-473b-bc53-79c3deb1f352"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 16:44:58.595932 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.595892 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3dcf2227-5799-473b-bc53-79c3deb1f352-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:44:58.595932 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.595924 2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3dcf2227-5799-473b-bc53-79c3deb1f352-tls-assets\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:44:58.595932 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.595933 2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3dcf2227-5799-473b-bc53-79c3deb1f352-config-out\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:44:58.595932 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.595941 2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3dcf2227-5799-473b-bc53-79c3deb1f352-web-config\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:44:58.596169 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.595950 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3dcf2227-5799-473b-bc53-79c3deb1f352-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:44:58.596169 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.595958 2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3dcf2227-5799-473b-bc53-79c3deb1f352-alertmanager-main-db\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:44:58.596169 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.595967 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qj56\" (UniqueName: \"kubernetes.io/projected/3dcf2227-5799-473b-bc53-79c3deb1f352-kube-api-access-5qj56\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:44:58.596169 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.595977 2559 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3dcf2227-5799-473b-bc53-79c3deb1f352-cluster-tls-config\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:44:58.596169 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.595985 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3dcf2227-5799-473b-bc53-79c3deb1f352-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:44:58.596169 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.595993 2559 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3dcf2227-5799-473b-bc53-79c3deb1f352-config-volume\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:44:58.596169 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.596001 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3dcf2227-5799-473b-bc53-79c3deb1f352-secret-alertmanager-main-tls\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:44:58.629170 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.629141 2559 patch_prober.go:28] interesting pod/console-6d799b4fd5-c29mv container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.25:8443/health\": dial tcp 10.133.0.25:8443: connect: connection refused" start-of-body= Jul 15 16:44:58.629279 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:58.629194 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6d799b4fd5-c29mv" podUID="67ced135-59cc-483e-a334-9ea24133d481" containerName="console" probeResult="failure" output="Get \"https://10.133.0.25:8443/health\": dial tcp 10.133.0.25:8443: connect: connection refused" Jul 15 16:44:59.187645 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.187522 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nqjzl" event={"ID":"a0eef5ad-3412-4990-b896-87e4444303d1","Type":"ContainerStarted","Data":"31de70c283b8c31b3e45cb47ed4d45c5bf6a86c230f976d4a9311e3b8ad90fee"} Jul 15 16:44:59.191448 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.191422 2559 generic.go:356] "Generic (PLEG): container finished" podID="3dcf2227-5799-473b-bc53-79c3deb1f352" containerID="02f85118d2f082e70faf8dc35b3856eb537b6428b76d88d9f8b66c9b7cfa2258" exitCode=0 Jul 15 16:44:59.191539 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.191450 2559 generic.go:356] "Generic (PLEG): container finished" podID="3dcf2227-5799-473b-bc53-79c3deb1f352" containerID="2619320d2feea0be2fd7ecef3884bfe87a29bbed226a7b45622169d81bc1dfd4" exitCode=0 Jul 15 16:44:59.191539 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.191477 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3dcf2227-5799-473b-bc53-79c3deb1f352","Type":"ContainerDied","Data":"02f85118d2f082e70faf8dc35b3856eb537b6428b76d88d9f8b66c9b7cfa2258"} Jul 15 16:44:59.191539 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.191522 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:59.191688 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.191547 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3dcf2227-5799-473b-bc53-79c3deb1f352","Type":"ContainerDied","Data":"2619320d2feea0be2fd7ecef3884bfe87a29bbed226a7b45622169d81bc1dfd4"} Jul 15 16:44:59.191688 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.191593 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3dcf2227-5799-473b-bc53-79c3deb1f352","Type":"ContainerDied","Data":"19b2b7c70b8b5ff08eac5e65e3f12cc2bc781f998a6a38478d59dbf4b38c1a30"} Jul 15 16:44:59.191688 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.191624 2559 scope.go:117] "RemoveContainer" containerID="f32740a568cca1fe08f5393b880d15758bfe2789d52a8242dcb8e3f4d8f1dd45" Jul 15 16:44:59.207771 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.207725 2559 scope.go:117] "RemoveContainer" containerID="02f85118d2f082e70faf8dc35b3856eb537b6428b76d88d9f8b66c9b7cfa2258" Jul 15 16:44:59.215887 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.215867 2559 scope.go:117] "RemoveContainer" containerID="ddc736d36179cb2daf3b2c2769e57244b662c2609ed2e71afa613f41dcac21fc" Jul 15 16:44:59.223543 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.223519 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 16:44:59.225843 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.225824 2559 scope.go:117] "RemoveContainer" containerID="2619320d2feea0be2fd7ecef3884bfe87a29bbed226a7b45622169d81bc1dfd4" Jul 15 16:44:59.227394 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.227375 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 16:44:59.234030 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.234010 2559 scope.go:117] "RemoveContainer" containerID="27917a1123fb340c64f367a3237d464d45b0d7d29d41620139659d039714219f" Jul 15 16:44:59.242963 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.242942 2559 scope.go:117] "RemoveContainer" containerID="9376f25c0c774d217cb82057600f2b06c743c51cc62998c2f1480ad3bd92f3b4" Jul 15 16:44:59.251640 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.251609 2559 scope.go:117] "RemoveContainer" containerID="e67ea91eef5a6565d9e54decd27f2b41f4eaefeb3fcbb0f970f9854d7b31272f" Jul 15 16:44:59.259838 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.259776 2559 scope.go:117] "RemoveContainer" containerID="f32740a568cca1fe08f5393b880d15758bfe2789d52a8242dcb8e3f4d8f1dd45" Jul 15 16:44:59.260369 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:44:59.260182 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f32740a568cca1fe08f5393b880d15758bfe2789d52a8242dcb8e3f4d8f1dd45\": container with ID starting with f32740a568cca1fe08f5393b880d15758bfe2789d52a8242dcb8e3f4d8f1dd45 not found: ID does not exist" containerID="f32740a568cca1fe08f5393b880d15758bfe2789d52a8242dcb8e3f4d8f1dd45" Jul 15 16:44:59.260630 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.260225 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f32740a568cca1fe08f5393b880d15758bfe2789d52a8242dcb8e3f4d8f1dd45"} err="failed to get container status \"f32740a568cca1fe08f5393b880d15758bfe2789d52a8242dcb8e3f4d8f1dd45\": rpc error: code = NotFound desc = could not find container \"f32740a568cca1fe08f5393b880d15758bfe2789d52a8242dcb8e3f4d8f1dd45\": container with ID starting with f32740a568cca1fe08f5393b880d15758bfe2789d52a8242dcb8e3f4d8f1dd45 not found: ID does not exist" Jul 15 16:44:59.260630 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.260501 2559 scope.go:117] "RemoveContainer" containerID="02f85118d2f082e70faf8dc35b3856eb537b6428b76d88d9f8b66c9b7cfa2258" Jul 15 16:44:59.261190 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:44:59.261151 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02f85118d2f082e70faf8dc35b3856eb537b6428b76d88d9f8b66c9b7cfa2258\": container with ID starting with 02f85118d2f082e70faf8dc35b3856eb537b6428b76d88d9f8b66c9b7cfa2258 not found: ID does not exist" containerID="02f85118d2f082e70faf8dc35b3856eb537b6428b76d88d9f8b66c9b7cfa2258" Jul 15 16:44:59.261274 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.261184 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02f85118d2f082e70faf8dc35b3856eb537b6428b76d88d9f8b66c9b7cfa2258"} err="failed to get container status \"02f85118d2f082e70faf8dc35b3856eb537b6428b76d88d9f8b66c9b7cfa2258\": rpc error: code = NotFound desc = could not find container \"02f85118d2f082e70faf8dc35b3856eb537b6428b76d88d9f8b66c9b7cfa2258\": container with ID starting with 02f85118d2f082e70faf8dc35b3856eb537b6428b76d88d9f8b66c9b7cfa2258 not found: ID does not exist" Jul 15 16:44:59.261274 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.261204 2559 scope.go:117] "RemoveContainer" containerID="ddc736d36179cb2daf3b2c2769e57244b662c2609ed2e71afa613f41dcac21fc" Jul 15 16:44:59.261521 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:44:59.261484 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddc736d36179cb2daf3b2c2769e57244b662c2609ed2e71afa613f41dcac21fc\": container with ID starting with ddc736d36179cb2daf3b2c2769e57244b662c2609ed2e71afa613f41dcac21fc not found: ID does not exist" containerID="ddc736d36179cb2daf3b2c2769e57244b662c2609ed2e71afa613f41dcac21fc" Jul 15 16:44:59.261610 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.261528 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddc736d36179cb2daf3b2c2769e57244b662c2609ed2e71afa613f41dcac21fc"} err="failed to get container status \"ddc736d36179cb2daf3b2c2769e57244b662c2609ed2e71afa613f41dcac21fc\": rpc error: code = NotFound desc = could not find container \"ddc736d36179cb2daf3b2c2769e57244b662c2609ed2e71afa613f41dcac21fc\": container with ID starting with ddc736d36179cb2daf3b2c2769e57244b662c2609ed2e71afa613f41dcac21fc not found: ID does not exist" Jul 15 16:44:59.261610 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.261550 2559 scope.go:117] "RemoveContainer" containerID="2619320d2feea0be2fd7ecef3884bfe87a29bbed226a7b45622169d81bc1dfd4" Jul 15 16:44:59.261866 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:44:59.261841 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2619320d2feea0be2fd7ecef3884bfe87a29bbed226a7b45622169d81bc1dfd4\": container with ID starting with 2619320d2feea0be2fd7ecef3884bfe87a29bbed226a7b45622169d81bc1dfd4 not found: ID does not exist" containerID="2619320d2feea0be2fd7ecef3884bfe87a29bbed226a7b45622169d81bc1dfd4" Jul 15 16:44:59.261973 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.261873 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2619320d2feea0be2fd7ecef3884bfe87a29bbed226a7b45622169d81bc1dfd4"} err="failed to get container status \"2619320d2feea0be2fd7ecef3884bfe87a29bbed226a7b45622169d81bc1dfd4\": rpc error: code = NotFound desc = could not find container \"2619320d2feea0be2fd7ecef3884bfe87a29bbed226a7b45622169d81bc1dfd4\": container with ID starting with 2619320d2feea0be2fd7ecef3884bfe87a29bbed226a7b45622169d81bc1dfd4 not found: ID does not exist" Jul 15 16:44:59.261973 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.261890 2559 scope.go:117] "RemoveContainer" containerID="27917a1123fb340c64f367a3237d464d45b0d7d29d41620139659d039714219f" Jul 15 16:44:59.262251 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.262230 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 16:44:59.262347 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:44:59.262322 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27917a1123fb340c64f367a3237d464d45b0d7d29d41620139659d039714219f\": container with ID starting with 27917a1123fb340c64f367a3237d464d45b0d7d29d41620139659d039714219f not found: ID does not exist" containerID="27917a1123fb340c64f367a3237d464d45b0d7d29d41620139659d039714219f" Jul 15 16:44:59.262434 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.262351 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27917a1123fb340c64f367a3237d464d45b0d7d29d41620139659d039714219f"} err="failed to get container status \"27917a1123fb340c64f367a3237d464d45b0d7d29d41620139659d039714219f\": rpc error: code = NotFound desc = could not find container \"27917a1123fb340c64f367a3237d464d45b0d7d29d41620139659d039714219f\": container with ID starting with 27917a1123fb340c64f367a3237d464d45b0d7d29d41620139659d039714219f not found: ID does not exist" Jul 15 16:44:59.262434 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.262414 2559 scope.go:117] "RemoveContainer" containerID="9376f25c0c774d217cb82057600f2b06c743c51cc62998c2f1480ad3bd92f3b4" Jul 15 16:44:59.262704 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.262685 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dcf2227-5799-473b-bc53-79c3deb1f352" containerName="kube-rbac-proxy-metric" Jul 15 16:44:59.262805 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.262708 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dcf2227-5799-473b-bc53-79c3deb1f352" containerName="kube-rbac-proxy-metric" Jul 15 16:44:59.262805 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.262728 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dcf2227-5799-473b-bc53-79c3deb1f352" containerName="init-config-reloader" Jul 15 16:44:59.262805 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.262737 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dcf2227-5799-473b-bc53-79c3deb1f352" containerName="init-config-reloader" Jul 15 16:44:59.262805 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.262779 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dcf2227-5799-473b-bc53-79c3deb1f352" containerName="kube-rbac-proxy" Jul 15 16:44:59.262805 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.262788 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dcf2227-5799-473b-bc53-79c3deb1f352" containerName="kube-rbac-proxy" Jul 15 16:44:59.262805 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.262800 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dcf2227-5799-473b-bc53-79c3deb1f352" containerName="config-reloader" Jul 15 16:44:59.263097 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.262807 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dcf2227-5799-473b-bc53-79c3deb1f352" containerName="config-reloader" Jul 15 16:44:59.263097 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.262817 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dcf2227-5799-473b-bc53-79c3deb1f352" containerName="alertmanager" Jul 15 16:44:59.263097 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.262824 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dcf2227-5799-473b-bc53-79c3deb1f352" containerName="alertmanager" Jul 15 16:44:59.263097 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.262838 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dcf2227-5799-473b-bc53-79c3deb1f352" containerName="kube-rbac-proxy-web" Jul 15 16:44:59.263097 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.262846 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dcf2227-5799-473b-bc53-79c3deb1f352" containerName="kube-rbac-proxy-web" Jul 15 16:44:59.263097 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.262866 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dcf2227-5799-473b-bc53-79c3deb1f352" containerName="prom-label-proxy" Jul 15 16:44:59.263097 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.262874 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dcf2227-5799-473b-bc53-79c3deb1f352" containerName="prom-label-proxy" Jul 15 16:44:59.263097 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.262957 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dcf2227-5799-473b-bc53-79c3deb1f352" containerName="prom-label-proxy" Jul 15 16:44:59.263097 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.262970 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dcf2227-5799-473b-bc53-79c3deb1f352" containerName="kube-rbac-proxy-metric" Jul 15 16:44:59.263097 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.262982 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dcf2227-5799-473b-bc53-79c3deb1f352" containerName="kube-rbac-proxy-web" Jul 15 16:44:59.263097 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.262990 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dcf2227-5799-473b-bc53-79c3deb1f352" containerName="kube-rbac-proxy" Jul 15 16:44:59.263097 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.262998 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dcf2227-5799-473b-bc53-79c3deb1f352" containerName="alertmanager" Jul 15 16:44:59.263097 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.263005 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dcf2227-5799-473b-bc53-79c3deb1f352" containerName="config-reloader" Jul 15 16:44:59.263742 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:44:59.263399 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9376f25c0c774d217cb82057600f2b06c743c51cc62998c2f1480ad3bd92f3b4\": container with ID starting with 9376f25c0c774d217cb82057600f2b06c743c51cc62998c2f1480ad3bd92f3b4 not found: ID does not exist" containerID="9376f25c0c774d217cb82057600f2b06c743c51cc62998c2f1480ad3bd92f3b4" Jul 15 16:44:59.263742 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.263424 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9376f25c0c774d217cb82057600f2b06c743c51cc62998c2f1480ad3bd92f3b4"} err="failed to get container status \"9376f25c0c774d217cb82057600f2b06c743c51cc62998c2f1480ad3bd92f3b4\": rpc error: code = NotFound desc = could not find container \"9376f25c0c774d217cb82057600f2b06c743c51cc62998c2f1480ad3bd92f3b4\": container with ID starting with 9376f25c0c774d217cb82057600f2b06c743c51cc62998c2f1480ad3bd92f3b4 not found: ID does not exist" Jul 15 16:44:59.263742 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.263443 2559 scope.go:117] "RemoveContainer" containerID="e67ea91eef5a6565d9e54decd27f2b41f4eaefeb3fcbb0f970f9854d7b31272f" Jul 15 16:44:59.263742 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:44:59.263695 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e67ea91eef5a6565d9e54decd27f2b41f4eaefeb3fcbb0f970f9854d7b31272f\": container with ID starting with e67ea91eef5a6565d9e54decd27f2b41f4eaefeb3fcbb0f970f9854d7b31272f not found: ID does not exist" containerID="e67ea91eef5a6565d9e54decd27f2b41f4eaefeb3fcbb0f970f9854d7b31272f" Jul 15 16:44:59.263742 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.263717 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e67ea91eef5a6565d9e54decd27f2b41f4eaefeb3fcbb0f970f9854d7b31272f"} err="failed to get container status \"e67ea91eef5a6565d9e54decd27f2b41f4eaefeb3fcbb0f970f9854d7b31272f\": rpc error: code = NotFound desc = could not find container \"e67ea91eef5a6565d9e54decd27f2b41f4eaefeb3fcbb0f970f9854d7b31272f\": container with ID starting with e67ea91eef5a6565d9e54decd27f2b41f4eaefeb3fcbb0f970f9854d7b31272f not found: ID does not exist" Jul 15 16:44:59.263742 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.263735 2559 scope.go:117] "RemoveContainer" containerID="f32740a568cca1fe08f5393b880d15758bfe2789d52a8242dcb8e3f4d8f1dd45" Jul 15 16:44:59.264071 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.264043 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f32740a568cca1fe08f5393b880d15758bfe2789d52a8242dcb8e3f4d8f1dd45"} err="failed to get container status \"f32740a568cca1fe08f5393b880d15758bfe2789d52a8242dcb8e3f4d8f1dd45\": rpc error: code = NotFound desc = could not find container \"f32740a568cca1fe08f5393b880d15758bfe2789d52a8242dcb8e3f4d8f1dd45\": container with ID starting with f32740a568cca1fe08f5393b880d15758bfe2789d52a8242dcb8e3f4d8f1dd45 not found: ID does not exist" Jul 15 16:44:59.264139 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.264075 2559 scope.go:117] "RemoveContainer" containerID="02f85118d2f082e70faf8dc35b3856eb537b6428b76d88d9f8b66c9b7cfa2258" Jul 15 16:44:59.264424 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.264399 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02f85118d2f082e70faf8dc35b3856eb537b6428b76d88d9f8b66c9b7cfa2258"} err="failed to get container status \"02f85118d2f082e70faf8dc35b3856eb537b6428b76d88d9f8b66c9b7cfa2258\": rpc error: code = NotFound desc = could not find container \"02f85118d2f082e70faf8dc35b3856eb537b6428b76d88d9f8b66c9b7cfa2258\": container with ID starting with 02f85118d2f082e70faf8dc35b3856eb537b6428b76d88d9f8b66c9b7cfa2258 not found: ID does not exist" Jul 15 16:44:59.264553 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.264427 2559 scope.go:117] "RemoveContainer" containerID="ddc736d36179cb2daf3b2c2769e57244b662c2609ed2e71afa613f41dcac21fc" Jul 15 16:44:59.264784 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.264715 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddc736d36179cb2daf3b2c2769e57244b662c2609ed2e71afa613f41dcac21fc"} err="failed to get container status \"ddc736d36179cb2daf3b2c2769e57244b662c2609ed2e71afa613f41dcac21fc\": rpc error: code = NotFound desc = could not find container \"ddc736d36179cb2daf3b2c2769e57244b662c2609ed2e71afa613f41dcac21fc\": container with ID starting with ddc736d36179cb2daf3b2c2769e57244b662c2609ed2e71afa613f41dcac21fc not found: ID does not exist" Jul 15 16:44:59.264784 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.264769 2559 scope.go:117] "RemoveContainer" containerID="2619320d2feea0be2fd7ecef3884bfe87a29bbed226a7b45622169d81bc1dfd4" Jul 15 16:44:59.265071 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.265047 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2619320d2feea0be2fd7ecef3884bfe87a29bbed226a7b45622169d81bc1dfd4"} err="failed to get container status \"2619320d2feea0be2fd7ecef3884bfe87a29bbed226a7b45622169d81bc1dfd4\": rpc error: code = NotFound desc = could not find container \"2619320d2feea0be2fd7ecef3884bfe87a29bbed226a7b45622169d81bc1dfd4\": container with ID starting with 2619320d2feea0be2fd7ecef3884bfe87a29bbed226a7b45622169d81bc1dfd4 not found: ID does not exist" Jul 15 16:44:59.265122 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.265074 2559 scope.go:117] "RemoveContainer" containerID="27917a1123fb340c64f367a3237d464d45b0d7d29d41620139659d039714219f" Jul 15 16:44:59.265340 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.265313 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27917a1123fb340c64f367a3237d464d45b0d7d29d41620139659d039714219f"} err="failed to get container status \"27917a1123fb340c64f367a3237d464d45b0d7d29d41620139659d039714219f\": rpc error: code = NotFound desc = could not find container \"27917a1123fb340c64f367a3237d464d45b0d7d29d41620139659d039714219f\": container with ID starting with 27917a1123fb340c64f367a3237d464d45b0d7d29d41620139659d039714219f not found: ID does not exist" Jul 15 16:44:59.265340 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.265334 2559 scope.go:117] "RemoveContainer" containerID="9376f25c0c774d217cb82057600f2b06c743c51cc62998c2f1480ad3bd92f3b4" Jul 15 16:44:59.265588 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.265556 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9376f25c0c774d217cb82057600f2b06c743c51cc62998c2f1480ad3bd92f3b4"} err="failed to get container status \"9376f25c0c774d217cb82057600f2b06c743c51cc62998c2f1480ad3bd92f3b4\": rpc error: code = NotFound desc = could not find container \"9376f25c0c774d217cb82057600f2b06c743c51cc62998c2f1480ad3bd92f3b4\": container with ID starting with 9376f25c0c774d217cb82057600f2b06c743c51cc62998c2f1480ad3bd92f3b4 not found: ID does not exist" Jul 15 16:44:59.265588 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.265577 2559 scope.go:117] "RemoveContainer" containerID="e67ea91eef5a6565d9e54decd27f2b41f4eaefeb3fcbb0f970f9854d7b31272f" Jul 15 16:44:59.265929 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.265903 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e67ea91eef5a6565d9e54decd27f2b41f4eaefeb3fcbb0f970f9854d7b31272f"} err="failed to get container status \"e67ea91eef5a6565d9e54decd27f2b41f4eaefeb3fcbb0f970f9854d7b31272f\": rpc error: code = NotFound desc = could not find container \"e67ea91eef5a6565d9e54decd27f2b41f4eaefeb3fcbb0f970f9854d7b31272f\": container with ID starting with e67ea91eef5a6565d9e54decd27f2b41f4eaefeb3fcbb0f970f9854d7b31272f not found: ID does not exist" Jul 15 16:44:59.267242 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.267224 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:59.270004 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.269985 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 15 16:44:59.270169 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.270082 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 15 16:44:59.270265 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.270249 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 15 16:44:59.270517 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.270498 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 15 16:44:59.270620 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.270524 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 15 16:44:59.270881 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.270711 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-x6kfw\"" Jul 15 16:44:59.270881 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.270785 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 15 16:44:59.270881 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.270824 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 15 16:44:59.271170 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.271138 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 15 16:44:59.280731 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.280707 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 15 16:44:59.287330 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.287307 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 16:44:59.403565 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.403526 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c5e2b4c-e367-43f6-becd-b6d9facedd79-web-config\") pod \"alertmanager-main-0\" (UID: \"5c5e2b4c-e367-43f6-becd-b6d9facedd79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:59.403741 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.403571 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c5e2b4c-e367-43f6-becd-b6d9facedd79-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5c5e2b4c-e367-43f6-becd-b6d9facedd79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:59.403741 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.403643 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5c5e2b4c-e367-43f6-becd-b6d9facedd79-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5c5e2b4c-e367-43f6-becd-b6d9facedd79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:59.403741 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.403714 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5c5e2b4c-e367-43f6-becd-b6d9facedd79-config-volume\") pod \"alertmanager-main-0\" (UID: \"5c5e2b4c-e367-43f6-becd-b6d9facedd79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:59.403741 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.403739 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5c5e2b4c-e367-43f6-becd-b6d9facedd79-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5c5e2b4c-e367-43f6-becd-b6d9facedd79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:59.403932 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.403825 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5c5e2b4c-e367-43f6-becd-b6d9facedd79-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5c5e2b4c-e367-43f6-becd-b6d9facedd79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:59.403932 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.403870 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5c5e2b4c-e367-43f6-becd-b6d9facedd79-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5c5e2b4c-e367-43f6-becd-b6d9facedd79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:59.403932 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.403907 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c5e2b4c-e367-43f6-becd-b6d9facedd79-config-out\") pod \"alertmanager-main-0\" (UID: \"5c5e2b4c-e367-43f6-becd-b6d9facedd79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:59.404056 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.403957 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c5e2b4c-e367-43f6-becd-b6d9facedd79-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5c5e2b4c-e367-43f6-becd-b6d9facedd79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:59.404056 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.403990 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c5e2b4c-e367-43f6-becd-b6d9facedd79-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5c5e2b4c-e367-43f6-becd-b6d9facedd79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:59.404155 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.404051 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c5e2b4c-e367-43f6-becd-b6d9facedd79-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5c5e2b4c-e367-43f6-becd-b6d9facedd79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:59.404155 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.404085 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c5e2b4c-e367-43f6-becd-b6d9facedd79-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5c5e2b4c-e367-43f6-becd-b6d9facedd79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:59.404155 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.404112 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4wch\" (UniqueName: \"kubernetes.io/projected/5c5e2b4c-e367-43f6-becd-b6d9facedd79-kube-api-access-g4wch\") pod \"alertmanager-main-0\" (UID: \"5c5e2b4c-e367-43f6-becd-b6d9facedd79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:59.505204 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.505105 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c5e2b4c-e367-43f6-becd-b6d9facedd79-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5c5e2b4c-e367-43f6-becd-b6d9facedd79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:59.505204 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.505160 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c5e2b4c-e367-43f6-becd-b6d9facedd79-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5c5e2b4c-e367-43f6-becd-b6d9facedd79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:59.505204 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.505187 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c5e2b4c-e367-43f6-becd-b6d9facedd79-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5c5e2b4c-e367-43f6-becd-b6d9facedd79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:59.505484 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.505216 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c5e2b4c-e367-43f6-becd-b6d9facedd79-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5c5e2b4c-e367-43f6-becd-b6d9facedd79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:59.505484 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.505239 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4wch\" (UniqueName: \"kubernetes.io/projected/5c5e2b4c-e367-43f6-becd-b6d9facedd79-kube-api-access-g4wch\") pod \"alertmanager-main-0\" (UID: \"5c5e2b4c-e367-43f6-becd-b6d9facedd79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:59.505484 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.505400 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c5e2b4c-e367-43f6-becd-b6d9facedd79-web-config\") pod \"alertmanager-main-0\" (UID: \"5c5e2b4c-e367-43f6-becd-b6d9facedd79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:59.505484 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.505449 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c5e2b4c-e367-43f6-becd-b6d9facedd79-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5c5e2b4c-e367-43f6-becd-b6d9facedd79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:59.505484 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.505480 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5c5e2b4c-e367-43f6-becd-b6d9facedd79-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5c5e2b4c-e367-43f6-becd-b6d9facedd79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:59.505725 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.505512 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5c5e2b4c-e367-43f6-becd-b6d9facedd79-config-volume\") pod \"alertmanager-main-0\" (UID: \"5c5e2b4c-e367-43f6-becd-b6d9facedd79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:59.505725 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.505531 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5c5e2b4c-e367-43f6-becd-b6d9facedd79-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5c5e2b4c-e367-43f6-becd-b6d9facedd79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:59.505725 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.505574 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5c5e2b4c-e367-43f6-becd-b6d9facedd79-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5c5e2b4c-e367-43f6-becd-b6d9facedd79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:59.505725 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.505607 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5c5e2b4c-e367-43f6-becd-b6d9facedd79-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5c5e2b4c-e367-43f6-becd-b6d9facedd79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:59.505725 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.505641 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c5e2b4c-e367-43f6-becd-b6d9facedd79-config-out\") pod \"alertmanager-main-0\" (UID: \"5c5e2b4c-e367-43f6-becd-b6d9facedd79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:59.506834 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.506211 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c5e2b4c-e367-43f6-becd-b6d9facedd79-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5c5e2b4c-e367-43f6-becd-b6d9facedd79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:59.506834 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.506238 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c5e2b4c-e367-43f6-becd-b6d9facedd79-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5c5e2b4c-e367-43f6-becd-b6d9facedd79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:59.506834 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.506480 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5c5e2b4c-e367-43f6-becd-b6d9facedd79-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5c5e2b4c-e367-43f6-becd-b6d9facedd79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:59.508491 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.508171 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c5e2b4c-e367-43f6-becd-b6d9facedd79-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5c5e2b4c-e367-43f6-becd-b6d9facedd79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:59.508491 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.508475 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c5e2b4c-e367-43f6-becd-b6d9facedd79-config-out\") pod \"alertmanager-main-0\" (UID: \"5c5e2b4c-e367-43f6-becd-b6d9facedd79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:59.508664 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.508520 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c5e2b4c-e367-43f6-becd-b6d9facedd79-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5c5e2b4c-e367-43f6-becd-b6d9facedd79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:59.508820 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.508798 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5c5e2b4c-e367-43f6-becd-b6d9facedd79-config-volume\") pod \"alertmanager-main-0\" (UID: \"5c5e2b4c-e367-43f6-becd-b6d9facedd79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:59.509262 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.509236 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c5e2b4c-e367-43f6-becd-b6d9facedd79-web-config\") pod \"alertmanager-main-0\" (UID: \"5c5e2b4c-e367-43f6-becd-b6d9facedd79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:59.509423 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.509400 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c5e2b4c-e367-43f6-becd-b6d9facedd79-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5c5e2b4c-e367-43f6-becd-b6d9facedd79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:59.509489 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.509459 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5c5e2b4c-e367-43f6-becd-b6d9facedd79-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5c5e2b4c-e367-43f6-becd-b6d9facedd79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:59.509489 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.509477 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5c5e2b4c-e367-43f6-becd-b6d9facedd79-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5c5e2b4c-e367-43f6-becd-b6d9facedd79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:59.510228 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.510206 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5c5e2b4c-e367-43f6-becd-b6d9facedd79-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5c5e2b4c-e367-43f6-becd-b6d9facedd79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:59.514209 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.514187 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4wch\" (UniqueName: \"kubernetes.io/projected/5c5e2b4c-e367-43f6-becd-b6d9facedd79-kube-api-access-g4wch\") pod \"alertmanager-main-0\" (UID: \"5c5e2b4c-e367-43f6-becd-b6d9facedd79\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:59.583297 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.583262 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 15 16:44:59.750323 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:44:59.750170 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 16:45:00.087471 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:45:00.087439 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c5e2b4c_e367_43f6_becd_b6d9facedd79.slice/crio-379ffb00ba4076908b6a6cd9dcbfae2ad9b139255e31c32e1c874c83fece383e WatchSource:0}: Error finding container 379ffb00ba4076908b6a6cd9dcbfae2ad9b139255e31c32e1c874c83fece383e: Status 404 returned error can't find the container with id 379ffb00ba4076908b6a6cd9dcbfae2ad9b139255e31c32e1c874c83fece383e Jul 15 16:45:00.173397 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:00.173369 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3dcf2227-5799-473b-bc53-79c3deb1f352" path="/var/lib/kubelet/pods/3dcf2227-5799-473b-bc53-79c3deb1f352/volumes" Jul 15 16:45:00.199435 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:00.199255 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c5e2b4c-e367-43f6-becd-b6d9facedd79","Type":"ContainerStarted","Data":"4a60b4b4b31a2e4c4db7a423eee03d1386b8b302d535812aa1c2eb3e65b709d5"} Jul 15 16:45:00.199435 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:00.199311 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c5e2b4c-e367-43f6-becd-b6d9facedd79","Type":"ContainerStarted","Data":"379ffb00ba4076908b6a6cd9dcbfae2ad9b139255e31c32e1c874c83fece383e"} Jul 15 16:45:00.574229 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:00.574200 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7b7d4fcf9b-89vgf"] Jul 15 16:45:00.577268 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:00.577247 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7b7d4fcf9b-89vgf" Jul 15 16:45:00.580117 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:00.580085 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 15 16:45:00.580439 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:00.580268 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 15 16:45:00.580439 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:00.580308 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-wmn7n\"" Jul 15 16:45:00.580439 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:00.580336 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 15 16:45:00.580439 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:00.580372 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 15 16:45:00.580641 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:00.580382 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 15 16:45:00.588534 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:00.588205 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 15 16:45:00.595485 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:00.595457 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7b7d4fcf9b-89vgf"] Jul 15 16:45:00.716695 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:00.716654 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a10434eb-f613-45d3-837a-d509049505d0-serving-certs-ca-bundle\") pod \"telemeter-client-7b7d4fcf9b-89vgf\" (UID: \"a10434eb-f613-45d3-837a-d509049505d0\") " pod="openshift-monitoring/telemeter-client-7b7d4fcf9b-89vgf" Jul 15 16:45:00.716911 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:00.716699 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a10434eb-f613-45d3-837a-d509049505d0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b7d4fcf9b-89vgf\" (UID: \"a10434eb-f613-45d3-837a-d509049505d0\") " pod="openshift-monitoring/telemeter-client-7b7d4fcf9b-89vgf" Jul 15 16:45:00.716911 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:00.716784 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbd9k\" (UniqueName: \"kubernetes.io/projected/a10434eb-f613-45d3-837a-d509049505d0-kube-api-access-wbd9k\") pod \"telemeter-client-7b7d4fcf9b-89vgf\" (UID: \"a10434eb-f613-45d3-837a-d509049505d0\") " pod="openshift-monitoring/telemeter-client-7b7d4fcf9b-89vgf" Jul 15 16:45:00.716911 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:00.716828 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a10434eb-f613-45d3-837a-d509049505d0-secret-telemeter-client\") pod \"telemeter-client-7b7d4fcf9b-89vgf\" (UID: \"a10434eb-f613-45d3-837a-d509049505d0\") " pod="openshift-monitoring/telemeter-client-7b7d4fcf9b-89vgf" Jul 15 16:45:00.717034 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:00.716911 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a10434eb-f613-45d3-837a-d509049505d0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b7d4fcf9b-89vgf\" (UID: \"a10434eb-f613-45d3-837a-d509049505d0\") " pod="openshift-monitoring/telemeter-client-7b7d4fcf9b-89vgf" Jul 15 16:45:00.717034 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:00.716956 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a10434eb-f613-45d3-837a-d509049505d0-metrics-client-ca\") pod \"telemeter-client-7b7d4fcf9b-89vgf\" (UID: \"a10434eb-f613-45d3-837a-d509049505d0\") " pod="openshift-monitoring/telemeter-client-7b7d4fcf9b-89vgf" Jul 15 16:45:00.717034 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:00.716999 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a10434eb-f613-45d3-837a-d509049505d0-federate-client-tls\") pod \"telemeter-client-7b7d4fcf9b-89vgf\" (UID: \"a10434eb-f613-45d3-837a-d509049505d0\") " pod="openshift-monitoring/telemeter-client-7b7d4fcf9b-89vgf" Jul 15 16:45:00.717174 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:00.717105 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a10434eb-f613-45d3-837a-d509049505d0-telemeter-client-tls\") pod \"telemeter-client-7b7d4fcf9b-89vgf\" (UID: \"a10434eb-f613-45d3-837a-d509049505d0\") " pod="openshift-monitoring/telemeter-client-7b7d4fcf9b-89vgf" Jul 15 16:45:00.818052 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:00.818022 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a10434eb-f613-45d3-837a-d509049505d0-metrics-client-ca\") pod \"telemeter-client-7b7d4fcf9b-89vgf\" (UID: \"a10434eb-f613-45d3-837a-d509049505d0\") " pod="openshift-monitoring/telemeter-client-7b7d4fcf9b-89vgf" Jul 15 16:45:00.818052 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:00.818054 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a10434eb-f613-45d3-837a-d509049505d0-federate-client-tls\") pod \"telemeter-client-7b7d4fcf9b-89vgf\" (UID: \"a10434eb-f613-45d3-837a-d509049505d0\") " pod="openshift-monitoring/telemeter-client-7b7d4fcf9b-89vgf" Jul 15 16:45:00.818253 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:00.818096 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a10434eb-f613-45d3-837a-d509049505d0-telemeter-client-tls\") pod \"telemeter-client-7b7d4fcf9b-89vgf\" (UID: \"a10434eb-f613-45d3-837a-d509049505d0\") " pod="openshift-monitoring/telemeter-client-7b7d4fcf9b-89vgf" Jul 15 16:45:00.818315 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:00.818276 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a10434eb-f613-45d3-837a-d509049505d0-serving-certs-ca-bundle\") pod \"telemeter-client-7b7d4fcf9b-89vgf\" (UID: \"a10434eb-f613-45d3-837a-d509049505d0\") " pod="openshift-monitoring/telemeter-client-7b7d4fcf9b-89vgf" Jul 15 16:45:00.818369 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:00.818325 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a10434eb-f613-45d3-837a-d509049505d0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b7d4fcf9b-89vgf\" (UID: \"a10434eb-f613-45d3-837a-d509049505d0\") " pod="openshift-monitoring/telemeter-client-7b7d4fcf9b-89vgf" Jul 15 16:45:00.818421 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:00.818373 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbd9k\" (UniqueName: \"kubernetes.io/projected/a10434eb-f613-45d3-837a-d509049505d0-kube-api-access-wbd9k\") pod \"telemeter-client-7b7d4fcf9b-89vgf\" (UID: \"a10434eb-f613-45d3-837a-d509049505d0\") " pod="openshift-monitoring/telemeter-client-7b7d4fcf9b-89vgf" Jul 15 16:45:00.818469 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:00.818419 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a10434eb-f613-45d3-837a-d509049505d0-secret-telemeter-client\") pod \"telemeter-client-7b7d4fcf9b-89vgf\" (UID: \"a10434eb-f613-45d3-837a-d509049505d0\") " pod="openshift-monitoring/telemeter-client-7b7d4fcf9b-89vgf" Jul 15 16:45:00.818514 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:00.818466 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a10434eb-f613-45d3-837a-d509049505d0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b7d4fcf9b-89vgf\" (UID: \"a10434eb-f613-45d3-837a-d509049505d0\") " pod="openshift-monitoring/telemeter-client-7b7d4fcf9b-89vgf" Jul 15 16:45:00.818837 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:00.818810 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a10434eb-f613-45d3-837a-d509049505d0-metrics-client-ca\") pod \"telemeter-client-7b7d4fcf9b-89vgf\" (UID: \"a10434eb-f613-45d3-837a-d509049505d0\") " pod="openshift-monitoring/telemeter-client-7b7d4fcf9b-89vgf" Jul 15 16:45:00.818992 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:00.818964 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a10434eb-f613-45d3-837a-d509049505d0-serving-certs-ca-bundle\") pod \"telemeter-client-7b7d4fcf9b-89vgf\" (UID: \"a10434eb-f613-45d3-837a-d509049505d0\") " pod="openshift-monitoring/telemeter-client-7b7d4fcf9b-89vgf" Jul 15 16:45:00.819243 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:00.819216 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a10434eb-f613-45d3-837a-d509049505d0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b7d4fcf9b-89vgf\" (UID: \"a10434eb-f613-45d3-837a-d509049505d0\") " pod="openshift-monitoring/telemeter-client-7b7d4fcf9b-89vgf" Jul 15 16:45:00.820717 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:00.820698 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a10434eb-f613-45d3-837a-d509049505d0-telemeter-client-tls\") pod \"telemeter-client-7b7d4fcf9b-89vgf\" (UID: \"a10434eb-f613-45d3-837a-d509049505d0\") " pod="openshift-monitoring/telemeter-client-7b7d4fcf9b-89vgf" Jul 15 16:45:00.820850 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:00.820737 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a10434eb-f613-45d3-837a-d509049505d0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b7d4fcf9b-89vgf\" (UID: \"a10434eb-f613-45d3-837a-d509049505d0\") " pod="openshift-monitoring/telemeter-client-7b7d4fcf9b-89vgf" Jul 15 16:45:00.821072 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:00.821045 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a10434eb-f613-45d3-837a-d509049505d0-federate-client-tls\") pod \"telemeter-client-7b7d4fcf9b-89vgf\" (UID: \"a10434eb-f613-45d3-837a-d509049505d0\") " pod="openshift-monitoring/telemeter-client-7b7d4fcf9b-89vgf" Jul 15 16:45:00.821128 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:00.821083 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a10434eb-f613-45d3-837a-d509049505d0-secret-telemeter-client\") pod \"telemeter-client-7b7d4fcf9b-89vgf\" (UID: \"a10434eb-f613-45d3-837a-d509049505d0\") " pod="openshift-monitoring/telemeter-client-7b7d4fcf9b-89vgf" Jul 15 16:45:00.825961 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:00.825940 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbd9k\" (UniqueName: \"kubernetes.io/projected/a10434eb-f613-45d3-837a-d509049505d0-kube-api-access-wbd9k\") pod \"telemeter-client-7b7d4fcf9b-89vgf\" (UID: \"a10434eb-f613-45d3-837a-d509049505d0\") " pod="openshift-monitoring/telemeter-client-7b7d4fcf9b-89vgf" Jul 15 16:45:00.890999 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:00.890920 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7b7d4fcf9b-89vgf" Jul 15 16:45:01.037197 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:01.037158 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7b7d4fcf9b-89vgf"] Jul 15 16:45:01.040463 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:45:01.040438 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda10434eb_f613_45d3_837a_d509049505d0.slice/crio-68ccc98fff264d72ed23615dc57398ab9cd35727ef047fcafd9359941dae71b8 WatchSource:0}: Error finding container 68ccc98fff264d72ed23615dc57398ab9cd35727ef047fcafd9359941dae71b8: Status 404 returned error can't find the container with id 68ccc98fff264d72ed23615dc57398ab9cd35727ef047fcafd9359941dae71b8 Jul 15 16:45:01.210288 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:01.210250 2559 generic.go:356] "Generic (PLEG): container finished" podID="5c5e2b4c-e367-43f6-becd-b6d9facedd79" containerID="4a60b4b4b31a2e4c4db7a423eee03d1386b8b302d535812aa1c2eb3e65b709d5" exitCode=0 Jul 15 16:45:01.210713 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:01.210369 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c5e2b4c-e367-43f6-becd-b6d9facedd79","Type":"ContainerDied","Data":"4a60b4b4b31a2e4c4db7a423eee03d1386b8b302d535812aa1c2eb3e65b709d5"} Jul 15 16:45:01.210713 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:01.210447 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c5e2b4c-e367-43f6-becd-b6d9facedd79","Type":"ContainerStarted","Data":"49e7ded29dd2e6e83a22a5f11fe41b88034ec6dba61f1aeadc928e0a1f8bc38f"} Jul 15 16:45:01.210713 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:01.210490 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c5e2b4c-e367-43f6-becd-b6d9facedd79","Type":"ContainerStarted","Data":"4064ee24ff31271e97665b5bce2cce539bba3322274abc6f719f43fdcad162ab"} Jul 15 16:45:01.210713 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:01.210526 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c5e2b4c-e367-43f6-becd-b6d9facedd79","Type":"ContainerStarted","Data":"57fcce5e4271eec657b02a7324bf3566bee27301f3b7ae849b9e1bfc93fb3a78"} Jul 15 16:45:01.210713 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:01.210566 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c5e2b4c-e367-43f6-becd-b6d9facedd79","Type":"ContainerStarted","Data":"08730cbb029002084837f6453decf25cecc8589155dd078ce3e927ba8f4b490e"} Jul 15 16:45:01.210713 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:01.210602 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c5e2b4c-e367-43f6-becd-b6d9facedd79","Type":"ContainerStarted","Data":"81a748a8a854300e99c5a5fa78e1d0d8da6f72fe616f38d43b1b0b88d37c5a9f"} Jul 15 16:45:01.210713 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:01.210641 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c5e2b4c-e367-43f6-becd-b6d9facedd79","Type":"ContainerStarted","Data":"51ec0233700a346ef5d21a47cd0d06b9be442b80c5f9a095807502d104239564"} Jul 15 16:45:01.214767 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:01.214641 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b7d4fcf9b-89vgf" event={"ID":"a10434eb-f613-45d3-837a-d509049505d0","Type":"ContainerStarted","Data":"68ccc98fff264d72ed23615dc57398ab9cd35727ef047fcafd9359941dae71b8"} Jul 15 16:45:01.216887 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:01.216863 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nqjzl" event={"ID":"a0eef5ad-3412-4990-b896-87e4444303d1","Type":"ContainerStarted","Data":"c5415ee0c4957bd31651c6c74c3e0ea2597cab2689cebac53ab23449aa42bf3a"} Jul 15 16:45:01.217008 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:01.216911 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nqjzl" Jul 15 16:45:01.217008 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:01.216931 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nqjzl" event={"ID":"a0eef5ad-3412-4990-b896-87e4444303d1","Type":"ContainerStarted","Data":"d56da7b4e6501d465cca3a09cc800381afae73beec8f2fe337bad74b92fc80e1"} Jul 15 16:45:01.238001 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:01.237960 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.219715254 podStartE2EDuration="2.237946614s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.23136ms" isStatefulPod=false podCreationTimestamp="2026-07-15 16:44:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:45:01.235803852 +0000 UTC m=+287.662895957" watchObservedRunningTime="2026-07-15 16:45:01.237946614 +0000 UTC m=+287.665038697" Jul 15 16:45:01.293687 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:01.293633 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-nqjzl" podStartSLOduration=252.495398238 podStartE2EDuration="4m14.293614236s" totalImagesPullingTime="1.798215998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:40:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:45:01.285628995 +0000 UTC m=+287.712721089" watchObservedRunningTime="2026-07-15 16:45:01.293614236 +0000 UTC m=+287.720706322" Jul 15 16:45:03.229944 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:03.229910 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b7d4fcf9b-89vgf" event={"ID":"a10434eb-f613-45d3-837a-d509049505d0","Type":"ContainerStarted","Data":"36dedfb0c943c08c4bb199840b7bc4de6443b134a2027dac80e17957af6c50d4"} Jul 15 16:45:03.230329 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:03.229968 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b7d4fcf9b-89vgf" event={"ID":"a10434eb-f613-45d3-837a-d509049505d0","Type":"ContainerStarted","Data":"81cf247ea0f8b858a5884e67244ef8341464aaa25fd2ce7abb1b492d29c78a0d"} Jul 15 16:45:03.230329 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:03.229991 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b7d4fcf9b-89vgf" event={"ID":"a10434eb-f613-45d3-837a-d509049505d0","Type":"ContainerStarted","Data":"c936e6e9987a909b911ce090276a6c674d817fe3ed212854327623b12d90514b"} Jul 15 16:45:03.255297 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:03.255243 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7b7d4fcf9b-89vgf" podStartSLOduration=1.650285824 podStartE2EDuration="3.255225233s" totalImagesPullingTime="1.604939409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:45:03.253461053 +0000 UTC m=+289.680553164" watchObservedRunningTime="2026-07-15 16:45:03.255225233 +0000 UTC m=+289.682317343" Jul 15 16:45:03.350038 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:03.350010 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cb75775c9-x2lwt"] Jul 15 16:45:03.381628 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:03.381601 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b5ccd68f5-7v5j4"] Jul 15 16:45:03.384205 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:03.384187 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b5ccd68f5-7v5j4" Jul 15 16:45:03.395140 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:03.395115 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b5ccd68f5-7v5j4"] Jul 15 16:45:03.545609 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:03.545528 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skx9f\" (UniqueName: \"kubernetes.io/projected/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad-kube-api-access-skx9f\") pod \"console-5b5ccd68f5-7v5j4\" (UID: \"4fa651c5-dc2a-4d73-a8b9-124f1683b1ad\") " pod="openshift-console/console-5b5ccd68f5-7v5j4" Jul 15 16:45:03.545609 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:03.545571 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad-console-config\") pod \"console-5b5ccd68f5-7v5j4\" (UID: \"4fa651c5-dc2a-4d73-a8b9-124f1683b1ad\") " pod="openshift-console/console-5b5ccd68f5-7v5j4" Jul 15 16:45:03.545609 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:03.545591 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad-oauth-serving-cert\") pod \"console-5b5ccd68f5-7v5j4\" (UID: \"4fa651c5-dc2a-4d73-a8b9-124f1683b1ad\") " pod="openshift-console/console-5b5ccd68f5-7v5j4" Jul 15 16:45:03.545901 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:03.545650 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad-service-ca\") pod \"console-5b5ccd68f5-7v5j4\" (UID: \"4fa651c5-dc2a-4d73-a8b9-124f1683b1ad\") " pod="openshift-console/console-5b5ccd68f5-7v5j4" Jul 15 16:45:03.545901 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:03.545742 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad-console-serving-cert\") pod \"console-5b5ccd68f5-7v5j4\" (UID: \"4fa651c5-dc2a-4d73-a8b9-124f1683b1ad\") " pod="openshift-console/console-5b5ccd68f5-7v5j4" Jul 15 16:45:03.545901 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:03.545797 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad-console-oauth-config\") pod \"console-5b5ccd68f5-7v5j4\" (UID: \"4fa651c5-dc2a-4d73-a8b9-124f1683b1ad\") " pod="openshift-console/console-5b5ccd68f5-7v5j4" Jul 15 16:45:03.545901 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:03.545819 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad-trusted-ca-bundle\") pod \"console-5b5ccd68f5-7v5j4\" (UID: \"4fa651c5-dc2a-4d73-a8b9-124f1683b1ad\") " pod="openshift-console/console-5b5ccd68f5-7v5j4" Jul 15 16:45:03.646698 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:03.646662 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skx9f\" (UniqueName: \"kubernetes.io/projected/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad-kube-api-access-skx9f\") pod \"console-5b5ccd68f5-7v5j4\" (UID: \"4fa651c5-dc2a-4d73-a8b9-124f1683b1ad\") " pod="openshift-console/console-5b5ccd68f5-7v5j4" Jul 15 16:45:03.646866 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:03.646711 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad-console-config\") pod \"console-5b5ccd68f5-7v5j4\" (UID: \"4fa651c5-dc2a-4d73-a8b9-124f1683b1ad\") " pod="openshift-console/console-5b5ccd68f5-7v5j4" Jul 15 16:45:03.646866 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:03.646731 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad-oauth-serving-cert\") pod \"console-5b5ccd68f5-7v5j4\" (UID: \"4fa651c5-dc2a-4d73-a8b9-124f1683b1ad\") " pod="openshift-console/console-5b5ccd68f5-7v5j4" Jul 15 16:45:03.646866 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:03.646764 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad-service-ca\") pod \"console-5b5ccd68f5-7v5j4\" (UID: \"4fa651c5-dc2a-4d73-a8b9-124f1683b1ad\") " pod="openshift-console/console-5b5ccd68f5-7v5j4" Jul 15 16:45:03.646866 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:03.646811 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad-console-serving-cert\") pod \"console-5b5ccd68f5-7v5j4\" (UID: \"4fa651c5-dc2a-4d73-a8b9-124f1683b1ad\") " pod="openshift-console/console-5b5ccd68f5-7v5j4" Jul 15 16:45:03.646866 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:03.646833 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad-console-oauth-config\") pod \"console-5b5ccd68f5-7v5j4\" (UID: \"4fa651c5-dc2a-4d73-a8b9-124f1683b1ad\") " pod="openshift-console/console-5b5ccd68f5-7v5j4" Jul 15 16:45:03.646866 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:03.646859 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad-trusted-ca-bundle\") pod \"console-5b5ccd68f5-7v5j4\" (UID: \"4fa651c5-dc2a-4d73-a8b9-124f1683b1ad\") " pod="openshift-console/console-5b5ccd68f5-7v5j4" Jul 15 16:45:03.647663 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:03.647635 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad-console-config\") pod \"console-5b5ccd68f5-7v5j4\" (UID: \"4fa651c5-dc2a-4d73-a8b9-124f1683b1ad\") " pod="openshift-console/console-5b5ccd68f5-7v5j4" Jul 15 16:45:03.647814 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:03.647670 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad-oauth-serving-cert\") pod \"console-5b5ccd68f5-7v5j4\" (UID: \"4fa651c5-dc2a-4d73-a8b9-124f1683b1ad\") " pod="openshift-console/console-5b5ccd68f5-7v5j4" Jul 15 16:45:03.647876 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:03.647730 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad-service-ca\") pod \"console-5b5ccd68f5-7v5j4\" (UID: \"4fa651c5-dc2a-4d73-a8b9-124f1683b1ad\") " pod="openshift-console/console-5b5ccd68f5-7v5j4" Jul 15 16:45:03.647876 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:03.647768 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad-trusted-ca-bundle\") pod \"console-5b5ccd68f5-7v5j4\" (UID: \"4fa651c5-dc2a-4d73-a8b9-124f1683b1ad\") " pod="openshift-console/console-5b5ccd68f5-7v5j4" Jul 15 16:45:03.649467 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:03.649438 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad-console-serving-cert\") pod \"console-5b5ccd68f5-7v5j4\" (UID: \"4fa651c5-dc2a-4d73-a8b9-124f1683b1ad\") " pod="openshift-console/console-5b5ccd68f5-7v5j4" Jul 15 16:45:03.649565 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:03.649475 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad-console-oauth-config\") pod \"console-5b5ccd68f5-7v5j4\" (UID: \"4fa651c5-dc2a-4d73-a8b9-124f1683b1ad\") " pod="openshift-console/console-5b5ccd68f5-7v5j4" Jul 15 16:45:03.654879 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:03.654859 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skx9f\" (UniqueName: \"kubernetes.io/projected/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad-kube-api-access-skx9f\") pod \"console-5b5ccd68f5-7v5j4\" (UID: \"4fa651c5-dc2a-4d73-a8b9-124f1683b1ad\") " pod="openshift-console/console-5b5ccd68f5-7v5j4" Jul 15 16:45:03.692717 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:03.692680 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b5ccd68f5-7v5j4" Jul 15 16:45:03.845581 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:03.845555 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b5ccd68f5-7v5j4"] Jul 15 16:45:03.848974 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:45:03.848948 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fa651c5_dc2a_4d73_a8b9_124f1683b1ad.slice/crio-0cfd02aec28441d4bae6ea9753e34019002e124ff1f331512367baa9c2ae0682 WatchSource:0}: Error finding container 0cfd02aec28441d4bae6ea9753e34019002e124ff1f331512367baa9c2ae0682: Status 404 returned error can't find the container with id 0cfd02aec28441d4bae6ea9753e34019002e124ff1f331512367baa9c2ae0682 Jul 15 16:45:04.236223 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:04.236183 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b5ccd68f5-7v5j4" event={"ID":"4fa651c5-dc2a-4d73-a8b9-124f1683b1ad","Type":"ContainerStarted","Data":"eb71789b116c9a92af201a8c91d55e3453366679466152c89319ea14208578a0"} Jul 15 16:45:04.236627 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:04.236241 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b5ccd68f5-7v5j4" event={"ID":"4fa651c5-dc2a-4d73-a8b9-124f1683b1ad","Type":"ContainerStarted","Data":"0cfd02aec28441d4bae6ea9753e34019002e124ff1f331512367baa9c2ae0682"} Jul 15 16:45:04.256471 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:04.256423 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b5ccd68f5-7v5j4" podStartSLOduration=1.256408183 podStartE2EDuration="1.256408183s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:45:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:45:04.255647156 +0000 UTC m=+290.682739250" watchObservedRunningTime="2026-07-15 16:45:04.256408183 +0000 UTC m=+290.683500265" Jul 15 16:45:08.632210 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:08.632179 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d799b4fd5-c29mv" Jul 15 16:45:08.635802 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:08.635781 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d799b4fd5-c29mv" Jul 15 16:45:11.224433 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:11.224398 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nqjzl" Jul 15 16:45:13.693622 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:13.693575 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b5ccd68f5-7v5j4" Jul 15 16:45:13.694059 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:13.693729 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b5ccd68f5-7v5j4" Jul 15 16:45:13.698355 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:13.698337 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b5ccd68f5-7v5j4" Jul 15 16:45:14.004094 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:14.004064 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vcxdn_268a4cb9-c310-4681-91a6-efe9692f8327/console-operator/2.log" Jul 15 16:45:14.009237 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:14.009209 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vcxdn_268a4cb9-c310-4681-91a6-efe9692f8327/console-operator/2.log" Jul 15 16:45:14.009352 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:14.009292 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxsr7_1e30c2c6-c7eb-42ca-add5-239c71eafd0d/ovn-acl-logging/0.log" Jul 15 16:45:14.014016 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:14.013990 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxsr7_1e30c2c6-c7eb-42ca-add5-239c71eafd0d/ovn-acl-logging/0.log" Jul 15 16:45:14.016037 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:14.016020 2559 kubelet.go:1648] "Image garbage collection succeeded" Jul 15 16:45:14.283306 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:14.283129 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b5ccd68f5-7v5j4" Jul 15 16:45:14.329809 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:14.329779 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d799b4fd5-c29mv"] Jul 15 16:45:28.370051 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:28.369990 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5cb75775c9-x2lwt" podUID="72e8609c-6276-4d8d-b9d9-e1d9408fca7f" containerName="console" containerID="cri-o://7813d52efc8698b44470ac3b242ac263b9cdaefe044932bbf175654ed749ff48" gracePeriod=15 Jul 15 16:45:28.622504 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:28.622453 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb75775c9-x2lwt" Jul 15 16:45:28.658194 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:28.658165 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4c65\" (UniqueName: \"kubernetes.io/projected/72e8609c-6276-4d8d-b9d9-e1d9408fca7f-kube-api-access-d4c65\") pod \"72e8609c-6276-4d8d-b9d9-e1d9408fca7f\" (UID: \"72e8609c-6276-4d8d-b9d9-e1d9408fca7f\") " Jul 15 16:45:28.658324 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:28.658229 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/72e8609c-6276-4d8d-b9d9-e1d9408fca7f-service-ca\") pod \"72e8609c-6276-4d8d-b9d9-e1d9408fca7f\" (UID: \"72e8609c-6276-4d8d-b9d9-e1d9408fca7f\") " Jul 15 16:45:28.658399 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:28.658380 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/72e8609c-6276-4d8d-b9d9-e1d9408fca7f-console-serving-cert\") pod \"72e8609c-6276-4d8d-b9d9-e1d9408fca7f\" (UID: \"72e8609c-6276-4d8d-b9d9-e1d9408fca7f\") " Jul 15 16:45:28.658466 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:28.658409 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/72e8609c-6276-4d8d-b9d9-e1d9408fca7f-console-oauth-config\") pod \"72e8609c-6276-4d8d-b9d9-e1d9408fca7f\" (UID: \"72e8609c-6276-4d8d-b9d9-e1d9408fca7f\") " Jul 15 16:45:28.658466 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:28.658428 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/72e8609c-6276-4d8d-b9d9-e1d9408fca7f-console-config\") pod \"72e8609c-6276-4d8d-b9d9-e1d9408fca7f\" (UID: \"72e8609c-6276-4d8d-b9d9-e1d9408fca7f\") " Jul 15 16:45:28.658466 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:28.658449 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/72e8609c-6276-4d8d-b9d9-e1d9408fca7f-oauth-serving-cert\") pod \"72e8609c-6276-4d8d-b9d9-e1d9408fca7f\" (UID: \"72e8609c-6276-4d8d-b9d9-e1d9408fca7f\") " Jul 15 16:45:28.658610 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:28.658554 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72e8609c-6276-4d8d-b9d9-e1d9408fca7f-service-ca" (OuterVolumeSpecName: "service-ca") pod "72e8609c-6276-4d8d-b9d9-e1d9408fca7f" (UID: "72e8609c-6276-4d8d-b9d9-e1d9408fca7f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:45:28.658808 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:28.658780 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/72e8609c-6276-4d8d-b9d9-e1d9408fca7f-service-ca\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:45:28.658926 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:28.658845 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72e8609c-6276-4d8d-b9d9-e1d9408fca7f-console-config" (OuterVolumeSpecName: "console-config") pod "72e8609c-6276-4d8d-b9d9-e1d9408fca7f" (UID: "72e8609c-6276-4d8d-b9d9-e1d9408fca7f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:45:28.658926 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:28.658898 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72e8609c-6276-4d8d-b9d9-e1d9408fca7f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "72e8609c-6276-4d8d-b9d9-e1d9408fca7f" (UID: "72e8609c-6276-4d8d-b9d9-e1d9408fca7f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:45:28.660902 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:28.660879 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72e8609c-6276-4d8d-b9d9-e1d9408fca7f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "72e8609c-6276-4d8d-b9d9-e1d9408fca7f" (UID: "72e8609c-6276-4d8d-b9d9-e1d9408fca7f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 16:45:28.660990 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:28.660901 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72e8609c-6276-4d8d-b9d9-e1d9408fca7f-kube-api-access-d4c65" (OuterVolumeSpecName: "kube-api-access-d4c65") pod "72e8609c-6276-4d8d-b9d9-e1d9408fca7f" (UID: "72e8609c-6276-4d8d-b9d9-e1d9408fca7f"). InnerVolumeSpecName "kube-api-access-d4c65". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 16:45:28.660990 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:28.660939 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72e8609c-6276-4d8d-b9d9-e1d9408fca7f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "72e8609c-6276-4d8d-b9d9-e1d9408fca7f" (UID: "72e8609c-6276-4d8d-b9d9-e1d9408fca7f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 16:45:28.759530 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:28.759497 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/72e8609c-6276-4d8d-b9d9-e1d9408fca7f-console-serving-cert\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:45:28.759530 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:28.759523 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/72e8609c-6276-4d8d-b9d9-e1d9408fca7f-console-oauth-config\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:45:28.759530 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:28.759533 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/72e8609c-6276-4d8d-b9d9-e1d9408fca7f-console-config\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:45:28.759743 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:28.759544 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/72e8609c-6276-4d8d-b9d9-e1d9408fca7f-oauth-serving-cert\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:45:28.759743 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:28.759552 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4c65\" (UniqueName: \"kubernetes.io/projected/72e8609c-6276-4d8d-b9d9-e1d9408fca7f-kube-api-access-d4c65\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:45:29.345066 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:29.345031 2559 generic.go:356] "Generic (PLEG): container finished" podID="72e8609c-6276-4d8d-b9d9-e1d9408fca7f" containerID="7813d52efc8698b44470ac3b242ac263b9cdaefe044932bbf175654ed749ff48" exitCode=0 Jul 15 16:45:29.345278 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:29.345074 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb75775c9-x2lwt" Jul 15 16:45:29.345278 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:29.345121 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb75775c9-x2lwt" event={"ID":"72e8609c-6276-4d8d-b9d9-e1d9408fca7f","Type":"ContainerDied","Data":"7813d52efc8698b44470ac3b242ac263b9cdaefe044932bbf175654ed749ff48"} Jul 15 16:45:29.345278 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:29.345174 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb75775c9-x2lwt" event={"ID":"72e8609c-6276-4d8d-b9d9-e1d9408fca7f","Type":"ContainerDied","Data":"2f12999df8dbd95a5d57d4867379a4a880f7c7cbca0d4cec4d5b15b758df0a67"} Jul 15 16:45:29.345278 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:29.345199 2559 scope.go:117] "RemoveContainer" containerID="7813d52efc8698b44470ac3b242ac263b9cdaefe044932bbf175654ed749ff48" Jul 15 16:45:29.354488 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:29.354474 2559 scope.go:117] "RemoveContainer" containerID="7813d52efc8698b44470ac3b242ac263b9cdaefe044932bbf175654ed749ff48" Jul 15 16:45:29.354725 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:45:29.354708 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7813d52efc8698b44470ac3b242ac263b9cdaefe044932bbf175654ed749ff48\": container with ID starting with 7813d52efc8698b44470ac3b242ac263b9cdaefe044932bbf175654ed749ff48 not found: ID does not exist" containerID="7813d52efc8698b44470ac3b242ac263b9cdaefe044932bbf175654ed749ff48" Jul 15 16:45:29.354815 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:29.354736 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7813d52efc8698b44470ac3b242ac263b9cdaefe044932bbf175654ed749ff48"} err="failed to get container status \"7813d52efc8698b44470ac3b242ac263b9cdaefe044932bbf175654ed749ff48\": rpc error: code = NotFound desc = could not find container \"7813d52efc8698b44470ac3b242ac263b9cdaefe044932bbf175654ed749ff48\": container with ID starting with 7813d52efc8698b44470ac3b242ac263b9cdaefe044932bbf175654ed749ff48 not found: ID does not exist" Jul 15 16:45:29.366080 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:29.366058 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cb75775c9-x2lwt"] Jul 15 16:45:29.369799 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:29.369778 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cb75775c9-x2lwt"] Jul 15 16:45:30.172688 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:30.172660 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72e8609c-6276-4d8d-b9d9-e1d9408fca7f" path="/var/lib/kubelet/pods/72e8609c-6276-4d8d-b9d9-e1d9408fca7f/volumes" Jul 15 16:45:39.350047 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:39.350010 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6d799b4fd5-c29mv" podUID="67ced135-59cc-483e-a334-9ea24133d481" containerName="console" containerID="cri-o://2fa45038fc8de800aa8083cf763c8fb2af33d043ee242fca237f4a2cc367579f" gracePeriod=15 Jul 15 16:45:39.598200 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:39.598180 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d799b4fd5-c29mv" Jul 15 16:45:39.646287 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:39.646230 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/67ced135-59cc-483e-a334-9ea24133d481-console-serving-cert\") pod \"67ced135-59cc-483e-a334-9ea24133d481\" (UID: \"67ced135-59cc-483e-a334-9ea24133d481\") " Jul 15 16:45:39.646287 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:39.646259 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/67ced135-59cc-483e-a334-9ea24133d481-console-oauth-config\") pod \"67ced135-59cc-483e-a334-9ea24133d481\" (UID: \"67ced135-59cc-483e-a334-9ea24133d481\") " Jul 15 16:45:39.646287 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:39.646278 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/67ced135-59cc-483e-a334-9ea24133d481-oauth-serving-cert\") pod \"67ced135-59cc-483e-a334-9ea24133d481\" (UID: \"67ced135-59cc-483e-a334-9ea24133d481\") " Jul 15 16:45:39.646489 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:39.646302 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/67ced135-59cc-483e-a334-9ea24133d481-service-ca\") pod \"67ced135-59cc-483e-a334-9ea24133d481\" (UID: \"67ced135-59cc-483e-a334-9ea24133d481\") " Jul 15 16:45:39.646489 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:39.646343 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/67ced135-59cc-483e-a334-9ea24133d481-console-config\") pod \"67ced135-59cc-483e-a334-9ea24133d481\" (UID: \"67ced135-59cc-483e-a334-9ea24133d481\") " Jul 15 16:45:39.646489 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:39.646373 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67ced135-59cc-483e-a334-9ea24133d481-trusted-ca-bundle\") pod \"67ced135-59cc-483e-a334-9ea24133d481\" (UID: \"67ced135-59cc-483e-a334-9ea24133d481\") " Jul 15 16:45:39.646489 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:39.646450 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4lprc\" (UniqueName: \"kubernetes.io/projected/67ced135-59cc-483e-a334-9ea24133d481-kube-api-access-4lprc\") pod \"67ced135-59cc-483e-a334-9ea24133d481\" (UID: \"67ced135-59cc-483e-a334-9ea24133d481\") " Jul 15 16:45:39.646731 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:39.646697 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67ced135-59cc-483e-a334-9ea24133d481-service-ca" (OuterVolumeSpecName: "service-ca") pod "67ced135-59cc-483e-a334-9ea24133d481" (UID: "67ced135-59cc-483e-a334-9ea24133d481"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:45:39.646731 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:39.646705 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67ced135-59cc-483e-a334-9ea24133d481-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "67ced135-59cc-483e-a334-9ea24133d481" (UID: "67ced135-59cc-483e-a334-9ea24133d481"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:45:39.646880 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:39.646745 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67ced135-59cc-483e-a334-9ea24133d481-console-config" (OuterVolumeSpecName: "console-config") pod "67ced135-59cc-483e-a334-9ea24133d481" (UID: "67ced135-59cc-483e-a334-9ea24133d481"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:45:39.646880 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:39.646841 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67ced135-59cc-483e-a334-9ea24133d481-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "67ced135-59cc-483e-a334-9ea24133d481" (UID: "67ced135-59cc-483e-a334-9ea24133d481"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:45:39.648316 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:39.648285 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67ced135-59cc-483e-a334-9ea24133d481-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "67ced135-59cc-483e-a334-9ea24133d481" (UID: "67ced135-59cc-483e-a334-9ea24133d481"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 16:45:39.648401 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:39.648316 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67ced135-59cc-483e-a334-9ea24133d481-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "67ced135-59cc-483e-a334-9ea24133d481" (UID: "67ced135-59cc-483e-a334-9ea24133d481"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 16:45:39.648475 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:39.648451 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67ced135-59cc-483e-a334-9ea24133d481-kube-api-access-4lprc" (OuterVolumeSpecName: "kube-api-access-4lprc") pod "67ced135-59cc-483e-a334-9ea24133d481" (UID: "67ced135-59cc-483e-a334-9ea24133d481"). InnerVolumeSpecName "kube-api-access-4lprc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 16:45:39.747110 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:39.747088 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67ced135-59cc-483e-a334-9ea24133d481-trusted-ca-bundle\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:45:39.747110 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:39.747107 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4lprc\" (UniqueName: \"kubernetes.io/projected/67ced135-59cc-483e-a334-9ea24133d481-kube-api-access-4lprc\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:45:39.747230 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:39.747115 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/67ced135-59cc-483e-a334-9ea24133d481-console-serving-cert\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:45:39.747230 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:39.747124 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/67ced135-59cc-483e-a334-9ea24133d481-console-oauth-config\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:45:39.747230 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:39.747134 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/67ced135-59cc-483e-a334-9ea24133d481-oauth-serving-cert\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:45:39.747230 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:39.747144 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/67ced135-59cc-483e-a334-9ea24133d481-service-ca\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:45:39.747230 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:39.747152 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/67ced135-59cc-483e-a334-9ea24133d481-console-config\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:45:40.392827 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:40.392795 2559 generic.go:356] "Generic (PLEG): container finished" podID="67ced135-59cc-483e-a334-9ea24133d481" containerID="2fa45038fc8de800aa8083cf763c8fb2af33d043ee242fca237f4a2cc367579f" exitCode=0 Jul 15 16:45:40.393184 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:40.392836 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d799b4fd5-c29mv" Jul 15 16:45:40.393184 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:40.392882 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d799b4fd5-c29mv" event={"ID":"67ced135-59cc-483e-a334-9ea24133d481","Type":"ContainerDied","Data":"2fa45038fc8de800aa8083cf763c8fb2af33d043ee242fca237f4a2cc367579f"} Jul 15 16:45:40.393184 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:40.392926 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d799b4fd5-c29mv" event={"ID":"67ced135-59cc-483e-a334-9ea24133d481","Type":"ContainerDied","Data":"2f9d307db9f7095631bae76fa1c229b5652b7ef2286d3438145b37f2cb379679"} Jul 15 16:45:40.393184 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:40.392945 2559 scope.go:117] "RemoveContainer" containerID="2fa45038fc8de800aa8083cf763c8fb2af33d043ee242fca237f4a2cc367579f" Jul 15 16:45:40.401219 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:40.401204 2559 scope.go:117] "RemoveContainer" containerID="2fa45038fc8de800aa8083cf763c8fb2af33d043ee242fca237f4a2cc367579f" Jul 15 16:45:40.401438 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:45:40.401423 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fa45038fc8de800aa8083cf763c8fb2af33d043ee242fca237f4a2cc367579f\": container with ID starting with 2fa45038fc8de800aa8083cf763c8fb2af33d043ee242fca237f4a2cc367579f not found: ID does not exist" containerID="2fa45038fc8de800aa8083cf763c8fb2af33d043ee242fca237f4a2cc367579f" Jul 15 16:45:40.401497 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:40.401444 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fa45038fc8de800aa8083cf763c8fb2af33d043ee242fca237f4a2cc367579f"} err="failed to get container status \"2fa45038fc8de800aa8083cf763c8fb2af33d043ee242fca237f4a2cc367579f\": rpc error: code = NotFound desc = could not find container \"2fa45038fc8de800aa8083cf763c8fb2af33d043ee242fca237f4a2cc367579f\": container with ID starting with 2fa45038fc8de800aa8083cf763c8fb2af33d043ee242fca237f4a2cc367579f not found: ID does not exist" Jul 15 16:45:40.408729 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:40.408706 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d799b4fd5-c29mv"] Jul 15 16:45:40.414581 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:40.414549 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d799b4fd5-c29mv"] Jul 15 16:45:42.171688 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:45:42.171660 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67ced135-59cc-483e-a334-9ea24133d481" path="/var/lib/kubelet/pods/67ced135-59cc-483e-a334-9ea24133d481/volumes" Jul 15 16:46:36.903992 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:46:36.903959 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-747487df4d-7fj5s"] Jul 15 16:46:36.904879 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:46:36.904854 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67ced135-59cc-483e-a334-9ea24133d481" containerName="console" Jul 15 16:46:36.905015 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:46:36.904908 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="67ced135-59cc-483e-a334-9ea24133d481" containerName="console" Jul 15 16:46:36.905015 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:46:36.904964 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72e8609c-6276-4d8d-b9d9-e1d9408fca7f" containerName="console" Jul 15 16:46:36.905015 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:46:36.904973 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="72e8609c-6276-4d8d-b9d9-e1d9408fca7f" containerName="console" Jul 15 16:46:36.905221 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:46:36.905198 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="72e8609c-6276-4d8d-b9d9-e1d9408fca7f" containerName="console" Jul 15 16:46:36.905374 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:46:36.905246 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="67ced135-59cc-483e-a334-9ea24133d481" containerName="console" Jul 15 16:46:36.908499 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:46:36.908477 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-747487df4d-7fj5s" Jul 15 16:46:36.919849 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:46:36.919827 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-747487df4d-7fj5s"] Jul 15 16:46:36.991947 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:46:36.991920 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59108231-2169-40ab-ab93-8a2f98d52938-console-config\") pod \"console-747487df4d-7fj5s\" (UID: \"59108231-2169-40ab-ab93-8a2f98d52938\") " pod="openshift-console/console-747487df4d-7fj5s" Jul 15 16:46:36.992100 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:46:36.991966 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmppd\" (UniqueName: \"kubernetes.io/projected/59108231-2169-40ab-ab93-8a2f98d52938-kube-api-access-gmppd\") pod \"console-747487df4d-7fj5s\" (UID: \"59108231-2169-40ab-ab93-8a2f98d52938\") " pod="openshift-console/console-747487df4d-7fj5s" Jul 15 16:46:36.992100 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:46:36.991997 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59108231-2169-40ab-ab93-8a2f98d52938-oauth-serving-cert\") pod \"console-747487df4d-7fj5s\" (UID: \"59108231-2169-40ab-ab93-8a2f98d52938\") " pod="openshift-console/console-747487df4d-7fj5s" Jul 15 16:46:36.992100 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:46:36.992056 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59108231-2169-40ab-ab93-8a2f98d52938-console-serving-cert\") pod \"console-747487df4d-7fj5s\" (UID: \"59108231-2169-40ab-ab93-8a2f98d52938\") " pod="openshift-console/console-747487df4d-7fj5s" Jul 15 16:46:36.992100 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:46:36.992094 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59108231-2169-40ab-ab93-8a2f98d52938-console-oauth-config\") pod \"console-747487df4d-7fj5s\" (UID: \"59108231-2169-40ab-ab93-8a2f98d52938\") " pod="openshift-console/console-747487df4d-7fj5s" Jul 15 16:46:36.992231 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:46:36.992109 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59108231-2169-40ab-ab93-8a2f98d52938-trusted-ca-bundle\") pod \"console-747487df4d-7fj5s\" (UID: \"59108231-2169-40ab-ab93-8a2f98d52938\") " pod="openshift-console/console-747487df4d-7fj5s" Jul 15 16:46:36.992231 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:46:36.992136 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59108231-2169-40ab-ab93-8a2f98d52938-service-ca\") pod \"console-747487df4d-7fj5s\" (UID: \"59108231-2169-40ab-ab93-8a2f98d52938\") " pod="openshift-console/console-747487df4d-7fj5s" Jul 15 16:46:37.092907 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:46:37.092869 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59108231-2169-40ab-ab93-8a2f98d52938-console-config\") pod \"console-747487df4d-7fj5s\" (UID: \"59108231-2169-40ab-ab93-8a2f98d52938\") " pod="openshift-console/console-747487df4d-7fj5s" Jul 15 16:46:37.093087 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:46:37.092913 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmppd\" (UniqueName: \"kubernetes.io/projected/59108231-2169-40ab-ab93-8a2f98d52938-kube-api-access-gmppd\") pod \"console-747487df4d-7fj5s\" (UID: \"59108231-2169-40ab-ab93-8a2f98d52938\") " pod="openshift-console/console-747487df4d-7fj5s" Jul 15 16:46:37.093087 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:46:37.092954 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59108231-2169-40ab-ab93-8a2f98d52938-oauth-serving-cert\") pod \"console-747487df4d-7fj5s\" (UID: \"59108231-2169-40ab-ab93-8a2f98d52938\") " pod="openshift-console/console-747487df4d-7fj5s" Jul 15 16:46:37.093087 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:46:37.092982 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59108231-2169-40ab-ab93-8a2f98d52938-console-serving-cert\") pod \"console-747487df4d-7fj5s\" (UID: \"59108231-2169-40ab-ab93-8a2f98d52938\") " pod="openshift-console/console-747487df4d-7fj5s" Jul 15 16:46:37.093087 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:46:37.093010 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59108231-2169-40ab-ab93-8a2f98d52938-console-oauth-config\") pod \"console-747487df4d-7fj5s\" (UID: \"59108231-2169-40ab-ab93-8a2f98d52938\") " pod="openshift-console/console-747487df4d-7fj5s" Jul 15 16:46:37.093320 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:46:37.093218 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59108231-2169-40ab-ab93-8a2f98d52938-trusted-ca-bundle\") pod \"console-747487df4d-7fj5s\" (UID: \"59108231-2169-40ab-ab93-8a2f98d52938\") " pod="openshift-console/console-747487df4d-7fj5s" Jul 15 16:46:37.093320 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:46:37.093280 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59108231-2169-40ab-ab93-8a2f98d52938-service-ca\") pod \"console-747487df4d-7fj5s\" (UID: \"59108231-2169-40ab-ab93-8a2f98d52938\") " pod="openshift-console/console-747487df4d-7fj5s" Jul 15 16:46:37.093735 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:46:37.093708 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59108231-2169-40ab-ab93-8a2f98d52938-console-config\") pod \"console-747487df4d-7fj5s\" (UID: \"59108231-2169-40ab-ab93-8a2f98d52938\") " pod="openshift-console/console-747487df4d-7fj5s" Jul 15 16:46:37.093869 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:46:37.093779 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59108231-2169-40ab-ab93-8a2f98d52938-oauth-serving-cert\") pod \"console-747487df4d-7fj5s\" (UID: \"59108231-2169-40ab-ab93-8a2f98d52938\") " pod="openshift-console/console-747487df4d-7fj5s" Jul 15 16:46:37.093932 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:46:37.093901 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59108231-2169-40ab-ab93-8a2f98d52938-service-ca\") pod \"console-747487df4d-7fj5s\" (UID: \"59108231-2169-40ab-ab93-8a2f98d52938\") " pod="openshift-console/console-747487df4d-7fj5s" Jul 15 16:46:37.094058 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:46:37.094038 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59108231-2169-40ab-ab93-8a2f98d52938-trusted-ca-bundle\") pod \"console-747487df4d-7fj5s\" (UID: \"59108231-2169-40ab-ab93-8a2f98d52938\") " pod="openshift-console/console-747487df4d-7fj5s" Jul 15 16:46:37.095428 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:46:37.095400 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59108231-2169-40ab-ab93-8a2f98d52938-console-oauth-config\") pod \"console-747487df4d-7fj5s\" (UID: \"59108231-2169-40ab-ab93-8a2f98d52938\") " pod="openshift-console/console-747487df4d-7fj5s" Jul 15 16:46:37.095628 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:46:37.095606 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59108231-2169-40ab-ab93-8a2f98d52938-console-serving-cert\") pod \"console-747487df4d-7fj5s\" (UID: \"59108231-2169-40ab-ab93-8a2f98d52938\") " pod="openshift-console/console-747487df4d-7fj5s" Jul 15 16:46:37.100482 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:46:37.100459 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmppd\" (UniqueName: \"kubernetes.io/projected/59108231-2169-40ab-ab93-8a2f98d52938-kube-api-access-gmppd\") pod \"console-747487df4d-7fj5s\" (UID: \"59108231-2169-40ab-ab93-8a2f98d52938\") " pod="openshift-console/console-747487df4d-7fj5s" Jul 15 16:46:37.217785 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:46:37.217742 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-747487df4d-7fj5s" Jul 15 16:46:37.347135 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:46:37.347110 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-747487df4d-7fj5s"] Jul 15 16:46:37.349513 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:46:37.349485 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59108231_2169_40ab_ab93_8a2f98d52938.slice/crio-f946e07cf454c7c85588e8c39e0bc45af785611416a34aa5fd64ea58717e5652 WatchSource:0}: Error finding container f946e07cf454c7c85588e8c39e0bc45af785611416a34aa5fd64ea58717e5652: Status 404 returned error can't find the container with id f946e07cf454c7c85588e8c39e0bc45af785611416a34aa5fd64ea58717e5652 Jul 15 16:46:37.634489 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:46:37.634402 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-747487df4d-7fj5s" event={"ID":"59108231-2169-40ab-ab93-8a2f98d52938","Type":"ContainerStarted","Data":"c9c385b0777a5d75cf3108bf5bf259d91f88b6cd56af57353fca84db64b69aeb"} Jul 15 16:46:37.634489 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:46:37.634448 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-747487df4d-7fj5s" event={"ID":"59108231-2169-40ab-ab93-8a2f98d52938","Type":"ContainerStarted","Data":"f946e07cf454c7c85588e8c39e0bc45af785611416a34aa5fd64ea58717e5652"} Jul 15 16:46:37.652356 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:46:37.652304 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-747487df4d-7fj5s" podStartSLOduration=1.652287469 podStartE2EDuration="1.652287469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:46:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:46:37.651250534 +0000 UTC m=+384.078342632" watchObservedRunningTime="2026-07-15 16:46:37.652287469 +0000 UTC m=+384.079379551" Jul 15 16:46:47.218436 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:46:47.218406 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-747487df4d-7fj5s" Jul 15 16:46:47.218836 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:46:47.218459 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-747487df4d-7fj5s" Jul 15 16:46:47.222759 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:46:47.222722 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-747487df4d-7fj5s" Jul 15 16:46:47.680384 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:46:47.680357 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-747487df4d-7fj5s" Jul 15 16:46:47.745686 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:46:47.745660 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b5ccd68f5-7v5j4"] Jul 15 16:47:12.766229 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:12.766170 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5b5ccd68f5-7v5j4" podUID="4fa651c5-dc2a-4d73-a8b9-124f1683b1ad" containerName="console" containerID="cri-o://eb71789b116c9a92af201a8c91d55e3453366679466152c89319ea14208578a0" gracePeriod=15 Jul 15 16:47:13.003477 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.003451 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b5ccd68f5-7v5j4" Jul 15 16:47:13.188430 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.188400 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad-console-serving-cert\") pod \"4fa651c5-dc2a-4d73-a8b9-124f1683b1ad\" (UID: \"4fa651c5-dc2a-4d73-a8b9-124f1683b1ad\") " Jul 15 16:47:13.188430 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.188433 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad-console-oauth-config\") pod \"4fa651c5-dc2a-4d73-a8b9-124f1683b1ad\" (UID: \"4fa651c5-dc2a-4d73-a8b9-124f1683b1ad\") " Jul 15 16:47:13.188659 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.188451 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad-oauth-serving-cert\") pod \"4fa651c5-dc2a-4d73-a8b9-124f1683b1ad\" (UID: \"4fa651c5-dc2a-4d73-a8b9-124f1683b1ad\") " Jul 15 16:47:13.188659 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.188494 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad-console-config\") pod \"4fa651c5-dc2a-4d73-a8b9-124f1683b1ad\" (UID: \"4fa651c5-dc2a-4d73-a8b9-124f1683b1ad\") " Jul 15 16:47:13.188787 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.188658 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad-trusted-ca-bundle\") pod \"4fa651c5-dc2a-4d73-a8b9-124f1683b1ad\" (UID: \"4fa651c5-dc2a-4d73-a8b9-124f1683b1ad\") " Jul 15 16:47:13.188854 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.188835 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad-console-config" (OuterVolumeSpecName: "console-config") pod "4fa651c5-dc2a-4d73-a8b9-124f1683b1ad" (UID: "4fa651c5-dc2a-4d73-a8b9-124f1683b1ad"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:47:13.188854 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.188841 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad-service-ca\") pod \"4fa651c5-dc2a-4d73-a8b9-124f1683b1ad\" (UID: \"4fa651c5-dc2a-4d73-a8b9-124f1683b1ad\") " Jul 15 16:47:13.188987 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.188959 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4fa651c5-dc2a-4d73-a8b9-124f1683b1ad" (UID: "4fa651c5-dc2a-4d73-a8b9-124f1683b1ad"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:47:13.189058 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.189016 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-skx9f\" (UniqueName: \"kubernetes.io/projected/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad-kube-api-access-skx9f\") pod \"4fa651c5-dc2a-4d73-a8b9-124f1683b1ad\" (UID: \"4fa651c5-dc2a-4d73-a8b9-124f1683b1ad\") " Jul 15 16:47:13.189107 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.189050 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4fa651c5-dc2a-4d73-a8b9-124f1683b1ad" (UID: "4fa651c5-dc2a-4d73-a8b9-124f1683b1ad"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:47:13.189154 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.189120 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad-service-ca" (OuterVolumeSpecName: "service-ca") pod "4fa651c5-dc2a-4d73-a8b9-124f1683b1ad" (UID: "4fa651c5-dc2a-4d73-a8b9-124f1683b1ad"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:47:13.189291 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.189275 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad-console-config\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:47:13.189335 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.189300 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad-trusted-ca-bundle\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:47:13.189335 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.189316 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad-service-ca\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:47:13.189335 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.189329 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad-oauth-serving-cert\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:47:13.190631 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.190610 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4fa651c5-dc2a-4d73-a8b9-124f1683b1ad" (UID: "4fa651c5-dc2a-4d73-a8b9-124f1683b1ad"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 16:47:13.190722 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.190650 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4fa651c5-dc2a-4d73-a8b9-124f1683b1ad" (UID: "4fa651c5-dc2a-4d73-a8b9-124f1683b1ad"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 16:47:13.190840 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.190822 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad-kube-api-access-skx9f" (OuterVolumeSpecName: "kube-api-access-skx9f") pod "4fa651c5-dc2a-4d73-a8b9-124f1683b1ad" (UID: "4fa651c5-dc2a-4d73-a8b9-124f1683b1ad"). InnerVolumeSpecName "kube-api-access-skx9f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 16:47:13.220973 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.220945 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4cfm"] Jul 15 16:47:13.221267 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.221255 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fa651c5-dc2a-4d73-a8b9-124f1683b1ad" containerName="console" Jul 15 16:47:13.221303 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.221268 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fa651c5-dc2a-4d73-a8b9-124f1683b1ad" containerName="console" Jul 15 16:47:13.221343 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.221336 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fa651c5-dc2a-4d73-a8b9-124f1683b1ad" containerName="console" Jul 15 16:47:13.224539 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.224524 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4cfm" Jul 15 16:47:13.227026 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.227003 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 15 16:47:13.227130 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.227042 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 15 16:47:13.227130 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.227068 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-p8fzl\"" Jul 15 16:47:13.232585 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.232563 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4cfm"] Jul 15 16:47:13.289760 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.289720 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxw2r\" (UniqueName: \"kubernetes.io/projected/81dfdf66-ca53-4062-b980-2163ebd52f20-kube-api-access-jxw2r\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4cfm\" (UID: \"81dfdf66-ca53-4062-b980-2163ebd52f20\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4cfm" Jul 15 16:47:13.289939 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.289850 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81dfdf66-ca53-4062-b980-2163ebd52f20-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4cfm\" (UID: \"81dfdf66-ca53-4062-b980-2163ebd52f20\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4cfm" Jul 15 16:47:13.289939 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.289919 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81dfdf66-ca53-4062-b980-2163ebd52f20-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4cfm\" (UID: \"81dfdf66-ca53-4062-b980-2163ebd52f20\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4cfm" Jul 15 16:47:13.290020 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.289963 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-skx9f\" (UniqueName: \"kubernetes.io/projected/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad-kube-api-access-skx9f\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:47:13.290020 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.289975 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad-console-serving-cert\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:47:13.290020 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.289983 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad-console-oauth-config\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:47:13.390505 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.390463 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81dfdf66-ca53-4062-b980-2163ebd52f20-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4cfm\" (UID: \"81dfdf66-ca53-4062-b980-2163ebd52f20\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4cfm" Jul 15 16:47:13.390686 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.390518 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81dfdf66-ca53-4062-b980-2163ebd52f20-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4cfm\" (UID: \"81dfdf66-ca53-4062-b980-2163ebd52f20\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4cfm" Jul 15 16:47:13.390686 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.390550 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxw2r\" (UniqueName: \"kubernetes.io/projected/81dfdf66-ca53-4062-b980-2163ebd52f20-kube-api-access-jxw2r\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4cfm\" (UID: \"81dfdf66-ca53-4062-b980-2163ebd52f20\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4cfm" Jul 15 16:47:13.390883 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.390864 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81dfdf66-ca53-4062-b980-2163ebd52f20-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4cfm\" (UID: \"81dfdf66-ca53-4062-b980-2163ebd52f20\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4cfm" Jul 15 16:47:13.390947 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.390917 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81dfdf66-ca53-4062-b980-2163ebd52f20-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4cfm\" (UID: \"81dfdf66-ca53-4062-b980-2163ebd52f20\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4cfm" Jul 15 16:47:13.398656 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.398631 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxw2r\" (UniqueName: \"kubernetes.io/projected/81dfdf66-ca53-4062-b980-2163ebd52f20-kube-api-access-jxw2r\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4cfm\" (UID: \"81dfdf66-ca53-4062-b980-2163ebd52f20\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4cfm" Jul 15 16:47:13.534570 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.534490 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4cfm" Jul 15 16:47:13.664284 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.664263 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4cfm"] Jul 15 16:47:13.666040 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:47:13.666012 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81dfdf66_ca53_4062_b980_2163ebd52f20.slice/crio-70cf70293fc7cec699aec09b3e2e712818e6c9e4fb0b006fac22263d920c7c23 WatchSource:0}: Error finding container 70cf70293fc7cec699aec09b3e2e712818e6c9e4fb0b006fac22263d920c7c23: Status 404 returned error can't find the container with id 70cf70293fc7cec699aec09b3e2e712818e6c9e4fb0b006fac22263d920c7c23 Jul 15 16:47:13.667815 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.667801 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 16:47:13.793836 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.793735 2559 generic.go:356] "Generic (PLEG): container finished" podID="4fa651c5-dc2a-4d73-a8b9-124f1683b1ad" containerID="eb71789b116c9a92af201a8c91d55e3453366679466152c89319ea14208578a0" exitCode=0 Jul 15 16:47:13.793836 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.793799 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b5ccd68f5-7v5j4" Jul 15 16:47:13.793836 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.793819 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b5ccd68f5-7v5j4" event={"ID":"4fa651c5-dc2a-4d73-a8b9-124f1683b1ad","Type":"ContainerDied","Data":"eb71789b116c9a92af201a8c91d55e3453366679466152c89319ea14208578a0"} Jul 15 16:47:13.794337 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.793871 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b5ccd68f5-7v5j4" event={"ID":"4fa651c5-dc2a-4d73-a8b9-124f1683b1ad","Type":"ContainerDied","Data":"0cfd02aec28441d4bae6ea9753e34019002e124ff1f331512367baa9c2ae0682"} Jul 15 16:47:13.794337 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.793893 2559 scope.go:117] "RemoveContainer" containerID="eb71789b116c9a92af201a8c91d55e3453366679466152c89319ea14208578a0" Jul 15 16:47:13.795179 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.795160 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4cfm" event={"ID":"81dfdf66-ca53-4062-b980-2163ebd52f20","Type":"ContainerStarted","Data":"70cf70293fc7cec699aec09b3e2e712818e6c9e4fb0b006fac22263d920c7c23"} Jul 15 16:47:13.802483 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.802464 2559 scope.go:117] "RemoveContainer" containerID="eb71789b116c9a92af201a8c91d55e3453366679466152c89319ea14208578a0" Jul 15 16:47:13.802777 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:47:13.802742 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb71789b116c9a92af201a8c91d55e3453366679466152c89319ea14208578a0\": container with ID starting with eb71789b116c9a92af201a8c91d55e3453366679466152c89319ea14208578a0 not found: ID does not exist" containerID="eb71789b116c9a92af201a8c91d55e3453366679466152c89319ea14208578a0" Jul 15 16:47:13.802840 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.802790 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb71789b116c9a92af201a8c91d55e3453366679466152c89319ea14208578a0"} err="failed to get container status \"eb71789b116c9a92af201a8c91d55e3453366679466152c89319ea14208578a0\": rpc error: code = NotFound desc = could not find container \"eb71789b116c9a92af201a8c91d55e3453366679466152c89319ea14208578a0\": container with ID starting with eb71789b116c9a92af201a8c91d55e3453366679466152c89319ea14208578a0 not found: ID does not exist" Jul 15 16:47:13.815570 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.815546 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b5ccd68f5-7v5j4"] Jul 15 16:47:13.818560 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:13.818541 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b5ccd68f5-7v5j4"] Jul 15 16:47:14.177247 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:14.177218 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fa651c5-dc2a-4d73-a8b9-124f1683b1ad" path="/var/lib/kubelet/pods/4fa651c5-dc2a-4d73-a8b9-124f1683b1ad/volumes" Jul 15 16:47:21.835328 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:21.835292 2559 generic.go:356] "Generic (PLEG): container finished" podID="81dfdf66-ca53-4062-b980-2163ebd52f20" containerID="9027d9faadeefa5bf8f56e1c5fc7a8c732a47bd7119014ac8db911b0568d2942" exitCode=0 Jul 15 16:47:21.835902 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:21.835339 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4cfm" event={"ID":"81dfdf66-ca53-4062-b980-2163ebd52f20","Type":"ContainerDied","Data":"9027d9faadeefa5bf8f56e1c5fc7a8c732a47bd7119014ac8db911b0568d2942"} Jul 15 16:47:23.848044 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:23.847961 2559 generic.go:356] "Generic (PLEG): container finished" podID="81dfdf66-ca53-4062-b980-2163ebd52f20" containerID="fdcdade93659a06ed407ddc440ef7fba24c0156d68e1a7c845354c7d5e365f47" exitCode=0 Jul 15 16:47:23.848044 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:23.848006 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4cfm" event={"ID":"81dfdf66-ca53-4062-b980-2163ebd52f20","Type":"ContainerDied","Data":"fdcdade93659a06ed407ddc440ef7fba24c0156d68e1a7c845354c7d5e365f47"} Jul 15 16:47:31.891364 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:31.891327 2559 generic.go:356] "Generic (PLEG): container finished" podID="81dfdf66-ca53-4062-b980-2163ebd52f20" containerID="972829d8a378fc386821cf0ccce155924121d527ca66495abb222d6218b81d19" exitCode=0 Jul 15 16:47:31.891814 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:31.891368 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4cfm" event={"ID":"81dfdf66-ca53-4062-b980-2163ebd52f20","Type":"ContainerDied","Data":"972829d8a378fc386821cf0ccce155924121d527ca66495abb222d6218b81d19"} Jul 15 16:47:33.022946 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:33.022921 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4cfm" Jul 15 16:47:33.047839 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:33.047813 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxw2r\" (UniqueName: \"kubernetes.io/projected/81dfdf66-ca53-4062-b980-2163ebd52f20-kube-api-access-jxw2r\") pod \"81dfdf66-ca53-4062-b980-2163ebd52f20\" (UID: \"81dfdf66-ca53-4062-b980-2163ebd52f20\") " Jul 15 16:47:33.047965 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:33.047850 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81dfdf66-ca53-4062-b980-2163ebd52f20-bundle\") pod \"81dfdf66-ca53-4062-b980-2163ebd52f20\" (UID: \"81dfdf66-ca53-4062-b980-2163ebd52f20\") " Jul 15 16:47:33.047965 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:33.047908 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81dfdf66-ca53-4062-b980-2163ebd52f20-util\") pod \"81dfdf66-ca53-4062-b980-2163ebd52f20\" (UID: \"81dfdf66-ca53-4062-b980-2163ebd52f20\") " Jul 15 16:47:33.048686 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:33.048657 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81dfdf66-ca53-4062-b980-2163ebd52f20-bundle" (OuterVolumeSpecName: "bundle") pod "81dfdf66-ca53-4062-b980-2163ebd52f20" (UID: "81dfdf66-ca53-4062-b980-2163ebd52f20"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 16:47:33.050015 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:33.049994 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81dfdf66-ca53-4062-b980-2163ebd52f20-kube-api-access-jxw2r" (OuterVolumeSpecName: "kube-api-access-jxw2r") pod "81dfdf66-ca53-4062-b980-2163ebd52f20" (UID: "81dfdf66-ca53-4062-b980-2163ebd52f20"). InnerVolumeSpecName "kube-api-access-jxw2r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 16:47:33.055493 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:33.055469 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81dfdf66-ca53-4062-b980-2163ebd52f20-util" (OuterVolumeSpecName: "util") pod "81dfdf66-ca53-4062-b980-2163ebd52f20" (UID: "81dfdf66-ca53-4062-b980-2163ebd52f20"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 16:47:33.149079 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:33.149013 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81dfdf66-ca53-4062-b980-2163ebd52f20-util\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:47:33.149079 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:33.149034 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxw2r\" (UniqueName: \"kubernetes.io/projected/81dfdf66-ca53-4062-b980-2163ebd52f20-kube-api-access-jxw2r\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:47:33.149079 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:33.149045 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81dfdf66-ca53-4062-b980-2163ebd52f20-bundle\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:47:33.901690 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:33.901659 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4cfm" Jul 15 16:47:33.901690 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:33.901665 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4cfm" event={"ID":"81dfdf66-ca53-4062-b980-2163ebd52f20","Type":"ContainerDied","Data":"70cf70293fc7cec699aec09b3e2e712818e6c9e4fb0b006fac22263d920c7c23"} Jul 15 16:47:33.901911 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:33.901716 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="70cf70293fc7cec699aec09b3e2e712818e6c9e4fb0b006fac22263d920c7c23" Jul 15 16:47:47.859976 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:47.859888 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-bc2fw"] Jul 15 16:47:47.860510 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:47.860402 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81dfdf66-ca53-4062-b980-2163ebd52f20" containerName="pull" Jul 15 16:47:47.860510 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:47.860422 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="81dfdf66-ca53-4062-b980-2163ebd52f20" containerName="pull" Jul 15 16:47:47.860510 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:47.860441 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81dfdf66-ca53-4062-b980-2163ebd52f20" containerName="util" Jul 15 16:47:47.860510 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:47.860452 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="81dfdf66-ca53-4062-b980-2163ebd52f20" containerName="util" Jul 15 16:47:47.860510 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:47.860463 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81dfdf66-ca53-4062-b980-2163ebd52f20" containerName="extract" Jul 15 16:47:47.860510 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:47.860472 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="81dfdf66-ca53-4062-b980-2163ebd52f20" containerName="extract" Jul 15 16:47:47.860837 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:47.860565 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="81dfdf66-ca53-4062-b980-2163ebd52f20" containerName="extract" Jul 15 16:47:47.863019 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:47.862999 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-bc2fw" Jul 15 16:47:47.865910 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:47.865892 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 15 16:47:47.866013 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:47.865921 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 15 16:47:47.873413 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:47.873393 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-bc2fw"] Jul 15 16:47:47.967335 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:47.967309 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32df63e3-ed1b-4004-ad69-919d6bf9f0ec-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-bc2fw\" (UID: \"32df63e3-ed1b-4004-ad69-919d6bf9f0ec\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bc2fw" Jul 15 16:47:47.967435 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:47.967334 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbnpz\" (UniqueName: \"kubernetes.io/projected/32df63e3-ed1b-4004-ad69-919d6bf9f0ec-kube-api-access-zbnpz\") pod \"cert-manager-webhook-6486ffd997-bc2fw\" (UID: \"32df63e3-ed1b-4004-ad69-919d6bf9f0ec\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bc2fw" Jul 15 16:47:48.068308 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:48.068281 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32df63e3-ed1b-4004-ad69-919d6bf9f0ec-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-bc2fw\" (UID: \"32df63e3-ed1b-4004-ad69-919d6bf9f0ec\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bc2fw" Jul 15 16:47:48.068308 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:48.068310 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbnpz\" (UniqueName: \"kubernetes.io/projected/32df63e3-ed1b-4004-ad69-919d6bf9f0ec-kube-api-access-zbnpz\") pod \"cert-manager-webhook-6486ffd997-bc2fw\" (UID: \"32df63e3-ed1b-4004-ad69-919d6bf9f0ec\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bc2fw" Jul 15 16:47:48.078442 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:48.078421 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32df63e3-ed1b-4004-ad69-919d6bf9f0ec-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-bc2fw\" (UID: \"32df63e3-ed1b-4004-ad69-919d6bf9f0ec\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bc2fw" Jul 15 16:47:48.078551 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:48.078509 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbnpz\" (UniqueName: \"kubernetes.io/projected/32df63e3-ed1b-4004-ad69-919d6bf9f0ec-kube-api-access-zbnpz\") pod \"cert-manager-webhook-6486ffd997-bc2fw\" (UID: \"32df63e3-ed1b-4004-ad69-919d6bf9f0ec\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bc2fw" Jul 15 16:47:48.179675 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:48.179654 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-bc2fw" Jul 15 16:47:48.305119 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:48.305097 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-bc2fw"] Jul 15 16:47:48.307364 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:47:48.307339 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32df63e3_ed1b_4004_ad69_919d6bf9f0ec.slice/crio-6a19d17afef28e17fa352c203860c7cdca69cb8f59e466b5acbbf502cbb17396 WatchSource:0}: Error finding container 6a19d17afef28e17fa352c203860c7cdca69cb8f59e466b5acbbf502cbb17396: Status 404 returned error can't find the container with id 6a19d17afef28e17fa352c203860c7cdca69cb8f59e466b5acbbf502cbb17396 Jul 15 16:47:48.965555 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:48.965522 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-bc2fw" event={"ID":"32df63e3-ed1b-4004-ad69-919d6bf9f0ec","Type":"ContainerStarted","Data":"6a19d17afef28e17fa352c203860c7cdca69cb8f59e466b5acbbf502cbb17396"} Jul 15 16:47:50.527551 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:50.527520 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-pp6n7"] Jul 15 16:47:50.530244 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:50.530217 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pp6n7" Jul 15 16:47:50.533137 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:50.533114 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-8z2vn\"" Jul 15 16:47:50.542480 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:50.542458 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-pp6n7"] Jul 15 16:47:50.592022 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:50.591981 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntv2q\" (UniqueName: \"kubernetes.io/projected/adb2c835-65fa-4a7a-98c2-2c72617a5848-kube-api-access-ntv2q\") pod \"cert-manager-cainjector-559cdd8c87-pp6n7\" (UID: \"adb2c835-65fa-4a7a-98c2-2c72617a5848\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pp6n7" Jul 15 16:47:50.592182 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:50.592040 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/adb2c835-65fa-4a7a-98c2-2c72617a5848-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-pp6n7\" (UID: \"adb2c835-65fa-4a7a-98c2-2c72617a5848\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pp6n7" Jul 15 16:47:50.692569 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:50.692532 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntv2q\" (UniqueName: \"kubernetes.io/projected/adb2c835-65fa-4a7a-98c2-2c72617a5848-kube-api-access-ntv2q\") pod \"cert-manager-cainjector-559cdd8c87-pp6n7\" (UID: \"adb2c835-65fa-4a7a-98c2-2c72617a5848\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pp6n7" Jul 15 16:47:50.692729 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:50.692599 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/adb2c835-65fa-4a7a-98c2-2c72617a5848-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-pp6n7\" (UID: \"adb2c835-65fa-4a7a-98c2-2c72617a5848\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pp6n7" Jul 15 16:47:50.702516 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:50.702488 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/adb2c835-65fa-4a7a-98c2-2c72617a5848-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-pp6n7\" (UID: \"adb2c835-65fa-4a7a-98c2-2c72617a5848\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pp6n7" Jul 15 16:47:50.702717 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:50.702691 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntv2q\" (UniqueName: \"kubernetes.io/projected/adb2c835-65fa-4a7a-98c2-2c72617a5848-kube-api-access-ntv2q\") pod \"cert-manager-cainjector-559cdd8c87-pp6n7\" (UID: \"adb2c835-65fa-4a7a-98c2-2c72617a5848\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pp6n7" Jul 15 16:47:50.841337 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:50.841270 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pp6n7" Jul 15 16:47:50.970965 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:50.970936 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-pp6n7"] Jul 15 16:47:50.973535 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:47:50.973504 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podadb2c835_65fa_4a7a_98c2_2c72617a5848.slice/crio-90b45711b3f861658848959e2ed5e83ce3c329ffb96e0929b68c4cfacd2044c1 WatchSource:0}: Error finding container 90b45711b3f861658848959e2ed5e83ce3c329ffb96e0929b68c4cfacd2044c1: Status 404 returned error can't find the container with id 90b45711b3f861658848959e2ed5e83ce3c329ffb96e0929b68c4cfacd2044c1 Jul 15 16:47:50.976678 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:50.976652 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-bc2fw" event={"ID":"32df63e3-ed1b-4004-ad69-919d6bf9f0ec","Type":"ContainerStarted","Data":"219f5f84adc8f0f2c31905dbc8700262717dbb28e6eeb8ab228d625f61d8f1e9"} Jul 15 16:47:50.976800 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:50.976781 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-bc2fw" Jul 15 16:47:50.993910 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:50.993867 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-bc2fw" podStartSLOduration=1.4532493149999999 podStartE2EDuration="3.99384977s" totalImagesPullingTime="2.540600455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:47:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:47:50.992634998 +0000 UTC m=+457.419727103" watchObservedRunningTime="2026-07-15 16:47:50.99384977 +0000 UTC m=+457.420941854" Jul 15 16:47:51.982560 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:51.982526 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pp6n7" event={"ID":"adb2c835-65fa-4a7a-98c2-2c72617a5848","Type":"ContainerStarted","Data":"afa16f9ae8db1d703a47ff84c38a187f8db4387918165c5e5077181c82999588"} Jul 15 16:47:51.982938 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:51.982573 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pp6n7" event={"ID":"adb2c835-65fa-4a7a-98c2-2c72617a5848","Type":"ContainerStarted","Data":"90b45711b3f861658848959e2ed5e83ce3c329ffb96e0929b68c4cfacd2044c1"} Jul 15 16:47:52.006848 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:52.006805 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pp6n7" podStartSLOduration=2.00679065 podStartE2EDuration="2.00679065s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:47:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:47:52.000234086 +0000 UTC m=+458.427326194" watchObservedRunningTime="2026-07-15 16:47:52.00679065 +0000 UTC m=+458.433882732" Jul 15 16:47:56.984607 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:47:56.984576 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-bc2fw" Jul 15 16:48:24.663017 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:24.662982 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7fxhr"] Jul 15 16:48:24.666339 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:24.666322 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7fxhr" Jul 15 16:48:24.668598 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:24.668572 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 15 16:48:24.669570 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:24.669547 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-p8fzl\"" Jul 15 16:48:24.669668 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:24.669623 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 15 16:48:24.675383 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:24.675361 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7fxhr"] Jul 15 16:48:24.759609 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:24.759583 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed1cea28-4b36-4b0e-9eeb-396908ee8585-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7fxhr\" (UID: \"ed1cea28-4b36-4b0e-9eeb-396908ee8585\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7fxhr" Jul 15 16:48:24.759609 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:24.759612 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed1cea28-4b36-4b0e-9eeb-396908ee8585-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7fxhr\" (UID: \"ed1cea28-4b36-4b0e-9eeb-396908ee8585\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7fxhr" Jul 15 16:48:24.759835 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:24.759634 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf6bf\" (UniqueName: \"kubernetes.io/projected/ed1cea28-4b36-4b0e-9eeb-396908ee8585-kube-api-access-pf6bf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7fxhr\" (UID: \"ed1cea28-4b36-4b0e-9eeb-396908ee8585\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7fxhr" Jul 15 16:48:24.860984 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:24.860957 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed1cea28-4b36-4b0e-9eeb-396908ee8585-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7fxhr\" (UID: \"ed1cea28-4b36-4b0e-9eeb-396908ee8585\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7fxhr" Jul 15 16:48:24.861154 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:24.860993 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed1cea28-4b36-4b0e-9eeb-396908ee8585-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7fxhr\" (UID: \"ed1cea28-4b36-4b0e-9eeb-396908ee8585\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7fxhr" Jul 15 16:48:24.861154 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:24.861023 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf6bf\" (UniqueName: \"kubernetes.io/projected/ed1cea28-4b36-4b0e-9eeb-396908ee8585-kube-api-access-pf6bf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7fxhr\" (UID: \"ed1cea28-4b36-4b0e-9eeb-396908ee8585\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7fxhr" Jul 15 16:48:24.861348 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:24.861328 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed1cea28-4b36-4b0e-9eeb-396908ee8585-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7fxhr\" (UID: \"ed1cea28-4b36-4b0e-9eeb-396908ee8585\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7fxhr" Jul 15 16:48:24.861410 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:24.861394 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed1cea28-4b36-4b0e-9eeb-396908ee8585-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7fxhr\" (UID: \"ed1cea28-4b36-4b0e-9eeb-396908ee8585\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7fxhr" Jul 15 16:48:24.868893 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:24.868866 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf6bf\" (UniqueName: \"kubernetes.io/projected/ed1cea28-4b36-4b0e-9eeb-396908ee8585-kube-api-access-pf6bf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7fxhr\" (UID: \"ed1cea28-4b36-4b0e-9eeb-396908ee8585\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7fxhr" Jul 15 16:48:24.976157 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:24.976079 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7fxhr" Jul 15 16:48:25.103159 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:25.103137 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7fxhr"] Jul 15 16:48:25.105175 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:48:25.105148 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded1cea28_4b36_4b0e_9eeb_396908ee8585.slice/crio-08d6ca2e6efab200019b83143683f5e2d7aa4c739ddf3894e1ad8e7fc4ba01bb WatchSource:0}: Error finding container 08d6ca2e6efab200019b83143683f5e2d7aa4c739ddf3894e1ad8e7fc4ba01bb: Status 404 returned error can't find the container with id 08d6ca2e6efab200019b83143683f5e2d7aa4c739ddf3894e1ad8e7fc4ba01bb Jul 15 16:48:25.129225 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:25.129203 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7fxhr" event={"ID":"ed1cea28-4b36-4b0e-9eeb-396908ee8585","Type":"ContainerStarted","Data":"08d6ca2e6efab200019b83143683f5e2d7aa4c739ddf3894e1ad8e7fc4ba01bb"} Jul 15 16:48:26.135450 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:26.135377 2559 generic.go:356] "Generic (PLEG): container finished" podID="ed1cea28-4b36-4b0e-9eeb-396908ee8585" containerID="c859742d6c6e02284d43c1ef044ae84454ee1b346d678a36fa38f30494d1da1b" exitCode=0 Jul 15 16:48:26.135450 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:26.135442 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7fxhr" event={"ID":"ed1cea28-4b36-4b0e-9eeb-396908ee8585","Type":"ContainerDied","Data":"c859742d6c6e02284d43c1ef044ae84454ee1b346d678a36fa38f30494d1da1b"} Jul 15 16:48:27.141467 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:27.141393 2559 generic.go:356] "Generic (PLEG): container finished" podID="ed1cea28-4b36-4b0e-9eeb-396908ee8585" containerID="8af8bce59f9fd89ebcd3c3675afaa9a7c0982f3e6add9b8f085fab183614fe14" exitCode=0 Jul 15 16:48:27.141996 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:27.141480 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7fxhr" event={"ID":"ed1cea28-4b36-4b0e-9eeb-396908ee8585","Type":"ContainerDied","Data":"8af8bce59f9fd89ebcd3c3675afaa9a7c0982f3e6add9b8f085fab183614fe14"} Jul 15 16:48:28.148038 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:28.147998 2559 generic.go:356] "Generic (PLEG): container finished" podID="ed1cea28-4b36-4b0e-9eeb-396908ee8585" containerID="f5f225578aa4fbb2a3b82da0e286494ecedd56399e5077dd4f83f9d673afcd36" exitCode=0 Jul 15 16:48:28.148391 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:28.148089 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7fxhr" event={"ID":"ed1cea28-4b36-4b0e-9eeb-396908ee8585","Type":"ContainerDied","Data":"f5f225578aa4fbb2a3b82da0e286494ecedd56399e5077dd4f83f9d673afcd36"} Jul 15 16:48:29.105065 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:29.105029 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c79d97d55-wt6bm"] Jul 15 16:48:29.108088 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:29.108068 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c79d97d55-wt6bm" Jul 15 16:48:29.110710 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:29.110679 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 15 16:48:29.110848 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:29.110741 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 15 16:48:29.111609 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:29.111590 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 15 16:48:29.111718 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:29.111661 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-v5rbw\"" Jul 15 16:48:29.111718 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:29.111661 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 15 16:48:29.111832 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:29.111722 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 15 16:48:29.117814 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:29.117795 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c79d97d55-wt6bm"] Jul 15 16:48:29.190387 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:29.190356 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1e02312f-1368-486f-9b24-7ddc63da8155-manager-config\") pod \"lws-controller-manager-5c79d97d55-wt6bm\" (UID: \"1e02312f-1368-486f-9b24-7ddc63da8155\") " pod="openshift-lws-operator/lws-controller-manager-5c79d97d55-wt6bm" Jul 15 16:48:29.191154 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:29.190400 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e02312f-1368-486f-9b24-7ddc63da8155-cert\") pod \"lws-controller-manager-5c79d97d55-wt6bm\" (UID: \"1e02312f-1368-486f-9b24-7ddc63da8155\") " pod="openshift-lws-operator/lws-controller-manager-5c79d97d55-wt6bm" Jul 15 16:48:29.191154 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:29.190449 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjdwz\" (UniqueName: \"kubernetes.io/projected/1e02312f-1368-486f-9b24-7ddc63da8155-kube-api-access-pjdwz\") pod \"lws-controller-manager-5c79d97d55-wt6bm\" (UID: \"1e02312f-1368-486f-9b24-7ddc63da8155\") " pod="openshift-lws-operator/lws-controller-manager-5c79d97d55-wt6bm" Jul 15 16:48:29.191154 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:29.190561 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1e02312f-1368-486f-9b24-7ddc63da8155-metrics-cert\") pod \"lws-controller-manager-5c79d97d55-wt6bm\" (UID: \"1e02312f-1368-486f-9b24-7ddc63da8155\") " pod="openshift-lws-operator/lws-controller-manager-5c79d97d55-wt6bm" Jul 15 16:48:29.287773 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:29.287739 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7fxhr" Jul 15 16:48:29.291054 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:29.291035 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1e02312f-1368-486f-9b24-7ddc63da8155-manager-config\") pod \"lws-controller-manager-5c79d97d55-wt6bm\" (UID: \"1e02312f-1368-486f-9b24-7ddc63da8155\") " pod="openshift-lws-operator/lws-controller-manager-5c79d97d55-wt6bm" Jul 15 16:48:29.291119 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:29.291070 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e02312f-1368-486f-9b24-7ddc63da8155-cert\") pod \"lws-controller-manager-5c79d97d55-wt6bm\" (UID: \"1e02312f-1368-486f-9b24-7ddc63da8155\") " pod="openshift-lws-operator/lws-controller-manager-5c79d97d55-wt6bm" Jul 15 16:48:29.291119 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:29.291114 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjdwz\" (UniqueName: \"kubernetes.io/projected/1e02312f-1368-486f-9b24-7ddc63da8155-kube-api-access-pjdwz\") pod \"lws-controller-manager-5c79d97d55-wt6bm\" (UID: \"1e02312f-1368-486f-9b24-7ddc63da8155\") " pod="openshift-lws-operator/lws-controller-manager-5c79d97d55-wt6bm" Jul 15 16:48:29.291200 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:29.291144 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1e02312f-1368-486f-9b24-7ddc63da8155-metrics-cert\") pod \"lws-controller-manager-5c79d97d55-wt6bm\" (UID: \"1e02312f-1368-486f-9b24-7ddc63da8155\") " pod="openshift-lws-operator/lws-controller-manager-5c79d97d55-wt6bm" Jul 15 16:48:29.291619 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:29.291597 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1e02312f-1368-486f-9b24-7ddc63da8155-manager-config\") pod \"lws-controller-manager-5c79d97d55-wt6bm\" (UID: \"1e02312f-1368-486f-9b24-7ddc63da8155\") " pod="openshift-lws-operator/lws-controller-manager-5c79d97d55-wt6bm" Jul 15 16:48:29.293494 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:29.293470 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1e02312f-1368-486f-9b24-7ddc63da8155-metrics-cert\") pod \"lws-controller-manager-5c79d97d55-wt6bm\" (UID: \"1e02312f-1368-486f-9b24-7ddc63da8155\") " pod="openshift-lws-operator/lws-controller-manager-5c79d97d55-wt6bm" Jul 15 16:48:29.293575 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:29.293495 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e02312f-1368-486f-9b24-7ddc63da8155-cert\") pod \"lws-controller-manager-5c79d97d55-wt6bm\" (UID: \"1e02312f-1368-486f-9b24-7ddc63da8155\") " pod="openshift-lws-operator/lws-controller-manager-5c79d97d55-wt6bm" Jul 15 16:48:29.299699 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:29.299678 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjdwz\" (UniqueName: \"kubernetes.io/projected/1e02312f-1368-486f-9b24-7ddc63da8155-kube-api-access-pjdwz\") pod \"lws-controller-manager-5c79d97d55-wt6bm\" (UID: \"1e02312f-1368-486f-9b24-7ddc63da8155\") " pod="openshift-lws-operator/lws-controller-manager-5c79d97d55-wt6bm" Jul 15 16:48:29.391616 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:29.391554 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pf6bf\" (UniqueName: \"kubernetes.io/projected/ed1cea28-4b36-4b0e-9eeb-396908ee8585-kube-api-access-pf6bf\") pod \"ed1cea28-4b36-4b0e-9eeb-396908ee8585\" (UID: \"ed1cea28-4b36-4b0e-9eeb-396908ee8585\") " Jul 15 16:48:29.391616 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:29.391598 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed1cea28-4b36-4b0e-9eeb-396908ee8585-util\") pod \"ed1cea28-4b36-4b0e-9eeb-396908ee8585\" (UID: \"ed1cea28-4b36-4b0e-9eeb-396908ee8585\") " Jul 15 16:48:29.391616 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:29.391614 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed1cea28-4b36-4b0e-9eeb-396908ee8585-bundle\") pod \"ed1cea28-4b36-4b0e-9eeb-396908ee8585\" (UID: \"ed1cea28-4b36-4b0e-9eeb-396908ee8585\") " Jul 15 16:48:29.392342 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:29.392317 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed1cea28-4b36-4b0e-9eeb-396908ee8585-bundle" (OuterVolumeSpecName: "bundle") pod "ed1cea28-4b36-4b0e-9eeb-396908ee8585" (UID: "ed1cea28-4b36-4b0e-9eeb-396908ee8585"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 16:48:29.393646 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:29.393618 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed1cea28-4b36-4b0e-9eeb-396908ee8585-kube-api-access-pf6bf" (OuterVolumeSpecName: "kube-api-access-pf6bf") pod "ed1cea28-4b36-4b0e-9eeb-396908ee8585" (UID: "ed1cea28-4b36-4b0e-9eeb-396908ee8585"). InnerVolumeSpecName "kube-api-access-pf6bf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 16:48:29.397106 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:29.397060 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed1cea28-4b36-4b0e-9eeb-396908ee8585-util" (OuterVolumeSpecName: "util") pod "ed1cea28-4b36-4b0e-9eeb-396908ee8585" (UID: "ed1cea28-4b36-4b0e-9eeb-396908ee8585"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 16:48:29.418421 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:29.418396 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c79d97d55-wt6bm" Jul 15 16:48:29.492510 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:29.492433 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pf6bf\" (UniqueName: \"kubernetes.io/projected/ed1cea28-4b36-4b0e-9eeb-396908ee8585-kube-api-access-pf6bf\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:48:29.492510 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:29.492464 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed1cea28-4b36-4b0e-9eeb-396908ee8585-util\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:48:29.492510 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:29.492479 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed1cea28-4b36-4b0e-9eeb-396908ee8585-bundle\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:48:29.556151 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:29.556125 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c79d97d55-wt6bm"] Jul 15 16:48:29.558521 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:48:29.558489 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e02312f_1368_486f_9b24_7ddc63da8155.slice/crio-3c6ffc68e9152eb5187b7d852600f22d184e63e5c865d57b4b1ded58bd379f68 WatchSource:0}: Error finding container 3c6ffc68e9152eb5187b7d852600f22d184e63e5c865d57b4b1ded58bd379f68: Status 404 returned error can't find the container with id 3c6ffc68e9152eb5187b7d852600f22d184e63e5c865d57b4b1ded58bd379f68 Jul 15 16:48:30.158839 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:30.158790 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7fxhr" event={"ID":"ed1cea28-4b36-4b0e-9eeb-396908ee8585","Type":"ContainerDied","Data":"08d6ca2e6efab200019b83143683f5e2d7aa4c739ddf3894e1ad8e7fc4ba01bb"} Jul 15 16:48:30.159024 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:30.158851 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="08d6ca2e6efab200019b83143683f5e2d7aa4c739ddf3894e1ad8e7fc4ba01bb" Jul 15 16:48:30.159024 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:30.158813 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7fxhr" Jul 15 16:48:30.160030 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:30.160006 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c79d97d55-wt6bm" event={"ID":"1e02312f-1368-486f-9b24-7ddc63da8155","Type":"ContainerStarted","Data":"3c6ffc68e9152eb5187b7d852600f22d184e63e5c865d57b4b1ded58bd379f68"} Jul 15 16:48:32.178904 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:32.178871 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c79d97d55-wt6bm" event={"ID":"1e02312f-1368-486f-9b24-7ddc63da8155","Type":"ContainerStarted","Data":"f0ed47cb8e063ce9104ef025c9cd8699984555907ceb9002f320cefb0cd5b6c8"} Jul 15 16:48:32.179237 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:32.178921 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5c79d97d55-wt6bm" Jul 15 16:48:32.195242 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:32.195198 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5c79d97d55-wt6bm" podStartSLOduration=0.701324219 podStartE2EDuration="3.195183851s" totalImagesPullingTime="2.493859632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:48:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:48:32.19380217 +0000 UTC m=+498.620894252" watchObservedRunningTime="2026-07-15 16:48:32.195183851 +0000 UTC m=+498.622275933" Jul 15 16:48:41.959184 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:41.959149 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9487b7458-nnjmd"] Jul 15 16:48:41.959637 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:41.959619 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed1cea28-4b36-4b0e-9eeb-396908ee8585" containerName="pull" Jul 15 16:48:41.959716 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:41.959640 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed1cea28-4b36-4b0e-9eeb-396908ee8585" containerName="pull" Jul 15 16:48:41.959716 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:41.959662 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed1cea28-4b36-4b0e-9eeb-396908ee8585" containerName="util" Jul 15 16:48:41.959716 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:41.959667 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed1cea28-4b36-4b0e-9eeb-396908ee8585" containerName="util" Jul 15 16:48:41.959716 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:41.959675 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed1cea28-4b36-4b0e-9eeb-396908ee8585" containerName="extract" Jul 15 16:48:41.959716 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:41.959681 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed1cea28-4b36-4b0e-9eeb-396908ee8585" containerName="extract" Jul 15 16:48:41.959961 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:41.959762 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed1cea28-4b36-4b0e-9eeb-396908ee8585" containerName="extract" Jul 15 16:48:41.963228 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:41.963205 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-nnjmd" Jul 15 16:48:41.965831 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:41.965720 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 15 16:48:41.965831 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:41.965800 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 15 16:48:41.965831 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:41.965810 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-htrvj\"" Jul 15 16:48:41.966082 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:41.965884 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 15 16:48:41.966082 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:41.965805 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 15 16:48:41.978484 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:41.978465 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9487b7458-nnjmd"] Jul 15 16:48:42.096868 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:42.096837 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee0aa582-abb4-4ac9-9f76-2773095f646b-webhook-cert\") pod \"opendatahub-operator-controller-manager-9487b7458-nnjmd\" (UID: \"ee0aa582-abb4-4ac9-9f76-2773095f646b\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-nnjmd" Jul 15 16:48:42.096868 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:42.096875 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ee0aa582-abb4-4ac9-9f76-2773095f646b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9487b7458-nnjmd\" (UID: \"ee0aa582-abb4-4ac9-9f76-2773095f646b\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-nnjmd" Jul 15 16:48:42.097083 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:42.096901 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxtv4\" (UniqueName: \"kubernetes.io/projected/ee0aa582-abb4-4ac9-9f76-2773095f646b-kube-api-access-pxtv4\") pod \"opendatahub-operator-controller-manager-9487b7458-nnjmd\" (UID: \"ee0aa582-abb4-4ac9-9f76-2773095f646b\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-nnjmd" Jul 15 16:48:42.097083 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:42.096949 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ee0aa582-abb4-4ac9-9f76-2773095f646b-manifests\") pod \"opendatahub-operator-controller-manager-9487b7458-nnjmd\" (UID: \"ee0aa582-abb4-4ac9-9f76-2773095f646b\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-nnjmd" Jul 15 16:48:42.097083 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:42.096967 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee0aa582-abb4-4ac9-9f76-2773095f646b-tmp\") pod \"opendatahub-operator-controller-manager-9487b7458-nnjmd\" (UID: \"ee0aa582-abb4-4ac9-9f76-2773095f646b\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-nnjmd" Jul 15 16:48:42.197894 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:42.197863 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxtv4\" (UniqueName: \"kubernetes.io/projected/ee0aa582-abb4-4ac9-9f76-2773095f646b-kube-api-access-pxtv4\") pod \"opendatahub-operator-controller-manager-9487b7458-nnjmd\" (UID: \"ee0aa582-abb4-4ac9-9f76-2773095f646b\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-nnjmd" Jul 15 16:48:42.198047 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:42.197900 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ee0aa582-abb4-4ac9-9f76-2773095f646b-manifests\") pod \"opendatahub-operator-controller-manager-9487b7458-nnjmd\" (UID: \"ee0aa582-abb4-4ac9-9f76-2773095f646b\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-nnjmd" Jul 15 16:48:42.198047 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:42.197918 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee0aa582-abb4-4ac9-9f76-2773095f646b-tmp\") pod \"opendatahub-operator-controller-manager-9487b7458-nnjmd\" (UID: \"ee0aa582-abb4-4ac9-9f76-2773095f646b\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-nnjmd" Jul 15 16:48:42.198047 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:42.197992 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee0aa582-abb4-4ac9-9f76-2773095f646b-webhook-cert\") pod \"opendatahub-operator-controller-manager-9487b7458-nnjmd\" (UID: \"ee0aa582-abb4-4ac9-9f76-2773095f646b\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-nnjmd" Jul 15 16:48:42.198047 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:42.198025 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ee0aa582-abb4-4ac9-9f76-2773095f646b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9487b7458-nnjmd\" (UID: \"ee0aa582-abb4-4ac9-9f76-2773095f646b\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-nnjmd" Jul 15 16:48:42.198320 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:42.198301 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ee0aa582-abb4-4ac9-9f76-2773095f646b-manifests\") pod \"opendatahub-operator-controller-manager-9487b7458-nnjmd\" (UID: \"ee0aa582-abb4-4ac9-9f76-2773095f646b\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-nnjmd" Jul 15 16:48:42.200261 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:42.200229 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee0aa582-abb4-4ac9-9f76-2773095f646b-tmp\") pod \"opendatahub-operator-controller-manager-9487b7458-nnjmd\" (UID: \"ee0aa582-abb4-4ac9-9f76-2773095f646b\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-nnjmd" Jul 15 16:48:42.200410 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:42.200394 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee0aa582-abb4-4ac9-9f76-2773095f646b-webhook-cert\") pod \"opendatahub-operator-controller-manager-9487b7458-nnjmd\" (UID: \"ee0aa582-abb4-4ac9-9f76-2773095f646b\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-nnjmd" Jul 15 16:48:42.200472 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:42.200422 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ee0aa582-abb4-4ac9-9f76-2773095f646b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9487b7458-nnjmd\" (UID: \"ee0aa582-abb4-4ac9-9f76-2773095f646b\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-nnjmd" Jul 15 16:48:42.206611 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:42.206588 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxtv4\" (UniqueName: \"kubernetes.io/projected/ee0aa582-abb4-4ac9-9f76-2773095f646b-kube-api-access-pxtv4\") pod \"opendatahub-operator-controller-manager-9487b7458-nnjmd\" (UID: \"ee0aa582-abb4-4ac9-9f76-2773095f646b\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-nnjmd" Jul 15 16:48:42.274202 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:42.274135 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-nnjmd" Jul 15 16:48:42.409202 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:42.409178 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9487b7458-nnjmd"] Jul 15 16:48:42.411959 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:48:42.411934 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee0aa582_abb4_4ac9_9f76_2773095f646b.slice/crio-834d24772afb4cf0277fec61ae9144ed44173371602e92b1b4eaea660b5ae41b WatchSource:0}: Error finding container 834d24772afb4cf0277fec61ae9144ed44173371602e92b1b4eaea660b5ae41b: Status 404 returned error can't find the container with id 834d24772afb4cf0277fec61ae9144ed44173371602e92b1b4eaea660b5ae41b Jul 15 16:48:43.185316 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:43.185289 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5c79d97d55-wt6bm" Jul 15 16:48:43.231835 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:43.231795 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-nnjmd" event={"ID":"ee0aa582-abb4-4ac9-9f76-2773095f646b","Type":"ContainerStarted","Data":"834d24772afb4cf0277fec61ae9144ed44173371602e92b1b4eaea660b5ae41b"} Jul 15 16:48:46.248426 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:46.248390 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-nnjmd" event={"ID":"ee0aa582-abb4-4ac9-9f76-2773095f646b","Type":"ContainerStarted","Data":"1b2be0a1322e72f808861dcb8de16d15dbfe6ef5c57f8d72f28594bc66974eaa"} Jul 15 16:48:47.254627 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:47.254590 2559 generic.go:356] "Generic (PLEG): container finished" podID="ee0aa582-abb4-4ac9-9f76-2773095f646b" containerID="1b2be0a1322e72f808861dcb8de16d15dbfe6ef5c57f8d72f28594bc66974eaa" exitCode=0 Jul 15 16:48:47.255001 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:47.254667 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-nnjmd" event={"ID":"ee0aa582-abb4-4ac9-9f76-2773095f646b","Type":"ContainerDied","Data":"1b2be0a1322e72f808861dcb8de16d15dbfe6ef5c57f8d72f28594bc66974eaa"} Jul 15 16:48:48.261197 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:48.261161 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-nnjmd" event={"ID":"ee0aa582-abb4-4ac9-9f76-2773095f646b","Type":"ContainerStarted","Data":"df96ac66fe65e947bee3a0b5e0399f278dab025bbeda9a9eae849b0b338e83d9"} Jul 15 16:48:48.261579 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:48.261299 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-nnjmd" Jul 15 16:48:48.289208 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:48.289151 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-nnjmd" podStartSLOduration=2.786776445 podStartE2EDuration="7.289132036s" totalImagesPullingTime="3.472633674s" totalInitContainerRuntime="1.029721917s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:48:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:48:48.286448564 +0000 UTC m=+514.713540660" watchObservedRunningTime="2026-07-15 16:48:48.289132036 +0000 UTC m=+514.716224119" Jul 15 16:48:59.267605 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:48:59.267578 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-nnjmd" Jul 15 16:49:10.245354 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:49:10.245282 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hr2ls"] Jul 15 16:49:10.247815 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:49:10.247798 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hr2ls" Jul 15 16:49:10.250915 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:49:10.250889 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 15 16:49:10.250915 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:49:10.250909 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 15 16:49:10.251105 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:49:10.251062 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 15 16:49:10.251105 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:49:10.251064 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 15 16:49:10.251193 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:49:10.251108 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 15 16:49:10.251925 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:49:10.251911 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 15 16:49:10.251982 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:49:10.251966 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-s76ms\"" Jul 15 16:49:10.262021 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:49:10.261973 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hr2ls"] Jul 15 16:49:10.331071 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:49:10.331044 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-hr2ls\" (UID: \"e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hr2ls" Jul 15 16:49:10.331201 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:49:10.331077 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-hr2ls\" (UID: \"e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hr2ls" Jul 15 16:49:10.331201 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:49:10.331095 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-hr2ls\" (UID: \"e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hr2ls" Jul 15 16:49:10.331328 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:49:10.331216 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-hr2ls\" (UID: \"e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hr2ls" Jul 15 16:49:10.331328 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:49:10.331261 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52dd8\" (UniqueName: \"kubernetes.io/projected/e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2-kube-api-access-52dd8\") pod \"istiod-openshift-gateway-94bb8fbfd-hr2ls\" (UID: \"e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hr2ls" Jul 15 16:49:10.331328 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:49:10.331294 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-hr2ls\" (UID: \"e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hr2ls" Jul 15 16:49:10.331471 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:49:10.331381 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-hr2ls\" (UID: \"e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hr2ls" Jul 15 16:49:10.431872 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:49:10.431847 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52dd8\" (UniqueName: \"kubernetes.io/projected/e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2-kube-api-access-52dd8\") pod \"istiod-openshift-gateway-94bb8fbfd-hr2ls\" (UID: \"e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hr2ls" Jul 15 16:49:10.432017 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:49:10.431878 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-hr2ls\" (UID: \"e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hr2ls" Jul 15 16:49:10.432017 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:49:10.431901 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-hr2ls\" (UID: \"e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hr2ls" Jul 15 16:49:10.432017 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:49:10.431920 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-hr2ls\" (UID: \"e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hr2ls" Jul 15 16:49:10.432017 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:49:10.431965 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-hr2ls\" (UID: \"e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hr2ls" Jul 15 16:49:10.432017 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:49:10.432002 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-hr2ls\" (UID: \"e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hr2ls" Jul 15 16:49:10.432247 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:49:10.432091 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-hr2ls\" (UID: \"e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hr2ls" Jul 15 16:49:10.432556 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:49:10.432527 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-hr2ls\" (UID: \"e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hr2ls" Jul 15 16:49:10.434102 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:49:10.434081 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-hr2ls\" (UID: \"e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hr2ls" Jul 15 16:49:10.434292 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:49:10.434276 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-hr2ls\" (UID: \"e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hr2ls" Jul 15 16:49:10.434737 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:49:10.434718 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-hr2ls\" (UID: \"e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hr2ls" Jul 15 16:49:10.434828 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:49:10.434727 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-hr2ls\" (UID: \"e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hr2ls" Jul 15 16:49:10.448345 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:49:10.448318 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52dd8\" (UniqueName: \"kubernetes.io/projected/e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2-kube-api-access-52dd8\") pod \"istiod-openshift-gateway-94bb8fbfd-hr2ls\" (UID: \"e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hr2ls" Jul 15 16:49:10.458566 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:49:10.458527 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-hr2ls\" (UID: \"e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hr2ls" Jul 15 16:49:10.557879 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:49:10.557812 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hr2ls" Jul 15 16:49:10.690804 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:49:10.690710 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hr2ls"] Jul 15 16:49:10.693507 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:49:10.693481 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9fd9b2d_099a_44cd_a04f_7b59a5a80ea2.slice/crio-6bdb878c66b7b84407fdaf9d36992b96b87705c678627dc8ab2be67e9c7d89d5 WatchSource:0}: Error finding container 6bdb878c66b7b84407fdaf9d36992b96b87705c678627dc8ab2be67e9c7d89d5: Status 404 returned error can't find the container with id 6bdb878c66b7b84407fdaf9d36992b96b87705c678627dc8ab2be67e9c7d89d5 Jul 15 16:49:11.372522 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:49:11.372487 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hr2ls" event={"ID":"e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2","Type":"ContainerStarted","Data":"6bdb878c66b7b84407fdaf9d36992b96b87705c678627dc8ab2be67e9c7d89d5"} Jul 15 16:49:16.038199 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:49:16.038158 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 16:49:16.038472 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:49:16.038229 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 16:49:16.401382 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:49:16.401292 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hr2ls" event={"ID":"e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2","Type":"ContainerStarted","Data":"11383b399b5e70cc796ca142f065a7640d5e639de9f660424da7ff402c3af015"} Jul 15 16:49:16.401520 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:49:16.401398 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hr2ls" Jul 15 16:49:16.424136 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:49:16.424085 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hr2ls" podStartSLOduration=1.081608914 podStartE2EDuration="6.424069818s" totalImagesPullingTime="5.342460904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:49:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:49:16.422848274 +0000 UTC m=+542.849940382" watchObservedRunningTime="2026-07-15 16:49:16.424069818 +0000 UTC m=+542.851161900" Jul 15 16:49:17.408551 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:49:17.408522 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hr2ls" Jul 15 16:50:08.049968 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:08.049933 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7db595dbb-w8wvx"] Jul 15 16:50:08.059621 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:08.059589 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7db595dbb-w8wvx" Jul 15 16:50:08.064407 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:08.064378 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7db595dbb-w8wvx"] Jul 15 16:50:08.135938 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:08.135902 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f78d8209-e5a0-4b0c-9727-f77ae5048996-service-ca\") pod \"console-7db595dbb-w8wvx\" (UID: \"f78d8209-e5a0-4b0c-9727-f77ae5048996\") " pod="openshift-console/console-7db595dbb-w8wvx" Jul 15 16:50:08.136120 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:08.135944 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f78d8209-e5a0-4b0c-9727-f77ae5048996-console-config\") pod \"console-7db595dbb-w8wvx\" (UID: \"f78d8209-e5a0-4b0c-9727-f77ae5048996\") " pod="openshift-console/console-7db595dbb-w8wvx" Jul 15 16:50:08.136120 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:08.135984 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnn92\" (UniqueName: \"kubernetes.io/projected/f78d8209-e5a0-4b0c-9727-f77ae5048996-kube-api-access-dnn92\") pod \"console-7db595dbb-w8wvx\" (UID: \"f78d8209-e5a0-4b0c-9727-f77ae5048996\") " pod="openshift-console/console-7db595dbb-w8wvx" Jul 15 16:50:08.136120 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:08.136017 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f78d8209-e5a0-4b0c-9727-f77ae5048996-trusted-ca-bundle\") pod \"console-7db595dbb-w8wvx\" (UID: \"f78d8209-e5a0-4b0c-9727-f77ae5048996\") " pod="openshift-console/console-7db595dbb-w8wvx" Jul 15 16:50:08.136120 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:08.136049 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f78d8209-e5a0-4b0c-9727-f77ae5048996-console-oauth-config\") pod \"console-7db595dbb-w8wvx\" (UID: \"f78d8209-e5a0-4b0c-9727-f77ae5048996\") " pod="openshift-console/console-7db595dbb-w8wvx" Jul 15 16:50:08.136120 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:08.136074 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f78d8209-e5a0-4b0c-9727-f77ae5048996-console-serving-cert\") pod \"console-7db595dbb-w8wvx\" (UID: \"f78d8209-e5a0-4b0c-9727-f77ae5048996\") " pod="openshift-console/console-7db595dbb-w8wvx" Jul 15 16:50:08.136120 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:08.136114 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f78d8209-e5a0-4b0c-9727-f77ae5048996-oauth-serving-cert\") pod \"console-7db595dbb-w8wvx\" (UID: \"f78d8209-e5a0-4b0c-9727-f77ae5048996\") " pod="openshift-console/console-7db595dbb-w8wvx" Jul 15 16:50:08.236559 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:08.236532 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f78d8209-e5a0-4b0c-9727-f77ae5048996-console-serving-cert\") pod \"console-7db595dbb-w8wvx\" (UID: \"f78d8209-e5a0-4b0c-9727-f77ae5048996\") " pod="openshift-console/console-7db595dbb-w8wvx" Jul 15 16:50:08.236735 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:08.236571 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f78d8209-e5a0-4b0c-9727-f77ae5048996-oauth-serving-cert\") pod \"console-7db595dbb-w8wvx\" (UID: \"f78d8209-e5a0-4b0c-9727-f77ae5048996\") " pod="openshift-console/console-7db595dbb-w8wvx" Jul 15 16:50:08.236735 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:08.236644 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f78d8209-e5a0-4b0c-9727-f77ae5048996-service-ca\") pod \"console-7db595dbb-w8wvx\" (UID: \"f78d8209-e5a0-4b0c-9727-f77ae5048996\") " pod="openshift-console/console-7db595dbb-w8wvx" Jul 15 16:50:08.236735 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:08.236673 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f78d8209-e5a0-4b0c-9727-f77ae5048996-console-config\") pod \"console-7db595dbb-w8wvx\" (UID: \"f78d8209-e5a0-4b0c-9727-f77ae5048996\") " pod="openshift-console/console-7db595dbb-w8wvx" Jul 15 16:50:08.236735 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:08.236693 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnn92\" (UniqueName: \"kubernetes.io/projected/f78d8209-e5a0-4b0c-9727-f77ae5048996-kube-api-access-dnn92\") pod \"console-7db595dbb-w8wvx\" (UID: \"f78d8209-e5a0-4b0c-9727-f77ae5048996\") " pod="openshift-console/console-7db595dbb-w8wvx" Jul 15 16:50:08.236735 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:08.236730 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f78d8209-e5a0-4b0c-9727-f77ae5048996-trusted-ca-bundle\") pod \"console-7db595dbb-w8wvx\" (UID: \"f78d8209-e5a0-4b0c-9727-f77ae5048996\") " pod="openshift-console/console-7db595dbb-w8wvx" Jul 15 16:50:08.237016 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:08.236785 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f78d8209-e5a0-4b0c-9727-f77ae5048996-console-oauth-config\") pod \"console-7db595dbb-w8wvx\" (UID: \"f78d8209-e5a0-4b0c-9727-f77ae5048996\") " pod="openshift-console/console-7db595dbb-w8wvx" Jul 15 16:50:08.237424 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:08.237391 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f78d8209-e5a0-4b0c-9727-f77ae5048996-oauth-serving-cert\") pod \"console-7db595dbb-w8wvx\" (UID: \"f78d8209-e5a0-4b0c-9727-f77ae5048996\") " pod="openshift-console/console-7db595dbb-w8wvx" Jul 15 16:50:08.237540 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:08.237425 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f78d8209-e5a0-4b0c-9727-f77ae5048996-service-ca\") pod \"console-7db595dbb-w8wvx\" (UID: \"f78d8209-e5a0-4b0c-9727-f77ae5048996\") " pod="openshift-console/console-7db595dbb-w8wvx" Jul 15 16:50:08.237540 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:08.237445 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f78d8209-e5a0-4b0c-9727-f77ae5048996-console-config\") pod \"console-7db595dbb-w8wvx\" (UID: \"f78d8209-e5a0-4b0c-9727-f77ae5048996\") " pod="openshift-console/console-7db595dbb-w8wvx" Jul 15 16:50:08.237708 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:08.237683 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f78d8209-e5a0-4b0c-9727-f77ae5048996-trusted-ca-bundle\") pod \"console-7db595dbb-w8wvx\" (UID: \"f78d8209-e5a0-4b0c-9727-f77ae5048996\") " pod="openshift-console/console-7db595dbb-w8wvx" Jul 15 16:50:08.239267 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:08.239238 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f78d8209-e5a0-4b0c-9727-f77ae5048996-console-oauth-config\") pod \"console-7db595dbb-w8wvx\" (UID: \"f78d8209-e5a0-4b0c-9727-f77ae5048996\") " pod="openshift-console/console-7db595dbb-w8wvx" Jul 15 16:50:08.239358 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:08.239271 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f78d8209-e5a0-4b0c-9727-f77ae5048996-console-serving-cert\") pod \"console-7db595dbb-w8wvx\" (UID: \"f78d8209-e5a0-4b0c-9727-f77ae5048996\") " pod="openshift-console/console-7db595dbb-w8wvx" Jul 15 16:50:08.247234 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:08.247215 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnn92\" (UniqueName: \"kubernetes.io/projected/f78d8209-e5a0-4b0c-9727-f77ae5048996-kube-api-access-dnn92\") pod \"console-7db595dbb-w8wvx\" (UID: \"f78d8209-e5a0-4b0c-9727-f77ae5048996\") " pod="openshift-console/console-7db595dbb-w8wvx" Jul 15 16:50:08.370046 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:08.369982 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7db595dbb-w8wvx" Jul 15 16:50:08.499344 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:08.499320 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7db595dbb-w8wvx"] Jul 15 16:50:08.501554 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:50:08.501529 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf78d8209_e5a0_4b0c_9727_f77ae5048996.slice/crio-449d0b935b7b65d1dbf36f9ba1b902f9a0c49c3de6d33863db399509cad924ea WatchSource:0}: Error finding container 449d0b935b7b65d1dbf36f9ba1b902f9a0c49c3de6d33863db399509cad924ea: Status 404 returned error can't find the container with id 449d0b935b7b65d1dbf36f9ba1b902f9a0c49c3de6d33863db399509cad924ea Jul 15 16:50:08.646453 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:08.646366 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7db595dbb-w8wvx" event={"ID":"f78d8209-e5a0-4b0c-9727-f77ae5048996","Type":"ContainerStarted","Data":"6bada5cc51de4920e3bb29eb548aa718c08ddf28469a8ba1e55e2720973ba833"} Jul 15 16:50:08.646453 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:08.646420 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7db595dbb-w8wvx" event={"ID":"f78d8209-e5a0-4b0c-9727-f77ae5048996","Type":"ContainerStarted","Data":"449d0b935b7b65d1dbf36f9ba1b902f9a0c49c3de6d33863db399509cad924ea"} Jul 15 16:50:08.664219 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:08.664171 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7db595dbb-w8wvx" podStartSLOduration=0.664154367 podStartE2EDuration="664.154367ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:50:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:50:08.663258601 +0000 UTC m=+595.090350689" watchObservedRunningTime="2026-07-15 16:50:08.664154367 +0000 UTC m=+595.091246450" Jul 15 16:50:14.038335 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:14.038302 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vcxdn_268a4cb9-c310-4681-91a6-efe9692f8327/console-operator/2.log" Jul 15 16:50:14.041024 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:14.041003 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vcxdn_268a4cb9-c310-4681-91a6-efe9692f8327/console-operator/2.log" Jul 15 16:50:14.042311 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:14.042293 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxsr7_1e30c2c6-c7eb-42ca-add5-239c71eafd0d/ovn-acl-logging/0.log" Jul 15 16:50:14.044915 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:14.044895 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxsr7_1e30c2c6-c7eb-42ca-add5-239c71eafd0d/ovn-acl-logging/0.log" Jul 15 16:50:18.370993 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:18.370958 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7db595dbb-w8wvx" Jul 15 16:50:18.372484 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:18.371005 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7db595dbb-w8wvx" Jul 15 16:50:18.375725 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:18.375699 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7db595dbb-w8wvx" Jul 15 16:50:18.699466 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:18.699437 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7db595dbb-w8wvx" Jul 15 16:50:18.742550 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:18.742516 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-747487df4d-7fj5s"] Jul 15 16:50:43.765669 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:43.765567 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-747487df4d-7fj5s" podUID="59108231-2169-40ab-ab93-8a2f98d52938" containerName="console" containerID="cri-o://c9c385b0777a5d75cf3108bf5bf259d91f88b6cd56af57353fca84db64b69aeb" gracePeriod=15 Jul 15 16:50:44.010600 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:44.010572 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-747487df4d-7fj5s" Jul 15 16:50:44.151765 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:44.151674 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59108231-2169-40ab-ab93-8a2f98d52938-service-ca\") pod \"59108231-2169-40ab-ab93-8a2f98d52938\" (UID: \"59108231-2169-40ab-ab93-8a2f98d52938\") " Jul 15 16:50:44.151915 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:44.151782 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmppd\" (UniqueName: \"kubernetes.io/projected/59108231-2169-40ab-ab93-8a2f98d52938-kube-api-access-gmppd\") pod \"59108231-2169-40ab-ab93-8a2f98d52938\" (UID: \"59108231-2169-40ab-ab93-8a2f98d52938\") " Jul 15 16:50:44.151915 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:44.151813 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59108231-2169-40ab-ab93-8a2f98d52938-console-oauth-config\") pod \"59108231-2169-40ab-ab93-8a2f98d52938\" (UID: \"59108231-2169-40ab-ab93-8a2f98d52938\") " Jul 15 16:50:44.151915 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:44.151844 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59108231-2169-40ab-ab93-8a2f98d52938-console-serving-cert\") pod \"59108231-2169-40ab-ab93-8a2f98d52938\" (UID: \"59108231-2169-40ab-ab93-8a2f98d52938\") " Jul 15 16:50:44.151915 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:44.151913 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59108231-2169-40ab-ab93-8a2f98d52938-oauth-serving-cert\") pod \"59108231-2169-40ab-ab93-8a2f98d52938\" (UID: \"59108231-2169-40ab-ab93-8a2f98d52938\") " Jul 15 16:50:44.152129 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:44.151949 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59108231-2169-40ab-ab93-8a2f98d52938-console-config\") pod \"59108231-2169-40ab-ab93-8a2f98d52938\" (UID: \"59108231-2169-40ab-ab93-8a2f98d52938\") " Jul 15 16:50:44.152129 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:44.151973 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59108231-2169-40ab-ab93-8a2f98d52938-trusted-ca-bundle\") pod \"59108231-2169-40ab-ab93-8a2f98d52938\" (UID: \"59108231-2169-40ab-ab93-8a2f98d52938\") " Jul 15 16:50:44.152225 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:44.152124 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59108231-2169-40ab-ab93-8a2f98d52938-service-ca" (OuterVolumeSpecName: "service-ca") pod "59108231-2169-40ab-ab93-8a2f98d52938" (UID: "59108231-2169-40ab-ab93-8a2f98d52938"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:50:44.152353 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:44.152333 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59108231-2169-40ab-ab93-8a2f98d52938-service-ca\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:50:44.152488 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:44.152356 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59108231-2169-40ab-ab93-8a2f98d52938-console-config" (OuterVolumeSpecName: "console-config") pod "59108231-2169-40ab-ab93-8a2f98d52938" (UID: "59108231-2169-40ab-ab93-8a2f98d52938"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:50:44.152546 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:44.152349 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59108231-2169-40ab-ab93-8a2f98d52938-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "59108231-2169-40ab-ab93-8a2f98d52938" (UID: "59108231-2169-40ab-ab93-8a2f98d52938"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:50:44.152546 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:44.152437 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59108231-2169-40ab-ab93-8a2f98d52938-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "59108231-2169-40ab-ab93-8a2f98d52938" (UID: "59108231-2169-40ab-ab93-8a2f98d52938"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:50:44.153995 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:44.153968 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59108231-2169-40ab-ab93-8a2f98d52938-kube-api-access-gmppd" (OuterVolumeSpecName: "kube-api-access-gmppd") pod "59108231-2169-40ab-ab93-8a2f98d52938" (UID: "59108231-2169-40ab-ab93-8a2f98d52938"). InnerVolumeSpecName "kube-api-access-gmppd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 16:50:44.154071 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:44.154023 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59108231-2169-40ab-ab93-8a2f98d52938-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "59108231-2169-40ab-ab93-8a2f98d52938" (UID: "59108231-2169-40ab-ab93-8a2f98d52938"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 16:50:44.154071 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:44.154031 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59108231-2169-40ab-ab93-8a2f98d52938-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "59108231-2169-40ab-ab93-8a2f98d52938" (UID: "59108231-2169-40ab-ab93-8a2f98d52938"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 16:50:44.253799 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:44.253773 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59108231-2169-40ab-ab93-8a2f98d52938-oauth-serving-cert\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:50:44.253799 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:44.253796 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59108231-2169-40ab-ab93-8a2f98d52938-console-config\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:50:44.253937 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:44.253805 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59108231-2169-40ab-ab93-8a2f98d52938-trusted-ca-bundle\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:50:44.253937 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:44.253813 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmppd\" (UniqueName: \"kubernetes.io/projected/59108231-2169-40ab-ab93-8a2f98d52938-kube-api-access-gmppd\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:50:44.253937 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:44.253823 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59108231-2169-40ab-ab93-8a2f98d52938-console-oauth-config\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:50:44.253937 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:44.253831 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59108231-2169-40ab-ab93-8a2f98d52938-console-serving-cert\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:50:44.818896 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:44.818863 2559 generic.go:356] "Generic (PLEG): container finished" podID="59108231-2169-40ab-ab93-8a2f98d52938" containerID="c9c385b0777a5d75cf3108bf5bf259d91f88b6cd56af57353fca84db64b69aeb" exitCode=0 Jul 15 16:50:44.819310 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:44.818907 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-747487df4d-7fj5s" Jul 15 16:50:44.819310 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:44.818916 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-747487df4d-7fj5s" event={"ID":"59108231-2169-40ab-ab93-8a2f98d52938","Type":"ContainerDied","Data":"c9c385b0777a5d75cf3108bf5bf259d91f88b6cd56af57353fca84db64b69aeb"} Jul 15 16:50:44.819310 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:44.818957 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-747487df4d-7fj5s" event={"ID":"59108231-2169-40ab-ab93-8a2f98d52938","Type":"ContainerDied","Data":"f946e07cf454c7c85588e8c39e0bc45af785611416a34aa5fd64ea58717e5652"} Jul 15 16:50:44.819310 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:44.818976 2559 scope.go:117] "RemoveContainer" containerID="c9c385b0777a5d75cf3108bf5bf259d91f88b6cd56af57353fca84db64b69aeb" Jul 15 16:50:44.826951 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:44.826933 2559 scope.go:117] "RemoveContainer" containerID="c9c385b0777a5d75cf3108bf5bf259d91f88b6cd56af57353fca84db64b69aeb" Jul 15 16:50:44.827284 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:50:44.827260 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9c385b0777a5d75cf3108bf5bf259d91f88b6cd56af57353fca84db64b69aeb\": container with ID starting with c9c385b0777a5d75cf3108bf5bf259d91f88b6cd56af57353fca84db64b69aeb not found: ID does not exist" containerID="c9c385b0777a5d75cf3108bf5bf259d91f88b6cd56af57353fca84db64b69aeb" Jul 15 16:50:44.827328 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:44.827292 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9c385b0777a5d75cf3108bf5bf259d91f88b6cd56af57353fca84db64b69aeb"} err="failed to get container status \"c9c385b0777a5d75cf3108bf5bf259d91f88b6cd56af57353fca84db64b69aeb\": rpc error: code = NotFound desc = could not find container \"c9c385b0777a5d75cf3108bf5bf259d91f88b6cd56af57353fca84db64b69aeb\": container with ID starting with c9c385b0777a5d75cf3108bf5bf259d91f88b6cd56af57353fca84db64b69aeb not found: ID does not exist" Jul 15 16:50:44.845386 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:44.845359 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-747487df4d-7fj5s"] Jul 15 16:50:44.857949 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:44.857927 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-747487df4d-7fj5s"] Jul 15 16:50:46.172235 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:46.172202 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59108231-2169-40ab-ab93-8a2f98d52938" path="/var/lib/kubelet/pods/59108231-2169-40ab-ab93-8a2f98d52938/volumes" Jul 15 16:50:47.735738 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:47.735703 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-jbz7p"] Jul 15 16:50:47.736111 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:47.736088 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59108231-2169-40ab-ab93-8a2f98d52938" containerName="console" Jul 15 16:50:47.736111 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:47.736100 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="59108231-2169-40ab-ab93-8a2f98d52938" containerName="console" Jul 15 16:50:47.736177 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:47.736168 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="59108231-2169-40ab-ab93-8a2f98d52938" containerName="console" Jul 15 16:50:47.739063 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:47.739045 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jbz7p" Jul 15 16:50:47.741605 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:47.741583 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 15 16:50:47.741729 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:47.741605 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 15 16:50:47.741729 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:47.741607 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-hmb6p\"" Jul 15 16:50:47.742551 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:47.742531 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 15 16:50:47.752373 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:47.752347 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-jbz7p"] Jul 15 16:50:47.885235 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:47.885203 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2c98\" (UniqueName: \"kubernetes.io/projected/058df57d-84d1-49a0-958e-eb78abe6569c-kube-api-access-q2c98\") pod \"dns-operator-controller-manager-864dd78c4c-jbz7p\" (UID: \"058df57d-84d1-49a0-958e-eb78abe6569c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jbz7p" Jul 15 16:50:47.986337 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:47.986257 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2c98\" (UniqueName: \"kubernetes.io/projected/058df57d-84d1-49a0-958e-eb78abe6569c-kube-api-access-q2c98\") pod \"dns-operator-controller-manager-864dd78c4c-jbz7p\" (UID: \"058df57d-84d1-49a0-958e-eb78abe6569c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jbz7p" Jul 15 16:50:47.997707 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:47.997686 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2c98\" (UniqueName: \"kubernetes.io/projected/058df57d-84d1-49a0-958e-eb78abe6569c-kube-api-access-q2c98\") pod \"dns-operator-controller-manager-864dd78c4c-jbz7p\" (UID: \"058df57d-84d1-49a0-958e-eb78abe6569c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jbz7p" Jul 15 16:50:48.049553 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:48.049523 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jbz7p" Jul 15 16:50:48.179147 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:48.179125 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-jbz7p"] Jul 15 16:50:48.181060 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:50:48.181036 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod058df57d_84d1_49a0_958e_eb78abe6569c.slice/crio-66145ae564b10bdaa69d8f306001dbc5f5cbde69a1705ec95775d8be8f09d09c WatchSource:0}: Error finding container 66145ae564b10bdaa69d8f306001dbc5f5cbde69a1705ec95775d8be8f09d09c: Status 404 returned error can't find the container with id 66145ae564b10bdaa69d8f306001dbc5f5cbde69a1705ec95775d8be8f09d09c Jul 15 16:50:48.841067 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:48.841035 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jbz7p" event={"ID":"058df57d-84d1-49a0-958e-eb78abe6569c","Type":"ContainerStarted","Data":"66145ae564b10bdaa69d8f306001dbc5f5cbde69a1705ec95775d8be8f09d09c"} Jul 15 16:50:50.853425 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:50.853394 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jbz7p" event={"ID":"058df57d-84d1-49a0-958e-eb78abe6569c","Type":"ContainerStarted","Data":"db10cc9982683d08a205303a4b54548661edc29ad56bfd488dc0ba24788e0414"} Jul 15 16:50:50.853822 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:50.853520 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jbz7p" Jul 15 16:50:50.872021 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:50:50.871975 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jbz7p" podStartSLOduration=1.4182652390000001 podStartE2EDuration="3.871959704s" totalImagesPullingTime="2.453694465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:50:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:50:50.869352594 +0000 UTC m=+637.296444675" watchObservedRunningTime="2026-07-15 16:50:50.871959704 +0000 UTC m=+637.299051787" Jul 15 16:51:01.861269 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:01.861231 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jbz7p" Jul 15 16:51:04.023112 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:04.023077 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vs2hq"] Jul 15 16:51:04.025658 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:04.025643 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vs2hq" Jul 15 16:51:04.029471 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:04.029452 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qmq6r\"" Jul 15 16:51:04.040512 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:04.040490 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vs2hq"] Jul 15 16:51:04.119432 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:04.119402 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqclp\" (UniqueName: \"kubernetes.io/projected/8c96913d-28e7-41b5-862d-a173b87bde7d-kube-api-access-tqclp\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vs2hq\" (UID: \"8c96913d-28e7-41b5-862d-a173b87bde7d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vs2hq" Jul 15 16:51:04.119582 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:04.119440 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c96913d-28e7-41b5-862d-a173b87bde7d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vs2hq\" (UID: \"8c96913d-28e7-41b5-862d-a173b87bde7d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vs2hq" Jul 15 16:51:04.220624 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:04.220584 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqclp\" (UniqueName: \"kubernetes.io/projected/8c96913d-28e7-41b5-862d-a173b87bde7d-kube-api-access-tqclp\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vs2hq\" (UID: \"8c96913d-28e7-41b5-862d-a173b87bde7d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vs2hq" Jul 15 16:51:04.220812 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:04.220636 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c96913d-28e7-41b5-862d-a173b87bde7d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vs2hq\" (UID: \"8c96913d-28e7-41b5-862d-a173b87bde7d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vs2hq" Jul 15 16:51:04.221055 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:04.221037 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c96913d-28e7-41b5-862d-a173b87bde7d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vs2hq\" (UID: \"8c96913d-28e7-41b5-862d-a173b87bde7d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vs2hq" Jul 15 16:51:04.228720 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:04.228689 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqclp\" (UniqueName: \"kubernetes.io/projected/8c96913d-28e7-41b5-862d-a173b87bde7d-kube-api-access-tqclp\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vs2hq\" (UID: \"8c96913d-28e7-41b5-862d-a173b87bde7d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vs2hq" Jul 15 16:51:04.335717 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:04.335655 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vs2hq" Jul 15 16:51:04.466081 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:04.466058 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vs2hq"] Jul 15 16:51:04.468149 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:51:04.468121 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c96913d_28e7_41b5_862d_a173b87bde7d.slice/crio-e48cddcf72e68bdd76205b58306e66086caeed840d88730974b3c2a08a79d717 WatchSource:0}: Error finding container e48cddcf72e68bdd76205b58306e66086caeed840d88730974b3c2a08a79d717: Status 404 returned error can't find the container with id e48cddcf72e68bdd76205b58306e66086caeed840d88730974b3c2a08a79d717 Jul 15 16:51:04.789929 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:04.789898 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vs2hq"] Jul 15 16:51:04.792785 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:04.792730 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vs2hq"] Jul 15 16:51:10.954488 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:10.954435 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vs2hq" podUID="8c96913d-28e7-41b5-862d-a173b87bde7d" containerName="manager" containerID="cri-o://543160d8cdc8b43245951fb467623de38d532b0b4e781e5c0ab37758076452fc" gracePeriod=2 Jul 15 16:51:11.196127 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:11.196106 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vs2hq" Jul 15 16:51:11.198536 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:51:11.198510 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-vs2hq\" is forbidden: User \"system:node:ip-10-0-132-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-162.ec2.internal' and this object" podUID="8c96913d-28e7-41b5-862d-a173b87bde7d" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vs2hq" Jul 15 16:51:11.286601 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:11.286548 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c96913d-28e7-41b5-862d-a173b87bde7d-extensions-socket-volume\") pod \"8c96913d-28e7-41b5-862d-a173b87bde7d\" (UID: \"8c96913d-28e7-41b5-862d-a173b87bde7d\") " Jul 15 16:51:11.286702 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:11.286610 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqclp\" (UniqueName: \"kubernetes.io/projected/8c96913d-28e7-41b5-862d-a173b87bde7d-kube-api-access-tqclp\") pod \"8c96913d-28e7-41b5-862d-a173b87bde7d\" (UID: \"8c96913d-28e7-41b5-862d-a173b87bde7d\") " Jul 15 16:51:11.286846 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:11.286824 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c96913d-28e7-41b5-862d-a173b87bde7d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8c96913d-28e7-41b5-862d-a173b87bde7d" (UID: "8c96913d-28e7-41b5-862d-a173b87bde7d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 16:51:11.286912 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:11.286898 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c96913d-28e7-41b5-862d-a173b87bde7d-extensions-socket-volume\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:51:11.288623 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:11.288592 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c96913d-28e7-41b5-862d-a173b87bde7d-kube-api-access-tqclp" (OuterVolumeSpecName: "kube-api-access-tqclp") pod "8c96913d-28e7-41b5-862d-a173b87bde7d" (UID: "8c96913d-28e7-41b5-862d-a173b87bde7d"). InnerVolumeSpecName "kube-api-access-tqclp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 16:51:11.388272 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:11.388246 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqclp\" (UniqueName: \"kubernetes.io/projected/8c96913d-28e7-41b5-862d-a173b87bde7d-kube-api-access-tqclp\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:51:11.960551 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:11.960523 2559 generic.go:356] "Generic (PLEG): container finished" podID="8c96913d-28e7-41b5-862d-a173b87bde7d" containerID="543160d8cdc8b43245951fb467623de38d532b0b4e781e5c0ab37758076452fc" exitCode=2 Jul 15 16:51:11.961009 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:11.960565 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vs2hq" Jul 15 16:51:11.961009 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:11.960602 2559 scope.go:117] "RemoveContainer" containerID="543160d8cdc8b43245951fb467623de38d532b0b4e781e5c0ab37758076452fc" Jul 15 16:51:11.962973 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:51:11.962938 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-vs2hq\" is forbidden: User \"system:node:ip-10-0-132-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-162.ec2.internal' and this object" podUID="8c96913d-28e7-41b5-862d-a173b87bde7d" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vs2hq" Jul 15 16:51:11.969014 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:11.968998 2559 scope.go:117] "RemoveContainer" containerID="543160d8cdc8b43245951fb467623de38d532b0b4e781e5c0ab37758076452fc" Jul 15 16:51:11.969277 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:51:11.969260 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"543160d8cdc8b43245951fb467623de38d532b0b4e781e5c0ab37758076452fc\": container with ID starting with 543160d8cdc8b43245951fb467623de38d532b0b4e781e5c0ab37758076452fc not found: ID does not exist" containerID="543160d8cdc8b43245951fb467623de38d532b0b4e781e5c0ab37758076452fc" Jul 15 16:51:11.969325 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:11.969288 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"543160d8cdc8b43245951fb467623de38d532b0b4e781e5c0ab37758076452fc"} err="failed to get container status \"543160d8cdc8b43245951fb467623de38d532b0b4e781e5c0ab37758076452fc\": rpc error: code = NotFound desc = could not find container \"543160d8cdc8b43245951fb467623de38d532b0b4e781e5c0ab37758076452fc\": container with ID starting with 543160d8cdc8b43245951fb467623de38d532b0b4e781e5c0ab37758076452fc not found: ID does not exist" Jul 15 16:51:11.970320 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:51:11.970298 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-vs2hq\" is forbidden: User \"system:node:ip-10-0-132-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-162.ec2.internal' and this object" podUID="8c96913d-28e7-41b5-862d-a173b87bde7d" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vs2hq" Jul 15 16:51:12.172648 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:12.172610 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c96913d-28e7-41b5-862d-a173b87bde7d" path="/var/lib/kubelet/pods/8c96913d-28e7-41b5-862d-a173b87bde7d/volumes" Jul 15 16:51:33.860174 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:33.860140 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x4mbs"] Jul 15 16:51:33.860524 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:33.860503 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c96913d-28e7-41b5-862d-a173b87bde7d" containerName="manager" Jul 15 16:51:33.860524 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:33.860514 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c96913d-28e7-41b5-862d-a173b87bde7d" containerName="manager" Jul 15 16:51:33.860601 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:33.860590 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c96913d-28e7-41b5-862d-a173b87bde7d" containerName="manager" Jul 15 16:51:33.866081 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:33.866060 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x4mbs" Jul 15 16:51:33.869023 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:33.869005 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qmq6r\"" Jul 15 16:51:33.881162 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:33.881138 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x4mbs"] Jul 15 16:51:33.982456 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:33.982425 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgxxv\" (UniqueName: \"kubernetes.io/projected/5029ef3c-df69-4a67-8c23-98530564ee95-kube-api-access-zgxxv\") pod \"kuadrant-operator-controller-manager-86878c769f-x4mbs\" (UID: \"5029ef3c-df69-4a67-8c23-98530564ee95\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x4mbs" Jul 15 16:51:33.982456 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:33.982459 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5029ef3c-df69-4a67-8c23-98530564ee95-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-x4mbs\" (UID: \"5029ef3c-df69-4a67-8c23-98530564ee95\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x4mbs" Jul 15 16:51:34.082918 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:34.082891 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgxxv\" (UniqueName: \"kubernetes.io/projected/5029ef3c-df69-4a67-8c23-98530564ee95-kube-api-access-zgxxv\") pod \"kuadrant-operator-controller-manager-86878c769f-x4mbs\" (UID: \"5029ef3c-df69-4a67-8c23-98530564ee95\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x4mbs" Jul 15 16:51:34.083056 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:34.082923 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5029ef3c-df69-4a67-8c23-98530564ee95-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-x4mbs\" (UID: \"5029ef3c-df69-4a67-8c23-98530564ee95\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x4mbs" Jul 15 16:51:34.083241 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:34.083226 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5029ef3c-df69-4a67-8c23-98530564ee95-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-x4mbs\" (UID: \"5029ef3c-df69-4a67-8c23-98530564ee95\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x4mbs" Jul 15 16:51:34.091491 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:34.091467 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgxxv\" (UniqueName: \"kubernetes.io/projected/5029ef3c-df69-4a67-8c23-98530564ee95-kube-api-access-zgxxv\") pod \"kuadrant-operator-controller-manager-86878c769f-x4mbs\" (UID: \"5029ef3c-df69-4a67-8c23-98530564ee95\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x4mbs" Jul 15 16:51:34.175450 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:34.175430 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x4mbs" Jul 15 16:51:34.312509 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:34.312482 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x4mbs"] Jul 15 16:51:34.314463 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:51:34.314436 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5029ef3c_df69_4a67_8c23_98530564ee95.slice/crio-db7ac408a62ed6f7edc3054f5a3d548423c6fdb5d2ccc71b18ba3d80876e7c48 WatchSource:0}: Error finding container db7ac408a62ed6f7edc3054f5a3d548423c6fdb5d2ccc71b18ba3d80876e7c48: Status 404 returned error can't find the container with id db7ac408a62ed6f7edc3054f5a3d548423c6fdb5d2ccc71b18ba3d80876e7c48 Jul 15 16:51:35.071587 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:35.071552 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x4mbs" event={"ID":"5029ef3c-df69-4a67-8c23-98530564ee95","Type":"ContainerStarted","Data":"06978be6a616a187163dc414735757e816095fd1b60e407d686e537a67847724"} Jul 15 16:51:35.072057 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:35.071608 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x4mbs" event={"ID":"5029ef3c-df69-4a67-8c23-98530564ee95","Type":"ContainerStarted","Data":"db7ac408a62ed6f7edc3054f5a3d548423c6fdb5d2ccc71b18ba3d80876e7c48"} Jul 15 16:51:35.072057 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:35.071663 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x4mbs" Jul 15 16:51:35.095291 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:35.095245 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x4mbs" podStartSLOduration=2.095229972 podStartE2EDuration="2.095229972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:51:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:51:35.093288604 +0000 UTC m=+681.520380698" watchObservedRunningTime="2026-07-15 16:51:35.095229972 +0000 UTC m=+681.522322113" Jul 15 16:51:46.079291 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:51:46.079254 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x4mbs" Jul 15 16:52:33.637127 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:33.637095 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-57b6598dc8-srqf7"] Jul 15 16:52:33.639566 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:33.639550 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57b6598dc8-srqf7" Jul 15 16:52:33.642160 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:33.642130 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 15 16:52:33.643102 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:33.643084 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nbxxv\"" Jul 15 16:52:33.643203 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:33.643085 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 15 16:52:33.649693 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:33.649667 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57b6598dc8-srqf7"] Jul 15 16:52:33.759796 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:33.759745 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/654d17f2-b2f8-4f13-a417-f070684091bc-webhook-cert\") pod \"maas-controller-57b6598dc8-srqf7\" (UID: \"654d17f2-b2f8-4f13-a417-f070684091bc\") " pod="opendatahub/maas-controller-57b6598dc8-srqf7" Jul 15 16:52:33.759932 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:33.759826 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cp5jr\" (UniqueName: \"kubernetes.io/projected/654d17f2-b2f8-4f13-a417-f070684091bc-kube-api-access-cp5jr\") pod \"maas-controller-57b6598dc8-srqf7\" (UID: \"654d17f2-b2f8-4f13-a417-f070684091bc\") " pod="opendatahub/maas-controller-57b6598dc8-srqf7" Jul 15 16:52:33.815740 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:33.815709 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-77fd9784f8-whztm"] Jul 15 16:52:33.818628 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:33.818610 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77fd9784f8-whztm" Jul 15 16:52:33.832436 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:33.832416 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77fd9784f8-whztm"] Jul 15 16:52:33.860629 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:33.860606 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cp5jr\" (UniqueName: \"kubernetes.io/projected/654d17f2-b2f8-4f13-a417-f070684091bc-kube-api-access-cp5jr\") pod \"maas-controller-57b6598dc8-srqf7\" (UID: \"654d17f2-b2f8-4f13-a417-f070684091bc\") " pod="opendatahub/maas-controller-57b6598dc8-srqf7" Jul 15 16:52:33.860719 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:33.860687 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/654d17f2-b2f8-4f13-a417-f070684091bc-webhook-cert\") pod \"maas-controller-57b6598dc8-srqf7\" (UID: \"654d17f2-b2f8-4f13-a417-f070684091bc\") " pod="opendatahub/maas-controller-57b6598dc8-srqf7" Jul 15 16:52:33.862960 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:33.862942 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/654d17f2-b2f8-4f13-a417-f070684091bc-webhook-cert\") pod \"maas-controller-57b6598dc8-srqf7\" (UID: \"654d17f2-b2f8-4f13-a417-f070684091bc\") " pod="opendatahub/maas-controller-57b6598dc8-srqf7" Jul 15 16:52:33.872701 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:33.872679 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cp5jr\" (UniqueName: \"kubernetes.io/projected/654d17f2-b2f8-4f13-a417-f070684091bc-kube-api-access-cp5jr\") pod \"maas-controller-57b6598dc8-srqf7\" (UID: \"654d17f2-b2f8-4f13-a417-f070684091bc\") " pod="opendatahub/maas-controller-57b6598dc8-srqf7" Jul 15 16:52:33.950417 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:33.950394 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57b6598dc8-srqf7" Jul 15 16:52:33.961731 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:33.961710 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dq6q\" (UniqueName: \"kubernetes.io/projected/6d6a61e6-bb63-455a-ac59-7e6e7ada32ee-kube-api-access-5dq6q\") pod \"maas-controller-77fd9784f8-whztm\" (UID: \"6d6a61e6-bb63-455a-ac59-7e6e7ada32ee\") " pod="opendatahub/maas-controller-77fd9784f8-whztm" Jul 15 16:52:33.961844 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:33.961744 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d6a61e6-bb63-455a-ac59-7e6e7ada32ee-webhook-cert\") pod \"maas-controller-77fd9784f8-whztm\" (UID: \"6d6a61e6-bb63-455a-ac59-7e6e7ada32ee\") " pod="opendatahub/maas-controller-77fd9784f8-whztm" Jul 15 16:52:34.063348 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:34.063318 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dq6q\" (UniqueName: \"kubernetes.io/projected/6d6a61e6-bb63-455a-ac59-7e6e7ada32ee-kube-api-access-5dq6q\") pod \"maas-controller-77fd9784f8-whztm\" (UID: \"6d6a61e6-bb63-455a-ac59-7e6e7ada32ee\") " pod="opendatahub/maas-controller-77fd9784f8-whztm" Jul 15 16:52:34.063538 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:34.063365 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d6a61e6-bb63-455a-ac59-7e6e7ada32ee-webhook-cert\") pod \"maas-controller-77fd9784f8-whztm\" (UID: \"6d6a61e6-bb63-455a-ac59-7e6e7ada32ee\") " pod="opendatahub/maas-controller-77fd9784f8-whztm" Jul 15 16:52:34.065800 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:34.065772 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d6a61e6-bb63-455a-ac59-7e6e7ada32ee-webhook-cert\") pod \"maas-controller-77fd9784f8-whztm\" (UID: \"6d6a61e6-bb63-455a-ac59-7e6e7ada32ee\") " pod="opendatahub/maas-controller-77fd9784f8-whztm" Jul 15 16:52:34.070833 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:34.070814 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dq6q\" (UniqueName: \"kubernetes.io/projected/6d6a61e6-bb63-455a-ac59-7e6e7ada32ee-kube-api-access-5dq6q\") pod \"maas-controller-77fd9784f8-whztm\" (UID: \"6d6a61e6-bb63-455a-ac59-7e6e7ada32ee\") " pod="opendatahub/maas-controller-77fd9784f8-whztm" Jul 15 16:52:34.076475 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:34.076457 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57b6598dc8-srqf7"] Jul 15 16:52:34.077727 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:52:34.077700 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod654d17f2_b2f8_4f13_a417_f070684091bc.slice/crio-f3cf24eb8e2546fc0553db2fae4fc1cb6bc2b9a2724abcf5ff468d01e5435115 WatchSource:0}: Error finding container f3cf24eb8e2546fc0553db2fae4fc1cb6bc2b9a2724abcf5ff468d01e5435115: Status 404 returned error can't find the container with id f3cf24eb8e2546fc0553db2fae4fc1cb6bc2b9a2724abcf5ff468d01e5435115 Jul 15 16:52:34.078966 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:34.078951 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 16:52:34.128233 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:34.128206 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77fd9784f8-whztm" Jul 15 16:52:34.260229 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:34.260206 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77fd9784f8-whztm"] Jul 15 16:52:34.262066 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:52:34.262028 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d6a61e6_bb63_455a_ac59_7e6e7ada32ee.slice/crio-464514b9fb6e56013dd3e48cc71487cef3072e376ae13507ac2fad82add45991 WatchSource:0}: Error finding container 464514b9fb6e56013dd3e48cc71487cef3072e376ae13507ac2fad82add45991: Status 404 returned error can't find the container with id 464514b9fb6e56013dd3e48cc71487cef3072e376ae13507ac2fad82add45991 Jul 15 16:52:34.358716 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:34.358686 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77fd9784f8-whztm" event={"ID":"6d6a61e6-bb63-455a-ac59-7e6e7ada32ee","Type":"ContainerStarted","Data":"464514b9fb6e56013dd3e48cc71487cef3072e376ae13507ac2fad82add45991"} Jul 15 16:52:34.359870 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:34.359841 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57b6598dc8-srqf7" event={"ID":"654d17f2-b2f8-4f13-a417-f070684091bc","Type":"ContainerStarted","Data":"f3cf24eb8e2546fc0553db2fae4fc1cb6bc2b9a2724abcf5ff468d01e5435115"} Jul 15 16:52:37.380729 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:37.380691 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57b6598dc8-srqf7" event={"ID":"654d17f2-b2f8-4f13-a417-f070684091bc","Type":"ContainerStarted","Data":"a964cc1ca85c9d3fa9dd91851844a5f1587c29700d361e9007a3148089c4b74f"} Jul 15 16:52:37.381184 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:37.380792 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-57b6598dc8-srqf7" Jul 15 16:52:37.382262 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:37.382239 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77fd9784f8-whztm" event={"ID":"6d6a61e6-bb63-455a-ac59-7e6e7ada32ee","Type":"ContainerStarted","Data":"f9d967b20b6e39d46ddb8e658ae33048806e167be02c19331e2b2d7f908ea082"} Jul 15 16:52:37.382373 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:37.382303 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-77fd9784f8-whztm" Jul 15 16:52:37.405124 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:37.405056 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-57b6598dc8-srqf7" podStartSLOduration=1.748288278 podStartE2EDuration="4.405044371s" totalImagesPullingTime="2.656756093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:52:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:52:37.402910368 +0000 UTC m=+743.830002463" watchObservedRunningTime="2026-07-15 16:52:37.405044371 +0000 UTC m=+743.832136453" Jul 15 16:52:37.427597 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:37.427544 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-77fd9784f8-whztm" podStartSLOduration=1.944204628 podStartE2EDuration="4.42752579s" totalImagesPullingTime="2.483321162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:52:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:52:37.426545483 +0000 UTC m=+743.853637566" watchObservedRunningTime="2026-07-15 16:52:37.42752579 +0000 UTC m=+743.854617876" Jul 15 16:52:48.389022 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:48.388989 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-57b6598dc8-srqf7" Jul 15 16:52:48.389615 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:48.389153 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-77fd9784f8-whztm" Jul 15 16:52:48.452611 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:48.452582 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-57b6598dc8-srqf7"] Jul 15 16:52:48.453025 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:48.452994 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-57b6598dc8-srqf7" podUID="654d17f2-b2f8-4f13-a417-f070684091bc" containerName="manager" containerID="cri-o://a964cc1ca85c9d3fa9dd91851844a5f1587c29700d361e9007a3148089c4b74f" gracePeriod=30 Jul 15 16:52:48.701660 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:48.701637 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57b6598dc8-srqf7" Jul 15 16:52:48.794380 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:48.794354 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/654d17f2-b2f8-4f13-a417-f070684091bc-webhook-cert\") pod \"654d17f2-b2f8-4f13-a417-f070684091bc\" (UID: \"654d17f2-b2f8-4f13-a417-f070684091bc\") " Jul 15 16:52:48.794521 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:48.794398 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cp5jr\" (UniqueName: \"kubernetes.io/projected/654d17f2-b2f8-4f13-a417-f070684091bc-kube-api-access-cp5jr\") pod \"654d17f2-b2f8-4f13-a417-f070684091bc\" (UID: \"654d17f2-b2f8-4f13-a417-f070684091bc\") " Jul 15 16:52:48.796454 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:48.796427 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/654d17f2-b2f8-4f13-a417-f070684091bc-kube-api-access-cp5jr" (OuterVolumeSpecName: "kube-api-access-cp5jr") pod "654d17f2-b2f8-4f13-a417-f070684091bc" (UID: "654d17f2-b2f8-4f13-a417-f070684091bc"). InnerVolumeSpecName "kube-api-access-cp5jr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 16:52:48.796577 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:48.796427 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/654d17f2-b2f8-4f13-a417-f070684091bc-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "654d17f2-b2f8-4f13-a417-f070684091bc" (UID: "654d17f2-b2f8-4f13-a417-f070684091bc"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 16:52:48.895819 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:48.895791 2559 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/654d17f2-b2f8-4f13-a417-f070684091bc-webhook-cert\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:52:48.895819 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:48.895817 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cp5jr\" (UniqueName: \"kubernetes.io/projected/654d17f2-b2f8-4f13-a417-f070684091bc-kube-api-access-cp5jr\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:52:49.443917 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:49.443882 2559 generic.go:356] "Generic (PLEG): container finished" podID="654d17f2-b2f8-4f13-a417-f070684091bc" containerID="a964cc1ca85c9d3fa9dd91851844a5f1587c29700d361e9007a3148089c4b74f" exitCode=0 Jul 15 16:52:49.444362 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:49.443927 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57b6598dc8-srqf7" Jul 15 16:52:49.444362 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:49.443961 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57b6598dc8-srqf7" event={"ID":"654d17f2-b2f8-4f13-a417-f070684091bc","Type":"ContainerDied","Data":"a964cc1ca85c9d3fa9dd91851844a5f1587c29700d361e9007a3148089c4b74f"} Jul 15 16:52:49.444362 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:49.444025 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57b6598dc8-srqf7" event={"ID":"654d17f2-b2f8-4f13-a417-f070684091bc","Type":"ContainerDied","Data":"f3cf24eb8e2546fc0553db2fae4fc1cb6bc2b9a2724abcf5ff468d01e5435115"} Jul 15 16:52:49.444362 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:49.444058 2559 scope.go:117] "RemoveContainer" containerID="a964cc1ca85c9d3fa9dd91851844a5f1587c29700d361e9007a3148089c4b74f" Jul 15 16:52:49.452650 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:49.452633 2559 scope.go:117] "RemoveContainer" containerID="a964cc1ca85c9d3fa9dd91851844a5f1587c29700d361e9007a3148089c4b74f" Jul 15 16:52:49.452906 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:52:49.452888 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a964cc1ca85c9d3fa9dd91851844a5f1587c29700d361e9007a3148089c4b74f\": container with ID starting with a964cc1ca85c9d3fa9dd91851844a5f1587c29700d361e9007a3148089c4b74f not found: ID does not exist" containerID="a964cc1ca85c9d3fa9dd91851844a5f1587c29700d361e9007a3148089c4b74f" Jul 15 16:52:49.452982 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:49.452915 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a964cc1ca85c9d3fa9dd91851844a5f1587c29700d361e9007a3148089c4b74f"} err="failed to get container status \"a964cc1ca85c9d3fa9dd91851844a5f1587c29700d361e9007a3148089c4b74f\": rpc error: code = NotFound desc = could not find container \"a964cc1ca85c9d3fa9dd91851844a5f1587c29700d361e9007a3148089c4b74f\": container with ID starting with a964cc1ca85c9d3fa9dd91851844a5f1587c29700d361e9007a3148089c4b74f not found: ID does not exist" Jul 15 16:52:49.464673 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:49.464650 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-57b6598dc8-srqf7"] Jul 15 16:52:49.467071 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:49.467049 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-57b6598dc8-srqf7"] Jul 15 16:52:50.173427 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:52:50.173392 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="654d17f2-b2f8-4f13-a417-f070684091bc" path="/var/lib/kubelet/pods/654d17f2-b2f8-4f13-a417-f070684091bc/volumes" Jul 15 16:53:08.985220 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:08.985182 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-659f59cc95-2mn77"] Jul 15 16:53:08.985697 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:08.985626 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="654d17f2-b2f8-4f13-a417-f070684091bc" containerName="manager" Jul 15 16:53:08.985697 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:08.985640 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="654d17f2-b2f8-4f13-a417-f070684091bc" containerName="manager" Jul 15 16:53:08.985831 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:08.985739 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="654d17f2-b2f8-4f13-a417-f070684091bc" containerName="manager" Jul 15 16:53:08.988811 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:08.988793 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-659f59cc95-2mn77" Jul 15 16:53:08.991204 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:08.991176 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 15 16:53:08.991204 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:08.991181 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 15 16:53:08.991409 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:08.991280 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 16:53:08.992129 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:08.992112 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-c44qh\"" Jul 15 16:53:08.999485 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:08.999465 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-659f59cc95-2mn77"] Jul 15 16:53:09.074653 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:09.074610 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93c1d572-3682-4135-a6c5-8a2ecafc93cf-openshift-service-ca\") pod \"maas-api-659f59cc95-2mn77\" (UID: \"93c1d572-3682-4135-a6c5-8a2ecafc93cf\") " pod="odh-ai-gateway-infra/maas-api-659f59cc95-2mn77" Jul 15 16:53:09.074865 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:09.074677 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93c1d572-3682-4135-a6c5-8a2ecafc93cf-maas-api-tls\") pod \"maas-api-659f59cc95-2mn77\" (UID: \"93c1d572-3682-4135-a6c5-8a2ecafc93cf\") " pod="odh-ai-gateway-infra/maas-api-659f59cc95-2mn77" Jul 15 16:53:09.074865 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:09.074696 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnhcg\" (UniqueName: \"kubernetes.io/projected/93c1d572-3682-4135-a6c5-8a2ecafc93cf-kube-api-access-qnhcg\") pod \"maas-api-659f59cc95-2mn77\" (UID: \"93c1d572-3682-4135-a6c5-8a2ecafc93cf\") " pod="odh-ai-gateway-infra/maas-api-659f59cc95-2mn77" Jul 15 16:53:09.176008 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:09.175965 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93c1d572-3682-4135-a6c5-8a2ecafc93cf-openshift-service-ca\") pod \"maas-api-659f59cc95-2mn77\" (UID: \"93c1d572-3682-4135-a6c5-8a2ecafc93cf\") " pod="odh-ai-gateway-infra/maas-api-659f59cc95-2mn77" Jul 15 16:53:09.176212 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:09.176028 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93c1d572-3682-4135-a6c5-8a2ecafc93cf-maas-api-tls\") pod \"maas-api-659f59cc95-2mn77\" (UID: \"93c1d572-3682-4135-a6c5-8a2ecafc93cf\") " pod="odh-ai-gateway-infra/maas-api-659f59cc95-2mn77" Jul 15 16:53:09.176212 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:09.176049 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnhcg\" (UniqueName: \"kubernetes.io/projected/93c1d572-3682-4135-a6c5-8a2ecafc93cf-kube-api-access-qnhcg\") pod \"maas-api-659f59cc95-2mn77\" (UID: \"93c1d572-3682-4135-a6c5-8a2ecafc93cf\") " pod="odh-ai-gateway-infra/maas-api-659f59cc95-2mn77" Jul 15 16:53:09.176405 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:53:09.176206 2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jul 15 16:53:09.176405 ip-10-0-132-162 kubenswrapper[2559]: E0715 16:53:09.176296 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93c1d572-3682-4135-a6c5-8a2ecafc93cf-maas-api-tls podName:93c1d572-3682-4135-a6c5-8a2ecafc93cf nodeName:}" failed. No retries permitted until 2026-07-15 16:53:09.676278692 +0000 UTC m=+776.103370767 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/93c1d572-3682-4135-a6c5-8a2ecafc93cf-maas-api-tls") pod "maas-api-659f59cc95-2mn77" (UID: "93c1d572-3682-4135-a6c5-8a2ecafc93cf") : secret "maas-api-serving-cert" not found Jul 15 16:53:09.176778 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:09.176727 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93c1d572-3682-4135-a6c5-8a2ecafc93cf-openshift-service-ca\") pod \"maas-api-659f59cc95-2mn77\" (UID: \"93c1d572-3682-4135-a6c5-8a2ecafc93cf\") " pod="odh-ai-gateway-infra/maas-api-659f59cc95-2mn77" Jul 15 16:53:09.185964 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:09.185937 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnhcg\" (UniqueName: \"kubernetes.io/projected/93c1d572-3682-4135-a6c5-8a2ecafc93cf-kube-api-access-qnhcg\") pod \"maas-api-659f59cc95-2mn77\" (UID: \"93c1d572-3682-4135-a6c5-8a2ecafc93cf\") " pod="odh-ai-gateway-infra/maas-api-659f59cc95-2mn77" Jul 15 16:53:09.585183 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:09.585148 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-xpc7d"] Jul 15 16:53:09.588869 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:09.588844 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-xpc7d" Jul 15 16:53:09.591902 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:09.591881 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 15 16:53:09.600530 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:09.600471 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-xpc7d"] Jul 15 16:53:09.680071 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:09.680041 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93c1d572-3682-4135-a6c5-8a2ecafc93cf-maas-api-tls\") pod \"maas-api-659f59cc95-2mn77\" (UID: \"93c1d572-3682-4135-a6c5-8a2ecafc93cf\") " pod="odh-ai-gateway-infra/maas-api-659f59cc95-2mn77" Jul 15 16:53:09.680244 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:09.680082 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5dfd5816-ec68-44b9-8ee4-50d3a2791f6a-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-xpc7d\" (UID: \"5dfd5816-ec68-44b9-8ee4-50d3a2791f6a\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-xpc7d" Jul 15 16:53:09.680244 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:09.680118 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khzfw\" (UniqueName: \"kubernetes.io/projected/5dfd5816-ec68-44b9-8ee4-50d3a2791f6a-kube-api-access-khzfw\") pod \"payload-pre-processing-74584bb9f8-xpc7d\" (UID: \"5dfd5816-ec68-44b9-8ee4-50d3a2791f6a\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-xpc7d" Jul 15 16:53:09.682376 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:09.682347 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93c1d572-3682-4135-a6c5-8a2ecafc93cf-maas-api-tls\") pod \"maas-api-659f59cc95-2mn77\" (UID: \"93c1d572-3682-4135-a6c5-8a2ecafc93cf\") " pod="odh-ai-gateway-infra/maas-api-659f59cc95-2mn77" Jul 15 16:53:09.781502 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:09.781460 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khzfw\" (UniqueName: \"kubernetes.io/projected/5dfd5816-ec68-44b9-8ee4-50d3a2791f6a-kube-api-access-khzfw\") pod \"payload-pre-processing-74584bb9f8-xpc7d\" (UID: \"5dfd5816-ec68-44b9-8ee4-50d3a2791f6a\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-xpc7d" Jul 15 16:53:09.781701 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:09.781549 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5dfd5816-ec68-44b9-8ee4-50d3a2791f6a-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-xpc7d\" (UID: \"5dfd5816-ec68-44b9-8ee4-50d3a2791f6a\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-xpc7d" Jul 15 16:53:09.782233 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:09.782213 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5dfd5816-ec68-44b9-8ee4-50d3a2791f6a-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-xpc7d\" (UID: \"5dfd5816-ec68-44b9-8ee4-50d3a2791f6a\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-xpc7d" Jul 15 16:53:09.789844 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:09.789824 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khzfw\" (UniqueName: \"kubernetes.io/projected/5dfd5816-ec68-44b9-8ee4-50d3a2791f6a-kube-api-access-khzfw\") pod \"payload-pre-processing-74584bb9f8-xpc7d\" (UID: \"5dfd5816-ec68-44b9-8ee4-50d3a2791f6a\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-xpc7d" Jul 15 16:53:09.900729 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:09.900640 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-659f59cc95-2mn77" Jul 15 16:53:09.900920 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:09.900739 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-xpc7d" Jul 15 16:53:10.260381 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:10.260334 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-xpc7d"] Jul 15 16:53:10.261981 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:53:10.261939 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dfd5816_ec68_44b9_8ee4_50d3a2791f6a.slice/crio-02e6f44ca9fdfd73034606912ee46077db04fa3157535be33bc1d5f8e0225b84 WatchSource:0}: Error finding container 02e6f44ca9fdfd73034606912ee46077db04fa3157535be33bc1d5f8e0225b84: Status 404 returned error can't find the container with id 02e6f44ca9fdfd73034606912ee46077db04fa3157535be33bc1d5f8e0225b84 Jul 15 16:53:10.285677 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:10.285656 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-659f59cc95-2mn77"] Jul 15 16:53:10.288408 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:53:10.288379 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93c1d572_3682_4135_a6c5_8a2ecafc93cf.slice/crio-939473944d36e56f114d39e9efa935b57ae28fe9b84cd4d4e10a7bf98d0d8bab WatchSource:0}: Error finding container 939473944d36e56f114d39e9efa935b57ae28fe9b84cd4d4e10a7bf98d0d8bab: Status 404 returned error can't find the container with id 939473944d36e56f114d39e9efa935b57ae28fe9b84cd4d4e10a7bf98d0d8bab Jul 15 16:53:10.549064 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:10.548982 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-xpc7d" event={"ID":"5dfd5816-ec68-44b9-8ee4-50d3a2791f6a","Type":"ContainerStarted","Data":"02e6f44ca9fdfd73034606912ee46077db04fa3157535be33bc1d5f8e0225b84"} Jul 15 16:53:10.550076 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:10.550052 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-659f59cc95-2mn77" event={"ID":"93c1d572-3682-4135-a6c5-8a2ecafc93cf","Type":"ContainerStarted","Data":"939473944d36e56f114d39e9efa935b57ae28fe9b84cd4d4e10a7bf98d0d8bab"} Jul 15 16:53:12.561260 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:12.561227 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-xpc7d" event={"ID":"5dfd5816-ec68-44b9-8ee4-50d3a2791f6a","Type":"ContainerStarted","Data":"691ee23d41b1a27d0093f97a6036852c2205074ab802f5c1846931a9a0257bf0"} Jul 15 16:53:12.561694 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:12.561381 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-xpc7d" Jul 15 16:53:12.562654 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:12.562633 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-659f59cc95-2mn77" event={"ID":"93c1d572-3682-4135-a6c5-8a2ecafc93cf","Type":"ContainerStarted","Data":"88c74d879c83abad20e88d0567fa66e8533bd4d58984cc4e4268df59a4560b19"} Jul 15 16:53:12.562788 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:12.562715 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-659f59cc95-2mn77" Jul 15 16:53:12.579150 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:12.579103 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-xpc7d" podStartSLOduration=2.002371928 podStartE2EDuration="3.579090378s" totalImagesPullingTime="1.57671845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:53:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:53:12.57735332 +0000 UTC m=+779.004445403" watchObservedRunningTime="2026-07-15 16:53:12.579090378 +0000 UTC m=+779.006182461" Jul 15 16:53:12.598059 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:12.598015 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-659f59cc95-2mn77" podStartSLOduration=3.044279899 podStartE2EDuration="4.598002392s" totalImagesPullingTime="1.553722493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:53:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:53:12.59562105 +0000 UTC m=+779.022713155" watchObservedRunningTime="2026-07-15 16:53:12.598002392 +0000 UTC m=+779.025094475" Jul 15 16:53:18.573158 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:18.573131 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-659f59cc95-2mn77" Jul 15 16:53:23.570134 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:23.570099 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-xpc7d" Jul 15 16:53:43.332075 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:43.331994 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qf72d"] Jul 15 16:53:43.337125 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:43.337105 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qf72d" Jul 15 16:53:43.340711 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:43.340679 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 15 16:53:43.340867 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:43.340730 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hh5sk\"" Jul 15 16:53:43.340867 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:43.340792 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 15 16:53:43.340867 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:43.340794 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 15 16:53:43.345804 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:43.345785 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qf72d"] Jul 15 16:53:43.376121 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:43.376081 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cc7ee18-7ca4-4995-8376-9b3ba4f66ecf-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qf72d\" (UID: \"9cc7ee18-7ca4-4995-8376-9b3ba4f66ecf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qf72d" Jul 15 16:53:43.376248 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:43.376124 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cc7ee18-7ca4-4995-8376-9b3ba4f66ecf-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qf72d\" (UID: \"9cc7ee18-7ca4-4995-8376-9b3ba4f66ecf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qf72d" Jul 15 16:53:43.376248 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:43.376142 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cc7ee18-7ca4-4995-8376-9b3ba4f66ecf-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qf72d\" (UID: \"9cc7ee18-7ca4-4995-8376-9b3ba4f66ecf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qf72d" Jul 15 16:53:43.376248 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:43.376166 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cc7ee18-7ca4-4995-8376-9b3ba4f66ecf-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qf72d\" (UID: \"9cc7ee18-7ca4-4995-8376-9b3ba4f66ecf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qf72d" Jul 15 16:53:43.376248 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:43.376182 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsq52\" (UniqueName: \"kubernetes.io/projected/9cc7ee18-7ca4-4995-8376-9b3ba4f66ecf-kube-api-access-bsq52\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qf72d\" (UID: \"9cc7ee18-7ca4-4995-8376-9b3ba4f66ecf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qf72d" Jul 15 16:53:43.376448 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:43.376313 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cc7ee18-7ca4-4995-8376-9b3ba4f66ecf-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qf72d\" (UID: \"9cc7ee18-7ca4-4995-8376-9b3ba4f66ecf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qf72d" Jul 15 16:53:43.477227 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:43.477199 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cc7ee18-7ca4-4995-8376-9b3ba4f66ecf-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qf72d\" (UID: \"9cc7ee18-7ca4-4995-8376-9b3ba4f66ecf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qf72d" Jul 15 16:53:43.477227 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:43.477227 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cc7ee18-7ca4-4995-8376-9b3ba4f66ecf-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qf72d\" (UID: \"9cc7ee18-7ca4-4995-8376-9b3ba4f66ecf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qf72d" Jul 15 16:53:43.477429 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:43.477247 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cc7ee18-7ca4-4995-8376-9b3ba4f66ecf-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qf72d\" (UID: \"9cc7ee18-7ca4-4995-8376-9b3ba4f66ecf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qf72d" Jul 15 16:53:43.477429 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:43.477270 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cc7ee18-7ca4-4995-8376-9b3ba4f66ecf-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qf72d\" (UID: \"9cc7ee18-7ca4-4995-8376-9b3ba4f66ecf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qf72d" Jul 15 16:53:43.477429 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:43.477287 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsq52\" (UniqueName: \"kubernetes.io/projected/9cc7ee18-7ca4-4995-8376-9b3ba4f66ecf-kube-api-access-bsq52\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qf72d\" (UID: \"9cc7ee18-7ca4-4995-8376-9b3ba4f66ecf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qf72d" Jul 15 16:53:43.477429 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:43.477349 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cc7ee18-7ca4-4995-8376-9b3ba4f66ecf-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qf72d\" (UID: \"9cc7ee18-7ca4-4995-8376-9b3ba4f66ecf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qf72d" Jul 15 16:53:43.477660 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:43.477634 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cc7ee18-7ca4-4995-8376-9b3ba4f66ecf-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qf72d\" (UID: \"9cc7ee18-7ca4-4995-8376-9b3ba4f66ecf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qf72d" Jul 15 16:53:43.477719 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:43.477642 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cc7ee18-7ca4-4995-8376-9b3ba4f66ecf-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qf72d\" (UID: \"9cc7ee18-7ca4-4995-8376-9b3ba4f66ecf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qf72d" Jul 15 16:53:43.477784 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:43.477714 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cc7ee18-7ca4-4995-8376-9b3ba4f66ecf-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qf72d\" (UID: \"9cc7ee18-7ca4-4995-8376-9b3ba4f66ecf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qf72d" Jul 15 16:53:43.479455 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:43.479435 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cc7ee18-7ca4-4995-8376-9b3ba4f66ecf-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qf72d\" (UID: \"9cc7ee18-7ca4-4995-8376-9b3ba4f66ecf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qf72d" Jul 15 16:53:43.479722 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:43.479705 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cc7ee18-7ca4-4995-8376-9b3ba4f66ecf-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qf72d\" (UID: \"9cc7ee18-7ca4-4995-8376-9b3ba4f66ecf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qf72d" Jul 15 16:53:43.485276 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:43.485256 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsq52\" (UniqueName: \"kubernetes.io/projected/9cc7ee18-7ca4-4995-8376-9b3ba4f66ecf-kube-api-access-bsq52\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qf72d\" (UID: \"9cc7ee18-7ca4-4995-8376-9b3ba4f66ecf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qf72d" Jul 15 16:53:43.648524 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:43.648441 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qf72d" Jul 15 16:53:43.783329 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:43.783303 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qf72d"] Jul 15 16:53:43.785135 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:53:43.785105 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cc7ee18_7ca4_4995_8376_9b3ba4f66ecf.slice/crio-1f9d87900448a9ce3eda89b3766438b8872cea73e3a435b3283ae6a0285dcb83 WatchSource:0}: Error finding container 1f9d87900448a9ce3eda89b3766438b8872cea73e3a435b3283ae6a0285dcb83: Status 404 returned error can't find the container with id 1f9d87900448a9ce3eda89b3766438b8872cea73e3a435b3283ae6a0285dcb83 Jul 15 16:53:44.727208 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:44.727172 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qf72d" event={"ID":"9cc7ee18-7ca4-4995-8376-9b3ba4f66ecf","Type":"ContainerStarted","Data":"1f9d87900448a9ce3eda89b3766438b8872cea73e3a435b3283ae6a0285dcb83"} Jul 15 16:53:45.734348 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:45.734312 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qf72d" event={"ID":"9cc7ee18-7ca4-4995-8376-9b3ba4f66ecf","Type":"ContainerStarted","Data":"41ff155633b71176f41ac3b1602e4b65643df67283098230eec4cdf3f534a1ad"} Jul 15 16:53:45.754358 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:45.754309 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qf72d" podStartSLOduration=1.707167889 podStartE2EDuration="2.754293011s" totalImagesPullingTime="1.047125122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:53:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:53:45.751793364 +0000 UTC m=+812.178885443" watchObservedRunningTime="2026-07-15 16:53:45.754293011 +0000 UTC m=+812.181385093" Jul 15 16:53:53.648672 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:53.648636 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qf72d" Jul 15 16:53:53.649048 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:53.648699 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qf72d" Jul 15 16:53:53.660934 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:53.660913 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qf72d" Jul 15 16:53:53.784069 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:53:53.784038 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qf72d" Jul 15 16:54:03.632164 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:54:03.632130 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zz4z2"] Jul 15 16:54:03.636180 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:54:03.636160 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz4z2" Jul 15 16:54:03.638528 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:54:03.638510 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 15 16:54:03.649165 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:54:03.649131 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zz4z2"] Jul 15 16:54:03.756147 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:54:03.756102 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ececdd4-6d0f-4cb0-a7da-f4cbbb41b1a5-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zz4z2\" (UID: \"4ececdd4-6d0f-4cb0-a7da-f4cbbb41b1a5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz4z2" Jul 15 16:54:03.756353 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:54:03.756156 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsp5g\" (UniqueName: \"kubernetes.io/projected/4ececdd4-6d0f-4cb0-a7da-f4cbbb41b1a5-kube-api-access-vsp5g\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zz4z2\" (UID: \"4ececdd4-6d0f-4cb0-a7da-f4cbbb41b1a5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz4z2" Jul 15 16:54:03.756353 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:54:03.756225 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ececdd4-6d0f-4cb0-a7da-f4cbbb41b1a5-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zz4z2\" (UID: \"4ececdd4-6d0f-4cb0-a7da-f4cbbb41b1a5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz4z2" Jul 15 16:54:03.756353 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:54:03.756274 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ececdd4-6d0f-4cb0-a7da-f4cbbb41b1a5-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zz4z2\" (UID: \"4ececdd4-6d0f-4cb0-a7da-f4cbbb41b1a5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz4z2" Jul 15 16:54:03.756353 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:54:03.756309 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ececdd4-6d0f-4cb0-a7da-f4cbbb41b1a5-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zz4z2\" (UID: \"4ececdd4-6d0f-4cb0-a7da-f4cbbb41b1a5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz4z2" Jul 15 16:54:03.756523 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:54:03.756369 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ececdd4-6d0f-4cb0-a7da-f4cbbb41b1a5-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zz4z2\" (UID: \"4ececdd4-6d0f-4cb0-a7da-f4cbbb41b1a5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz4z2" Jul 15 16:54:03.857616 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:54:03.857581 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ececdd4-6d0f-4cb0-a7da-f4cbbb41b1a5-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zz4z2\" (UID: \"4ececdd4-6d0f-4cb0-a7da-f4cbbb41b1a5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz4z2" Jul 15 16:54:03.857815 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:54:03.857636 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ececdd4-6d0f-4cb0-a7da-f4cbbb41b1a5-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zz4z2\" (UID: \"4ececdd4-6d0f-4cb0-a7da-f4cbbb41b1a5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz4z2" Jul 15 16:54:03.857815 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:54:03.857671 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ececdd4-6d0f-4cb0-a7da-f4cbbb41b1a5-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zz4z2\" (UID: \"4ececdd4-6d0f-4cb0-a7da-f4cbbb41b1a5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz4z2" Jul 15 16:54:03.857815 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:54:03.857717 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ececdd4-6d0f-4cb0-a7da-f4cbbb41b1a5-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zz4z2\" (UID: \"4ececdd4-6d0f-4cb0-a7da-f4cbbb41b1a5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz4z2" Jul 15 16:54:03.857815 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:54:03.857763 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ececdd4-6d0f-4cb0-a7da-f4cbbb41b1a5-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zz4z2\" (UID: \"4ececdd4-6d0f-4cb0-a7da-f4cbbb41b1a5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz4z2" Jul 15 16:54:03.857815 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:54:03.857797 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsp5g\" (UniqueName: \"kubernetes.io/projected/4ececdd4-6d0f-4cb0-a7da-f4cbbb41b1a5-kube-api-access-vsp5g\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zz4z2\" (UID: \"4ececdd4-6d0f-4cb0-a7da-f4cbbb41b1a5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz4z2" Jul 15 16:54:03.858158 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:54:03.858130 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ececdd4-6d0f-4cb0-a7da-f4cbbb41b1a5-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zz4z2\" (UID: \"4ececdd4-6d0f-4cb0-a7da-f4cbbb41b1a5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz4z2" Jul 15 16:54:03.858221 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:54:03.858158 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ececdd4-6d0f-4cb0-a7da-f4cbbb41b1a5-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zz4z2\" (UID: \"4ececdd4-6d0f-4cb0-a7da-f4cbbb41b1a5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz4z2" Jul 15 16:54:03.858221 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:54:03.858201 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ececdd4-6d0f-4cb0-a7da-f4cbbb41b1a5-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zz4z2\" (UID: \"4ececdd4-6d0f-4cb0-a7da-f4cbbb41b1a5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz4z2" Jul 15 16:54:03.859922 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:54:03.859897 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ececdd4-6d0f-4cb0-a7da-f4cbbb41b1a5-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zz4z2\" (UID: \"4ececdd4-6d0f-4cb0-a7da-f4cbbb41b1a5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz4z2" Jul 15 16:54:03.860176 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:54:03.860155 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ececdd4-6d0f-4cb0-a7da-f4cbbb41b1a5-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zz4z2\" (UID: \"4ececdd4-6d0f-4cb0-a7da-f4cbbb41b1a5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz4z2" Jul 15 16:54:03.866433 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:54:03.866412 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsp5g\" (UniqueName: \"kubernetes.io/projected/4ececdd4-6d0f-4cb0-a7da-f4cbbb41b1a5-kube-api-access-vsp5g\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zz4z2\" (UID: \"4ececdd4-6d0f-4cb0-a7da-f4cbbb41b1a5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz4z2" Jul 15 16:54:03.950682 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:54:03.950648 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz4z2" Jul 15 16:54:04.083521 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:54:04.083495 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zz4z2"] Jul 15 16:54:04.085446 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:54:04.085425 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ececdd4_6d0f_4cb0_a7da_f4cbbb41b1a5.slice/crio-d5f29fa375b73abe5ec82b64c2c291f311d1fe7a574bca79f8aff08cfa19255e WatchSource:0}: Error finding container d5f29fa375b73abe5ec82b64c2c291f311d1fe7a574bca79f8aff08cfa19255e: Status 404 returned error can't find the container with id d5f29fa375b73abe5ec82b64c2c291f311d1fe7a574bca79f8aff08cfa19255e Jul 15 16:54:04.830856 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:54:04.830816 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz4z2" event={"ID":"4ececdd4-6d0f-4cb0-a7da-f4cbbb41b1a5","Type":"ContainerStarted","Data":"5541552bbb9b99c73360c3ebd366f40da70022a2a18c8bc38a9677288b930628"} Jul 15 16:54:04.831206 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:54:04.830877 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz4z2" event={"ID":"4ececdd4-6d0f-4cb0-a7da-f4cbbb41b1a5","Type":"ContainerStarted","Data":"d5f29fa375b73abe5ec82b64c2c291f311d1fe7a574bca79f8aff08cfa19255e"} Jul 15 16:54:04.848040 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:54:04.847990 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz4z2" podStartSLOduration=1.660186851 podStartE2EDuration="1.847971956s" totalImagesPullingTime="187.785105ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:54:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:54:04.847398082 +0000 UTC m=+831.274490167" watchObservedRunningTime="2026-07-15 16:54:04.847971956 +0000 UTC m=+831.275064039" Jul 15 16:54:13.950771 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:54:13.950722 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz4z2" Jul 15 16:54:13.951347 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:54:13.950819 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz4z2" Jul 15 16:54:13.963407 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:54:13.963379 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz4z2" Jul 15 16:54:14.893681 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:54:14.893648 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz4z2" Jul 15 16:55:14.074266 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:55:14.074225 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vcxdn_268a4cb9-c310-4681-91a6-efe9692f8327/console-operator/2.log" Jul 15 16:55:14.074708 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:55:14.074404 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vcxdn_268a4cb9-c310-4681-91a6-efe9692f8327/console-operator/2.log" Jul 15 16:55:14.078112 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:55:14.078092 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxsr7_1e30c2c6-c7eb-42ca-add5-239c71eafd0d/ovn-acl-logging/0.log" Jul 15 16:55:14.078614 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:55:14.078600 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxsr7_1e30c2c6-c7eb-42ca-add5-239c71eafd0d/ovn-acl-logging/0.log" Jul 15 16:56:19.354303 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:56:19.354249 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-77fd9784f8-whztm"] Jul 15 16:56:19.354999 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:56:19.354610 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-77fd9784f8-whztm" podUID="6d6a61e6-bb63-455a-ac59-7e6e7ada32ee" containerName="manager" containerID="cri-o://f9d967b20b6e39d46ddb8e658ae33048806e167be02c19331e2b2d7f908ea082" gracePeriod=30 Jul 15 16:56:19.519090 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:56:19.519061 2559 generic.go:356] "Generic (PLEG): container finished" podID="6d6a61e6-bb63-455a-ac59-7e6e7ada32ee" containerID="f9d967b20b6e39d46ddb8e658ae33048806e167be02c19331e2b2d7f908ea082" exitCode=0 Jul 15 16:56:19.519281 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:56:19.519114 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77fd9784f8-whztm" event={"ID":"6d6a61e6-bb63-455a-ac59-7e6e7ada32ee","Type":"ContainerDied","Data":"f9d967b20b6e39d46ddb8e658ae33048806e167be02c19331e2b2d7f908ea082"} Jul 15 16:56:19.605692 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:56:19.605637 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77fd9784f8-whztm" Jul 15 16:56:19.639239 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:56:19.639208 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dq6q\" (UniqueName: \"kubernetes.io/projected/6d6a61e6-bb63-455a-ac59-7e6e7ada32ee-kube-api-access-5dq6q\") pod \"6d6a61e6-bb63-455a-ac59-7e6e7ada32ee\" (UID: \"6d6a61e6-bb63-455a-ac59-7e6e7ada32ee\") " Jul 15 16:56:19.639395 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:56:19.639349 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d6a61e6-bb63-455a-ac59-7e6e7ada32ee-webhook-cert\") pod \"6d6a61e6-bb63-455a-ac59-7e6e7ada32ee\" (UID: \"6d6a61e6-bb63-455a-ac59-7e6e7ada32ee\") " Jul 15 16:56:19.641273 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:56:19.641241 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d6a61e6-bb63-455a-ac59-7e6e7ada32ee-kube-api-access-5dq6q" (OuterVolumeSpecName: "kube-api-access-5dq6q") pod "6d6a61e6-bb63-455a-ac59-7e6e7ada32ee" (UID: "6d6a61e6-bb63-455a-ac59-7e6e7ada32ee"). InnerVolumeSpecName "kube-api-access-5dq6q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 16:56:19.641676 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:56:19.641655 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d6a61e6-bb63-455a-ac59-7e6e7ada32ee-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6d6a61e6-bb63-455a-ac59-7e6e7ada32ee" (UID: "6d6a61e6-bb63-455a-ac59-7e6e7ada32ee"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 16:56:19.740345 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:56:19.740318 2559 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d6a61e6-bb63-455a-ac59-7e6e7ada32ee-webhook-cert\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:56:19.740345 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:56:19.740343 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dq6q\" (UniqueName: \"kubernetes.io/projected/6d6a61e6-bb63-455a-ac59-7e6e7ada32ee-kube-api-access-5dq6q\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 16:56:20.525657 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:56:20.525575 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77fd9784f8-whztm" event={"ID":"6d6a61e6-bb63-455a-ac59-7e6e7ada32ee","Type":"ContainerDied","Data":"464514b9fb6e56013dd3e48cc71487cef3072e376ae13507ac2fad82add45991"} Jul 15 16:56:20.525657 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:56:20.525618 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77fd9784f8-whztm" Jul 15 16:56:20.525657 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:56:20.525634 2559 scope.go:117] "RemoveContainer" containerID="f9d967b20b6e39d46ddb8e658ae33048806e167be02c19331e2b2d7f908ea082" Jul 15 16:56:20.541305 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:56:20.541278 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-77fd9784f8-whztm"] Jul 15 16:56:20.544992 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:56:20.544969 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-77fd9784f8-whztm"] Jul 15 16:56:21.308143 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:56:21.308109 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-77fd9784f8-sxlt5"] Jul 15 16:56:21.308544 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:56:21.308530 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d6a61e6-bb63-455a-ac59-7e6e7ada32ee" containerName="manager" Jul 15 16:56:21.308613 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:56:21.308545 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d6a61e6-bb63-455a-ac59-7e6e7ada32ee" containerName="manager" Jul 15 16:56:21.308655 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:56:21.308636 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d6a61e6-bb63-455a-ac59-7e6e7ada32ee" containerName="manager" Jul 15 16:56:21.313042 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:56:21.313024 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77fd9784f8-sxlt5" Jul 15 16:56:21.316098 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:56:21.316080 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 15 16:56:21.317017 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:56:21.317001 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 15 16:56:21.317113 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:56:21.317084 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nbxxv\"" Jul 15 16:56:21.326662 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:56:21.326639 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77fd9784f8-sxlt5"] Jul 15 16:56:21.354931 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:56:21.354897 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/904e7b42-202f-4d55-a81e-d42e6af9b820-webhook-cert\") pod \"maas-controller-77fd9784f8-sxlt5\" (UID: \"904e7b42-202f-4d55-a81e-d42e6af9b820\") " pod="opendatahub/maas-controller-77fd9784f8-sxlt5" Jul 15 16:56:21.355092 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:56:21.355000 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-764qh\" (UniqueName: \"kubernetes.io/projected/904e7b42-202f-4d55-a81e-d42e6af9b820-kube-api-access-764qh\") pod \"maas-controller-77fd9784f8-sxlt5\" (UID: \"904e7b42-202f-4d55-a81e-d42e6af9b820\") " pod="opendatahub/maas-controller-77fd9784f8-sxlt5" Jul 15 16:56:21.455999 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:56:21.455966 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/904e7b42-202f-4d55-a81e-d42e6af9b820-webhook-cert\") pod \"maas-controller-77fd9784f8-sxlt5\" (UID: \"904e7b42-202f-4d55-a81e-d42e6af9b820\") " pod="opendatahub/maas-controller-77fd9784f8-sxlt5" Jul 15 16:56:21.456168 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:56:21.456044 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-764qh\" (UniqueName: \"kubernetes.io/projected/904e7b42-202f-4d55-a81e-d42e6af9b820-kube-api-access-764qh\") pod \"maas-controller-77fd9784f8-sxlt5\" (UID: \"904e7b42-202f-4d55-a81e-d42e6af9b820\") " pod="opendatahub/maas-controller-77fd9784f8-sxlt5" Jul 15 16:56:21.458300 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:56:21.458278 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/904e7b42-202f-4d55-a81e-d42e6af9b820-webhook-cert\") pod \"maas-controller-77fd9784f8-sxlt5\" (UID: \"904e7b42-202f-4d55-a81e-d42e6af9b820\") " pod="opendatahub/maas-controller-77fd9784f8-sxlt5" Jul 15 16:56:21.464018 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:56:21.463995 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-764qh\" (UniqueName: \"kubernetes.io/projected/904e7b42-202f-4d55-a81e-d42e6af9b820-kube-api-access-764qh\") pod \"maas-controller-77fd9784f8-sxlt5\" (UID: \"904e7b42-202f-4d55-a81e-d42e6af9b820\") " pod="opendatahub/maas-controller-77fd9784f8-sxlt5" Jul 15 16:56:21.625437 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:56:21.625342 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77fd9784f8-sxlt5" Jul 15 16:56:21.762732 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:56:21.762703 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77fd9784f8-sxlt5"] Jul 15 16:56:21.764929 ip-10-0-132-162 kubenswrapper[2559]: W0715 16:56:21.764898 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod904e7b42_202f_4d55_a81e_d42e6af9b820.slice/crio-7bdea3d7f02531d05e388ad3d53ad9f553f2b8435182170bc268c2a88b4364ba WatchSource:0}: Error finding container 7bdea3d7f02531d05e388ad3d53ad9f553f2b8435182170bc268c2a88b4364ba: Status 404 returned error can't find the container with id 7bdea3d7f02531d05e388ad3d53ad9f553f2b8435182170bc268c2a88b4364ba Jul 15 16:56:22.173380 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:56:22.173344 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d6a61e6-bb63-455a-ac59-7e6e7ada32ee" path="/var/lib/kubelet/pods/6d6a61e6-bb63-455a-ac59-7e6e7ada32ee/volumes" Jul 15 16:56:22.538608 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:56:22.538511 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77fd9784f8-sxlt5" event={"ID":"904e7b42-202f-4d55-a81e-d42e6af9b820","Type":"ContainerStarted","Data":"ae76e73a29e57cd6c3a011811e8dd9a5dae05b3be480e078f136b6f94d7b957e"} Jul 15 16:56:22.538608 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:56:22.538572 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77fd9784f8-sxlt5" event={"ID":"904e7b42-202f-4d55-a81e-d42e6af9b820","Type":"ContainerStarted","Data":"7bdea3d7f02531d05e388ad3d53ad9f553f2b8435182170bc268c2a88b4364ba"} Jul 15 16:56:22.538608 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:56:22.538606 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-77fd9784f8-sxlt5" Jul 15 16:56:22.556353 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:56:22.556294 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-77fd9784f8-sxlt5" podStartSLOduration=1.102426093 podStartE2EDuration="1.55627557s" totalImagesPullingTime="453.849477ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:56:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:56:22.554181614 +0000 UTC m=+968.981273714" watchObservedRunningTime="2026-07-15 16:56:22.55627557 +0000 UTC m=+968.983367651" Jul 15 16:56:33.551263 ip-10-0-132-162 kubenswrapper[2559]: I0715 16:56:33.551232 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-77fd9784f8-sxlt5" Jul 15 17:00:00.144149 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:00:00.144060 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735580-f498m"] Jul 15 17:00:00.147846 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:00:00.147825 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735580-f498m" Jul 15 17:00:00.150108 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:00:00.150091 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nthsz\"" Jul 15 17:00:00.157463 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:00:00.157444 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735580-f498m" Jul 15 17:00:00.176918 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:00:00.176893 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735580-f498m"] Jul 15 17:00:00.297592 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:00:00.297567 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735580-f498m"] Jul 15 17:00:00.299328 ip-10-0-132-162 kubenswrapper[2559]: W0715 17:00:00.299301 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23fedaf4_a58d_4244_8ed5_9d268786c675.slice/crio-00b1ca9a44f14e6aaca03133cd1a1ce783713a0c58f711e6b933bf5158860634 WatchSource:0}: Error finding container 00b1ca9a44f14e6aaca03133cd1a1ce783713a0c58f711e6b933bf5158860634: Status 404 returned error can't find the container with id 00b1ca9a44f14e6aaca03133cd1a1ce783713a0c58f711e6b933bf5158860634 Jul 15 17:00:00.301113 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:00:00.301097 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 17:00:00.673370 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:00:00.673337 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735580-f498m" event={"ID":"23fedaf4-a58d-4244-8ed5-9d268786c675","Type":"ContainerStarted","Data":"00b1ca9a44f14e6aaca03133cd1a1ce783713a0c58f711e6b933bf5158860634"} Jul 15 17:00:06.705914 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:00:06.705867 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735580-f498m" event={"ID":"23fedaf4-a58d-4244-8ed5-9d268786c675","Type":"ContainerStarted","Data":"279964f878231f88062f911a0b370e208033d5ff728cf986d5fad87138dcc730"} Jul 15 17:00:06.722836 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:00:06.722777 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735580-f498m" podStartSLOduration=0.830300632 podStartE2EDuration="6.72273279s" totalImagesPullingTime="5.892432158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:00:06.722569366 +0000 UTC m=+1193.149661449" watchObservedRunningTime="2026-07-15 17:00:06.72273279 +0000 UTC m=+1193.149824871" Jul 15 17:00:07.712689 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:00:07.712656 2559 generic.go:356] "Generic (PLEG): container finished" podID="23fedaf4-a58d-4244-8ed5-9d268786c675" containerID="279964f878231f88062f911a0b370e208033d5ff728cf986d5fad87138dcc730" exitCode=0 Jul 15 17:00:07.713065 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:00:07.712714 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735580-f498m" event={"ID":"23fedaf4-a58d-4244-8ed5-9d268786c675","Type":"ContainerDied","Data":"279964f878231f88062f911a0b370e208033d5ff728cf986d5fad87138dcc730"} Jul 15 17:00:08.852272 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:00:08.852246 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735580-f498m" Jul 15 17:00:09.730326 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:00:09.730291 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735580-f498m" Jul 15 17:00:09.730496 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:00:09.730329 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735580-f498m" event={"ID":"23fedaf4-a58d-4244-8ed5-9d268786c675","Type":"ContainerDied","Data":"00b1ca9a44f14e6aaca03133cd1a1ce783713a0c58f711e6b933bf5158860634"} Jul 15 17:00:09.730496 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:00:09.730395 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="00b1ca9a44f14e6aaca03133cd1a1ce783713a0c58f711e6b933bf5158860634" Jul 15 17:00:14.118113 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:00:14.118089 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vcxdn_268a4cb9-c310-4681-91a6-efe9692f8327/console-operator/2.log" Jul 15 17:00:14.118535 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:00:14.118371 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vcxdn_268a4cb9-c310-4681-91a6-efe9692f8327/console-operator/2.log" Jul 15 17:00:14.122720 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:00:14.122689 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxsr7_1e30c2c6-c7eb-42ca-add5-239c71eafd0d/ovn-acl-logging/0.log" Jul 15 17:00:14.122871 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:00:14.122804 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxsr7_1e30c2c6-c7eb-42ca-add5-239c71eafd0d/ovn-acl-logging/0.log" Jul 15 17:01:07.275586 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:01:07.275460 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x4mbs"] Jul 15 17:01:07.277288 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:01:07.275777 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x4mbs" podUID="5029ef3c-df69-4a67-8c23-98530564ee95" containerName="manager" containerID="cri-o://06978be6a616a187163dc414735757e816095fd1b60e407d686e537a67847724" gracePeriod=10 Jul 15 17:01:09.335008 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:01:09.334983 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x4mbs" Jul 15 17:01:09.428478 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:01:09.428451 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5029ef3c-df69-4a67-8c23-98530564ee95-extensions-socket-volume\") pod \"5029ef3c-df69-4a67-8c23-98530564ee95\" (UID: \"5029ef3c-df69-4a67-8c23-98530564ee95\") " Jul 15 17:01:09.428631 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:01:09.428518 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgxxv\" (UniqueName: \"kubernetes.io/projected/5029ef3c-df69-4a67-8c23-98530564ee95-kube-api-access-zgxxv\") pod \"5029ef3c-df69-4a67-8c23-98530564ee95\" (UID: \"5029ef3c-df69-4a67-8c23-98530564ee95\") " Jul 15 17:01:09.428884 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:01:09.428858 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5029ef3c-df69-4a67-8c23-98530564ee95-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5029ef3c-df69-4a67-8c23-98530564ee95" (UID: "5029ef3c-df69-4a67-8c23-98530564ee95"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 17:01:09.430406 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:01:09.430385 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5029ef3c-df69-4a67-8c23-98530564ee95-kube-api-access-zgxxv" (OuterVolumeSpecName: "kube-api-access-zgxxv") pod "5029ef3c-df69-4a67-8c23-98530564ee95" (UID: "5029ef3c-df69-4a67-8c23-98530564ee95"). InnerVolumeSpecName "kube-api-access-zgxxv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 17:01:09.529720 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:01:09.529686 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5029ef3c-df69-4a67-8c23-98530564ee95-extensions-socket-volume\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 17:01:09.529720 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:01:09.529711 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgxxv\" (UniqueName: \"kubernetes.io/projected/5029ef3c-df69-4a67-8c23-98530564ee95-kube-api-access-zgxxv\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 17:01:10.057572 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:01:10.057537 2559 generic.go:356] "Generic (PLEG): container finished" podID="5029ef3c-df69-4a67-8c23-98530564ee95" containerID="06978be6a616a187163dc414735757e816095fd1b60e407d686e537a67847724" exitCode=0 Jul 15 17:01:10.057733 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:01:10.057582 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x4mbs" Jul 15 17:01:10.057733 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:01:10.057615 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x4mbs" event={"ID":"5029ef3c-df69-4a67-8c23-98530564ee95","Type":"ContainerDied","Data":"06978be6a616a187163dc414735757e816095fd1b60e407d686e537a67847724"} Jul 15 17:01:10.057733 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:01:10.057669 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x4mbs" event={"ID":"5029ef3c-df69-4a67-8c23-98530564ee95","Type":"ContainerDied","Data":"db7ac408a62ed6f7edc3054f5a3d548423c6fdb5d2ccc71b18ba3d80876e7c48"} Jul 15 17:01:10.057733 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:01:10.057684 2559 scope.go:117] "RemoveContainer" containerID="06978be6a616a187163dc414735757e816095fd1b60e407d686e537a67847724" Jul 15 17:01:10.067875 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:01:10.067859 2559 scope.go:117] "RemoveContainer" containerID="06978be6a616a187163dc414735757e816095fd1b60e407d686e537a67847724" Jul 15 17:01:10.068127 ip-10-0-132-162 kubenswrapper[2559]: E0715 17:01:10.068101 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06978be6a616a187163dc414735757e816095fd1b60e407d686e537a67847724\": container with ID starting with 06978be6a616a187163dc414735757e816095fd1b60e407d686e537a67847724 not found: ID does not exist" containerID="06978be6a616a187163dc414735757e816095fd1b60e407d686e537a67847724" Jul 15 17:01:10.068219 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:01:10.068135 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06978be6a616a187163dc414735757e816095fd1b60e407d686e537a67847724"} err="failed to get container status \"06978be6a616a187163dc414735757e816095fd1b60e407d686e537a67847724\": rpc error: code = NotFound desc = could not find container \"06978be6a616a187163dc414735757e816095fd1b60e407d686e537a67847724\": container with ID starting with 06978be6a616a187163dc414735757e816095fd1b60e407d686e537a67847724 not found: ID does not exist" Jul 15 17:01:10.079287 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:01:10.079261 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x4mbs"] Jul 15 17:01:10.082168 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:01:10.082144 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x4mbs"] Jul 15 17:01:10.172190 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:01:10.172160 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5029ef3c-df69-4a67-8c23-98530564ee95" path="/var/lib/kubelet/pods/5029ef3c-df69-4a67-8c23-98530564ee95/volumes" Jul 15 17:02:08.403794 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:02:08.403763 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hnkpk"] Jul 15 17:02:08.404289 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:02:08.404175 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23fedaf4-a58d-4244-8ed5-9d268786c675" containerName="cleanup" Jul 15 17:02:08.404289 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:02:08.404186 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="23fedaf4-a58d-4244-8ed5-9d268786c675" containerName="cleanup" Jul 15 17:02:08.404289 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:02:08.404203 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5029ef3c-df69-4a67-8c23-98530564ee95" containerName="manager" Jul 15 17:02:08.404289 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:02:08.404208 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5029ef3c-df69-4a67-8c23-98530564ee95" containerName="manager" Jul 15 17:02:08.404289 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:02:08.404278 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="23fedaf4-a58d-4244-8ed5-9d268786c675" containerName="cleanup" Jul 15 17:02:08.404289 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:02:08.404286 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5029ef3c-df69-4a67-8c23-98530564ee95" containerName="manager" Jul 15 17:02:08.407324 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:02:08.407302 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hnkpk" Jul 15 17:02:08.409716 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:02:08.409694 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qmq6r\"" Jul 15 17:02:08.417491 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:02:08.417461 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hnkpk"] Jul 15 17:02:08.435378 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:02:08.435338 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpjjf\" (UniqueName: \"kubernetes.io/projected/bd660fa4-2d65-484f-b48c-40bd9a03f073-kube-api-access-qpjjf\") pod \"kuadrant-operator-controller-manager-86878c769f-hnkpk\" (UID: \"bd660fa4-2d65-484f-b48c-40bd9a03f073\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hnkpk" Jul 15 17:02:08.435523 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:02:08.435425 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd660fa4-2d65-484f-b48c-40bd9a03f073-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hnkpk\" (UID: \"bd660fa4-2d65-484f-b48c-40bd9a03f073\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hnkpk" Jul 15 17:02:08.536077 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:02:08.536032 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpjjf\" (UniqueName: \"kubernetes.io/projected/bd660fa4-2d65-484f-b48c-40bd9a03f073-kube-api-access-qpjjf\") pod \"kuadrant-operator-controller-manager-86878c769f-hnkpk\" (UID: \"bd660fa4-2d65-484f-b48c-40bd9a03f073\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hnkpk" Jul 15 17:02:08.536283 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:02:08.536091 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd660fa4-2d65-484f-b48c-40bd9a03f073-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hnkpk\" (UID: \"bd660fa4-2d65-484f-b48c-40bd9a03f073\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hnkpk" Jul 15 17:02:08.536510 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:02:08.536486 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd660fa4-2d65-484f-b48c-40bd9a03f073-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hnkpk\" (UID: \"bd660fa4-2d65-484f-b48c-40bd9a03f073\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hnkpk" Jul 15 17:02:08.555571 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:02:08.555542 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpjjf\" (UniqueName: \"kubernetes.io/projected/bd660fa4-2d65-484f-b48c-40bd9a03f073-kube-api-access-qpjjf\") pod \"kuadrant-operator-controller-manager-86878c769f-hnkpk\" (UID: \"bd660fa4-2d65-484f-b48c-40bd9a03f073\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hnkpk" Jul 15 17:02:08.718689 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:02:08.718648 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hnkpk" Jul 15 17:02:08.858637 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:02:08.858605 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hnkpk"] Jul 15 17:02:08.860372 ip-10-0-132-162 kubenswrapper[2559]: W0715 17:02:08.860348 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd660fa4_2d65_484f_b48c_40bd9a03f073.slice/crio-3c5a834ed8015e3d9bb88bf5aa2ae10f88989d9e6441c583b7a47062fce05fcf WatchSource:0}: Error finding container 3c5a834ed8015e3d9bb88bf5aa2ae10f88989d9e6441c583b7a47062fce05fcf: Status 404 returned error can't find the container with id 3c5a834ed8015e3d9bb88bf5aa2ae10f88989d9e6441c583b7a47062fce05fcf Jul 15 17:02:09.361917 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:02:09.361877 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hnkpk" event={"ID":"bd660fa4-2d65-484f-b48c-40bd9a03f073","Type":"ContainerStarted","Data":"31b5809ff58d6bc339afeff9fe5b8e959f3eca6c14b9c574a27f1683ba773809"} Jul 15 17:02:09.362137 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:02:09.361958 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hnkpk" event={"ID":"bd660fa4-2d65-484f-b48c-40bd9a03f073","Type":"ContainerStarted","Data":"3c5a834ed8015e3d9bb88bf5aa2ae10f88989d9e6441c583b7a47062fce05fcf"} Jul 15 17:02:09.362137 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:02:09.362003 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hnkpk" Jul 15 17:02:09.382565 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:02:09.382513 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hnkpk" podStartSLOduration=1.382496363 podStartE2EDuration="1.382496363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:02:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:02:09.380504972 +0000 UTC m=+1315.807597099" watchObservedRunningTime="2026-07-15 17:02:09.382496363 +0000 UTC m=+1315.809588446" Jul 15 17:02:20.370385 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:02:20.370357 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hnkpk" Jul 15 17:05:14.160074 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:05:14.160046 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vcxdn_268a4cb9-c310-4681-91a6-efe9692f8327/console-operator/2.log" Jul 15 17:05:14.162240 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:05:14.162217 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vcxdn_268a4cb9-c310-4681-91a6-efe9692f8327/console-operator/2.log" Jul 15 17:05:14.164196 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:05:14.164177 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxsr7_1e30c2c6-c7eb-42ca-add5-239c71eafd0d/ovn-acl-logging/0.log" Jul 15 17:05:14.166460 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:05:14.166440 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxsr7_1e30c2c6-c7eb-42ca-add5-239c71eafd0d/ovn-acl-logging/0.log" Jul 15 17:08:28.380740 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:28.380701 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7bb30196-86d774d758-lj2zd"] Jul 15 17:08:28.384949 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:28.384927 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7bb30196-86d774d758-lj2zd" Jul 15 17:08:28.387439 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:28.387414 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-7bb30196-serving-cert\"" Jul 15 17:08:28.396559 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:28.396533 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7bb30196-86d774d758-lj2zd"] Jul 15 17:08:28.426956 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:28.426927 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/372c812a-23f1-4d74-a176-1103199c5986-openshift-service-ca\") pod \"maas-api-e2e-ait-7bb30196-86d774d758-lj2zd\" (UID: \"372c812a-23f1-4d74-a176-1103199c5986\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7bb30196-86d774d758-lj2zd" Jul 15 17:08:28.427072 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:28.426962 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zrcp\" (UniqueName: \"kubernetes.io/projected/372c812a-23f1-4d74-a176-1103199c5986-kube-api-access-9zrcp\") pod \"maas-api-e2e-ait-7bb30196-86d774d758-lj2zd\" (UID: \"372c812a-23f1-4d74-a176-1103199c5986\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7bb30196-86d774d758-lj2zd" Jul 15 17:08:28.427118 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:28.427069 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/372c812a-23f1-4d74-a176-1103199c5986-maas-api-tls\") pod \"maas-api-e2e-ait-7bb30196-86d774d758-lj2zd\" (UID: \"372c812a-23f1-4d74-a176-1103199c5986\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7bb30196-86d774d758-lj2zd" Jul 15 17:08:28.527878 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:28.527847 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/372c812a-23f1-4d74-a176-1103199c5986-openshift-service-ca\") pod \"maas-api-e2e-ait-7bb30196-86d774d758-lj2zd\" (UID: \"372c812a-23f1-4d74-a176-1103199c5986\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7bb30196-86d774d758-lj2zd" Jul 15 17:08:28.527878 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:28.527881 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zrcp\" (UniqueName: \"kubernetes.io/projected/372c812a-23f1-4d74-a176-1103199c5986-kube-api-access-9zrcp\") pod \"maas-api-e2e-ait-7bb30196-86d774d758-lj2zd\" (UID: \"372c812a-23f1-4d74-a176-1103199c5986\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7bb30196-86d774d758-lj2zd" Jul 15 17:08:28.528057 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:28.527931 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/372c812a-23f1-4d74-a176-1103199c5986-maas-api-tls\") pod \"maas-api-e2e-ait-7bb30196-86d774d758-lj2zd\" (UID: \"372c812a-23f1-4d74-a176-1103199c5986\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7bb30196-86d774d758-lj2zd" Jul 15 17:08:28.528487 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:28.528463 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/372c812a-23f1-4d74-a176-1103199c5986-openshift-service-ca\") pod \"maas-api-e2e-ait-7bb30196-86d774d758-lj2zd\" (UID: \"372c812a-23f1-4d74-a176-1103199c5986\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7bb30196-86d774d758-lj2zd" Jul 15 17:08:28.530419 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:28.530393 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/372c812a-23f1-4d74-a176-1103199c5986-maas-api-tls\") pod \"maas-api-e2e-ait-7bb30196-86d774d758-lj2zd\" (UID: \"372c812a-23f1-4d74-a176-1103199c5986\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7bb30196-86d774d758-lj2zd" Jul 15 17:08:28.537962 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:28.537937 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zrcp\" (UniqueName: \"kubernetes.io/projected/372c812a-23f1-4d74-a176-1103199c5986-kube-api-access-9zrcp\") pod \"maas-api-e2e-ait-7bb30196-86d774d758-lj2zd\" (UID: \"372c812a-23f1-4d74-a176-1103199c5986\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7bb30196-86d774d758-lj2zd" Jul 15 17:08:28.697798 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:28.697772 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7bb30196-86d774d758-lj2zd" Jul 15 17:08:28.836378 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:28.836348 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7bb30196-86d774d758-lj2zd"] Jul 15 17:08:28.838782 ip-10-0-132-162 kubenswrapper[2559]: W0715 17:08:28.838742 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod372c812a_23f1_4d74_a176_1103199c5986.slice/crio-59f8fef3f24f20f4172fda93b3a42c1c67fdcbda062920b3fcd20e0984f619c8 WatchSource:0}: Error finding container 59f8fef3f24f20f4172fda93b3a42c1c67fdcbda062920b3fcd20e0984f619c8: Status 404 returned error can't find the container with id 59f8fef3f24f20f4172fda93b3a42c1c67fdcbda062920b3fcd20e0984f619c8 Jul 15 17:08:28.840158 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:28.840140 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 17:08:29.342767 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:29.342725 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7bb30196-86d774d758-lj2zd" event={"ID":"372c812a-23f1-4d74-a176-1103199c5986","Type":"ContainerStarted","Data":"59f8fef3f24f20f4172fda93b3a42c1c67fdcbda062920b3fcd20e0984f619c8"} Jul 15 17:08:30.349657 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:30.349619 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7bb30196-86d774d758-lj2zd" event={"ID":"372c812a-23f1-4d74-a176-1103199c5986","Type":"ContainerStarted","Data":"14deb4b7be0b3d691b9185c8a2c4055ff78c5ef625be293e8e4db2cf0492721d"} Jul 15 17:08:30.350061 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:30.349680 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7bb30196-86d774d758-lj2zd" Jul 15 17:08:30.367021 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:30.366976 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7bb30196-86d774d758-lj2zd" podStartSLOduration=1.716154243 podStartE2EDuration="2.366961228s" totalImagesPullingTime="650.806985ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:08:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:08:30.365699154 +0000 UTC m=+1696.792791237" watchObservedRunningTime="2026-07-15 17:08:30.366961228 +0000 UTC m=+1696.794053350" Jul 15 17:08:36.362805 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:36.362716 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7bb30196-86d774d758-lj2zd" Jul 15 17:08:43.589024 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:43.588988 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7bb30196-86d774d758-lj2zd"] Jul 15 17:08:43.589643 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:43.589610 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7bb30196-86d774d758-lj2zd" podUID="372c812a-23f1-4d74-a176-1103199c5986" containerName="maas-api" containerID="cri-o://14deb4b7be0b3d691b9185c8a2c4055ff78c5ef625be293e8e4db2cf0492721d" gracePeriod=30 Jul 15 17:08:43.844224 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:43.844155 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7bb30196-86d774d758-lj2zd" Jul 15 17:08:43.963263 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:43.963234 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zrcp\" (UniqueName: \"kubernetes.io/projected/372c812a-23f1-4d74-a176-1103199c5986-kube-api-access-9zrcp\") pod \"372c812a-23f1-4d74-a176-1103199c5986\" (UID: \"372c812a-23f1-4d74-a176-1103199c5986\") " Jul 15 17:08:43.963454 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:43.963329 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/372c812a-23f1-4d74-a176-1103199c5986-openshift-service-ca\") pod \"372c812a-23f1-4d74-a176-1103199c5986\" (UID: \"372c812a-23f1-4d74-a176-1103199c5986\") " Jul 15 17:08:43.963454 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:43.963369 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/372c812a-23f1-4d74-a176-1103199c5986-maas-api-tls\") pod \"372c812a-23f1-4d74-a176-1103199c5986\" (UID: \"372c812a-23f1-4d74-a176-1103199c5986\") " Jul 15 17:08:43.963735 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:43.963706 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/372c812a-23f1-4d74-a176-1103199c5986-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "372c812a-23f1-4d74-a176-1103199c5986" (UID: "372c812a-23f1-4d74-a176-1103199c5986"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 17:08:43.965538 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:43.965511 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/372c812a-23f1-4d74-a176-1103199c5986-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "372c812a-23f1-4d74-a176-1103199c5986" (UID: "372c812a-23f1-4d74-a176-1103199c5986"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 17:08:43.965604 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:43.965574 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/372c812a-23f1-4d74-a176-1103199c5986-kube-api-access-9zrcp" (OuterVolumeSpecName: "kube-api-access-9zrcp") pod "372c812a-23f1-4d74-a176-1103199c5986" (UID: "372c812a-23f1-4d74-a176-1103199c5986"). InnerVolumeSpecName "kube-api-access-9zrcp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 17:08:44.064684 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:44.064653 2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/372c812a-23f1-4d74-a176-1103199c5986-openshift-service-ca\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 17:08:44.064684 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:44.064682 2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/372c812a-23f1-4d74-a176-1103199c5986-maas-api-tls\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 17:08:44.064878 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:44.064692 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zrcp\" (UniqueName: \"kubernetes.io/projected/372c812a-23f1-4d74-a176-1103199c5986-kube-api-access-9zrcp\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 17:08:44.426539 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:44.426510 2559 generic.go:356] "Generic (PLEG): container finished" podID="372c812a-23f1-4d74-a176-1103199c5986" containerID="14deb4b7be0b3d691b9185c8a2c4055ff78c5ef625be293e8e4db2cf0492721d" exitCode=0 Jul 15 17:08:44.426696 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:44.426549 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7bb30196-86d774d758-lj2zd" Jul 15 17:08:44.426696 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:44.426602 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7bb30196-86d774d758-lj2zd" event={"ID":"372c812a-23f1-4d74-a176-1103199c5986","Type":"ContainerDied","Data":"14deb4b7be0b3d691b9185c8a2c4055ff78c5ef625be293e8e4db2cf0492721d"} Jul 15 17:08:44.426696 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:44.426656 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7bb30196-86d774d758-lj2zd" event={"ID":"372c812a-23f1-4d74-a176-1103199c5986","Type":"ContainerDied","Data":"59f8fef3f24f20f4172fda93b3a42c1c67fdcbda062920b3fcd20e0984f619c8"} Jul 15 17:08:44.426696 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:44.426682 2559 scope.go:117] "RemoveContainer" containerID="14deb4b7be0b3d691b9185c8a2c4055ff78c5ef625be293e8e4db2cf0492721d" Jul 15 17:08:44.435452 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:44.435438 2559 scope.go:117] "RemoveContainer" containerID="14deb4b7be0b3d691b9185c8a2c4055ff78c5ef625be293e8e4db2cf0492721d" Jul 15 17:08:44.435703 ip-10-0-132-162 kubenswrapper[2559]: E0715 17:08:44.435686 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14deb4b7be0b3d691b9185c8a2c4055ff78c5ef625be293e8e4db2cf0492721d\": container with ID starting with 14deb4b7be0b3d691b9185c8a2c4055ff78c5ef625be293e8e4db2cf0492721d not found: ID does not exist" containerID="14deb4b7be0b3d691b9185c8a2c4055ff78c5ef625be293e8e4db2cf0492721d" Jul 15 17:08:44.435742 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:44.435712 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14deb4b7be0b3d691b9185c8a2c4055ff78c5ef625be293e8e4db2cf0492721d"} err="failed to get container status \"14deb4b7be0b3d691b9185c8a2c4055ff78c5ef625be293e8e4db2cf0492721d\": rpc error: code = NotFound desc = could not find container \"14deb4b7be0b3d691b9185c8a2c4055ff78c5ef625be293e8e4db2cf0492721d\": container with ID starting with 14deb4b7be0b3d691b9185c8a2c4055ff78c5ef625be293e8e4db2cf0492721d not found: ID does not exist" Jul 15 17:08:44.446450 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:44.446427 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7bb30196-86d774d758-lj2zd"] Jul 15 17:08:44.451228 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:44.451208 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7bb30196-86d774d758-lj2zd"] Jul 15 17:08:46.172518 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:08:46.172484 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="372c812a-23f1-4d74-a176-1103199c5986" path="/var/lib/kubelet/pods/372c812a-23f1-4d74-a176-1103199c5986/volumes" Jul 15 17:09:00.472014 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:09:00.471979 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-000d7ff6-78d895fdf4-f68jv"] Jul 15 17:09:00.472685 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:09:00.472667 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="372c812a-23f1-4d74-a176-1103199c5986" containerName="maas-api" Jul 15 17:09:00.472741 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:09:00.472689 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="372c812a-23f1-4d74-a176-1103199c5986" containerName="maas-api" Jul 15 17:09:00.472816 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:09:00.472804 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="372c812a-23f1-4d74-a176-1103199c5986" containerName="maas-api" Jul 15 17:09:00.476461 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:09:00.476440 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-000d7ff6-78d895fdf4-f68jv" Jul 15 17:09:00.479552 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:09:00.479422 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-000d7ff6-serving-cert\"" Jul 15 17:09:00.483400 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:09:00.483378 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-000d7ff6-78d895fdf4-f68jv"] Jul 15 17:09:00.609201 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:09:00.609171 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4d8b430-6b27-455c-b817-b69530cb7ad4-openshift-service-ca\") pod \"maas-api-e2e-migrate-000d7ff6-78d895fdf4-f68jv\" (UID: \"b4d8b430-6b27-455c-b817-b69530cb7ad4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-000d7ff6-78d895fdf4-f68jv" Jul 15 17:09:00.609360 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:09:00.609267 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4d8b430-6b27-455c-b817-b69530cb7ad4-maas-api-tls\") pod \"maas-api-e2e-migrate-000d7ff6-78d895fdf4-f68jv\" (UID: \"b4d8b430-6b27-455c-b817-b69530cb7ad4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-000d7ff6-78d895fdf4-f68jv" Jul 15 17:09:00.609360 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:09:00.609293 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9tdp\" (UniqueName: \"kubernetes.io/projected/b4d8b430-6b27-455c-b817-b69530cb7ad4-kube-api-access-l9tdp\") pod \"maas-api-e2e-migrate-000d7ff6-78d895fdf4-f68jv\" (UID: \"b4d8b430-6b27-455c-b817-b69530cb7ad4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-000d7ff6-78d895fdf4-f68jv" Jul 15 17:09:00.709973 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:09:00.709946 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4d8b430-6b27-455c-b817-b69530cb7ad4-openshift-service-ca\") pod \"maas-api-e2e-migrate-000d7ff6-78d895fdf4-f68jv\" (UID: \"b4d8b430-6b27-455c-b817-b69530cb7ad4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-000d7ff6-78d895fdf4-f68jv" Jul 15 17:09:00.710135 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:09:00.710009 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4d8b430-6b27-455c-b817-b69530cb7ad4-maas-api-tls\") pod \"maas-api-e2e-migrate-000d7ff6-78d895fdf4-f68jv\" (UID: \"b4d8b430-6b27-455c-b817-b69530cb7ad4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-000d7ff6-78d895fdf4-f68jv" Jul 15 17:09:00.710135 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:09:00.710029 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9tdp\" (UniqueName: \"kubernetes.io/projected/b4d8b430-6b27-455c-b817-b69530cb7ad4-kube-api-access-l9tdp\") pod \"maas-api-e2e-migrate-000d7ff6-78d895fdf4-f68jv\" (UID: \"b4d8b430-6b27-455c-b817-b69530cb7ad4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-000d7ff6-78d895fdf4-f68jv" Jul 15 17:09:00.710135 ip-10-0-132-162 kubenswrapper[2559]: E0715 17:09:00.710121 2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-000d7ff6-serving-cert: secret "maas-api-e2e-migrate-000d7ff6-serving-cert" not found Jul 15 17:09:00.710300 ip-10-0-132-162 kubenswrapper[2559]: E0715 17:09:00.710198 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4d8b430-6b27-455c-b817-b69530cb7ad4-maas-api-tls podName:b4d8b430-6b27-455c-b817-b69530cb7ad4 nodeName:}" failed. No retries permitted until 2026-07-15 17:09:01.210175133 +0000 UTC m=+1727.637267211 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b4d8b430-6b27-455c-b817-b69530cb7ad4-maas-api-tls") pod "maas-api-e2e-migrate-000d7ff6-78d895fdf4-f68jv" (UID: "b4d8b430-6b27-455c-b817-b69530cb7ad4") : secret "maas-api-e2e-migrate-000d7ff6-serving-cert" not found Jul 15 17:09:00.710595 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:09:00.710576 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4d8b430-6b27-455c-b817-b69530cb7ad4-openshift-service-ca\") pod \"maas-api-e2e-migrate-000d7ff6-78d895fdf4-f68jv\" (UID: \"b4d8b430-6b27-455c-b817-b69530cb7ad4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-000d7ff6-78d895fdf4-f68jv" Jul 15 17:09:00.718320 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:09:00.718298 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9tdp\" (UniqueName: \"kubernetes.io/projected/b4d8b430-6b27-455c-b817-b69530cb7ad4-kube-api-access-l9tdp\") pod \"maas-api-e2e-migrate-000d7ff6-78d895fdf4-f68jv\" (UID: \"b4d8b430-6b27-455c-b817-b69530cb7ad4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-000d7ff6-78d895fdf4-f68jv" Jul 15 17:09:01.214635 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:09:01.214597 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4d8b430-6b27-455c-b817-b69530cb7ad4-maas-api-tls\") pod \"maas-api-e2e-migrate-000d7ff6-78d895fdf4-f68jv\" (UID: \"b4d8b430-6b27-455c-b817-b69530cb7ad4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-000d7ff6-78d895fdf4-f68jv" Jul 15 17:09:01.217077 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:09:01.217053 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4d8b430-6b27-455c-b817-b69530cb7ad4-maas-api-tls\") pod \"maas-api-e2e-migrate-000d7ff6-78d895fdf4-f68jv\" (UID: \"b4d8b430-6b27-455c-b817-b69530cb7ad4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-000d7ff6-78d895fdf4-f68jv" Jul 15 17:09:01.389048 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:09:01.389020 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-000d7ff6-78d895fdf4-f68jv" Jul 15 17:09:01.734961 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:09:01.734934 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-000d7ff6-78d895fdf4-f68jv"] Jul 15 17:09:01.736684 ip-10-0-132-162 kubenswrapper[2559]: W0715 17:09:01.736649 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4d8b430_6b27_455c_b817_b69530cb7ad4.slice/crio-8ec6e34002ba5a8ba1cff3a4e172fc4a3ab84030f0498f79b04373fae6f489c0 WatchSource:0}: Error finding container 8ec6e34002ba5a8ba1cff3a4e172fc4a3ab84030f0498f79b04373fae6f489c0: Status 404 returned error can't find the container with id 8ec6e34002ba5a8ba1cff3a4e172fc4a3ab84030f0498f79b04373fae6f489c0 Jul 15 17:09:02.532178 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:09:02.532148 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-000d7ff6-78d895fdf4-f68jv" event={"ID":"b4d8b430-6b27-455c-b817-b69530cb7ad4","Type":"ContainerStarted","Data":"07c26bcdc52027b08fa2103b72b8b946172f8ef55204210373429bffe7fb3151"} Jul 15 17:09:02.532572 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:09:02.532201 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-000d7ff6-78d895fdf4-f68jv" event={"ID":"b4d8b430-6b27-455c-b817-b69530cb7ad4","Type":"ContainerStarted","Data":"8ec6e34002ba5a8ba1cff3a4e172fc4a3ab84030f0498f79b04373fae6f489c0"} Jul 15 17:09:02.532572 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:09:02.532236 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-000d7ff6-78d895fdf4-f68jv" Jul 15 17:09:02.550492 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:09:02.550447 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-000d7ff6-78d895fdf4-f68jv" podStartSLOduration=2.142689318 podStartE2EDuration="2.550431017s" totalImagesPullingTime="407.741699ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:09:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:09:02.547688582 +0000 UTC m=+1728.974780670" watchObservedRunningTime="2026-07-15 17:09:02.550431017 +0000 UTC m=+1728.977523099" Jul 15 17:09:08.542672 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:09:08.542638 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-000d7ff6-78d895fdf4-f68jv" Jul 15 17:10:05.357319 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:05.357285 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-000d7ff6-78d895fdf4-f68jv"] Jul 15 17:10:05.357847 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:05.357537 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-000d7ff6-78d895fdf4-f68jv" podUID="b4d8b430-6b27-455c-b817-b69530cb7ad4" containerName="maas-api" containerID="cri-o://07c26bcdc52027b08fa2103b72b8b946172f8ef55204210373429bffe7fb3151" gracePeriod=30 Jul 15 17:10:05.607908 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:05.607844 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-000d7ff6-78d895fdf4-f68jv" Jul 15 17:10:05.736894 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:05.736829 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4d8b430-6b27-455c-b817-b69530cb7ad4-maas-api-tls\") pod \"b4d8b430-6b27-455c-b817-b69530cb7ad4\" (UID: \"b4d8b430-6b27-455c-b817-b69530cb7ad4\") " Jul 15 17:10:05.736894 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:05.736870 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9tdp\" (UniqueName: \"kubernetes.io/projected/b4d8b430-6b27-455c-b817-b69530cb7ad4-kube-api-access-l9tdp\") pod \"b4d8b430-6b27-455c-b817-b69530cb7ad4\" (UID: \"b4d8b430-6b27-455c-b817-b69530cb7ad4\") " Jul 15 17:10:05.737067 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:05.736899 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4d8b430-6b27-455c-b817-b69530cb7ad4-openshift-service-ca\") pod \"b4d8b430-6b27-455c-b817-b69530cb7ad4\" (UID: \"b4d8b430-6b27-455c-b817-b69530cb7ad4\") " Jul 15 17:10:05.737302 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:05.737268 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4d8b430-6b27-455c-b817-b69530cb7ad4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b4d8b430-6b27-455c-b817-b69530cb7ad4" (UID: "b4d8b430-6b27-455c-b817-b69530cb7ad4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 17:10:05.738831 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:05.738810 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4d8b430-6b27-455c-b817-b69530cb7ad4-kube-api-access-l9tdp" (OuterVolumeSpecName: "kube-api-access-l9tdp") pod "b4d8b430-6b27-455c-b817-b69530cb7ad4" (UID: "b4d8b430-6b27-455c-b817-b69530cb7ad4"). InnerVolumeSpecName "kube-api-access-l9tdp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 17:10:05.738923 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:05.738902 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4d8b430-6b27-455c-b817-b69530cb7ad4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b4d8b430-6b27-455c-b817-b69530cb7ad4" (UID: "b4d8b430-6b27-455c-b817-b69530cb7ad4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 17:10:05.838458 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:05.838435 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9tdp\" (UniqueName: \"kubernetes.io/projected/b4d8b430-6b27-455c-b817-b69530cb7ad4-kube-api-access-l9tdp\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 17:10:05.838458 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:05.838456 2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4d8b430-6b27-455c-b817-b69530cb7ad4-openshift-service-ca\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 17:10:05.838582 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:05.838465 2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4d8b430-6b27-455c-b817-b69530cb7ad4-maas-api-tls\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 17:10:05.856350 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:05.856326 2559 generic.go:356] "Generic (PLEG): container finished" podID="b4d8b430-6b27-455c-b817-b69530cb7ad4" containerID="07c26bcdc52027b08fa2103b72b8b946172f8ef55204210373429bffe7fb3151" exitCode=0 Jul 15 17:10:05.856442 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:05.856375 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-000d7ff6-78d895fdf4-f68jv" Jul 15 17:10:05.856442 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:05.856383 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-000d7ff6-78d895fdf4-f68jv" event={"ID":"b4d8b430-6b27-455c-b817-b69530cb7ad4","Type":"ContainerDied","Data":"07c26bcdc52027b08fa2103b72b8b946172f8ef55204210373429bffe7fb3151"} Jul 15 17:10:05.856515 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:05.856452 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-000d7ff6-78d895fdf4-f68jv" event={"ID":"b4d8b430-6b27-455c-b817-b69530cb7ad4","Type":"ContainerDied","Data":"8ec6e34002ba5a8ba1cff3a4e172fc4a3ab84030f0498f79b04373fae6f489c0"} Jul 15 17:10:05.856515 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:05.856475 2559 scope.go:117] "RemoveContainer" containerID="07c26bcdc52027b08fa2103b72b8b946172f8ef55204210373429bffe7fb3151" Jul 15 17:10:05.865889 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:05.865871 2559 scope.go:117] "RemoveContainer" containerID="07c26bcdc52027b08fa2103b72b8b946172f8ef55204210373429bffe7fb3151" Jul 15 17:10:05.866143 ip-10-0-132-162 kubenswrapper[2559]: E0715 17:10:05.866119 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07c26bcdc52027b08fa2103b72b8b946172f8ef55204210373429bffe7fb3151\": container with ID starting with 07c26bcdc52027b08fa2103b72b8b946172f8ef55204210373429bffe7fb3151 not found: ID does not exist" containerID="07c26bcdc52027b08fa2103b72b8b946172f8ef55204210373429bffe7fb3151" Jul 15 17:10:05.866188 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:05.866152 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07c26bcdc52027b08fa2103b72b8b946172f8ef55204210373429bffe7fb3151"} err="failed to get container status \"07c26bcdc52027b08fa2103b72b8b946172f8ef55204210373429bffe7fb3151\": rpc error: code = NotFound desc = could not find container \"07c26bcdc52027b08fa2103b72b8b946172f8ef55204210373429bffe7fb3151\": container with ID starting with 07c26bcdc52027b08fa2103b72b8b946172f8ef55204210373429bffe7fb3151 not found: ID does not exist" Jul 15 17:10:05.877183 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:05.877160 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-000d7ff6-78d895fdf4-f68jv"] Jul 15 17:10:05.882863 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:05.882844 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-000d7ff6-78d895fdf4-f68jv"] Jul 15 17:10:06.172711 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:06.172688 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4d8b430-6b27-455c-b817-b69530cb7ad4" path="/var/lib/kubelet/pods/b4d8b430-6b27-455c-b817-b69530cb7ad4/volumes" Jul 15 17:10:14.198109 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:14.198083 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vcxdn_268a4cb9-c310-4681-91a6-efe9692f8327/console-operator/2.log" Jul 15 17:10:14.202212 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:14.202188 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vcxdn_268a4cb9-c310-4681-91a6-efe9692f8327/console-operator/2.log" Jul 15 17:10:14.202458 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:14.202444 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxsr7_1e30c2c6-c7eb-42ca-add5-239c71eafd0d/ovn-acl-logging/0.log" Jul 15 17:10:14.216438 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:14.216417 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxsr7_1e30c2c6-c7eb-42ca-add5-239c71eafd0d/ovn-acl-logging/0.log" Jul 15 17:10:17.493401 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:17.493368 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3e01659b-h9z59"] Jul 15 17:10:17.493798 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:17.493783 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4d8b430-6b27-455c-b817-b69530cb7ad4" containerName="maas-api" Jul 15 17:10:17.493798 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:17.493795 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4d8b430-6b27-455c-b817-b69530cb7ad4" containerName="maas-api" Jul 15 17:10:17.493897 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:17.493859 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4d8b430-6b27-455c-b817-b69530cb7ad4" containerName="maas-api" Jul 15 17:10:17.496726 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:17.496710 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3e01659b-h9z59" Jul 15 17:10:17.499052 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:17.499028 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nthsz\"" Jul 15 17:10:17.504280 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:17.504254 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3e01659b-h9z59"] Jul 15 17:10:17.543235 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:17.543206 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12aa93c6-9724-4163-aafc-cf10e50267ef-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3e01659b-h9z59\" (UID: \"12aa93c6-9724-4163-aafc-cf10e50267ef\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3e01659b-h9z59" Jul 15 17:10:17.644105 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:17.644076 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12aa93c6-9724-4163-aafc-cf10e50267ef-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3e01659b-h9z59\" (UID: \"12aa93c6-9724-4163-aafc-cf10e50267ef\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3e01659b-h9z59" Jul 15 17:10:17.644665 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:17.644645 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12aa93c6-9724-4163-aafc-cf10e50267ef-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3e01659b-h9z59\" (UID: \"12aa93c6-9724-4163-aafc-cf10e50267ef\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3e01659b-h9z59" Jul 15 17:10:17.809504 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:17.809417 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3e01659b-h9z59" Jul 15 17:10:17.941253 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:17.941228 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3e01659b-h9z59"] Jul 15 17:10:17.943585 ip-10-0-132-162 kubenswrapper[2559]: W0715 17:10:17.943558 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12aa93c6_9724_4163_aafc_cf10e50267ef.slice/crio-d1f4cbf212966aaf79bac0476d4ede5a8e1010610597038272e7466b2320dd76 WatchSource:0}: Error finding container d1f4cbf212966aaf79bac0476d4ede5a8e1010610597038272e7466b2320dd76: Status 404 returned error can't find the container with id d1f4cbf212966aaf79bac0476d4ede5a8e1010610597038272e7466b2320dd76 Jul 15 17:10:18.929093 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:18.929055 2559 generic.go:356] "Generic (PLEG): container finished" podID="12aa93c6-9724-4163-aafc-cf10e50267ef" containerID="bf2a5a38cbff662be0b06ec828038d42786b0e46f30bf23ec690bf46d33a728b" exitCode=7 Jul 15 17:10:18.929534 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:18.929110 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3e01659b-h9z59" event={"ID":"12aa93c6-9724-4163-aafc-cf10e50267ef","Type":"ContainerDied","Data":"bf2a5a38cbff662be0b06ec828038d42786b0e46f30bf23ec690bf46d33a728b"} Jul 15 17:10:18.929534 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:18.929145 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3e01659b-h9z59" event={"ID":"12aa93c6-9724-4163-aafc-cf10e50267ef","Type":"ContainerStarted","Data":"d1f4cbf212966aaf79bac0476d4ede5a8e1010610597038272e7466b2320dd76"} Jul 15 17:10:18.929534 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:18.929338 2559 scope.go:117] "RemoveContainer" containerID="bf2a5a38cbff662be0b06ec828038d42786b0e46f30bf23ec690bf46d33a728b" Jul 15 17:10:19.937362 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:19.937335 2559 generic.go:356] "Generic (PLEG): container finished" podID="12aa93c6-9724-4163-aafc-cf10e50267ef" containerID="05bb2bf1a7495c588524c8d09209d9f51ea1d08207bc7bdcab50f3e5275b4546" exitCode=7 Jul 15 17:10:19.937714 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:19.937424 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3e01659b-h9z59" event={"ID":"12aa93c6-9724-4163-aafc-cf10e50267ef","Type":"ContainerDied","Data":"05bb2bf1a7495c588524c8d09209d9f51ea1d08207bc7bdcab50f3e5275b4546"} Jul 15 17:10:19.937714 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:19.937478 2559 scope.go:117] "RemoveContainer" containerID="bf2a5a38cbff662be0b06ec828038d42786b0e46f30bf23ec690bf46d33a728b" Jul 15 17:10:19.937714 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:19.937592 2559 scope.go:117] "RemoveContainer" containerID="05bb2bf1a7495c588524c8d09209d9f51ea1d08207bc7bdcab50f3e5275b4546" Jul 15 17:10:19.937841 ip-10-0-132-162 kubenswrapper[2559]: E0715 17:10:19.937821 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3e01659b-h9z59_odh-ai-gateway-infra(12aa93c6-9724-4163-aafc-cf10e50267ef)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3e01659b-h9z59" podUID="12aa93c6-9724-4163-aafc-cf10e50267ef" Jul 15 17:10:20.944492 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:20.944467 2559 scope.go:117] "RemoveContainer" containerID="05bb2bf1a7495c588524c8d09209d9f51ea1d08207bc7bdcab50f3e5275b4546" Jul 15 17:10:20.944886 ip-10-0-132-162 kubenswrapper[2559]: E0715 17:10:20.944655 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3e01659b-h9z59_odh-ai-gateway-infra(12aa93c6-9724-4163-aafc-cf10e50267ef)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3e01659b-h9z59" podUID="12aa93c6-9724-4163-aafc-cf10e50267ef" Jul 15 17:10:34.172560 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:34.172535 2559 scope.go:117] "RemoveContainer" containerID="05bb2bf1a7495c588524c8d09209d9f51ea1d08207bc7bdcab50f3e5275b4546" Jul 15 17:10:35.018010 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:35.017982 2559 generic.go:356] "Generic (PLEG): container finished" podID="12aa93c6-9724-4163-aafc-cf10e50267ef" containerID="e047d28c0cbd54f88e9c5406609f4fcf07e602e30f09eaa56f534817b0511a72" exitCode=0 Jul 15 17:10:35.018123 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:35.018056 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3e01659b-h9z59" event={"ID":"12aa93c6-9724-4163-aafc-cf10e50267ef","Type":"ContainerDied","Data":"e047d28c0cbd54f88e9c5406609f4fcf07e602e30f09eaa56f534817b0511a72"} Jul 15 17:10:35.018123 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:35.018115 2559 scope.go:117] "RemoveContainer" containerID="05bb2bf1a7495c588524c8d09209d9f51ea1d08207bc7bdcab50f3e5275b4546" Jul 15 17:10:36.046317 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:36.046289 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3e01659b-h9z59"] Jul 15 17:10:36.162102 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:36.162080 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3e01659b-h9z59" Jul 15 17:10:36.292300 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:36.292232 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12aa93c6-9724-4163-aafc-cf10e50267ef-maas-api-service-ca\") pod \"12aa93c6-9724-4163-aafc-cf10e50267ef\" (UID: \"12aa93c6-9724-4163-aafc-cf10e50267ef\") " Jul 15 17:10:36.292587 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:36.292547 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12aa93c6-9724-4163-aafc-cf10e50267ef-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "12aa93c6-9724-4163-aafc-cf10e50267ef" (UID: "12aa93c6-9724-4163-aafc-cf10e50267ef"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 17:10:36.393658 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:36.393633 2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12aa93c6-9724-4163-aafc-cf10e50267ef-maas-api-service-ca\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 17:10:37.031178 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:37.031155 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3e01659b-h9z59" Jul 15 17:10:37.031303 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:37.031193 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3e01659b-h9z59" event={"ID":"12aa93c6-9724-4163-aafc-cf10e50267ef","Type":"ContainerDied","Data":"d1f4cbf212966aaf79bac0476d4ede5a8e1010610597038272e7466b2320dd76"} Jul 15 17:10:37.031303 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:37.031261 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d1f4cbf212966aaf79bac0476d4ede5a8e1010610597038272e7466b2320dd76" Jul 15 17:10:37.058859 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:37.058825 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3e01659b-h9z59"] Jul 15 17:10:37.065137 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:37.065116 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3e01659b-h9z59"] Jul 15 17:10:38.172736 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:10:38.172705 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12aa93c6-9724-4163-aafc-cf10e50267ef" path="/var/lib/kubelet/pods/12aa93c6-9724-4163-aafc-cf10e50267ef/volumes" Jul 15 17:11:07.533606 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:07.533568 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3e01659b-fr2sl"] Jul 15 17:11:07.534222 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:07.534205 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12aa93c6-9724-4163-aafc-cf10e50267ef" containerName="revoke-keys" Jul 15 17:11:07.534268 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:07.534226 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="12aa93c6-9724-4163-aafc-cf10e50267ef" containerName="revoke-keys" Jul 15 17:11:07.534268 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:07.534244 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12aa93c6-9724-4163-aafc-cf10e50267ef" containerName="revoke-keys" Jul 15 17:11:07.534268 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:07.534254 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="12aa93c6-9724-4163-aafc-cf10e50267ef" containerName="revoke-keys" Jul 15 17:11:07.534376 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:07.534283 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12aa93c6-9724-4163-aafc-cf10e50267ef" containerName="revoke-keys" Jul 15 17:11:07.534376 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:07.534292 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="12aa93c6-9724-4163-aafc-cf10e50267ef" containerName="revoke-keys" Jul 15 17:11:07.534437 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:07.534380 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="12aa93c6-9724-4163-aafc-cf10e50267ef" containerName="revoke-keys" Jul 15 17:11:07.534437 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:07.534392 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="12aa93c6-9724-4163-aafc-cf10e50267ef" containerName="revoke-keys" Jul 15 17:11:07.538050 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:07.538033 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3e01659b-fr2sl" Jul 15 17:11:07.540923 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:07.540898 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nthsz\"" Jul 15 17:11:07.543092 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:07.543069 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3e01659b-fr2sl"] Jul 15 17:11:07.545391 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:07.545364 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fe5d1d0-ac91-44fd-a45d-b586d7afc660-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3e01659b-fr2sl\" (UID: \"4fe5d1d0-ac91-44fd-a45d-b586d7afc660\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3e01659b-fr2sl" Jul 15 17:11:07.646536 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:07.646508 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fe5d1d0-ac91-44fd-a45d-b586d7afc660-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3e01659b-fr2sl\" (UID: \"4fe5d1d0-ac91-44fd-a45d-b586d7afc660\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3e01659b-fr2sl" Jul 15 17:11:07.647179 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:07.647158 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fe5d1d0-ac91-44fd-a45d-b586d7afc660-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3e01659b-fr2sl\" (UID: \"4fe5d1d0-ac91-44fd-a45d-b586d7afc660\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3e01659b-fr2sl" Jul 15 17:11:07.850788 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:07.850688 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3e01659b-fr2sl" Jul 15 17:11:07.979893 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:07.979864 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3e01659b-fr2sl"] Jul 15 17:11:07.982167 ip-10-0-132-162 kubenswrapper[2559]: W0715 17:11:07.982137 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fe5d1d0_ac91_44fd_a45d_b586d7afc660.slice/crio-c2f40d1fd84a01a5bc16714aaa940dec4e227d27121f01be3943f1f9fc2c6667 WatchSource:0}: Error finding container c2f40d1fd84a01a5bc16714aaa940dec4e227d27121f01be3943f1f9fc2c6667: Status 404 returned error can't find the container with id c2f40d1fd84a01a5bc16714aaa940dec4e227d27121f01be3943f1f9fc2c6667 Jul 15 17:11:08.185578 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:08.185552 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3e01659b-fr2sl" event={"ID":"4fe5d1d0-ac91-44fd-a45d-b586d7afc660","Type":"ContainerStarted","Data":"c2f40d1fd84a01a5bc16714aaa940dec4e227d27121f01be3943f1f9fc2c6667"} Jul 15 17:11:09.191969 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:09.191934 2559 generic.go:356] "Generic (PLEG): container finished" podID="4fe5d1d0-ac91-44fd-a45d-b586d7afc660" containerID="3e7fd227326a8bc50712099b841b6d2b685b54e8c96a559e7d66eca757480f54" exitCode=0 Jul 15 17:11:09.192333 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:09.191998 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3e01659b-fr2sl" event={"ID":"4fe5d1d0-ac91-44fd-a45d-b586d7afc660","Type":"ContainerDied","Data":"3e7fd227326a8bc50712099b841b6d2b685b54e8c96a559e7d66eca757480f54"} Jul 15 17:11:10.334713 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:10.334688 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3e01659b-fr2sl" Jul 15 17:11:10.370107 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:10.370045 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fe5d1d0-ac91-44fd-a45d-b586d7afc660-maas-api-service-ca\") pod \"4fe5d1d0-ac91-44fd-a45d-b586d7afc660\" (UID: \"4fe5d1d0-ac91-44fd-a45d-b586d7afc660\") " Jul 15 17:11:10.370342 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:10.370322 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fe5d1d0-ac91-44fd-a45d-b586d7afc660-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4fe5d1d0-ac91-44fd-a45d-b586d7afc660" (UID: "4fe5d1d0-ac91-44fd-a45d-b586d7afc660"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 17:11:10.471090 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:10.471024 2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fe5d1d0-ac91-44fd-a45d-b586d7afc660-maas-api-service-ca\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 17:11:11.202687 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:11.202655 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3e01659b-fr2sl" Jul 15 17:11:11.202884 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:11.202688 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3e01659b-fr2sl" event={"ID":"4fe5d1d0-ac91-44fd-a45d-b586d7afc660","Type":"ContainerDied","Data":"c2f40d1fd84a01a5bc16714aaa940dec4e227d27121f01be3943f1f9fc2c6667"} Jul 15 17:11:11.202884 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:11.202740 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c2f40d1fd84a01a5bc16714aaa940dec4e227d27121f01be3943f1f9fc2c6667" Jul 15 17:11:39.556239 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:39.556201 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0be65efc-sjx4l"] Jul 15 17:11:39.556692 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:39.556681 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fe5d1d0-ac91-44fd-a45d-b586d7afc660" containerName="revoke-keys" Jul 15 17:11:39.556735 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:39.556693 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fe5d1d0-ac91-44fd-a45d-b586d7afc660" containerName="revoke-keys" Jul 15 17:11:39.556818 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:39.556777 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fe5d1d0-ac91-44fd-a45d-b586d7afc660" containerName="revoke-keys" Jul 15 17:11:39.556818 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:39.556793 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="12aa93c6-9724-4163-aafc-cf10e50267ef" containerName="revoke-keys" Jul 15 17:11:39.560070 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:39.560053 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0be65efc-sjx4l" Jul 15 17:11:39.562380 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:39.562365 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nthsz\"" Jul 15 17:11:39.566644 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:39.566619 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0be65efc-sjx4l"] Jul 15 17:11:39.642521 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:39.642492 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5cbc9b1-36ea-4584-ab47-5e334c861187-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0be65efc-sjx4l\" (UID: \"e5cbc9b1-36ea-4584-ab47-5e334c861187\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0be65efc-sjx4l" Jul 15 17:11:39.743202 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:39.743170 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5cbc9b1-36ea-4584-ab47-5e334c861187-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0be65efc-sjx4l\" (UID: \"e5cbc9b1-36ea-4584-ab47-5e334c861187\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0be65efc-sjx4l" Jul 15 17:11:39.743816 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:39.743797 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5cbc9b1-36ea-4584-ab47-5e334c861187-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0be65efc-sjx4l\" (UID: \"e5cbc9b1-36ea-4584-ab47-5e334c861187\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0be65efc-sjx4l" Jul 15 17:11:39.872232 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:39.872150 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0be65efc-sjx4l" Jul 15 17:11:40.011013 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:40.010982 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0be65efc-sjx4l"] Jul 15 17:11:40.012583 ip-10-0-132-162 kubenswrapper[2559]: W0715 17:11:40.012549 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5cbc9b1_36ea_4584_ab47_5e334c861187.slice/crio-d39b97a00bcaaa1ee7f4e6c746b5ce879edefa6f6ee0239bbe3dc60f1515b85f WatchSource:0}: Error finding container d39b97a00bcaaa1ee7f4e6c746b5ce879edefa6f6ee0239bbe3dc60f1515b85f: Status 404 returned error can't find the container with id d39b97a00bcaaa1ee7f4e6c746b5ce879edefa6f6ee0239bbe3dc60f1515b85f Jul 15 17:11:40.359911 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:40.359872 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0be65efc-sjx4l" event={"ID":"e5cbc9b1-36ea-4584-ab47-5e334c861187","Type":"ContainerStarted","Data":"ca0b38fc545f875a4e5d632a2b79747a0d8e479e1b1d3ade1da3d564757d5580"} Jul 15 17:11:40.360059 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:40.359952 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0be65efc-sjx4l" event={"ID":"e5cbc9b1-36ea-4584-ab47-5e334c861187","Type":"ContainerStarted","Data":"d39b97a00bcaaa1ee7f4e6c746b5ce879edefa6f6ee0239bbe3dc60f1515b85f"} Jul 15 17:11:40.375846 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:40.375791 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0be65efc-sjx4l" podStartSLOduration=1.3757770520000001 podStartE2EDuration="1.375777052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:11:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:11:40.374395304 +0000 UTC m=+1886.801487386" watchObservedRunningTime="2026-07-15 17:11:40.375777052 +0000 UTC m=+1886.802869137" Jul 15 17:11:41.366688 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:41.366649 2559 generic.go:356] "Generic (PLEG): container finished" podID="e5cbc9b1-36ea-4584-ab47-5e334c861187" containerID="ca0b38fc545f875a4e5d632a2b79747a0d8e479e1b1d3ade1da3d564757d5580" exitCode=7 Jul 15 17:11:41.367090 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:41.366738 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0be65efc-sjx4l" event={"ID":"e5cbc9b1-36ea-4584-ab47-5e334c861187","Type":"ContainerDied","Data":"ca0b38fc545f875a4e5d632a2b79747a0d8e479e1b1d3ade1da3d564757d5580"} Jul 15 17:11:41.367090 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:41.366896 2559 scope.go:117] "RemoveContainer" containerID="ca0b38fc545f875a4e5d632a2b79747a0d8e479e1b1d3ade1da3d564757d5580" Jul 15 17:11:42.373772 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:42.373682 2559 generic.go:356] "Generic (PLEG): container finished" podID="e5cbc9b1-36ea-4584-ab47-5e334c861187" containerID="074cacded2fe9dab63d3a3af85328b702c2c14bade33728f1a13dfff3ff10a77" exitCode=7 Jul 15 17:11:42.373772 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:42.373743 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0be65efc-sjx4l" event={"ID":"e5cbc9b1-36ea-4584-ab47-5e334c861187","Type":"ContainerDied","Data":"074cacded2fe9dab63d3a3af85328b702c2c14bade33728f1a13dfff3ff10a77"} Jul 15 17:11:42.374219 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:42.373815 2559 scope.go:117] "RemoveContainer" containerID="ca0b38fc545f875a4e5d632a2b79747a0d8e479e1b1d3ade1da3d564757d5580" Jul 15 17:11:42.374219 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:42.373947 2559 scope.go:117] "RemoveContainer" containerID="074cacded2fe9dab63d3a3af85328b702c2c14bade33728f1a13dfff3ff10a77" Jul 15 17:11:42.374219 ip-10-0-132-162 kubenswrapper[2559]: E0715 17:11:42.374179 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-0be65efc-sjx4l_odh-ai-gateway-infra(e5cbc9b1-36ea-4584-ab47-5e334c861187)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0be65efc-sjx4l" podUID="e5cbc9b1-36ea-4584-ab47-5e334c861187" Jul 15 17:11:43.381665 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:43.381641 2559 scope.go:117] "RemoveContainer" containerID="074cacded2fe9dab63d3a3af85328b702c2c14bade33728f1a13dfff3ff10a77" Jul 15 17:11:43.382059 ip-10-0-132-162 kubenswrapper[2559]: E0715 17:11:43.381856 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-0be65efc-sjx4l_odh-ai-gateway-infra(e5cbc9b1-36ea-4584-ab47-5e334c861187)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0be65efc-sjx4l" podUID="e5cbc9b1-36ea-4584-ab47-5e334c861187" Jul 15 17:11:55.166823 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:55.166784 2559 scope.go:117] "RemoveContainer" containerID="074cacded2fe9dab63d3a3af85328b702c2c14bade33728f1a13dfff3ff10a77" Jul 15 17:11:55.452066 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:55.451992 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0be65efc-sjx4l" event={"ID":"e5cbc9b1-36ea-4584-ab47-5e334c861187","Type":"ContainerStarted","Data":"d1682024adce41344d8bce1ec5870516b04d2d7c816e938c227807ab64a53014"} Jul 15 17:11:56.458740 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:56.458708 2559 generic.go:356] "Generic (PLEG): container finished" podID="e5cbc9b1-36ea-4584-ab47-5e334c861187" containerID="d1682024adce41344d8bce1ec5870516b04d2d7c816e938c227807ab64a53014" exitCode=0 Jul 15 17:11:56.459165 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:56.458744 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0be65efc-sjx4l" event={"ID":"e5cbc9b1-36ea-4584-ab47-5e334c861187","Type":"ContainerDied","Data":"d1682024adce41344d8bce1ec5870516b04d2d7c816e938c227807ab64a53014"} Jul 15 17:11:56.459165 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:56.458828 2559 scope.go:117] "RemoveContainer" containerID="074cacded2fe9dab63d3a3af85328b702c2c14bade33728f1a13dfff3ff10a77" Jul 15 17:11:56.484443 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:56.484403 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0be65efc-sjx4l"] Jul 15 17:11:57.606922 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:57.606890 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0be65efc-sjx4l" Jul 15 17:11:57.706733 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:57.706701 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5cbc9b1-36ea-4584-ab47-5e334c861187-maas-api-service-ca\") pod \"e5cbc9b1-36ea-4584-ab47-5e334c861187\" (UID: \"e5cbc9b1-36ea-4584-ab47-5e334c861187\") " Jul 15 17:11:57.707079 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:57.707056 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5cbc9b1-36ea-4584-ab47-5e334c861187-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e5cbc9b1-36ea-4584-ab47-5e334c861187" (UID: "e5cbc9b1-36ea-4584-ab47-5e334c861187"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 17:11:57.807823 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:57.807724 2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5cbc9b1-36ea-4584-ab47-5e334c861187-maas-api-service-ca\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 17:11:58.472023 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:58.471936 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0be65efc-sjx4l" Jul 15 17:11:58.472023 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:58.471970 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0be65efc-sjx4l" event={"ID":"e5cbc9b1-36ea-4584-ab47-5e334c861187","Type":"ContainerDied","Data":"d39b97a00bcaaa1ee7f4e6c746b5ce879edefa6f6ee0239bbe3dc60f1515b85f"} Jul 15 17:11:58.472205 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:58.472042 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d39b97a00bcaaa1ee7f4e6c746b5ce879edefa6f6ee0239bbe3dc60f1515b85f" Jul 15 17:11:58.502337 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:58.502310 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0be65efc-sjx4l"] Jul 15 17:11:58.506230 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:11:58.506203 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0be65efc-sjx4l"] Jul 15 17:12:00.173454 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:12:00.173418 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5cbc9b1-36ea-4584-ab47-5e334c861187" path="/var/lib/kubelet/pods/e5cbc9b1-36ea-4584-ab47-5e334c861187/volumes" Jul 15 17:12:29.602528 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:12:29.602491 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0be65efc-mfjsj"] Jul 15 17:12:29.604907 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:12:29.602951 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5cbc9b1-36ea-4584-ab47-5e334c861187" containerName="revoke-keys" Jul 15 17:12:29.604907 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:12:29.602963 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5cbc9b1-36ea-4584-ab47-5e334c861187" containerName="revoke-keys" Jul 15 17:12:29.604907 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:12:29.602980 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5cbc9b1-36ea-4584-ab47-5e334c861187" containerName="revoke-keys" Jul 15 17:12:29.604907 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:12:29.602987 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5cbc9b1-36ea-4584-ab47-5e334c861187" containerName="revoke-keys" Jul 15 17:12:29.604907 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:12:29.603063 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5cbc9b1-36ea-4584-ab47-5e334c861187" containerName="revoke-keys" Jul 15 17:12:29.604907 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:12:29.603072 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5cbc9b1-36ea-4584-ab47-5e334c861187" containerName="revoke-keys" Jul 15 17:12:29.604907 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:12:29.603079 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5cbc9b1-36ea-4584-ab47-5e334c861187" containerName="revoke-keys" Jul 15 17:12:29.606033 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:12:29.606018 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0be65efc-mfjsj" Jul 15 17:12:29.608546 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:12:29.608526 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nthsz\"" Jul 15 17:12:29.612014 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:12:29.611989 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0be65efc-mfjsj"] Jul 15 17:12:29.800262 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:12:29.800224 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fba227f-691a-4d39-82b8-f9d4362e2dab-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0be65efc-mfjsj\" (UID: \"2fba227f-691a-4d39-82b8-f9d4362e2dab\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0be65efc-mfjsj" Jul 15 17:12:29.901327 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:12:29.901224 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fba227f-691a-4d39-82b8-f9d4362e2dab-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0be65efc-mfjsj\" (UID: \"2fba227f-691a-4d39-82b8-f9d4362e2dab\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0be65efc-mfjsj" Jul 15 17:12:29.902134 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:12:29.902109 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fba227f-691a-4d39-82b8-f9d4362e2dab-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0be65efc-mfjsj\" (UID: \"2fba227f-691a-4d39-82b8-f9d4362e2dab\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0be65efc-mfjsj" Jul 15 17:12:29.919900 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:12:29.919869 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0be65efc-mfjsj" Jul 15 17:12:30.056674 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:12:30.056647 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0be65efc-mfjsj"] Jul 15 17:12:30.058973 ip-10-0-132-162 kubenswrapper[2559]: W0715 17:12:30.058941 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fba227f_691a_4d39_82b8_f9d4362e2dab.slice/crio-5be2c13106db6986211f161e7532495b82bd8b86e4d8183967c36ca0d8d467a0 WatchSource:0}: Error finding container 5be2c13106db6986211f161e7532495b82bd8b86e4d8183967c36ca0d8d467a0: Status 404 returned error can't find the container with id 5be2c13106db6986211f161e7532495b82bd8b86e4d8183967c36ca0d8d467a0 Jul 15 17:12:30.646092 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:12:30.645998 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0be65efc-mfjsj" event={"ID":"2fba227f-691a-4d39-82b8-f9d4362e2dab","Type":"ContainerStarted","Data":"12e6dfcf6eeb16d4a2b75bb7426d1c86a34145db5ef9b23add97f0549c7f9ad3"} Jul 15 17:12:30.646092 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:12:30.646047 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0be65efc-mfjsj" event={"ID":"2fba227f-691a-4d39-82b8-f9d4362e2dab","Type":"ContainerStarted","Data":"5be2c13106db6986211f161e7532495b82bd8b86e4d8183967c36ca0d8d467a0"} Jul 15 17:12:30.663355 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:12:30.663308 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0be65efc-mfjsj" podStartSLOduration=1.663291227 podStartE2EDuration="1.663291227s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:12:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:12:30.661350728 +0000 UTC m=+1937.088442813" watchObservedRunningTime="2026-07-15 17:12:30.663291227 +0000 UTC m=+1937.090383312" Jul 15 17:12:31.653019 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:12:31.652977 2559 generic.go:356] "Generic (PLEG): container finished" podID="2fba227f-691a-4d39-82b8-f9d4362e2dab" containerID="12e6dfcf6eeb16d4a2b75bb7426d1c86a34145db5ef9b23add97f0549c7f9ad3" exitCode=0 Jul 15 17:12:31.653408 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:12:31.653069 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0be65efc-mfjsj" event={"ID":"2fba227f-691a-4d39-82b8-f9d4362e2dab","Type":"ContainerDied","Data":"12e6dfcf6eeb16d4a2b75bb7426d1c86a34145db5ef9b23add97f0549c7f9ad3"} Jul 15 17:12:32.795022 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:12:32.794997 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0be65efc-mfjsj" Jul 15 17:12:32.825104 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:12:32.825077 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fba227f-691a-4d39-82b8-f9d4362e2dab-maas-api-service-ca\") pod \"2fba227f-691a-4d39-82b8-f9d4362e2dab\" (UID: \"2fba227f-691a-4d39-82b8-f9d4362e2dab\") " Jul 15 17:12:32.825413 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:12:32.825391 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fba227f-691a-4d39-82b8-f9d4362e2dab-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2fba227f-691a-4d39-82b8-f9d4362e2dab" (UID: "2fba227f-691a-4d39-82b8-f9d4362e2dab"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 17:12:32.925738 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:12:32.925708 2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fba227f-691a-4d39-82b8-f9d4362e2dab-maas-api-service-ca\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 17:12:33.666273 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:12:33.666247 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0be65efc-mfjsj" Jul 15 17:12:33.666458 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:12:33.666281 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0be65efc-mfjsj" event={"ID":"2fba227f-691a-4d39-82b8-f9d4362e2dab","Type":"ContainerDied","Data":"5be2c13106db6986211f161e7532495b82bd8b86e4d8183967c36ca0d8d467a0"} Jul 15 17:12:33.666458 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:12:33.666331 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5be2c13106db6986211f161e7532495b82bd8b86e4d8183967c36ca0d8d467a0" Jul 15 17:14:45.571345 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:14:45.571301 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-68500967-hbshq"] Jul 15 17:14:45.571814 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:14:45.571787 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5cbc9b1-36ea-4584-ab47-5e334c861187" containerName="revoke-keys" Jul 15 17:14:45.571814 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:14:45.571801 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5cbc9b1-36ea-4584-ab47-5e334c861187" containerName="revoke-keys" Jul 15 17:14:45.571814 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:14:45.571811 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fba227f-691a-4d39-82b8-f9d4362e2dab" containerName="revoke-keys" Jul 15 17:14:45.571937 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:14:45.571817 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fba227f-691a-4d39-82b8-f9d4362e2dab" containerName="revoke-keys" Jul 15 17:14:45.571937 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:14:45.571887 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fba227f-691a-4d39-82b8-f9d4362e2dab" containerName="revoke-keys" Jul 15 17:14:45.575061 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:14:45.575035 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-68500967-hbshq" Jul 15 17:14:45.577544 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:14:45.577521 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nthsz\"" Jul 15 17:14:45.586406 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:14:45.586363 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-68500967-hbshq"] Jul 15 17:14:45.703580 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:14:45.703533 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/03e2900f-0355-4520-9349-8c3847389118-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-68500967-hbshq\" (UID: \"03e2900f-0355-4520-9349-8c3847389118\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-68500967-hbshq" Jul 15 17:14:45.805224 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:14:45.805183 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/03e2900f-0355-4520-9349-8c3847389118-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-68500967-hbshq\" (UID: \"03e2900f-0355-4520-9349-8c3847389118\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-68500967-hbshq" Jul 15 17:14:45.805850 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:14:45.805829 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/03e2900f-0355-4520-9349-8c3847389118-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-68500967-hbshq\" (UID: \"03e2900f-0355-4520-9349-8c3847389118\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-68500967-hbshq" Jul 15 17:14:45.897089 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:14:45.896995 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-68500967-hbshq" Jul 15 17:14:46.053115 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:14:46.053084 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-68500967-hbshq"] Jul 15 17:14:46.055887 ip-10-0-132-162 kubenswrapper[2559]: W0715 17:14:46.055859 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03e2900f_0355_4520_9349_8c3847389118.slice/crio-b219635b1d1f7dfc23adabda540e661526aca4992e754606493943443b569730 WatchSource:0}: Error finding container b219635b1d1f7dfc23adabda540e661526aca4992e754606493943443b569730: Status 404 returned error can't find the container with id b219635b1d1f7dfc23adabda540e661526aca4992e754606493943443b569730 Jul 15 17:14:46.416162 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:14:46.416114 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-68500967-hbshq" event={"ID":"03e2900f-0355-4520-9349-8c3847389118","Type":"ContainerStarted","Data":"a9f323c8a4fe423c19231a7943fc0aba7611242d0d67b1d01555bce036757b26"} Jul 15 17:14:46.416367 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:14:46.416183 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-68500967-hbshq" event={"ID":"03e2900f-0355-4520-9349-8c3847389118","Type":"ContainerStarted","Data":"b219635b1d1f7dfc23adabda540e661526aca4992e754606493943443b569730"} Jul 15 17:14:46.432365 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:14:46.432308 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-68500967-hbshq" podStartSLOduration=1.432288073 podStartE2EDuration="1.432288073s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:14:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:14:46.430544248 +0000 UTC m=+2072.857636349" watchObservedRunningTime="2026-07-15 17:14:46.432288073 +0000 UTC m=+2072.859380157" Jul 15 17:14:47.423812 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:14:47.423776 2559 generic.go:356] "Generic (PLEG): container finished" podID="03e2900f-0355-4520-9349-8c3847389118" containerID="a9f323c8a4fe423c19231a7943fc0aba7611242d0d67b1d01555bce036757b26" exitCode=0 Jul 15 17:14:47.424244 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:14:47.423844 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-68500967-hbshq" event={"ID":"03e2900f-0355-4520-9349-8c3847389118","Type":"ContainerDied","Data":"a9f323c8a4fe423c19231a7943fc0aba7611242d0d67b1d01555bce036757b26"} Jul 15 17:14:48.573369 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:14:48.573336 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-68500967-hbshq" Jul 15 17:14:48.631430 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:14:48.631396 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/03e2900f-0355-4520-9349-8c3847389118-maas-api-service-ca\") pod \"03e2900f-0355-4520-9349-8c3847389118\" (UID: \"03e2900f-0355-4520-9349-8c3847389118\") " Jul 15 17:14:48.631803 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:14:48.631781 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03e2900f-0355-4520-9349-8c3847389118-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "03e2900f-0355-4520-9349-8c3847389118" (UID: "03e2900f-0355-4520-9349-8c3847389118"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 17:14:48.733003 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:14:48.732919 2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/03e2900f-0355-4520-9349-8c3847389118-maas-api-service-ca\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 17:14:49.437176 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:14:49.437145 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-68500967-hbshq" Jul 15 17:14:49.437176 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:14:49.437157 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-68500967-hbshq" event={"ID":"03e2900f-0355-4520-9349-8c3847389118","Type":"ContainerDied","Data":"b219635b1d1f7dfc23adabda540e661526aca4992e754606493943443b569730"} Jul 15 17:14:49.437466 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:14:49.437202 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b219635b1d1f7dfc23adabda540e661526aca4992e754606493943443b569730" Jul 15 17:15:14.245069 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:15:14.245040 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vcxdn_268a4cb9-c310-4681-91a6-efe9692f8327/console-operator/2.log" Jul 15 17:15:14.249448 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:15:14.249426 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxsr7_1e30c2c6-c7eb-42ca-add5-239c71eafd0d/ovn-acl-logging/0.log" Jul 15 17:15:14.249448 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:15:14.249439 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vcxdn_268a4cb9-c310-4681-91a6-efe9692f8327/console-operator/2.log" Jul 15 17:15:14.253673 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:15:14.253653 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxsr7_1e30c2c6-c7eb-42ca-add5-239c71eafd0d/ovn-acl-logging/0.log" Jul 15 17:16:31.370837 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:16:31.370736 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1858e64a-6pzlm"] Jul 15 17:16:31.371428 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:16:31.371407 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03e2900f-0355-4520-9349-8c3847389118" containerName="revoke-keys" Jul 15 17:16:31.371474 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:16:31.371435 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="03e2900f-0355-4520-9349-8c3847389118" containerName="revoke-keys" Jul 15 17:16:31.371561 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:16:31.371545 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="03e2900f-0355-4520-9349-8c3847389118" containerName="revoke-keys" Jul 15 17:16:31.375231 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:16:31.375205 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1858e64a-6pzlm" Jul 15 17:16:31.377948 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:16:31.377925 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nthsz\"" Jul 15 17:16:31.379970 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:16:31.379946 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1858e64a-6pzlm"] Jul 15 17:16:31.517191 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:16:31.517153 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c048031-72d7-4cd7-8afa-6e79033d9d46-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1858e64a-6pzlm\" (UID: \"3c048031-72d7-4cd7-8afa-6e79033d9d46\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1858e64a-6pzlm" Jul 15 17:16:31.618175 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:16:31.618132 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c048031-72d7-4cd7-8afa-6e79033d9d46-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1858e64a-6pzlm\" (UID: \"3c048031-72d7-4cd7-8afa-6e79033d9d46\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1858e64a-6pzlm" Jul 15 17:16:31.618923 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:16:31.618900 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c048031-72d7-4cd7-8afa-6e79033d9d46-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1858e64a-6pzlm\" (UID: \"3c048031-72d7-4cd7-8afa-6e79033d9d46\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1858e64a-6pzlm" Jul 15 17:16:31.687306 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:16:31.687264 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1858e64a-6pzlm" Jul 15 17:16:31.835510 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:16:31.835477 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1858e64a-6pzlm"] Jul 15 17:16:31.839680 ip-10-0-132-162 kubenswrapper[2559]: W0715 17:16:31.839652 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c048031_72d7_4cd7_8afa_6e79033d9d46.slice/crio-5ae6ba882d60364fc11d376c5fc867ed61aba8405c5acebae5a960b93b9f816d WatchSource:0}: Error finding container 5ae6ba882d60364fc11d376c5fc867ed61aba8405c5acebae5a960b93b9f816d: Status 404 returned error can't find the container with id 5ae6ba882d60364fc11d376c5fc867ed61aba8405c5acebae5a960b93b9f816d Jul 15 17:16:32.016563 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:16:32.016478 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1858e64a-6pzlm" event={"ID":"3c048031-72d7-4cd7-8afa-6e79033d9d46","Type":"ContainerStarted","Data":"5ae6ba882d60364fc11d376c5fc867ed61aba8405c5acebae5a960b93b9f816d"} Jul 15 17:16:33.023034 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:16:33.023001 2559 generic.go:356] "Generic (PLEG): container finished" podID="3c048031-72d7-4cd7-8afa-6e79033d9d46" containerID="076b07be31c240c299410071b02a77fc8cbb56f714541247e238a7a8c68bd109" exitCode=0 Jul 15 17:16:33.023420 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:16:33.023081 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1858e64a-6pzlm" event={"ID":"3c048031-72d7-4cd7-8afa-6e79033d9d46","Type":"ContainerDied","Data":"076b07be31c240c299410071b02a77fc8cbb56f714541247e238a7a8c68bd109"} Jul 15 17:16:34.170354 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:16:34.170325 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1858e64a-6pzlm" Jul 15 17:16:34.243482 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:16:34.243453 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c048031-72d7-4cd7-8afa-6e79033d9d46-maas-api-service-ca\") pod \"3c048031-72d7-4cd7-8afa-6e79033d9d46\" (UID: \"3c048031-72d7-4cd7-8afa-6e79033d9d46\") " Jul 15 17:16:34.243836 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:16:34.243813 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c048031-72d7-4cd7-8afa-6e79033d9d46-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3c048031-72d7-4cd7-8afa-6e79033d9d46" (UID: "3c048031-72d7-4cd7-8afa-6e79033d9d46"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 17:16:34.344559 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:16:34.344466 2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c048031-72d7-4cd7-8afa-6e79033d9d46-maas-api-service-ca\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 17:16:35.035297 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:16:35.035268 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1858e64a-6pzlm" Jul 15 17:16:35.035490 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:16:35.035301 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1858e64a-6pzlm" event={"ID":"3c048031-72d7-4cd7-8afa-6e79033d9d46","Type":"ContainerDied","Data":"5ae6ba882d60364fc11d376c5fc867ed61aba8405c5acebae5a960b93b9f816d"} Jul 15 17:16:35.035490 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:16:35.035347 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5ae6ba882d60364fc11d376c5fc867ed61aba8405c5acebae5a960b93b9f816d" Jul 15 17:17:14.295539 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:17:14.295508 2559 scope.go:117] "RemoveContainer" containerID="e047d28c0cbd54f88e9c5406609f4fcf07e602e30f09eaa56f534817b0511a72" Jul 15 17:18:14.318117 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:18:14.318083 2559 scope.go:117] "RemoveContainer" containerID="d1682024adce41344d8bce1ec5870516b04d2d7c816e938c227807ab64a53014" Jul 15 17:20:14.288331 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:14.288302 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vcxdn_268a4cb9-c310-4681-91a6-efe9692f8327/console-operator/2.log" Jul 15 17:20:14.292643 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:14.292622 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxsr7_1e30c2c6-c7eb-42ca-add5-239c71eafd0d/ovn-acl-logging/0.log" Jul 15 17:20:14.295476 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:14.295454 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vcxdn_268a4cb9-c310-4681-91a6-efe9692f8327/console-operator/2.log" Jul 15 17:20:14.299547 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:14.299527 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxsr7_1e30c2c6-c7eb-42ca-add5-239c71eafd0d/ovn-acl-logging/0.log" Jul 15 17:20:29.052791 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:29.052714 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-53dfff-vcvxm"] Jul 15 17:20:29.053229 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:29.053189 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c048031-72d7-4cd7-8afa-6e79033d9d46" containerName="revoke-keys" Jul 15 17:20:29.053229 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:29.053204 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c048031-72d7-4cd7-8afa-6e79033d9d46" containerName="revoke-keys" Jul 15 17:20:29.053378 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:29.053268 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c048031-72d7-4cd7-8afa-6e79033d9d46" containerName="revoke-keys" Jul 15 17:20:29.056286 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:29.056270 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-53dfff-vcvxm" Jul 15 17:20:29.058708 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:29.058684 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nthsz\"" Jul 15 17:20:29.064633 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:29.064610 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-53dfff-vcvxm"] Jul 15 17:20:29.084697 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:29.084664 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad5e630a-9bad-47e1-8098-5f24f87b04c7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-53dfff-vcvxm\" (UID: \"ad5e630a-9bad-47e1-8098-5f24f87b04c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-53dfff-vcvxm" Jul 15 17:20:29.185637 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:29.185589 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad5e630a-9bad-47e1-8098-5f24f87b04c7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-53dfff-vcvxm\" (UID: \"ad5e630a-9bad-47e1-8098-5f24f87b04c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-53dfff-vcvxm" Jul 15 17:20:29.186283 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:29.186260 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad5e630a-9bad-47e1-8098-5f24f87b04c7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-53dfff-vcvxm\" (UID: \"ad5e630a-9bad-47e1-8098-5f24f87b04c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-53dfff-vcvxm" Jul 15 17:20:29.368126 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:29.368045 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-53dfff-vcvxm" Jul 15 17:20:29.511044 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:29.511013 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-53dfff-vcvxm"] Jul 15 17:20:29.512357 ip-10-0-132-162 kubenswrapper[2559]: W0715 17:20:29.512328 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad5e630a_9bad_47e1_8098_5f24f87b04c7.slice/crio-60a72a7f8065b7582dd45f94bfbba0f376b1094a48ad8fe83c7cf8a822f9be52 WatchSource:0}: Error finding container 60a72a7f8065b7582dd45f94bfbba0f376b1094a48ad8fe83c7cf8a822f9be52: Status 404 returned error can't find the container with id 60a72a7f8065b7582dd45f94bfbba0f376b1094a48ad8fe83c7cf8a822f9be52 Jul 15 17:20:30.353706 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:30.353672 2559 generic.go:356] "Generic (PLEG): container finished" podID="ad5e630a-9bad-47e1-8098-5f24f87b04c7" containerID="c20e449478dc91383b89b4fa559c469afc19396b62553ab5d4e96ff14891ebad" exitCode=0 Jul 15 17:20:30.354088 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:30.353768 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-53dfff-vcvxm" event={"ID":"ad5e630a-9bad-47e1-8098-5f24f87b04c7","Type":"ContainerDied","Data":"c20e449478dc91383b89b4fa559c469afc19396b62553ab5d4e96ff14891ebad"} Jul 15 17:20:30.354088 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:30.353817 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-53dfff-vcvxm" event={"ID":"ad5e630a-9bad-47e1-8098-5f24f87b04c7","Type":"ContainerStarted","Data":"60a72a7f8065b7582dd45f94bfbba0f376b1094a48ad8fe83c7cf8a822f9be52"} Jul 15 17:20:31.493394 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:31.493367 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-53dfff-vcvxm" Jul 15 17:20:31.502170 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:31.502148 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad5e630a-9bad-47e1-8098-5f24f87b04c7-maas-api-service-ca\") pod \"ad5e630a-9bad-47e1-8098-5f24f87b04c7\" (UID: \"ad5e630a-9bad-47e1-8098-5f24f87b04c7\") " Jul 15 17:20:31.502448 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:31.502428 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad5e630a-9bad-47e1-8098-5f24f87b04c7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ad5e630a-9bad-47e1-8098-5f24f87b04c7" (UID: "ad5e630a-9bad-47e1-8098-5f24f87b04c7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 17:20:31.603193 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:31.603149 2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad5e630a-9bad-47e1-8098-5f24f87b04c7-maas-api-service-ca\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 17:20:32.365984 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:32.365951 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-53dfff-vcvxm" Jul 15 17:20:32.366171 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:32.365986 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-53dfff-vcvxm" event={"ID":"ad5e630a-9bad-47e1-8098-5f24f87b04c7","Type":"ContainerDied","Data":"60a72a7f8065b7582dd45f94bfbba0f376b1094a48ad8fe83c7cf8a822f9be52"} Jul 15 17:20:32.366171 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:32.366043 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="60a72a7f8065b7582dd45f94bfbba0f376b1094a48ad8fe83c7cf8a822f9be52" Jul 15 17:20:55.241349 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:55.241306 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c6b351-4rmpj"] Jul 15 17:20:55.242023 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:55.242002 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad5e630a-9bad-47e1-8098-5f24f87b04c7" containerName="revoke-keys" Jul 15 17:20:55.242111 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:55.242025 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad5e630a-9bad-47e1-8098-5f24f87b04c7" containerName="revoke-keys" Jul 15 17:20:55.242165 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:55.242115 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad5e630a-9bad-47e1-8098-5f24f87b04c7" containerName="revoke-keys" Jul 15 17:20:55.245300 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:55.245276 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c6b351-4rmpj" Jul 15 17:20:55.247862 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:55.247836 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nthsz\"" Jul 15 17:20:55.251787 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:55.251760 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c6b351-4rmpj"] Jul 15 17:20:55.332304 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:55.332265 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e85019a8-9be4-4672-bc93-fd4f69eb79ba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-c6b351-4rmpj\" (UID: \"e85019a8-9be4-4672-bc93-fd4f69eb79ba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c6b351-4rmpj" Jul 15 17:20:55.433567 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:55.433532 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e85019a8-9be4-4672-bc93-fd4f69eb79ba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-c6b351-4rmpj\" (UID: \"e85019a8-9be4-4672-bc93-fd4f69eb79ba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c6b351-4rmpj" Jul 15 17:20:55.434197 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:55.434177 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e85019a8-9be4-4672-bc93-fd4f69eb79ba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-c6b351-4rmpj\" (UID: \"e85019a8-9be4-4672-bc93-fd4f69eb79ba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c6b351-4rmpj" Jul 15 17:20:55.557903 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:55.557824 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c6b351-4rmpj" Jul 15 17:20:55.699417 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:55.699388 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c6b351-4rmpj"] Jul 15 17:20:55.701376 ip-10-0-132-162 kubenswrapper[2559]: W0715 17:20:55.701345 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode85019a8_9be4_4672_bc93_fd4f69eb79ba.slice/crio-8653286176f0a44317b9a997f947d6c76af69b353a5a8a32d6baf83fb49962f0 WatchSource:0}: Error finding container 8653286176f0a44317b9a997f947d6c76af69b353a5a8a32d6baf83fb49962f0: Status 404 returned error can't find the container with id 8653286176f0a44317b9a997f947d6c76af69b353a5a8a32d6baf83fb49962f0 Jul 15 17:20:56.496738 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:56.496703 2559 generic.go:356] "Generic (PLEG): container finished" podID="e85019a8-9be4-4672-bc93-fd4f69eb79ba" containerID="b517462d46e721ae1e9d13fc516b4ebd93be4940c74a1525f6a3004d12d2a842" exitCode=0 Jul 15 17:20:56.497071 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:56.496797 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c6b351-4rmpj" event={"ID":"e85019a8-9be4-4672-bc93-fd4f69eb79ba","Type":"ContainerDied","Data":"b517462d46e721ae1e9d13fc516b4ebd93be4940c74a1525f6a3004d12d2a842"} Jul 15 17:20:56.497071 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:56.496854 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c6b351-4rmpj" event={"ID":"e85019a8-9be4-4672-bc93-fd4f69eb79ba","Type":"ContainerStarted","Data":"8653286176f0a44317b9a997f947d6c76af69b353a5a8a32d6baf83fb49962f0"} Jul 15 17:20:57.637945 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:57.637918 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c6b351-4rmpj" Jul 15 17:20:57.754864 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:57.754798 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e85019a8-9be4-4672-bc93-fd4f69eb79ba-maas-api-service-ca\") pod \"e85019a8-9be4-4672-bc93-fd4f69eb79ba\" (UID: \"e85019a8-9be4-4672-bc93-fd4f69eb79ba\") " Jul 15 17:20:57.755120 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:57.755099 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e85019a8-9be4-4672-bc93-fd4f69eb79ba-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e85019a8-9be4-4672-bc93-fd4f69eb79ba" (UID: "e85019a8-9be4-4672-bc93-fd4f69eb79ba"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 17:20:57.856086 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:57.856063 2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e85019a8-9be4-4672-bc93-fd4f69eb79ba-maas-api-service-ca\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 17:20:58.509610 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:58.509533 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c6b351-4rmpj" Jul 15 17:20:58.509764 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:58.509535 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c6b351-4rmpj" event={"ID":"e85019a8-9be4-4672-bc93-fd4f69eb79ba","Type":"ContainerDied","Data":"8653286176f0a44317b9a997f947d6c76af69b353a5a8a32d6baf83fb49962f0"} Jul 15 17:20:58.509764 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:20:58.509660 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8653286176f0a44317b9a997f947d6c76af69b353a5a8a32d6baf83fb49962f0" Jul 15 17:21:45.656393 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:21:45.656359 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-29071b-szbwz"] Jul 15 17:21:45.656831 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:21:45.656813 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e85019a8-9be4-4672-bc93-fd4f69eb79ba" containerName="revoke-keys" Jul 15 17:21:45.656831 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:21:45.656830 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e85019a8-9be4-4672-bc93-fd4f69eb79ba" containerName="revoke-keys" Jul 15 17:21:45.656922 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:21:45.656912 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e85019a8-9be4-4672-bc93-fd4f69eb79ba" containerName="revoke-keys" Jul 15 17:21:45.660074 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:21:45.660058 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-29071b-szbwz" Jul 15 17:21:45.662380 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:21:45.662361 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nthsz\"" Jul 15 17:21:45.667671 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:21:45.667650 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-29071b-szbwz"] Jul 15 17:21:45.783490 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:21:45.783466 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a650039-dbfe-446d-8523-5aa8651bd97b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-29071b-szbwz\" (UID: \"5a650039-dbfe-446d-8523-5aa8651bd97b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-29071b-szbwz" Jul 15 17:21:45.884795 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:21:45.884737 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a650039-dbfe-446d-8523-5aa8651bd97b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-29071b-szbwz\" (UID: \"5a650039-dbfe-446d-8523-5aa8651bd97b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-29071b-szbwz" Jul 15 17:21:45.885411 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:21:45.885386 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a650039-dbfe-446d-8523-5aa8651bd97b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-29071b-szbwz\" (UID: \"5a650039-dbfe-446d-8523-5aa8651bd97b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-29071b-szbwz" Jul 15 17:21:45.972547 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:21:45.972514 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-29071b-szbwz" Jul 15 17:21:46.109787 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:21:46.109196 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-29071b-szbwz"] Jul 15 17:21:46.112919 ip-10-0-132-162 kubenswrapper[2559]: W0715 17:21:46.112862 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a650039_dbfe_446d_8523_5aa8651bd97b.slice/crio-eda1e33e3b4e2d93026f71aa62b1824032b22e93f1913edcbe29e34fd3f17ce0 WatchSource:0}: Error finding container eda1e33e3b4e2d93026f71aa62b1824032b22e93f1913edcbe29e34fd3f17ce0: Status 404 returned error can't find the container with id eda1e33e3b4e2d93026f71aa62b1824032b22e93f1913edcbe29e34fd3f17ce0 Jul 15 17:21:46.772802 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:21:46.772740 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-29071b-szbwz" event={"ID":"5a650039-dbfe-446d-8523-5aa8651bd97b","Type":"ContainerStarted","Data":"e704c963db44e4c3d7b696edfa954c88798fe1bc0a88ae000345307d8b99c641"} Jul 15 17:21:46.773209 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:21:46.772823 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-29071b-szbwz" event={"ID":"5a650039-dbfe-446d-8523-5aa8651bd97b","Type":"ContainerStarted","Data":"eda1e33e3b4e2d93026f71aa62b1824032b22e93f1913edcbe29e34fd3f17ce0"} Jul 15 17:21:46.790863 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:21:46.790809 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-29071b-szbwz" podStartSLOduration=1.7907907280000002 podStartE2EDuration="1.790790728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:21:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:21:46.789937737 +0000 UTC m=+2493.217029836" watchObservedRunningTime="2026-07-15 17:21:46.790790728 +0000 UTC m=+2493.217882811" Jul 15 17:21:47.779573 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:21:47.779541 2559 generic.go:356] "Generic (PLEG): container finished" podID="5a650039-dbfe-446d-8523-5aa8651bd97b" containerID="e704c963db44e4c3d7b696edfa954c88798fe1bc0a88ae000345307d8b99c641" exitCode=0 Jul 15 17:21:47.779961 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:21:47.779597 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-29071b-szbwz" event={"ID":"5a650039-dbfe-446d-8523-5aa8651bd97b","Type":"ContainerDied","Data":"e704c963db44e4c3d7b696edfa954c88798fe1bc0a88ae000345307d8b99c641"} Jul 15 17:21:48.942378 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:21:48.942350 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-29071b-szbwz" Jul 15 17:21:49.113240 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:21:49.113166 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a650039-dbfe-446d-8523-5aa8651bd97b-maas-api-service-ca\") pod \"5a650039-dbfe-446d-8523-5aa8651bd97b\" (UID: \"5a650039-dbfe-446d-8523-5aa8651bd97b\") " Jul 15 17:21:49.113505 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:21:49.113485 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a650039-dbfe-446d-8523-5aa8651bd97b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5a650039-dbfe-446d-8523-5aa8651bd97b" (UID: "5a650039-dbfe-446d-8523-5aa8651bd97b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 17:21:49.214085 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:21:49.214059 2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a650039-dbfe-446d-8523-5aa8651bd97b-maas-api-service-ca\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 17:21:49.791759 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:21:49.791722 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-29071b-szbwz" event={"ID":"5a650039-dbfe-446d-8523-5aa8651bd97b","Type":"ContainerDied","Data":"eda1e33e3b4e2d93026f71aa62b1824032b22e93f1913edcbe29e34fd3f17ce0"} Jul 15 17:21:49.791918 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:21:49.791783 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-29071b-szbwz" Jul 15 17:21:49.791918 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:21:49.791803 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eda1e33e3b4e2d93026f71aa62b1824032b22e93f1913edcbe29e34fd3f17ce0" Jul 15 17:22:11.767349 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:22:11.763640 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-714199-rz5rs"] Jul 15 17:22:11.767349 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:22:11.764806 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a650039-dbfe-446d-8523-5aa8651bd97b" containerName="revoke-keys" Jul 15 17:22:11.767349 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:22:11.764829 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a650039-dbfe-446d-8523-5aa8651bd97b" containerName="revoke-keys" Jul 15 17:22:11.767349 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:22:11.765040 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a650039-dbfe-446d-8523-5aa8651bd97b" containerName="revoke-keys" Jul 15 17:22:11.769501 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:22:11.769474 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-714199-rz5rs" Jul 15 17:22:11.772263 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:22:11.772228 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nthsz\"" Jul 15 17:22:11.774578 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:22:11.774553 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-714199-rz5rs"] Jul 15 17:22:11.811944 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:22:11.811910 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be69dfda-097c-49be-abf5-1fb928a6bdc1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-714199-rz5rs\" (UID: \"be69dfda-097c-49be-abf5-1fb928a6bdc1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-714199-rz5rs" Jul 15 17:22:11.912614 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:22:11.912578 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be69dfda-097c-49be-abf5-1fb928a6bdc1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-714199-rz5rs\" (UID: \"be69dfda-097c-49be-abf5-1fb928a6bdc1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-714199-rz5rs" Jul 15 17:22:11.913285 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:22:11.913265 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be69dfda-097c-49be-abf5-1fb928a6bdc1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-714199-rz5rs\" (UID: \"be69dfda-097c-49be-abf5-1fb928a6bdc1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-714199-rz5rs" Jul 15 17:22:12.082798 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:22:12.082697 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-714199-rz5rs" Jul 15 17:22:12.425049 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:22:12.425015 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-714199-rz5rs"] Jul 15 17:22:12.426472 ip-10-0-132-162 kubenswrapper[2559]: W0715 17:22:12.426442 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe69dfda_097c_49be_abf5_1fb928a6bdc1.slice/crio-92d6f5c47fc91b1be0e23dbc3422d9395e06f6ee128f99f822e0b61515619dbd WatchSource:0}: Error finding container 92d6f5c47fc91b1be0e23dbc3422d9395e06f6ee128f99f822e0b61515619dbd: Status 404 returned error can't find the container with id 92d6f5c47fc91b1be0e23dbc3422d9395e06f6ee128f99f822e0b61515619dbd Jul 15 17:22:12.933939 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:22:12.933901 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-714199-rz5rs" event={"ID":"be69dfda-097c-49be-abf5-1fb928a6bdc1","Type":"ContainerStarted","Data":"b3a4ae9f533f1eccaefe4ced291b510996b7fe14486bc533132448fbaab2fede"} Jul 15 17:22:12.934317 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:22:12.933965 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-714199-rz5rs" event={"ID":"be69dfda-097c-49be-abf5-1fb928a6bdc1","Type":"ContainerStarted","Data":"92d6f5c47fc91b1be0e23dbc3422d9395e06f6ee128f99f822e0b61515619dbd"} Jul 15 17:22:12.949321 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:22:12.949277 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-714199-rz5rs" podStartSLOduration=1.94926252 podStartE2EDuration="1.94926252s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:22:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:22:12.948203647 +0000 UTC m=+2519.375295733" watchObservedRunningTime="2026-07-15 17:22:12.94926252 +0000 UTC m=+2519.376354641" Jul 15 17:22:13.941290 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:22:13.941258 2559 generic.go:356] "Generic (PLEG): container finished" podID="be69dfda-097c-49be-abf5-1fb928a6bdc1" containerID="b3a4ae9f533f1eccaefe4ced291b510996b7fe14486bc533132448fbaab2fede" exitCode=0 Jul 15 17:22:13.941668 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:22:13.941303 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-714199-rz5rs" event={"ID":"be69dfda-097c-49be-abf5-1fb928a6bdc1","Type":"ContainerDied","Data":"b3a4ae9f533f1eccaefe4ced291b510996b7fe14486bc533132448fbaab2fede"} Jul 15 17:22:15.080626 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:22:15.080605 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-714199-rz5rs" Jul 15 17:22:15.142934 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:22:15.142911 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be69dfda-097c-49be-abf5-1fb928a6bdc1-maas-api-service-ca\") pod \"be69dfda-097c-49be-abf5-1fb928a6bdc1\" (UID: \"be69dfda-097c-49be-abf5-1fb928a6bdc1\") " Jul 15 17:22:15.143229 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:22:15.143207 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be69dfda-097c-49be-abf5-1fb928a6bdc1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "be69dfda-097c-49be-abf5-1fb928a6bdc1" (UID: "be69dfda-097c-49be-abf5-1fb928a6bdc1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 17:22:15.243985 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:22:15.243918 2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be69dfda-097c-49be-abf5-1fb928a6bdc1-maas-api-service-ca\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 17:22:15.953620 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:22:15.953588 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-714199-rz5rs" Jul 15 17:22:15.953807 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:22:15.953617 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-714199-rz5rs" event={"ID":"be69dfda-097c-49be-abf5-1fb928a6bdc1","Type":"ContainerDied","Data":"92d6f5c47fc91b1be0e23dbc3422d9395e06f6ee128f99f822e0b61515619dbd"} Jul 15 17:22:15.953807 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:22:15.953664 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="92d6f5c47fc91b1be0e23dbc3422d9395e06f6ee128f99f822e0b61515619dbd" Jul 15 17:25:14.336984 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:25:14.336902 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vcxdn_268a4cb9-c310-4681-91a6-efe9692f8327/console-operator/2.log" Jul 15 17:25:14.341244 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:25:14.341218 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxsr7_1e30c2c6-c7eb-42ca-add5-239c71eafd0d/ovn-acl-logging/0.log" Jul 15 17:25:14.345187 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:25:14.345166 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vcxdn_268a4cb9-c310-4681-91a6-efe9692f8327/console-operator/2.log" Jul 15 17:25:14.349187 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:25:14.349169 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxsr7_1e30c2c6-c7eb-42ca-add5-239c71eafd0d/ovn-acl-logging/0.log" Jul 15 17:28:52.939370 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:28:52.939328 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-abaf36-xjzzz"] Jul 15 17:28:52.940042 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:28:52.940019 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be69dfda-097c-49be-abf5-1fb928a6bdc1" containerName="revoke-keys" Jul 15 17:28:52.940137 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:28:52.940044 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="be69dfda-097c-49be-abf5-1fb928a6bdc1" containerName="revoke-keys" Jul 15 17:28:52.940192 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:28:52.940145 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="be69dfda-097c-49be-abf5-1fb928a6bdc1" containerName="revoke-keys" Jul 15 17:28:52.943385 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:28:52.943360 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-abaf36-xjzzz" Jul 15 17:28:52.945657 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:28:52.945628 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nthsz\"" Jul 15 17:28:52.949626 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:28:52.949605 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-abaf36-xjzzz"] Jul 15 17:28:53.093691 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:28:53.093652 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6840116b-63c7-431a-9062-e4a3aa36a0be-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-abaf36-xjzzz\" (UID: \"6840116b-63c7-431a-9062-e4a3aa36a0be\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-abaf36-xjzzz" Jul 15 17:28:53.194596 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:28:53.194513 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6840116b-63c7-431a-9062-e4a3aa36a0be-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-abaf36-xjzzz\" (UID: \"6840116b-63c7-431a-9062-e4a3aa36a0be\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-abaf36-xjzzz" Jul 15 17:28:53.195361 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:28:53.195340 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6840116b-63c7-431a-9062-e4a3aa36a0be-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-abaf36-xjzzz\" (UID: \"6840116b-63c7-431a-9062-e4a3aa36a0be\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-abaf36-xjzzz" Jul 15 17:28:53.255644 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:28:53.255609 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-abaf36-xjzzz" Jul 15 17:28:53.399264 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:28:53.399225 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-abaf36-xjzzz"] Jul 15 17:28:53.401052 ip-10-0-132-162 kubenswrapper[2559]: W0715 17:28:53.401029 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6840116b_63c7_431a_9062_e4a3aa36a0be.slice/crio-2bee78378aaf75b9b411888368ee5d31badd51605ffc67efb2b695c1a42e2ce7 WatchSource:0}: Error finding container 2bee78378aaf75b9b411888368ee5d31badd51605ffc67efb2b695c1a42e2ce7: Status 404 returned error can't find the container with id 2bee78378aaf75b9b411888368ee5d31badd51605ffc67efb2b695c1a42e2ce7 Jul 15 17:28:54.205526 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:28:54.205489 2559 generic.go:356] "Generic (PLEG): container finished" podID="6840116b-63c7-431a-9062-e4a3aa36a0be" containerID="f0c58052f2df888ae63f34fa5de1c1c69728880777cc5bc59b38d85aff5038d0" exitCode=0 Jul 15 17:28:54.205526 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:28:54.205529 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-abaf36-xjzzz" event={"ID":"6840116b-63c7-431a-9062-e4a3aa36a0be","Type":"ContainerDied","Data":"f0c58052f2df888ae63f34fa5de1c1c69728880777cc5bc59b38d85aff5038d0"} Jul 15 17:28:54.205981 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:28:54.205565 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-abaf36-xjzzz" event={"ID":"6840116b-63c7-431a-9062-e4a3aa36a0be","Type":"ContainerStarted","Data":"2bee78378aaf75b9b411888368ee5d31badd51605ffc67efb2b695c1a42e2ce7"} Jul 15 17:28:55.347069 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:28:55.347038 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-abaf36-xjzzz" Jul 15 17:28:55.518198 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:28:55.518101 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6840116b-63c7-431a-9062-e4a3aa36a0be-maas-api-service-ca\") pod \"6840116b-63c7-431a-9062-e4a3aa36a0be\" (UID: \"6840116b-63c7-431a-9062-e4a3aa36a0be\") " Jul 15 17:28:55.518530 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:28:55.518498 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6840116b-63c7-431a-9062-e4a3aa36a0be-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6840116b-63c7-431a-9062-e4a3aa36a0be" (UID: "6840116b-63c7-431a-9062-e4a3aa36a0be"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 17:28:55.618978 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:28:55.618937 2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6840116b-63c7-431a-9062-e4a3aa36a0be-maas-api-service-ca\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 17:28:56.217960 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:28:56.217930 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-abaf36-xjzzz" Jul 15 17:28:56.218131 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:28:56.217970 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-abaf36-xjzzz" event={"ID":"6840116b-63c7-431a-9062-e4a3aa36a0be","Type":"ContainerDied","Data":"2bee78378aaf75b9b411888368ee5d31badd51605ffc67efb2b695c1a42e2ce7"} Jul 15 17:28:56.218131 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:28:56.218019 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2bee78378aaf75b9b411888368ee5d31badd51605ffc67efb2b695c1a42e2ce7" Jul 15 17:29:19.057247 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:19.057207 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1e0e66-7c2z7"] Jul 15 17:29:19.057813 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:19.057797 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6840116b-63c7-431a-9062-e4a3aa36a0be" containerName="revoke-keys" Jul 15 17:29:19.057813 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:19.057814 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6840116b-63c7-431a-9062-e4a3aa36a0be" containerName="revoke-keys" Jul 15 17:29:19.057921 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:19.057913 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6840116b-63c7-431a-9062-e4a3aa36a0be" containerName="revoke-keys" Jul 15 17:29:19.061432 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:19.061413 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1e0e66-7c2z7" Jul 15 17:29:19.063906 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:19.063881 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nthsz\"" Jul 15 17:29:19.067857 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:19.067834 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1e0e66-7c2z7"] Jul 15 17:29:19.159035 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:19.159007 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf0cda93-7876-4f75-98e4-3513f1793cc7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-1e0e66-7c2z7\" (UID: \"cf0cda93-7876-4f75-98e4-3513f1793cc7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1e0e66-7c2z7" Jul 15 17:29:19.259558 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:19.259531 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf0cda93-7876-4f75-98e4-3513f1793cc7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-1e0e66-7c2z7\" (UID: \"cf0cda93-7876-4f75-98e4-3513f1793cc7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1e0e66-7c2z7" Jul 15 17:29:19.260179 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:19.260160 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf0cda93-7876-4f75-98e4-3513f1793cc7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-1e0e66-7c2z7\" (UID: \"cf0cda93-7876-4f75-98e4-3513f1793cc7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1e0e66-7c2z7" Jul 15 17:29:19.374313 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:19.374242 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1e0e66-7c2z7" Jul 15 17:29:19.509473 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:19.509448 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1e0e66-7c2z7"] Jul 15 17:29:19.511938 ip-10-0-132-162 kubenswrapper[2559]: W0715 17:29:19.511905 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf0cda93_7876_4f75_98e4_3513f1793cc7.slice/crio-631e864ad3ae130d4b41a381b4dacc355316be9e13c3d5328e7f650d462f66e3 WatchSource:0}: Error finding container 631e864ad3ae130d4b41a381b4dacc355316be9e13c3d5328e7f650d462f66e3: Status 404 returned error can't find the container with id 631e864ad3ae130d4b41a381b4dacc355316be9e13c3d5328e7f650d462f66e3 Jul 15 17:29:20.359033 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:20.359004 2559 generic.go:356] "Generic (PLEG): container finished" podID="cf0cda93-7876-4f75-98e4-3513f1793cc7" containerID="33951157692c807496538703f64745985c64ef66fe6a1dae25886a597eee7e2d" exitCode=0 Jul 15 17:29:20.359401 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:20.359095 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1e0e66-7c2z7" event={"ID":"cf0cda93-7876-4f75-98e4-3513f1793cc7","Type":"ContainerDied","Data":"33951157692c807496538703f64745985c64ef66fe6a1dae25886a597eee7e2d"} Jul 15 17:29:20.359401 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:20.359161 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1e0e66-7c2z7" event={"ID":"cf0cda93-7876-4f75-98e4-3513f1793cc7","Type":"ContainerStarted","Data":"631e864ad3ae130d4b41a381b4dacc355316be9e13c3d5328e7f650d462f66e3"} Jul 15 17:29:21.503376 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:21.503350 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1e0e66-7c2z7" Jul 15 17:29:21.578889 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:21.578862 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf0cda93-7876-4f75-98e4-3513f1793cc7-maas-api-service-ca\") pod \"cf0cda93-7876-4f75-98e4-3513f1793cc7\" (UID: \"cf0cda93-7876-4f75-98e4-3513f1793cc7\") " Jul 15 17:29:21.579195 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:21.579174 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf0cda93-7876-4f75-98e4-3513f1793cc7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cf0cda93-7876-4f75-98e4-3513f1793cc7" (UID: "cf0cda93-7876-4f75-98e4-3513f1793cc7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 17:29:21.680121 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:21.680100 2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf0cda93-7876-4f75-98e4-3513f1793cc7-maas-api-service-ca\") on node \"ip-10-0-132-162.ec2.internal\" DevicePath \"\"" Jul 15 17:29:22.372551 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:22.372522 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1e0e66-7c2z7" Jul 15 17:29:22.372715 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:22.372550 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1e0e66-7c2z7" event={"ID":"cf0cda93-7876-4f75-98e4-3513f1793cc7","Type":"ContainerDied","Data":"631e864ad3ae130d4b41a381b4dacc355316be9e13c3d5328e7f650d462f66e3"} Jul 15 17:29:22.372715 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:22.372603 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="631e864ad3ae130d4b41a381b4dacc355316be9e13c3d5328e7f650d462f66e3" Jul 15 17:29:51.004021 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:51.003993 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-77fd9784f8-sxlt5_904e7b42-202f-4d55-a81e-d42e6af9b820/manager/0.log" Jul 15 17:29:51.479459 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:51.479434 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9487b7458-nnjmd_ee0aa582-abb4-4ac9-9f76-2773095f646b/copy-manifests/0.log" Jul 15 17:29:51.491346 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:51.491326 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9487b7458-nnjmd_ee0aa582-abb4-4ac9-9f76-2773095f646b/manager/0.log" Jul 15 17:29:51.995413 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:51.995385 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-659f59cc95-2mn77_93c1d572-3682-4135-a6c5-8a2ecafc93cf/maas-api/0.log" Jul 15 17:29:52.111172 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:52.111131 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735580-f498m_23fedaf4-a58d-4244-8ed5-9d268786c675/cleanup/0.log" Jul 15 17:29:52.338367 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:52.338294 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-3e01659b-fr2sl_4fe5d1d0-ac91-44fd-a45d-b586d7afc660/revoke-keys/0.log" Jul 15 17:29:52.555073 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:52.555044 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-29071b-szbwz_5a650039-dbfe-446d-8523-5aa8651bd97b/revoke-keys/0.log" Jul 15 17:29:52.664740 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:52.664715 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-714199-rz5rs_be69dfda-097c-49be-abf5-1fb928a6bdc1/revoke-keys/0.log" Jul 15 17:29:52.771597 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:52.771567 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-0be65efc-mfjsj_2fba227f-691a-4d39-82b8-f9d4362e2dab/revoke-keys/0.log" Jul 15 17:29:52.877313 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:52.877284 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-53dfff-vcvxm_ad5e630a-9bad-47e1-8098-5f24f87b04c7/revoke-keys/0.log" Jul 15 17:29:52.983101 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:52.983017 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-c6b351-4rmpj_e85019a8-9be4-4672-bc93-fd4f69eb79ba/revoke-keys/0.log" Jul 15 17:29:53.204644 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:53.204613 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-1858e64a-6pzlm_3c048031-72d7-4cd7-8afa-6e79033d9d46/revoke-keys/0.log" Jul 15 17:29:53.316871 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:53.316779 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-68500967-hbshq_03e2900f-0355-4520-9349-8c3847389118/revoke-keys/0.log" Jul 15 17:29:53.425880 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:53.425849 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-abaf36-xjzzz_6840116b-63c7-431a-9062-e4a3aa36a0be/revoke-keys/0.log" Jul 15 17:29:53.539531 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:53.539495 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-1e0e66-7c2z7_cf0cda93-7876-4f75-98e4-3513f1793cc7/revoke-keys/0.log" Jul 15 17:29:55.174578 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:55.174550 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-jbz7p_058df57d-84d1-49a0-958e-eb78abe6569c/manager/0.log" Jul 15 17:29:55.524715 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:55.524633 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-hnkpk_bd660fa4-2d65-484f-b48c-40bd9a03f073/manager/0.log" Jul 15 17:29:56.260723 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:56.260690 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-hr2ls_e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2/discovery/0.log" Jul 15 17:29:56.717435 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:56.717408 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-xpc7d_5dfd5816-ec68-44b9-8ee4-50d3a2791f6a/payload-pre-processing/0.log" Jul 15 17:29:57.407153 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:57.407125 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-qf72d_9cc7ee18-7ca4-4995-8376-9b3ba4f66ecf/main/0.log" Jul 15 17:29:57.730682 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:29:57.730653 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-zz4z2_4ececdd4-6d0f-4cb0-a7da-f4cbbb41b1a5/main/0.log" Jul 15 17:30:06.723546 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:06.723516 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8kzck_0dcb64c6-1cc0-4bb8-b0eb-f97eb952dd0e/global-pull-secret-syncer/0.log" Jul 15 17:30:06.876806 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:06.876775 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bwv27_6ebc4f77-e864-4fb8-b9d6-5e5b6c91fd9a/konnectivity-agent/0.log" Jul 15 17:30:06.948460 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:06.948432 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-162.ec2.internal_0819db2e07dd6ab94870584aab4ec920/haproxy/0.log" Jul 15 17:30:12.286456 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:12.286421 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-jbz7p_058df57d-84d1-49a0-958e-eb78abe6569c/manager/0.log" Jul 15 17:30:12.504811 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:12.504771 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-hnkpk_bd660fa4-2d65-484f-b48c-40bd9a03f073/manager/0.log" Jul 15 17:30:14.116702 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:14.116667 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5c5e2b4c-e367-43f6-becd-b6d9facedd79/alertmanager/0.log" Jul 15 17:30:14.143609 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:14.143580 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5c5e2b4c-e367-43f6-becd-b6d9facedd79/config-reloader/0.log" Jul 15 17:30:14.171004 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:14.170974 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5c5e2b4c-e367-43f6-becd-b6d9facedd79/kube-rbac-proxy-web/0.log" Jul 15 17:30:14.192620 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:14.192595 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5c5e2b4c-e367-43f6-becd-b6d9facedd79/kube-rbac-proxy/0.log" Jul 15 17:30:14.213866 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:14.213839 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5c5e2b4c-e367-43f6-becd-b6d9facedd79/kube-rbac-proxy-metric/0.log" Jul 15 17:30:14.234352 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:14.234322 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5c5e2b4c-e367-43f6-becd-b6d9facedd79/prom-label-proxy/0.log" Jul 15 17:30:14.254547 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:14.254523 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5c5e2b4c-e367-43f6-becd-b6d9facedd79/init-config-reloader/0.log" Jul 15 17:30:14.351333 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:14.351306 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-sgrd6_4c86b83a-9e88-40fe-bd48-de0cd484b746/kube-state-metrics/0.log" Jul 15 17:30:14.372609 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:14.372517 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-sgrd6_4c86b83a-9e88-40fe-bd48-de0cd484b746/kube-rbac-proxy-main/0.log" Jul 15 17:30:14.376217 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:14.376194 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vcxdn_268a4cb9-c310-4681-91a6-efe9692f8327/console-operator/2.log" Jul 15 17:30:14.380847 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:14.380824 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxsr7_1e30c2c6-c7eb-42ca-add5-239c71eafd0d/ovn-acl-logging/0.log" Jul 15 17:30:14.385738 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:14.385718 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vcxdn_268a4cb9-c310-4681-91a6-efe9692f8327/console-operator/2.log" Jul 15 17:30:14.389885 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:14.389867 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxsr7_1e30c2c6-c7eb-42ca-add5-239c71eafd0d/ovn-acl-logging/0.log" Jul 15 17:30:14.400895 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:14.400873 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-sgrd6_4c86b83a-9e88-40fe-bd48-de0cd484b746/kube-rbac-proxy-self/0.log" Jul 15 17:30:14.470651 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:14.470622 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-ftbvc_b77182b9-ad00-4a6e-8166-d93b24cd4969/monitoring-plugin/0.log" Jul 15 17:30:14.673164 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:14.673139 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l6ddv_89319841-337a-497d-b21a-2fb3b88cb5c5/node-exporter/0.log" Jul 15 17:30:14.698354 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:14.698329 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l6ddv_89319841-337a-497d-b21a-2fb3b88cb5c5/kube-rbac-proxy/0.log" Jul 15 17:30:14.719778 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:14.719738 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l6ddv_89319841-337a-497d-b21a-2fb3b88cb5c5/init-textfile/0.log" Jul 15 17:30:14.752552 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:14.752525 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-wvb5d_2748021c-88bb-4663-bdd3-a58eb99055b7/kube-rbac-proxy-main/0.log" Jul 15 17:30:14.775842 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:14.775815 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-wvb5d_2748021c-88bb-4663-bdd3-a58eb99055b7/kube-rbac-proxy-self/0.log" Jul 15 17:30:14.804030 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:14.803986 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-wvb5d_2748021c-88bb-4663-bdd3-a58eb99055b7/openshift-state-metrics/0.log" Jul 15 17:30:15.014247 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:15.014169 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-nk25g_2b17740b-019e-4b4c-9fcb-e84f2facf4ce/prometheus-operator/0.log" Jul 15 17:30:15.033791 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:15.033764 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-nk25g_2b17740b-019e-4b4c-9fcb-e84f2facf4ce/kube-rbac-proxy/0.log" Jul 15 17:30:15.067263 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:15.067233 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-pgzj7_877406f9-6c0a-44cb-90a0-fb910f72e845/prometheus-operator-admission-webhook/0.log" Jul 15 17:30:15.111083 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:15.111047 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b7d4fcf9b-89vgf_a10434eb-f613-45d3-837a-d509049505d0/telemeter-client/0.log" Jul 15 17:30:15.137703 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:15.137677 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b7d4fcf9b-89vgf_a10434eb-f613-45d3-837a-d509049505d0/reload/0.log" Jul 15 17:30:15.159339 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:15.159311 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b7d4fcf9b-89vgf_a10434eb-f613-45d3-837a-d509049505d0/kube-rbac-proxy/0.log" Jul 15 17:30:16.589161 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:16.589127 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-wzjfl_a9e89c3e-e71a-4e4a-9f37-e4db39bb80c3/networking-console-plugin/0.log" Jul 15 17:30:17.171545 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:17.171517 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vcxdn_268a4cb9-c310-4681-91a6-efe9692f8327/console-operator/2.log" Jul 15 17:30:17.176946 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:17.176929 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vcxdn_268a4cb9-c310-4681-91a6-efe9692f8327/console-operator/3.log" Jul 15 17:30:17.412326 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:17.412292 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zfgvt/perf-node-gather-daemonset-w6t7c"] Jul 15 17:30:17.412783 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:17.412763 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf0cda93-7876-4f75-98e4-3513f1793cc7" containerName="revoke-keys" Jul 15 17:30:17.412783 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:17.412782 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf0cda93-7876-4f75-98e4-3513f1793cc7" containerName="revoke-keys" Jul 15 17:30:17.412943 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:17.412877 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf0cda93-7876-4f75-98e4-3513f1793cc7" containerName="revoke-keys" Jul 15 17:30:17.416083 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:17.416067 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-w6t7c" Jul 15 17:30:17.418612 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:17.418592 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zfgvt\"/\"kube-root-ca.crt\"" Jul 15 17:30:17.419651 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:17.419632 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zfgvt\"/\"openshift-service-ca.crt\"" Jul 15 17:30:17.419760 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:17.419633 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zfgvt\"/\"default-dockercfg-zs575\"" Jul 15 17:30:17.427695 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:17.427670 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zfgvt/perf-node-gather-daemonset-w6t7c"] Jul 15 17:30:17.471218 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:17.471179 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e3987032-edf1-4d84-b6d7-60d4c2cc4694-proc\") pod \"perf-node-gather-daemonset-w6t7c\" (UID: \"e3987032-edf1-4d84-b6d7-60d4c2cc4694\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-w6t7c" Jul 15 17:30:17.471401 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:17.471237 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e3987032-edf1-4d84-b6d7-60d4c2cc4694-lib-modules\") pod \"perf-node-gather-daemonset-w6t7c\" (UID: \"e3987032-edf1-4d84-b6d7-60d4c2cc4694\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-w6t7c" Jul 15 17:30:17.471401 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:17.471289 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpn82\" (UniqueName: \"kubernetes.io/projected/e3987032-edf1-4d84-b6d7-60d4c2cc4694-kube-api-access-hpn82\") pod \"perf-node-gather-daemonset-w6t7c\" (UID: \"e3987032-edf1-4d84-b6d7-60d4c2cc4694\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-w6t7c" Jul 15 17:30:17.471401 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:17.471373 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e3987032-edf1-4d84-b6d7-60d4c2cc4694-sys\") pod \"perf-node-gather-daemonset-w6t7c\" (UID: \"e3987032-edf1-4d84-b6d7-60d4c2cc4694\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-w6t7c" Jul 15 17:30:17.471506 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:17.471412 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e3987032-edf1-4d84-b6d7-60d4c2cc4694-podres\") pod \"perf-node-gather-daemonset-w6t7c\" (UID: \"e3987032-edf1-4d84-b6d7-60d4c2cc4694\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-w6t7c" Jul 15 17:30:17.572552 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:17.572510 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpn82\" (UniqueName: \"kubernetes.io/projected/e3987032-edf1-4d84-b6d7-60d4c2cc4694-kube-api-access-hpn82\") pod \"perf-node-gather-daemonset-w6t7c\" (UID: \"e3987032-edf1-4d84-b6d7-60d4c2cc4694\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-w6t7c" Jul 15 17:30:17.572552 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:17.572556 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e3987032-edf1-4d84-b6d7-60d4c2cc4694-sys\") pod \"perf-node-gather-daemonset-w6t7c\" (UID: \"e3987032-edf1-4d84-b6d7-60d4c2cc4694\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-w6t7c" Jul 15 17:30:17.572813 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:17.572582 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e3987032-edf1-4d84-b6d7-60d4c2cc4694-podres\") pod \"perf-node-gather-daemonset-w6t7c\" (UID: \"e3987032-edf1-4d84-b6d7-60d4c2cc4694\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-w6t7c" Jul 15 17:30:17.572813 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:17.572646 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e3987032-edf1-4d84-b6d7-60d4c2cc4694-proc\") pod \"perf-node-gather-daemonset-w6t7c\" (UID: \"e3987032-edf1-4d84-b6d7-60d4c2cc4694\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-w6t7c" Jul 15 17:30:17.572813 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:17.572668 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e3987032-edf1-4d84-b6d7-60d4c2cc4694-sys\") pod \"perf-node-gather-daemonset-w6t7c\" (UID: \"e3987032-edf1-4d84-b6d7-60d4c2cc4694\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-w6t7c" Jul 15 17:30:17.572813 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:17.572685 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e3987032-edf1-4d84-b6d7-60d4c2cc4694-lib-modules\") pod \"perf-node-gather-daemonset-w6t7c\" (UID: \"e3987032-edf1-4d84-b6d7-60d4c2cc4694\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-w6t7c" Jul 15 17:30:17.572813 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:17.572740 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e3987032-edf1-4d84-b6d7-60d4c2cc4694-proc\") pod \"perf-node-gather-daemonset-w6t7c\" (UID: \"e3987032-edf1-4d84-b6d7-60d4c2cc4694\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-w6t7c" Jul 15 17:30:17.572813 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:17.572804 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e3987032-edf1-4d84-b6d7-60d4c2cc4694-podres\") pod \"perf-node-gather-daemonset-w6t7c\" (UID: \"e3987032-edf1-4d84-b6d7-60d4c2cc4694\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-w6t7c" Jul 15 17:30:17.573011 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:17.572814 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e3987032-edf1-4d84-b6d7-60d4c2cc4694-lib-modules\") pod \"perf-node-gather-daemonset-w6t7c\" (UID: \"e3987032-edf1-4d84-b6d7-60d4c2cc4694\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-w6t7c" Jul 15 17:30:17.580234 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:17.580204 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpn82\" (UniqueName: \"kubernetes.io/projected/e3987032-edf1-4d84-b6d7-60d4c2cc4694-kube-api-access-hpn82\") pod \"perf-node-gather-daemonset-w6t7c\" (UID: \"e3987032-edf1-4d84-b6d7-60d4c2cc4694\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-w6t7c" Jul 15 17:30:17.726764 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:17.726665 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-w6t7c" Jul 15 17:30:17.806547 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:17.806522 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7db595dbb-w8wvx_f78d8209-e5a0-4b0c-9727-f77ae5048996/console/0.log" Jul 15 17:30:17.870384 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:17.870348 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zfgvt/perf-node-gather-daemonset-w6t7c"] Jul 15 17:30:17.871689 ip-10-0-132-162 kubenswrapper[2559]: W0715 17:30:17.871663 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode3987032_edf1_4d84_b6d7_60d4c2cc4694.slice/crio-83652bc9b798e5f7fbed4f0d362e4756032badfeccb22b7a3dcbc95f401c40fc WatchSource:0}: Error finding container 83652bc9b798e5f7fbed4f0d362e4756032badfeccb22b7a3dcbc95f401c40fc: Status 404 returned error can't find the container with id 83652bc9b798e5f7fbed4f0d362e4756032badfeccb22b7a3dcbc95f401c40fc Jul 15 17:30:18.474549 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:18.474519 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-zjt5q_752e487f-d91a-4af1-ba20-00ae3a06e305/volume-data-source-validator/0.log" Jul 15 17:30:18.694181 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:18.694144 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-w6t7c" event={"ID":"e3987032-edf1-4d84-b6d7-60d4c2cc4694","Type":"ContainerStarted","Data":"14791b67e57fd44fe484330a4e9faf79da914ee6588a1510ad264cfe37585ac1"} Jul 15 17:30:18.694401 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:18.694201 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-w6t7c" event={"ID":"e3987032-edf1-4d84-b6d7-60d4c2cc4694","Type":"ContainerStarted","Data":"83652bc9b798e5f7fbed4f0d362e4756032badfeccb22b7a3dcbc95f401c40fc"} Jul 15 17:30:18.694401 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:18.694231 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-w6t7c" Jul 15 17:30:18.711201 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:18.711148 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-w6t7c" podStartSLOduration=1.711132284 podStartE2EDuration="1.711132284s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 17:30:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:30:18.708736915 +0000 UTC m=+3005.135829000" watchObservedRunningTime="2026-07-15 17:30:18.711132284 +0000 UTC m=+3005.138224427" Jul 15 17:30:19.531888 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:19.531855 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nqjzl_a0eef5ad-3412-4990-b896-87e4444303d1/dns/0.log" Jul 15 17:30:19.550019 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:19.549994 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nqjzl_a0eef5ad-3412-4990-b896-87e4444303d1/kube-rbac-proxy/0.log" Jul 15 17:30:19.571992 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:19.571964 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-54dr5_4de0f0e6-c52c-439f-b547-d7449edde627/dns-node-resolver/0.log" Jul 15 17:30:20.210243 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:20.210213 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zrwsm_5695f6d9-f75a-4b9c-9417-babb852ef469/node-ca/0.log" Jul 15 17:30:21.219139 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:21.219104 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-hr2ls_e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2/discovery/0.log" Jul 15 17:30:21.340766 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:21.340711 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-xpc7d_5dfd5816-ec68-44b9-8ee4-50d3a2791f6a/payload-pre-processing/0.log" Jul 15 17:30:22.096473 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:22.096444 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tp2cw_ebf98561-bc05-4673-939a-5dedebfefff1/serve-healthcheck-canary/0.log" Jul 15 17:30:22.565400 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:22.565370 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-q46z2_efda2baa-1340-49e7-ba0d-3f3765e3ebda/insights-operator/0.log" Jul 15 17:30:22.567448 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:22.567428 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-q46z2_efda2baa-1340-49e7-ba0d-3f3765e3ebda/insights-operator/1.log" Jul 15 17:30:22.586208 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:22.586185 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nt78r_925c9c99-eb8f-43a8-ad1f-489e63fb358e/kube-rbac-proxy/0.log" Jul 15 17:30:22.604424 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:22.604396 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nt78r_925c9c99-eb8f-43a8-ad1f-489e63fb358e/exporter/0.log" Jul 15 17:30:22.623286 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:22.623262 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nt78r_925c9c99-eb8f-43a8-ad1f-489e63fb358e/extractor/0.log" Jul 15 17:30:24.710677 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:24.710648 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-w6t7c" Jul 15 17:30:25.143032 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:25.142938 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-77fd9784f8-sxlt5_904e7b42-202f-4d55-a81e-d42e6af9b820/manager/0.log" Jul 15 17:30:25.333896 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:25.333865 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9487b7458-nnjmd_ee0aa582-abb4-4ac9-9f76-2773095f646b/manager/0.log" Jul 15 17:30:25.348390 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:25.348368 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9487b7458-nnjmd_ee0aa582-abb4-4ac9-9f76-2773095f646b/copy-manifests/0.log" Jul 15 17:30:26.752300 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:26.752269 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5c79d97d55-wt6bm_1e02312f-1368-486f-9b24-7ddc63da8155/manager/0.log" Jul 15 17:30:28.352419 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:28.352387 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-hr2ls_e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2/discovery/0.log" Jul 15 17:30:28.444332 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:28.444298 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-xpc7d_5dfd5816-ec68-44b9-8ee4-50d3a2791f6a/payload-pre-processing/0.log" Jul 15 17:30:29.931787 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:29.931735 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-hr2ls_e9fd9b2d-099a-44cd-a04f-7b59a5a80ea2/discovery/0.log" Jul 15 17:30:30.036875 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:30.036845 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-xpc7d_5dfd5816-ec68-44b9-8ee4-50d3a2791f6a/payload-pre-processing/0.log" Jul 15 17:30:31.995423 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:31.995390 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-5mxzd_06b2d24a-a0c0-420e-bd18-263111cdbde2/migrator/0.log" Jul 15 17:30:32.013199 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:32.013173 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-5mxzd_06b2d24a-a0c0-420e-bd18-263111cdbde2/graceful-termination/0.log" Jul 15 17:30:33.465250 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:33.465216 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cjrnr_e7f78480-9e9a-488a-9cfa-ba14ad74e3e8/kube-multus-additional-cni-plugins/0.log" Jul 15 17:30:33.482991 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:33.482960 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cjrnr_e7f78480-9e9a-488a-9cfa-ba14ad74e3e8/egress-router-binary-copy/0.log" Jul 15 17:30:33.500725 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:33.500700 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cjrnr_e7f78480-9e9a-488a-9cfa-ba14ad74e3e8/cni-plugins/0.log" Jul 15 17:30:33.518511 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:33.518481 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cjrnr_e7f78480-9e9a-488a-9cfa-ba14ad74e3e8/bond-cni-plugin/0.log" Jul 15 17:30:33.536300 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:33.536271 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cjrnr_e7f78480-9e9a-488a-9cfa-ba14ad74e3e8/routeoverride-cni/0.log" Jul 15 17:30:33.555914 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:33.555887 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cjrnr_e7f78480-9e9a-488a-9cfa-ba14ad74e3e8/whereabouts-cni-bincopy/0.log" Jul 15 17:30:33.573530 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:33.573508 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cjrnr_e7f78480-9e9a-488a-9cfa-ba14ad74e3e8/whereabouts-cni/0.log" Jul 15 17:30:33.751935 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:33.751908 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-f4xlb_e471bdf5-0615-42d5-821a-21fb696e6412/kube-multus/0.log" Jul 15 17:30:33.873023 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:33.872988 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cp4kd_07a4919e-5119-4287-8068-6fbcea6161de/network-metrics-daemon/0.log" Jul 15 17:30:33.892236 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:33.892207 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cp4kd_07a4919e-5119-4287-8068-6fbcea6161de/kube-rbac-proxy/0.log" Jul 15 17:30:34.740968 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:34.740938 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxsr7_1e30c2c6-c7eb-42ca-add5-239c71eafd0d/ovn-controller/0.log" Jul 15 17:30:34.755603 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:34.755569 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxsr7_1e30c2c6-c7eb-42ca-add5-239c71eafd0d/ovn-acl-logging/1.log" Jul 15 17:30:34.755769 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:34.755612 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxsr7_1e30c2c6-c7eb-42ca-add5-239c71eafd0d/ovn-acl-logging/0.log" Jul 15 17:30:34.771980 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:34.771952 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxsr7_1e30c2c6-c7eb-42ca-add5-239c71eafd0d/kube-rbac-proxy-node/0.log" Jul 15 17:30:34.791237 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:34.791214 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxsr7_1e30c2c6-c7eb-42ca-add5-239c71eafd0d/kube-rbac-proxy-ovn-metrics/0.log" Jul 15 17:30:34.806977 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:34.806949 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxsr7_1e30c2c6-c7eb-42ca-add5-239c71eafd0d/northd/0.log" Jul 15 17:30:34.824556 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:34.824531 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxsr7_1e30c2c6-c7eb-42ca-add5-239c71eafd0d/nbdb/0.log" Jul 15 17:30:34.843088 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:34.843066 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxsr7_1e30c2c6-c7eb-42ca-add5-239c71eafd0d/sbdb/0.log" Jul 15 17:30:34.893346 ip-10-0-132-162 kubenswrapper[2559]: I0715 17:30:34.893313 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxsr7_1e30c2c6-c7eb-42ca-add5-239c71eafd0d/ovnkube-controller/0.log"