Jul 15 21:09:37.995133 ip-10-0-131-113 systemd[1]: Starting Kubernetes Kubelet... Jul 15 21:09:38.368508 ip-10-0-131-113 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 21:09:38.368508 ip-10-0-131-113 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 15 21:09:38.368508 ip-10-0-131-113 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 21:09:38.368508 ip-10-0-131-113 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 15 21:09:38.368508 ip-10-0-131-113 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 21:09:38.369148 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.368498 2570 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 15 21:09:38.372140 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372124 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 21:09:38.372140 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372140 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 21:09:38.372206 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372144 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 21:09:38.372206 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372148 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 21:09:38.372206 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372151 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 21:09:38.372206 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372154 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 21:09:38.372206 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372157 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 21:09:38.372206 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372159 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 21:09:38.372206 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372162 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 21:09:38.372206 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372165 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 21:09:38.372206 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372169 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 21:09:38.372206 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372173 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 21:09:38.372206 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372177 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 21:09:38.372206 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372180 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 21:09:38.372206 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372182 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 21:09:38.372206 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372190 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 15 21:09:38.372206 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372193 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 21:09:38.372206 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372196 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 21:09:38.372206 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372198 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 21:09:38.372206 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372201 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 21:09:38.372206 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372204 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 21:09:38.372675 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372206 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 21:09:38.372675 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372209 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 21:09:38.372675 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372212 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 21:09:38.372675 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372215 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 21:09:38.372675 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372218 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 21:09:38.372675 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372220 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 21:09:38.372675 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372223 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 21:09:38.372675 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372226 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 21:09:38.372675 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372229 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 21:09:38.372675 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372232 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 21:09:38.372675 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372236 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 21:09:38.372675 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372239 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 21:09:38.372675 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372241 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 21:09:38.372675 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372244 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 21:09:38.372675 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372247 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 21:09:38.372675 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372249 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 21:09:38.372675 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372252 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 21:09:38.372675 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372256 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 21:09:38.372675 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372259 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 21:09:38.373114 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372262 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 21:09:38.373114 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372265 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 21:09:38.373114 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372268 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 21:09:38.373114 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372272 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 21:09:38.373114 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372275 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 21:09:38.373114 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372277 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 21:09:38.373114 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372280 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 21:09:38.373114 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372282 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 21:09:38.373114 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372285 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 21:09:38.373114 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372305 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 21:09:38.373114 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372309 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 21:09:38.373114 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372311 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 21:09:38.373114 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372314 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 21:09:38.373114 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372317 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 21:09:38.373114 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372320 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 21:09:38.373114 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372322 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 21:09:38.373114 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372325 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 21:09:38.373114 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372328 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 21:09:38.373114 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372331 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 21:09:38.373114 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372334 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 21:09:38.373597 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372336 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 21:09:38.373597 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372339 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 21:09:38.373597 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372341 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 21:09:38.373597 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372344 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 21:09:38.373597 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372347 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 21:09:38.373597 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372349 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 21:09:38.373597 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372352 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 21:09:38.373597 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372354 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 21:09:38.373597 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372357 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 21:09:38.373597 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372360 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 21:09:38.373597 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372363 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 21:09:38.373597 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372368 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 21:09:38.373597 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372371 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 21:09:38.373597 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372374 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 21:09:38.373597 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372377 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 21:09:38.373597 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372379 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 21:09:38.373597 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372382 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 21:09:38.373597 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372384 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 21:09:38.373597 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372387 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 21:09:38.374040 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372389 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 21:09:38.374040 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372393 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 21:09:38.374040 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372395 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 21:09:38.374040 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372397 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 21:09:38.374040 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372400 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 21:09:38.374040 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372402 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 21:09:38.374040 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372405 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 21:09:38.374040 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372407 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 21:09:38.374040 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372410 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 21:09:38.374040 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372412 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 21:09:38.374040 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372415 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 21:09:38.374040 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372418 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 21:09:38.374040 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372420 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 21:09:38.374040 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372423 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 21:09:38.374040 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372425 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 21:09:38.374040 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372428 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 21:09:38.374040 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372430 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 21:09:38.374040 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372433 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 21:09:38.374040 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372435 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 21:09:38.374040 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.372438 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 21:09:38.374516 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373135 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 21:09:38.374516 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373141 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 21:09:38.374516 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373144 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 21:09:38.374516 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373147 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 21:09:38.374516 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373151 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 21:09:38.374516 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373154 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 21:09:38.374516 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373158 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 21:09:38.374516 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373161 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 21:09:38.374516 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373163 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 21:09:38.374516 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373166 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 21:09:38.374516 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373169 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 21:09:38.374516 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373172 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 21:09:38.374516 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373175 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 21:09:38.374516 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373177 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 21:09:38.374516 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373180 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 21:09:38.374516 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373182 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 21:09:38.374516 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373187 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 21:09:38.374516 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373191 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 21:09:38.374516 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373195 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 21:09:38.374516 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373197 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 21:09:38.375018 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373200 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 21:09:38.375018 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373203 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 21:09:38.375018 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373206 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 21:09:38.375018 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373210 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 21:09:38.375018 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373214 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 21:09:38.375018 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373217 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 21:09:38.375018 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373221 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 21:09:38.375018 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373224 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 21:09:38.375018 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373227 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 21:09:38.375018 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373230 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 21:09:38.375018 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373233 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 21:09:38.375018 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373236 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 21:09:38.375018 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373238 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 21:09:38.375018 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373241 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 21:09:38.375018 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373244 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 21:09:38.375018 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373247 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 21:09:38.375018 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373251 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 21:09:38.375018 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373254 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 21:09:38.375018 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373257 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 21:09:38.375018 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373260 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 21:09:38.375506 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373263 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 21:09:38.375506 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373265 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 21:09:38.375506 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373268 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 21:09:38.375506 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373270 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 21:09:38.375506 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373273 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 15 21:09:38.375506 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373276 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 21:09:38.375506 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373278 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 21:09:38.375506 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373281 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 21:09:38.375506 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373283 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 21:09:38.375506 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373286 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 21:09:38.375506 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373304 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 21:09:38.375506 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373308 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 21:09:38.375506 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373312 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 21:09:38.375506 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373315 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 21:09:38.375506 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373318 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 21:09:38.375506 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373322 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 21:09:38.375506 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373324 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 21:09:38.375506 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373327 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 21:09:38.375506 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373330 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 21:09:38.375952 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373332 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 21:09:38.375952 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373335 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 21:09:38.375952 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373338 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 21:09:38.375952 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373340 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 21:09:38.375952 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373343 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 21:09:38.375952 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373345 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 21:09:38.375952 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373348 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 21:09:38.375952 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373350 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 21:09:38.375952 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373354 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 21:09:38.375952 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373357 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 21:09:38.375952 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373359 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 21:09:38.375952 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373362 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 21:09:38.375952 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373365 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 21:09:38.375952 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373368 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 21:09:38.375952 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373371 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 21:09:38.375952 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373374 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 21:09:38.375952 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373377 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 21:09:38.375952 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373379 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 21:09:38.375952 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373382 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 21:09:38.375952 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373384 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 21:09:38.376442 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373387 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 21:09:38.376442 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373389 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 21:09:38.376442 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373392 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 21:09:38.376442 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373394 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 21:09:38.376442 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373396 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 21:09:38.376442 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373399 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 21:09:38.376442 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373402 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 21:09:38.376442 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373404 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 21:09:38.376442 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373406 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 21:09:38.376442 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373409 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 21:09:38.376442 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373411 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 21:09:38.376442 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373414 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 21:09:38.376442 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373416 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 21:09:38.376442 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373419 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 21:09:38.376442 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373422 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 21:09:38.376442 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373424 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 21:09:38.376442 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373427 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 21:09:38.376442 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373429 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 21:09:38.376442 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373431 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 21:09:38.376442 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373434 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 21:09:38.376910 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373792 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 21:09:38.376910 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373797 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 21:09:38.376910 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373801 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 21:09:38.376910 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373805 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 21:09:38.376910 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373810 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 21:09:38.376910 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373813 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 21:09:38.376910 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373817 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 21:09:38.376910 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373819 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 21:09:38.376910 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373822 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 21:09:38.376910 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373824 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 21:09:38.376910 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373827 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 21:09:38.376910 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373830 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 21:09:38.376910 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373832 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 21:09:38.376910 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373835 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 21:09:38.376910 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373837 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 21:09:38.376910 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373840 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 21:09:38.376910 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373842 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 21:09:38.376910 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373845 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 21:09:38.376910 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373847 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 21:09:38.377372 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373850 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 21:09:38.377372 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373852 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 21:09:38.377372 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373855 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 21:09:38.377372 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373857 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 21:09:38.377372 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373860 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 21:09:38.377372 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373863 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 21:09:38.377372 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373866 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 21:09:38.377372 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373868 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 21:09:38.377372 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373871 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 21:09:38.377372 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373874 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 21:09:38.377372 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373876 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 21:09:38.377372 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373879 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 21:09:38.377372 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373881 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 21:09:38.377372 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373884 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 21:09:38.377372 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373887 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 21:09:38.377372 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373889 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 21:09:38.377372 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373892 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 21:09:38.377372 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373895 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 21:09:38.377372 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373898 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 21:09:38.377372 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373901 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 21:09:38.377843 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373903 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 21:09:38.377843 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373906 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 15 21:09:38.377843 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373909 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 21:09:38.377843 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373911 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 21:09:38.377843 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373914 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 21:09:38.377843 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373916 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 21:09:38.377843 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373919 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 21:09:38.377843 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373921 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 21:09:38.377843 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373923 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 21:09:38.377843 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373926 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 21:09:38.377843 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373928 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 21:09:38.377843 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373931 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 21:09:38.377843 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373934 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 21:09:38.377843 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373937 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 21:09:38.377843 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373939 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 21:09:38.377843 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373941 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 21:09:38.377843 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373944 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 21:09:38.377843 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373947 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 21:09:38.377843 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373950 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 21:09:38.377843 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373952 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 21:09:38.378313 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373954 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 21:09:38.378313 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373957 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 21:09:38.378313 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373959 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 21:09:38.378313 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373961 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 21:09:38.378313 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373964 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 21:09:38.378313 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373968 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 21:09:38.378313 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373974 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 21:09:38.378313 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373977 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 21:09:38.378313 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373980 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 21:09:38.378313 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373983 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 21:09:38.378313 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373986 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 21:09:38.378313 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373989 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 21:09:38.378313 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373992 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 21:09:38.378313 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373995 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 21:09:38.378313 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.373997 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 21:09:38.378313 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374000 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 21:09:38.378313 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374004 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 21:09:38.378313 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374006 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 21:09:38.378313 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374009 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 21:09:38.378762 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374011 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 21:09:38.378762 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374014 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 21:09:38.378762 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374016 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 21:09:38.378762 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374019 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 21:09:38.378762 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374021 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 21:09:38.378762 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374024 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 21:09:38.378762 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374026 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 21:09:38.378762 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374029 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 21:09:38.378762 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374031 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 21:09:38.378762 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374036 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 21:09:38.378762 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374038 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 21:09:38.378762 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374041 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 21:09:38.378762 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374044 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 21:09:38.378762 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374046 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 21:09:38.378762 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374049 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 21:09:38.378762 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374052 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 21:09:38.378762 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374054 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 21:09:38.378762 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374057 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 21:09:38.378762 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374060 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 21:09:38.379208 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374065 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 21:09:38.379208 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374069 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 21:09:38.379208 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374140 2570 flags.go:64] FLAG: --address="0.0.0.0" Jul 15 21:09:38.379208 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374147 2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 15 21:09:38.379208 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374154 2570 flags.go:64] FLAG: --anonymous-auth="true" Jul 15 21:09:38.379208 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374160 2570 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 15 21:09:38.379208 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374167 2570 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 15 21:09:38.379208 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374172 2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 15 21:09:38.379208 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374178 2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 15 21:09:38.379208 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374185 2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 15 21:09:38.379208 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374188 2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 15 21:09:38.379208 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374191 2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 15 21:09:38.379208 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374195 2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 15 21:09:38.379208 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374198 2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 15 21:09:38.379208 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374202 2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 15 21:09:38.379208 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374205 2570 flags.go:64] FLAG: --cgroup-root="" Jul 15 21:09:38.379208 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374208 2570 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 15 21:09:38.379208 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374211 2570 flags.go:64] FLAG: --client-ca-file="" Jul 15 21:09:38.379208 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374213 2570 flags.go:64] FLAG: --cloud-provider="external" Jul 15 21:09:38.379208 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374216 2570 flags.go:64] FLAG: --cluster-dns="[]" Jul 15 21:09:38.379208 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374221 2570 flags.go:64] FLAG: --cluster-domain="" Jul 15 21:09:38.379208 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374223 2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 15 21:09:38.379208 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374228 2570 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 15 21:09:38.379800 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374231 2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 15 21:09:38.379800 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374234 2570 flags.go:64] FLAG: --container-log-max-files="5" Jul 15 21:09:38.379800 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374238 2570 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 15 21:09:38.379800 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374241 2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 15 21:09:38.379800 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374244 2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 15 21:09:38.379800 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374248 2570 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 15 21:09:38.379800 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374250 2570 flags.go:64] FLAG: --contention-profiling="false" Jul 15 21:09:38.379800 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374253 2570 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 15 21:09:38.379800 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374256 2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 15 21:09:38.379800 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374261 2570 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 15 21:09:38.379800 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374264 2570 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 15 21:09:38.379800 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374268 2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 15 21:09:38.379800 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374271 2570 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 15 21:09:38.379800 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374274 2570 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 15 21:09:38.379800 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374277 2570 flags.go:64] FLAG: --enable-load-reader="false" Jul 15 21:09:38.379800 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374281 2570 flags.go:64] FLAG: --enable-server="true" Jul 15 21:09:38.379800 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374285 2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 15 21:09:38.379800 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374303 2570 flags.go:64] FLAG: --event-burst="100" Jul 15 21:09:38.379800 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374306 2570 flags.go:64] FLAG: --event-qps="50" Jul 15 21:09:38.379800 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374310 2570 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 15 21:09:38.379800 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374313 2570 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 15 21:09:38.379800 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374316 2570 flags.go:64] FLAG: --eviction-hard="" Jul 15 21:09:38.379800 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374320 2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 15 21:09:38.379800 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374322 2570 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 15 21:09:38.380370 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374326 2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 15 21:09:38.380370 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374329 2570 flags.go:64] FLAG: --eviction-soft="" Jul 15 21:09:38.380370 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374332 2570 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 15 21:09:38.380370 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374334 2570 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 15 21:09:38.380370 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374338 2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 15 21:09:38.380370 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374340 2570 flags.go:64] FLAG: --experimental-mounter-path="" Jul 15 21:09:38.380370 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374343 2570 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 15 21:09:38.380370 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374347 2570 flags.go:64] FLAG: --fail-swap-on="true" Jul 15 21:09:38.380370 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374350 2570 flags.go:64] FLAG: --feature-gates="" Jul 15 21:09:38.380370 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374354 2570 flags.go:64] FLAG: --file-check-frequency="20s" Jul 15 21:09:38.380370 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374357 2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 15 21:09:38.380370 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374360 2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 15 21:09:38.380370 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374364 2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 15 21:09:38.380370 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374367 2570 flags.go:64] FLAG: --healthz-port="10248" Jul 15 21:09:38.380370 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374370 2570 flags.go:64] FLAG: --help="false" Jul 15 21:09:38.380370 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374373 2570 flags.go:64] FLAG: --hostname-override="ip-10-0-131-113.ec2.internal" Jul 15 21:09:38.380370 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374376 2570 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 15 21:09:38.380370 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374380 2570 flags.go:64] FLAG: --http-check-frequency="20s" Jul 15 21:09:38.380370 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374383 2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 15 21:09:38.380370 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374387 2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 15 21:09:38.380370 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374390 2570 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 15 21:09:38.380370 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374393 2570 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 15 21:09:38.380370 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374396 2570 flags.go:64] FLAG: --image-service-endpoint="" Jul 15 21:09:38.380955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374399 2570 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 15 21:09:38.380955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374402 2570 flags.go:64] FLAG: --kube-api-burst="100" Jul 15 21:09:38.380955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374406 2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 15 21:09:38.380955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374409 2570 flags.go:64] FLAG: --kube-api-qps="50" Jul 15 21:09:38.380955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374412 2570 flags.go:64] FLAG: --kube-reserved="" Jul 15 21:09:38.380955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374415 2570 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 15 21:09:38.380955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374418 2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 15 21:09:38.380955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374421 2570 flags.go:64] FLAG: --kubelet-cgroups="" Jul 15 21:09:38.380955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374424 2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 15 21:09:38.380955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374427 2570 flags.go:64] FLAG: --lock-file="" Jul 15 21:09:38.380955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374429 2570 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 15 21:09:38.380955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374432 2570 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 15 21:09:38.380955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374435 2570 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 15 21:09:38.380955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374441 2570 flags.go:64] FLAG: --log-json-split-stream="false" Jul 15 21:09:38.380955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374444 2570 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 15 21:09:38.380955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374446 2570 flags.go:64] FLAG: --log-text-split-stream="false" Jul 15 21:09:38.380955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374451 2570 flags.go:64] FLAG: --logging-format="text" Jul 15 21:09:38.380955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374454 2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 15 21:09:38.380955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374458 2570 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 15 21:09:38.380955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374461 2570 flags.go:64] FLAG: --manifest-url="" Jul 15 21:09:38.380955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374463 2570 flags.go:64] FLAG: --manifest-url-header="" Jul 15 21:09:38.380955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374468 2570 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 15 21:09:38.380955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374471 2570 flags.go:64] FLAG: --max-open-files="1000000" Jul 15 21:09:38.380955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374475 2570 flags.go:64] FLAG: --max-pods="110" Jul 15 21:09:38.380955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374478 2570 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 15 21:09:38.381571 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374481 2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 15 21:09:38.381571 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374485 2570 flags.go:64] FLAG: --memory-manager-policy="None" Jul 15 21:09:38.381571 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374488 2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 15 21:09:38.381571 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374492 2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 15 21:09:38.381571 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374495 2570 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 15 21:09:38.381571 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374498 2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 15 21:09:38.381571 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374505 2570 flags.go:64] FLAG: --node-status-max-images="50" Jul 15 21:09:38.381571 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374508 2570 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 15 21:09:38.381571 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374511 2570 flags.go:64] FLAG: --oom-score-adj="-999" Jul 15 21:09:38.381571 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374514 2570 flags.go:64] FLAG: --pod-cidr="" Jul 15 21:09:38.381571 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374518 2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 15 21:09:38.381571 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374524 2570 flags.go:64] FLAG: --pod-manifest-path="" Jul 15 21:09:38.381571 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374527 2570 flags.go:64] FLAG: --pod-max-pids="-1" Jul 15 21:09:38.381571 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374530 2570 flags.go:64] FLAG: --pods-per-core="0" Jul 15 21:09:38.381571 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374533 2570 flags.go:64] FLAG: --port="10250" Jul 15 21:09:38.381571 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374536 2570 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 15 21:09:38.381571 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374539 2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d0e6d10453593162" Jul 15 21:09:38.381571 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374543 2570 flags.go:64] FLAG: --qos-reserved="" Jul 15 21:09:38.381571 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374546 2570 flags.go:64] FLAG: --read-only-port="10255" Jul 15 21:09:38.381571 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374549 2570 flags.go:64] FLAG: --register-node="true" Jul 15 21:09:38.381571 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374551 2570 flags.go:64] FLAG: --register-with-taints="" Jul 15 21:09:38.381571 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374555 2570 flags.go:64] FLAG: --registry-burst="10" Jul 15 21:09:38.381571 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374558 2570 flags.go:64] FLAG: --registry-qps="5" Jul 15 21:09:38.381571 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374562 2570 flags.go:64] FLAG: --reserved-cpus="" Jul 15 21:09:38.382129 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374565 2570 flags.go:64] FLAG: --reserved-memory="" Jul 15 21:09:38.382129 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374569 2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 15 21:09:38.382129 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374572 2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 15 21:09:38.382129 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374575 2570 flags.go:64] FLAG: --rotate-certificates="false" Jul 15 21:09:38.382129 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374578 2570 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 15 21:09:38.382129 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374581 2570 flags.go:64] FLAG: --runonce="false" Jul 15 21:09:38.382129 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374584 2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 15 21:09:38.382129 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374587 2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 15 21:09:38.382129 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374590 2570 flags.go:64] FLAG: --seccomp-default="false" Jul 15 21:09:38.382129 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374593 2570 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 15 21:09:38.382129 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374598 2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 15 21:09:38.382129 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374601 2570 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 15 21:09:38.382129 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374604 2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 15 21:09:38.382129 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374607 2570 flags.go:64] FLAG: --storage-driver-password="root" Jul 15 21:09:38.382129 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374610 2570 flags.go:64] FLAG: --storage-driver-secure="false" Jul 15 21:09:38.382129 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374613 2570 flags.go:64] FLAG: --storage-driver-table="stats" Jul 15 21:09:38.382129 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374616 2570 flags.go:64] FLAG: --storage-driver-user="root" Jul 15 21:09:38.382129 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374619 2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 15 21:09:38.382129 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374622 2570 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 15 21:09:38.382129 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374626 2570 flags.go:64] FLAG: --system-cgroups="" Jul 15 21:09:38.382129 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374629 2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 15 21:09:38.382129 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374634 2570 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 15 21:09:38.382129 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374637 2570 flags.go:64] FLAG: --tls-cert-file="" Jul 15 21:09:38.382129 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374640 2570 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 15 21:09:38.382129 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374644 2570 flags.go:64] FLAG: --tls-min-version="" Jul 15 21:09:38.382762 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374647 2570 flags.go:64] FLAG: --tls-private-key-file="" Jul 15 21:09:38.382762 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374649 2570 flags.go:64] FLAG: --topology-manager-policy="none" Jul 15 21:09:38.382762 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374652 2570 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 15 21:09:38.382762 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374655 2570 flags.go:64] FLAG: --topology-manager-scope="container" Jul 15 21:09:38.382762 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374658 2570 flags.go:64] FLAG: --v="2" Jul 15 21:09:38.382762 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374662 2570 flags.go:64] FLAG: --version="false" Jul 15 21:09:38.382762 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374666 2570 flags.go:64] FLAG: --vmodule="" Jul 15 21:09:38.382762 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374670 2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 15 21:09:38.382762 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.374673 2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 15 21:09:38.382762 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374786 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 21:09:38.382762 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374790 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 21:09:38.382762 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374794 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 21:09:38.382762 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374797 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 21:09:38.382762 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374800 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 21:09:38.382762 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374803 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 21:09:38.382762 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374806 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 21:09:38.382762 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374809 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 21:09:38.382762 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374813 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 21:09:38.382762 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374815 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 21:09:38.382762 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374818 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 21:09:38.382762 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374821 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 21:09:38.382762 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374824 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 21:09:38.383325 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374826 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 21:09:38.383325 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374829 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 21:09:38.383325 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374831 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 21:09:38.383325 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374834 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 21:09:38.383325 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374836 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 21:09:38.383325 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374839 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 21:09:38.383325 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374842 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 21:09:38.383325 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374845 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 21:09:38.383325 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374847 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 21:09:38.383325 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374850 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 21:09:38.383325 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374853 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 21:09:38.383325 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374855 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 21:09:38.383325 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374858 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 21:09:38.383325 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374860 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 21:09:38.383325 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374863 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 21:09:38.383325 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374865 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 21:09:38.383325 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374868 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 21:09:38.383325 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374870 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 21:09:38.383325 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374873 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 21:09:38.383325 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374875 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 21:09:38.383808 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374878 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 21:09:38.383808 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374881 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 21:09:38.383808 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374883 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 21:09:38.383808 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374886 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 21:09:38.383808 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374888 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 21:09:38.383808 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374891 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 21:09:38.383808 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374893 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 21:09:38.383808 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374898 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 21:09:38.383808 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374900 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 21:09:38.383808 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374903 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 21:09:38.383808 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374905 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 21:09:38.383808 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374909 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 21:09:38.383808 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374913 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 21:09:38.383808 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374916 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 21:09:38.383808 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374919 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 21:09:38.383808 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374921 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 21:09:38.383808 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374924 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 21:09:38.383808 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374926 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 21:09:38.383808 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374929 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 21:09:38.384261 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374932 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 21:09:38.384261 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374934 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 21:09:38.384261 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374937 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 21:09:38.384261 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374940 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 21:09:38.384261 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374942 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 21:09:38.384261 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374945 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 21:09:38.384261 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374947 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 21:09:38.384261 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374950 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 21:09:38.384261 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374952 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 21:09:38.384261 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374955 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 21:09:38.384261 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374957 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 21:09:38.384261 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374960 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 21:09:38.384261 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374962 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 21:09:38.384261 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374965 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 21:09:38.384261 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374967 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 21:09:38.384261 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374971 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 21:09:38.384261 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374979 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 21:09:38.384261 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374982 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 21:09:38.384261 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374985 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 21:09:38.384745 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374987 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 21:09:38.384745 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374991 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 21:09:38.384745 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374994 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 21:09:38.384745 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374997 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 21:09:38.384745 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.374999 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 21:09:38.384745 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.375002 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 21:09:38.384745 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.375004 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 21:09:38.384745 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.375007 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 21:09:38.384745 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.375010 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 21:09:38.384745 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.375012 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 21:09:38.384745 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.375015 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 15 21:09:38.384745 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.375018 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 21:09:38.384745 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.375021 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 21:09:38.384745 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.375024 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 21:09:38.384745 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.375026 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 21:09:38.384745 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.375029 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 21:09:38.384745 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.375032 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 21:09:38.384745 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.375035 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 21:09:38.384745 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.375037 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 21:09:38.384745 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.375040 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 21:09:38.384745 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.375042 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 21:09:38.385244 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.375045 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 21:09:38.385244 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.375047 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 21:09:38.385244 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.375051 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 21:09:38.385244 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.375055 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 21:09:38.385244 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.375058 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 21:09:38.385244 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.375061 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 21:09:38.385244 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.375064 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 21:09:38.385244 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.375887 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 21:09:38.385244 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.382941 2570 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 15 21:09:38.385244 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.382956 2570 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 15 21:09:38.385244 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.382976 2570 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 15 21:09:38.385244 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.382984 2570 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 15 21:09:38.385244 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383043 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 21:09:38.385244 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383049 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 21:09:38.385600 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383052 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 21:09:38.385600 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383056 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 21:09:38.385600 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383059 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 21:09:38.385600 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383063 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 21:09:38.385600 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383067 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 21:09:38.385600 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383073 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 21:09:38.385600 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383077 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 21:09:38.385600 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383080 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 21:09:38.385600 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383083 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 21:09:38.385600 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383086 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 21:09:38.385600 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383089 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 21:09:38.385600 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383092 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 21:09:38.385600 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383095 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 21:09:38.385600 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383098 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 21:09:38.385600 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383100 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 21:09:38.385600 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383103 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 21:09:38.385600 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383106 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 21:09:38.385600 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383109 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 21:09:38.385600 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383111 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 21:09:38.385600 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383114 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 21:09:38.386070 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383117 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 21:09:38.386070 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383120 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 21:09:38.386070 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383122 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 21:09:38.386070 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383125 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 21:09:38.386070 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383127 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 21:09:38.386070 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383129 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 21:09:38.386070 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383133 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 21:09:38.386070 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383138 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 21:09:38.386070 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383143 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 21:09:38.386070 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383149 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 21:09:38.386070 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383154 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 21:09:38.386070 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383159 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 21:09:38.386070 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383162 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 21:09:38.386070 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383164 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 21:09:38.386070 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383168 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 21:09:38.386070 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383171 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 21:09:38.386070 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383174 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 21:09:38.386070 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383176 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 21:09:38.386070 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383179 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 21:09:38.386070 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383182 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 21:09:38.386678 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383184 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 21:09:38.386678 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383187 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 21:09:38.386678 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383190 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 21:09:38.386678 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383192 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 21:09:38.386678 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383195 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 21:09:38.386678 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383197 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 21:09:38.386678 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383200 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 21:09:38.386678 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383203 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 21:09:38.386678 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383205 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 15 21:09:38.386678 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383208 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 21:09:38.386678 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383210 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 21:09:38.386678 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383213 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 21:09:38.386678 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383216 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 21:09:38.386678 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383218 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 21:09:38.386678 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383224 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 21:09:38.386678 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383230 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 21:09:38.386678 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383235 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 21:09:38.386678 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383238 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 21:09:38.386678 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383242 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 21:09:38.387427 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383246 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 21:09:38.387427 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383250 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 21:09:38.387427 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383253 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 21:09:38.387427 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383255 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 21:09:38.387427 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383258 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 21:09:38.387427 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383261 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 21:09:38.387427 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383264 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 21:09:38.387427 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383266 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 21:09:38.387427 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383269 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 21:09:38.387427 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383272 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 21:09:38.387427 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383275 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 21:09:38.387427 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383277 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 21:09:38.387427 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383280 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 21:09:38.387427 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383282 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 21:09:38.387427 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383285 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 21:09:38.387427 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383300 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 21:09:38.387427 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383305 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 21:09:38.387427 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383309 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 21:09:38.387427 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383313 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 21:09:38.387427 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383317 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 21:09:38.387947 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383321 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 21:09:38.387947 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383325 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 21:09:38.387947 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383329 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 21:09:38.387947 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383332 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 21:09:38.387947 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383335 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 21:09:38.387947 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383338 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 21:09:38.387947 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383341 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 21:09:38.387947 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383344 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 21:09:38.387947 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383346 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 21:09:38.387947 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383349 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 21:09:38.387947 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383351 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 21:09:38.387947 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383355 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 21:09:38.387947 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383358 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 21:09:38.387947 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383361 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 21:09:38.387947 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383365 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 21:09:38.387947 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383367 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 21:09:38.387947 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383370 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 21:09:38.387947 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383372 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 21:09:38.388552 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.383378 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 21:09:38.388552 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383505 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 21:09:38.388552 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383510 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 21:09:38.388552 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383513 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 21:09:38.388552 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383516 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 21:09:38.388552 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383520 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 21:09:38.388552 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383523 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 21:09:38.388552 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383525 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 21:09:38.388552 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383528 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 21:09:38.388552 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383531 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 21:09:38.388552 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383533 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 21:09:38.388552 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383536 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 21:09:38.388552 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383541 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 21:09:38.388552 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383545 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 21:09:38.388552 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383549 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 21:09:38.388929 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383554 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 21:09:38.388929 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383556 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 21:09:38.388929 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383559 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 21:09:38.388929 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383562 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 21:09:38.388929 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383565 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 21:09:38.388929 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383567 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 21:09:38.388929 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383570 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 21:09:38.388929 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383572 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 21:09:38.388929 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383575 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 21:09:38.388929 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383577 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 21:09:38.388929 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383580 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 21:09:38.388929 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383583 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 21:09:38.388929 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383586 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 21:09:38.388929 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383589 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 21:09:38.388929 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383592 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 21:09:38.388929 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383595 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 21:09:38.388929 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383598 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 15 21:09:38.388929 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383600 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 21:09:38.388929 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383603 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 21:09:38.388929 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383605 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 21:09:38.389482 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383608 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 21:09:38.389482 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383610 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 21:09:38.389482 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383613 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 21:09:38.389482 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383616 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 21:09:38.389482 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383621 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 21:09:38.389482 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383625 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 21:09:38.389482 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383629 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 21:09:38.389482 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383633 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 21:09:38.389482 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383635 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 21:09:38.389482 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383638 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 21:09:38.389482 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383640 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 21:09:38.389482 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383643 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 21:09:38.389482 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383645 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 21:09:38.389482 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383648 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 21:09:38.389482 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383651 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 21:09:38.389482 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383653 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 21:09:38.389482 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383656 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 21:09:38.389482 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383659 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 21:09:38.389482 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383661 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 21:09:38.389482 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383664 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 21:09:38.390073 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383666 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 21:09:38.390073 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383669 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 21:09:38.390073 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383671 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 21:09:38.390073 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383674 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 21:09:38.390073 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383676 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 21:09:38.390073 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383679 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 21:09:38.390073 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383681 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 21:09:38.390073 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383684 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 21:09:38.390073 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383687 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 21:09:38.390073 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383689 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 21:09:38.390073 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383692 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 21:09:38.390073 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383695 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 21:09:38.390073 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383700 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 21:09:38.390073 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383704 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 21:09:38.390073 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383708 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 21:09:38.390073 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383712 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 21:09:38.390073 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383714 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 21:09:38.390073 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383716 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 21:09:38.390073 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383719 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 21:09:38.390540 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383721 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 21:09:38.390540 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383724 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 21:09:38.390540 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383727 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 21:09:38.390540 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383729 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 21:09:38.390540 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383733 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 21:09:38.390540 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383736 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 21:09:38.390540 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383739 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 21:09:38.390540 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383742 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 21:09:38.390540 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383745 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 21:09:38.390540 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383748 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 21:09:38.390540 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383751 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 21:09:38.390540 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383753 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 21:09:38.390540 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383756 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 21:09:38.390540 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383759 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 21:09:38.390540 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383761 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 21:09:38.390540 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383764 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 21:09:38.390540 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383767 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 21:09:38.390540 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383770 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 21:09:38.390540 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383773 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 21:09:38.391377 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383778 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 21:09:38.391377 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383784 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 21:09:38.391377 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383790 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 21:09:38.391377 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383793 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 21:09:38.391377 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383796 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 21:09:38.391377 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383798 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 21:09:38.391377 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:38.383800 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 21:09:38.391377 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.383806 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 21:09:38.391377 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.383916 2570 server.go:962] "Client rotation is on, will bootstrap in background" Jul 15 21:09:38.391377 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.387004 2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 15 21:09:38.391377 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.389537 2570 server.go:1019] "Starting client certificate rotation" Jul 15 21:09:38.391377 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.389664 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 21:09:38.391377 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.389715 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 21:09:38.392407 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.392387 2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 21:09:38.393554 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.393534 2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 21:09:38.403904 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.403888 2570 log.go:25] "Validated CRI v1 runtime API" Jul 15 21:09:38.405745 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.405733 2570 log.go:25] "Validated CRI v1 image API" Jul 15 21:09:38.406594 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.406570 2570 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 15 21:09:38.410100 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.410083 2570 fs.go:135] Filesystem UUIDs: map[55ad15b4-ebe7-4e19-9f1d-71be0663276c:/dev/nvme0n1p3 5625aaf2-ad75-4ea3-b203-d6516e49e69d:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 15 21:09:38.410172 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.410100 2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 15 21:09:38.414438 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.414327 2570 manager.go:216] Machine: {Timestamp:2026-07-15 21:09:38.413816714 +0000 UTC m=+0.308220791 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3117265 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2eb3735439fc762cb094bb61f9b22b SystemUUID:ec2eb373-5439-fc76-2cb0-94bb61f9b22b BootID:42177bbc-dc6a-475a-9164-bf0e0198b8e5 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:52:63:9e:9b:35 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:52:63:9e:9b:35 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:be:24:5d:71:63:cc Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 15 21:09:38.414438 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.414432 2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 15 21:09:38.414561 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.414537 2570 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 15 21:09:38.415654 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.415633 2570 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 15 21:09:38.415791 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.415657 2570 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-113.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 15 21:09:38.416478 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.416468 2570 topology_manager.go:138] "Creating topology manager with none policy" Jul 15 21:09:38.416514 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.416481 2570 container_manager_linux.go:309] "Creating device plugin manager" Jul 15 21:09:38.416514 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.416489 2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 21:09:38.416514 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.416507 2570 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 21:09:38.417944 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.417933 2570 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 15 21:09:38.420985 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.420974 2570 state_mem.go:36] "Initialized new in-memory state store" Jul 15 21:09:38.421100 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.421091 2570 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 15 21:09:38.421789 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.421780 2570 kubelet.go:486] "Attempting to sync node with API server" Jul 15 21:09:38.421820 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.421793 2570 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 15 21:09:38.421820 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.421807 2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 15 21:09:38.421820 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.421816 2570 kubelet.go:398] "Adding apiserver pod source" Jul 15 21:09:38.421898 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.421824 2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 15 21:09:38.422305 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.422271 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 21:09:38.422375 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.422327 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 21:09:38.425162 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.425141 2570 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 15 21:09:38.428613 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.428591 2570 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 15 21:09:38.428686 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.428637 2570 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 15 21:09:38.428923 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.428909 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 15 21:09:38.428959 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.428933 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 15 21:09:38.428959 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.428942 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 15 21:09:38.428959 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.428958 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 15 21:09:38.429032 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.428970 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 15 21:09:38.429032 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.428978 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 15 21:09:38.429398 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.429380 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 15 21:09:38.429398 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.429401 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 15 21:09:38.429538 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.429431 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 15 21:09:38.429538 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.429440 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 15 21:09:38.429538 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.429452 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 15 21:09:38.429538 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.429464 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 15 21:09:38.430181 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.430163 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 15 21:09:38.430306 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.430268 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 15 21:09:38.434246 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.434230 2570 server.go:1268] "Started kubelet" Jul 15 21:09:38.434348 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.434270 2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 15 21:09:38.434399 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.434357 2570 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 15 21:09:38.434465 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.434420 2570 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 15 21:09:38.435082 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.435062 2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 21:09:38.435172 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:38.435149 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-113.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 15 21:09:38.435240 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.435225 2570 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-113.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 15 21:09:38.435238 ip-10-0-131-113 systemd[1]: Started Kubernetes Kubelet. Jul 15 21:09:38.435428 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:38.435404 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 15 21:09:38.436006 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.435923 2570 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 15 21:09:38.436470 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.436455 2570 server.go:310] "Adding debug handlers to kubelet server" Jul 15 21:09:38.438876 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:38.438845 2570 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 15 21:09:38.442493 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.442475 2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 15 21:09:38.442567 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.442504 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 15 21:09:38.442624 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:38.442582 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-113.ec2.internal\" not found" Jul 15 21:09:38.443131 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.443110 2570 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 15 21:09:38.443131 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.443113 2570 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 15 21:09:38.443256 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.443145 2570 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 15 21:09:38.443313 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.443275 2570 reconstruct.go:97] "Volume reconstruction finished" Jul 15 21:09:38.443313 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.443286 2570 reconciler.go:29] "Reconciler: start to sync state" Jul 15 21:09:38.443446 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.443431 2570 factory.go:55] Registering systemd factory Jul 15 21:09:38.443514 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.443454 2570 factory.go:223] Registration of the systemd container factory successfully Jul 15 21:09:38.443705 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.443691 2570 factory.go:153] Registering CRI-O factory Jul 15 21:09:38.443775 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.443707 2570 factory.go:223] Registration of the crio container factory successfully Jul 15 21:09:38.443775 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.443757 2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 15 21:09:38.443868 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.443822 2570 factory.go:103] Registering Raw factory Jul 15 21:09:38.443868 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.443835 2570 manager.go:1196] Started watching for new ooms in manager Jul 15 21:09:38.444451 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.444434 2570 manager.go:349] Starting recovery of all containers Jul 15 21:09:38.447883 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:38.447856 2570 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-113.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 15 21:09:38.448348 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:38.447128 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-113.ec2.internal.18c292c549a665db default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-113.ec2.internal,UID:ip-10-0-131-113.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-113.ec2.internal,},FirstTimestamp:2026-07-15 21:09:38.433992155 +0000 UTC m=+0.328396212,LastTimestamp:2026-07-15 21:09:38.433992155 +0000 UTC m=+0.328396212,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-113.ec2.internal,}" Jul 15 21:09:38.448506 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:38.448475 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 15 21:09:38.456743 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.456515 2570 manager.go:354] Recovery completed Jul 15 21:09:38.461630 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.461614 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 21:09:38.464711 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.464688 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-113.ec2.internal" event="NodeHasSufficientMemory" Jul 15 21:09:38.464780 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.464722 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-113.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 21:09:38.464780 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.464736 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-113.ec2.internal" event="NodeHasSufficientPID" Jul 15 21:09:38.465397 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.465380 2570 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 15 21:09:38.465397 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.465395 2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 15 21:09:38.465541 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.465409 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 21:09:38.465541 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.465415 2570 state_mem.go:36] "Initialized new in-memory state store" Jul 15 21:09:38.466600 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.466581 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-113.ec2.internal" event="NodeHasSufficientMemory" Jul 15 21:09:38.466653 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.466608 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-113.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 21:09:38.466653 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.466619 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-113.ec2.internal" event="NodeHasSufficientPID" Jul 15 21:09:38.466771 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.466763 2570 policy_none.go:49] "None policy: Start" Jul 15 21:09:38.466809 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.466777 2570 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 15 21:09:38.466809 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.466787 2570 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 15 21:09:38.467744 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.467733 2570 policy_none.go:47] "Start" Jul 15 21:09:38.480473 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:38.480396 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-113.ec2.internal.18c292c54b7b11aa default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-113.ec2.internal,UID:ip-10-0-131-113.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-113.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-113.ec2.internal,},FirstTimestamp:2026-07-15 21:09:38.464706986 +0000 UTC m=+0.359111043,LastTimestamp:2026-07-15 21:09:38.464706986 +0000 UTC m=+0.359111043,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-113.ec2.internal,}" Jul 15 21:09:38.494105 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:38.493902 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-113.ec2.internal.18c292c54b7b6b67 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-113.ec2.internal,UID:ip-10-0-131-113.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-131-113.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-131-113.ec2.internal,},FirstTimestamp:2026-07-15 21:09:38.464729959 +0000 UTC m=+0.359134016,LastTimestamp:2026-07-15 21:09:38.464729959 +0000 UTC m=+0.359134016,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-113.ec2.internal,}" Jul 15 21:09:38.498991 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.498978 2570 manager.go:337] "Starting Device Plugin manager" Jul 15 21:09:38.499039 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:38.499011 2570 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 15 21:09:38.499039 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.499021 2570 server.go:87] "Starting device plugin registration server" Jul 15 21:09:38.499319 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.499306 2570 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 15 21:09:38.499382 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.499324 2570 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 15 21:09:38.499489 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.499468 2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 15 21:09:38.499568 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.499555 2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 15 21:09:38.499568 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.499566 2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 15 21:09:38.500097 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:38.500078 2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 15 21:09:38.500169 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:38.500137 2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-113.ec2.internal\" not found" Jul 15 21:09:38.508696 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:38.508622 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-113.ec2.internal.18c292c54b7b920f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-113.ec2.internal,UID:ip-10-0-131-113.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-131-113.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-131-113.ec2.internal,},FirstTimestamp:2026-07-15 21:09:38.464739855 +0000 UTC m=+0.359143911,LastTimestamp:2026-07-15 21:09:38.464739855 +0000 UTC m=+0.359143911,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-113.ec2.internal,}" Jul 15 21:09:38.526265 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:38.526177 2570 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-131-113.ec2.internal.18c292c54b7b11aa\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-113.ec2.internal.18c292c54b7b11aa default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-113.ec2.internal,UID:ip-10-0-131-113.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-113.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-113.ec2.internal,},FirstTimestamp:2026-07-15 21:09:38.464706986 +0000 UTC m=+0.359111043,LastTimestamp:2026-07-15 21:09:38.466597049 +0000 UTC m=+0.361001105,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-113.ec2.internal,}" Jul 15 21:09:38.536253 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:38.536175 2570 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-131-113.ec2.internal.18c292c54b7b6b67\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-113.ec2.internal.18c292c54b7b6b67 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-113.ec2.internal,UID:ip-10-0-131-113.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-131-113.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-131-113.ec2.internal,},FirstTimestamp:2026-07-15 21:09:38.464729959 +0000 UTC m=+0.359134016,LastTimestamp:2026-07-15 21:09:38.466613122 +0000 UTC m=+0.361017179,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-113.ec2.internal,}" Jul 15 21:09:38.543930 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.538396 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wd58j" Jul 15 21:09:38.547410 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.547382 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wd58j" Jul 15 21:09:38.551032 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:38.550957 2570 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-131-113.ec2.internal.18c292c54b7b920f\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-113.ec2.internal.18c292c54b7b920f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-113.ec2.internal,UID:ip-10-0-131-113.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-131-113.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-131-113.ec2.internal,},FirstTimestamp:2026-07-15 21:09:38.464739855 +0000 UTC m=+0.359143911,LastTimestamp:2026-07-15 21:09:38.46662256 +0000 UTC m=+0.361026616,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-113.ec2.internal,}" Jul 15 21:09:38.581171 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.581130 2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 15 21:09:38.582496 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.582478 2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 15 21:09:38.582580 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.582518 2570 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 15 21:09:38.582580 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.582557 2570 kubelet.go:2448] "Starting kubelet main sync loop" Jul 15 21:09:38.582663 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:38.582595 2570 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 15 21:09:38.585320 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.585298 2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 21:09:38.600468 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.600443 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 21:09:38.601543 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.601528 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-113.ec2.internal" event="NodeHasSufficientMemory" Jul 15 21:09:38.601617 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.601558 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-113.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 21:09:38.601617 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.601572 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-113.ec2.internal" event="NodeHasSufficientPID" Jul 15 21:09:38.601617 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.601604 2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-113.ec2.internal" Jul 15 21:09:38.612199 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.612177 2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-113.ec2.internal" Jul 15 21:09:38.612265 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:38.612203 2570 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-113.ec2.internal\": node \"ip-10-0-131-113.ec2.internal\" not found" Jul 15 21:09:38.649158 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:38.649085 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-113.ec2.internal\" not found" Jul 15 21:09:38.683806 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.683777 2570 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-113.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-113.ec2.internal"] Jul 15 21:09:38.683884 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.683849 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 21:09:38.685719 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.685700 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-113.ec2.internal" event="NodeHasSufficientMemory" Jul 15 21:09:38.685814 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.685738 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-113.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 21:09:38.685814 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.685749 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-113.ec2.internal" event="NodeHasSufficientPID" Jul 15 21:09:38.687160 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.687147 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 21:09:38.687275 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.687260 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-113.ec2.internal" Jul 15 21:09:38.687322 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.687292 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 21:09:38.687957 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.687932 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-113.ec2.internal" event="NodeHasSufficientMemory" Jul 15 21:09:38.688055 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.687966 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-113.ec2.internal" event="NodeHasSufficientMemory" Jul 15 21:09:38.688055 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.687989 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-113.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 21:09:38.688055 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.687999 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-113.ec2.internal" event="NodeHasSufficientPID" Jul 15 21:09:38.688055 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.687969 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-113.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 21:09:38.688055 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.688052 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-113.ec2.internal" event="NodeHasSufficientPID" Jul 15 21:09:38.689167 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.689151 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-113.ec2.internal" Jul 15 21:09:38.689247 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.689175 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 21:09:38.689905 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.689888 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-113.ec2.internal" event="NodeHasSufficientMemory" Jul 15 21:09:38.690015 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.689924 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-113.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 21:09:38.690015 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.689954 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-113.ec2.internal" event="NodeHasSufficientPID" Jul 15 21:09:38.714076 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:38.714055 2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-113.ec2.internal\" not found" node="ip-10-0-131-113.ec2.internal" Jul 15 21:09:38.718668 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:38.718652 2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-113.ec2.internal\" not found" node="ip-10-0-131-113.ec2.internal" Jul 15 21:09:38.746277 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.746244 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/79cde544d17be45b537bc68d4a43ce88-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-113.ec2.internal\" (UID: \"79cde544d17be45b537bc68d4a43ce88\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-113.ec2.internal" Jul 15 21:09:38.746277 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.746281 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79cde544d17be45b537bc68d4a43ce88-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-113.ec2.internal\" (UID: \"79cde544d17be45b537bc68d4a43ce88\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-113.ec2.internal" Jul 15 21:09:38.746473 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.746318 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b6cd2e073ae6c0ce5cef35d9bfb6314d-config\") pod \"kube-apiserver-proxy-ip-10-0-131-113.ec2.internal\" (UID: \"b6cd2e073ae6c0ce5cef35d9bfb6314d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-113.ec2.internal" Jul 15 21:09:38.749871 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:38.749851 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-113.ec2.internal\" not found" Jul 15 21:09:38.847147 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.847108 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79cde544d17be45b537bc68d4a43ce88-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-113.ec2.internal\" (UID: \"79cde544d17be45b537bc68d4a43ce88\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-113.ec2.internal" Jul 15 21:09:38.847147 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.847152 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b6cd2e073ae6c0ce5cef35d9bfb6314d-config\") pod \"kube-apiserver-proxy-ip-10-0-131-113.ec2.internal\" (UID: \"b6cd2e073ae6c0ce5cef35d9bfb6314d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-113.ec2.internal" Jul 15 21:09:38.847394 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.847173 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/79cde544d17be45b537bc68d4a43ce88-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-113.ec2.internal\" (UID: \"79cde544d17be45b537bc68d4a43ce88\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-113.ec2.internal" Jul 15 21:09:38.847394 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.847223 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/79cde544d17be45b537bc68d4a43ce88-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-113.ec2.internal\" (UID: \"79cde544d17be45b537bc68d4a43ce88\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-113.ec2.internal" Jul 15 21:09:38.847394 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.847241 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b6cd2e073ae6c0ce5cef35d9bfb6314d-config\") pod \"kube-apiserver-proxy-ip-10-0-131-113.ec2.internal\" (UID: \"b6cd2e073ae6c0ce5cef35d9bfb6314d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-113.ec2.internal" Jul 15 21:09:38.847394 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:38.847223 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79cde544d17be45b537bc68d4a43ce88-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-113.ec2.internal\" (UID: \"79cde544d17be45b537bc68d4a43ce88\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-113.ec2.internal" Jul 15 21:09:38.850441 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:38.850425 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-113.ec2.internal\" not found" Jul 15 21:09:38.950614 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:38.950527 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-113.ec2.internal\" not found" Jul 15 21:09:39.016786 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:39.016754 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-113.ec2.internal" Jul 15 21:09:39.022175 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:39.022157 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-113.ec2.internal" Jul 15 21:09:39.051653 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:39.051621 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-113.ec2.internal\" not found" Jul 15 21:09:39.152505 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:39.152458 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-113.ec2.internal\" not found" Jul 15 21:09:39.253475 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:39.253399 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-113.ec2.internal\" not found" Jul 15 21:09:39.353646 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:39.353615 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-113.ec2.internal\" not found" Jul 15 21:09:39.381386 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:39.381359 2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 21:09:39.387703 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:39.387679 2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 15 21:09:39.387820 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:39.387803 2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 15 21:09:39.387871 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:39.387851 2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 15 21:09:39.454681 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:39.454646 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-113.ec2.internal\" not found" Jul 15 21:09:39.551339 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:39.551237 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 21:04:38 +0000 UTC" deadline="2028-04-08 02:40:19.448259836 +0000 UTC" Jul 15 21:09:39.551339 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:39.551277 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15173h30m39.896986323s" Jul 15 21:09:39.555613 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:39.555585 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-113.ec2.internal\" not found" Jul 15 21:09:39.608816 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:39.608784 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 21:09:39.610114 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:39.610088 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-113.ec2.internal" event="NodeHasSufficientMemory" Jul 15 21:09:39.610276 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:39.610131 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-113.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 21:09:39.610276 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:39.610147 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-113.ec2.internal" event="NodeHasSufficientPID" Jul 15 21:09:39.622312 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:39.622259 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6cd2e073ae6c0ce5cef35d9bfb6314d.slice/crio-df1601bc71cb7a775533cd4a76aacf89046ae07d11fcf5ea6de2fb777ab95c23 WatchSource:0}: Error finding container df1601bc71cb7a775533cd4a76aacf89046ae07d11fcf5ea6de2fb777ab95c23: Status 404 returned error can't find the container with id df1601bc71cb7a775533cd4a76aacf89046ae07d11fcf5ea6de2fb777ab95c23 Jul 15 21:09:39.623026 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:39.623005 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79cde544d17be45b537bc68d4a43ce88.slice/crio-a882bddbb4dc6b9ced0f4b60e56c233d23f3092f421b2833f9856db92cc8bfc3 WatchSource:0}: Error finding container a882bddbb4dc6b9ced0f4b60e56c233d23f3092f421b2833f9856db92cc8bfc3: Status 404 returned error can't find the container with id a882bddbb4dc6b9ced0f4b60e56c233d23f3092f421b2833f9856db92cc8bfc3 Jul 15 21:09:39.627648 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:39.627633 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 21:09:39.656780 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:39.656746 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-113.ec2.internal\" not found" Jul 15 21:09:39.713262 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:39.713235 2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 21:09:39.743908 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:39.743875 2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-113.ec2.internal" Jul 15 21:09:39.759498 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:39.759471 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 21:09:39.760770 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:39.760753 2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-113.ec2.internal" Jul 15 21:09:39.780370 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:39.780345 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 21:09:39.792784 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:39.792763 2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 21:09:40.287139 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.287102 2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 21:09:40.423349 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.423306 2570 apiserver.go:52] "Watching apiserver" Jul 15 21:09:40.429923 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.429896 2570 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 15 21:09:40.430422 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.430396 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-pxkxm","openshift-image-registry/node-ca-lkgf2","openshift-multus/multus-hmhs5","openshift-multus/network-metrics-daemon-89vwd","openshift-network-diagnostics/network-check-target-6p5nk","kube-system/konnectivity-agent-t6sjg","openshift-cluster-node-tuning-operator/tuned-dw8c6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-113.ec2.internal","openshift-multus/multus-additional-cni-plugins-k25xr","openshift-network-operator/iptables-alerter-lmdct","openshift-ovn-kubernetes/ovnkube-node-nhzkw","kube-system/global-pull-secret-syncer-8c5ks","kube-system/kube-apiserver-proxy-ip-10-0-131-113.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95tgp"] Jul 15 21:09:40.432143 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.432117 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k25xr" Jul 15 21:09:40.433631 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.433608 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.434790 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.434771 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.434914 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.434894 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 15 21:09:40.434984 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.434895 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 15 21:09:40.436035 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.436015 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lmdct" Jul 15 21:09:40.436685 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.436507 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 15 21:09:40.436685 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.436533 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 15 21:09:40.436685 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.436559 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8rw9s\"" Jul 15 21:09:40.436685 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.436598 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 15 21:09:40.436685 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.436648 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 15 21:09:40.437404 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.437386 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89vwd" Jul 15 21:09:40.437576 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:40.437549 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89vwd" podUID="e9154423-994b-45e7-9cad-813087e03e31" Jul 15 21:09:40.437913 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.437893 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 15 21:09:40.438008 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.437973 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 15 21:09:40.438336 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.438123 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9t7tk\"" Jul 15 21:09:40.438336 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.438187 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 15 21:09:40.438512 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.438431 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 15 21:09:40.439349 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.439328 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t6sjg" Jul 15 21:09:40.441420 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.440800 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 15 21:09:40.441490 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.441467 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 15 21:09:40.441942 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.441918 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 15 21:09:40.441942 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.441937 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jxgr8\"" Jul 15 21:09:40.442295 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.442275 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kx7c6\"" Jul 15 21:09:40.443066 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.442573 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 15 21:09:40.443066 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.442963 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 15 21:09:40.443246 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.443101 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 15 21:09:40.443246 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.443136 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 15 21:09:40.444398 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.443673 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 15 21:09:40.444398 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.443845 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ph6wg\"" Jul 15 21:09:40.444799 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.444775 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.446153 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.446129 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6p5nk" Jul 15 21:09:40.446256 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:40.446201 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6p5nk" podUID="b85e9808-cc68-4ebb-af04-6bd95b54a5c9" Jul 15 21:09:40.447439 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.447420 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 15 21:09:40.447622 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.447602 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pxkxm" Jul 15 21:09:40.447622 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.447596 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 15 21:09:40.447759 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.447701 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zffpx\"" Jul 15 21:09:40.449168 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.449149 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lkgf2" Jul 15 21:09:40.450868 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.450849 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8c5ks" Jul 15 21:09:40.450942 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:40.450918 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8c5ks" podUID="14f84a19-c09e-4724-892e-46796e611bd9" Jul 15 21:09:40.452132 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.452110 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 15 21:09:40.452233 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.452165 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-m4nw6\"" Jul 15 21:09:40.452626 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.452362 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95tgp" Jul 15 21:09:40.452626 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.452435 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 15 21:09:40.452886 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.452868 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7xmwc\"" Jul 15 21:09:40.453012 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.452901 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 15 21:09:40.453165 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.453093 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 15 21:09:40.453237 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.452906 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 15 21:09:40.456216 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.456043 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 15 21:09:40.456350 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.456326 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 15 21:09:40.458659 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.456792 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9qkls\"" Jul 15 21:09:40.458659 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.456818 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 15 21:09:40.459238 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.459166 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/db9d02a9-e0aa-4a47-b3ef-b518f555b872-host-slash\") pod \"iptables-alerter-lmdct\" (UID: \"db9d02a9-e0aa-4a47-b3ef-b518f555b872\") " pod="openshift-network-operator/iptables-alerter-lmdct" Jul 15 21:09:40.459238 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.459198 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-node-log\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.459238 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.459223 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.459463 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.459261 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e89cab18-de44-40e2-9486-0446676f8942-system-cni-dir\") pod \"multus-additional-cni-plugins-k25xr\" (UID: \"e89cab18-de44-40e2-9486-0446676f8942\") " pod="openshift-multus/multus-additional-cni-plugins-k25xr" Jul 15 21:09:40.459463 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.459287 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e89cab18-de44-40e2-9486-0446676f8942-os-release\") pod \"multus-additional-cni-plugins-k25xr\" (UID: \"e89cab18-de44-40e2-9486-0446676f8942\") " pod="openshift-multus/multus-additional-cni-plugins-k25xr" Jul 15 21:09:40.459463 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.459321 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7adb30c9-2d57-4688-a7cd-0bbb70fcd152-agent-certs\") pod \"konnectivity-agent-t6sjg\" (UID: \"7adb30c9-2d57-4688-a7cd-0bbb70fcd152\") " pod="kube-system/konnectivity-agent-t6sjg" Jul 15 21:09:40.459463 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.459346 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88-etc-modprobe-d\") pod \"tuned-dw8c6\" (UID: \"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.459463 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.459393 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcsz4\" (UniqueName: \"kubernetes.io/projected/cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88-kube-api-access-jcsz4\") pod \"tuned-dw8c6\" (UID: \"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.459463 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.459418 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88-etc-sysconfig\") pod \"tuned-dw8c6\" (UID: \"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.459463 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.459455 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9154423-994b-45e7-9cad-813087e03e31-metrics-certs\") pod \"network-metrics-daemon-89vwd\" (UID: \"e9154423-994b-45e7-9cad-813087e03e31\") " pod="openshift-multus/network-metrics-daemon-89vwd" Jul 15 21:09:40.459822 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.459483 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-run-systemd\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.459822 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.459507 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/beb5b136-86fb-4e57-9b27-3fc1079a9af3-ovnkube-config\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.459822 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.459544 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-multus-cni-dir\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.459822 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.459570 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-hostroot\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.459822 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.459593 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88-lib-modules\") pod \"tuned-dw8c6\" (UID: \"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.459822 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.459618 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-var-lib-openvswitch\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.459822 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.459645 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e89cab18-de44-40e2-9486-0446676f8942-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k25xr\" (UID: \"e89cab18-de44-40e2-9486-0446676f8942\") " pod="openshift-multus/multus-additional-cni-plugins-k25xr" Jul 15 21:09:40.459822 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.459670 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-host-run-ovn-kubernetes\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.459822 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.459695 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-systemd-units\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.459822 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.459726 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqm8s\" (UniqueName: \"kubernetes.io/projected/e9154423-994b-45e7-9cad-813087e03e31-kube-api-access-jqm8s\") pod \"network-metrics-daemon-89vwd\" (UID: \"e9154423-994b-45e7-9cad-813087e03e31\") " pod="openshift-multus/network-metrics-daemon-89vwd" Jul 15 21:09:40.459822 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.459771 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e89cab18-de44-40e2-9486-0446676f8942-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k25xr\" (UID: \"e89cab18-de44-40e2-9486-0446676f8942\") " pod="openshift-multus/multus-additional-cni-plugins-k25xr" Jul 15 21:09:40.459822 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.459797 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/beb5b136-86fb-4e57-9b27-3fc1079a9af3-ovn-node-metrics-cert\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.459822 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.459828 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-cni-binary-copy\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.460540 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.459852 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88-etc-kubernetes\") pod \"tuned-dw8c6\" (UID: \"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.460540 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.459876 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88-sys\") pod \"tuned-dw8c6\" (UID: \"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.460540 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.459899 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/db9d02a9-e0aa-4a47-b3ef-b518f555b872-iptables-alerter-script\") pod \"iptables-alerter-lmdct\" (UID: \"db9d02a9-e0aa-4a47-b3ef-b518f555b872\") " pod="openshift-network-operator/iptables-alerter-lmdct" Jul 15 21:09:40.460540 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.459935 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-host-slash\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.460540 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.459988 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-log-socket\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.460540 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.460013 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-os-release\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.460540 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.460048 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-multus-socket-dir-parent\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.460540 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.460075 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-host-var-lib-cni-multus\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.460540 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.460099 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7adb30c9-2d57-4688-a7cd-0bbb70fcd152-konnectivity-ca\") pod \"konnectivity-agent-t6sjg\" (UID: \"7adb30c9-2d57-4688-a7cd-0bbb70fcd152\") " pod="kube-system/konnectivity-agent-t6sjg" Jul 15 21:09:40.460540 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.460124 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-system-cni-dir\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.460540 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.460146 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-host-run-k8s-cni-cncf-io\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.460540 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.460173 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88-etc-sysctl-d\") pod \"tuned-dw8c6\" (UID: \"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.460540 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.460229 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-host-cni-netd\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.460540 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.460256 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-host-run-netns\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.460540 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.460283 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-etc-kubernetes\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.460540 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.460309 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-host-run-netns\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.460540 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.460433 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-multus-conf-dir\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.461431 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.460459 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-multus-daemon-config\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.461431 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.460498 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-host-run-multus-certs\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.461431 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.460543 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e89cab18-de44-40e2-9486-0446676f8942-cnibin\") pod \"multus-additional-cni-plugins-k25xr\" (UID: \"e89cab18-de44-40e2-9486-0446676f8942\") " pod="openshift-multus/multus-additional-cni-plugins-k25xr" Jul 15 21:09:40.461431 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.460582 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e89cab18-de44-40e2-9486-0446676f8942-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k25xr\" (UID: \"e89cab18-de44-40e2-9486-0446676f8942\") " pod="openshift-multus/multus-additional-cni-plugins-k25xr" Jul 15 21:09:40.461431 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.460614 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-host-kubelet\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.461431 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.460650 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxqnd\" (UniqueName: \"kubernetes.io/projected/beb5b136-86fb-4e57-9b27-3fc1079a9af3-kube-api-access-nxqnd\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.461431 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.460675 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-cnibin\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.461431 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.460692 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksfnj\" (UniqueName: \"kubernetes.io/projected/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-kube-api-access-ksfnj\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.461431 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.460706 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88-etc-sysctl-conf\") pod \"tuned-dw8c6\" (UID: \"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.461431 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.460726 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88-var-lib-kubelet\") pod \"tuned-dw8c6\" (UID: \"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.461431 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.460774 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65mm2\" (UniqueName: \"kubernetes.io/projected/e89cab18-de44-40e2-9486-0446676f8942-kube-api-access-65mm2\") pod \"multus-additional-cni-plugins-k25xr\" (UID: \"e89cab18-de44-40e2-9486-0446676f8942\") " pod="openshift-multus/multus-additional-cni-plugins-k25xr" Jul 15 21:09:40.461431 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.460805 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-run-ovn\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.461431 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.460834 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/beb5b136-86fb-4e57-9b27-3fc1079a9af3-env-overrides\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.461431 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.460856 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-host-var-lib-kubelet\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.461431 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.460870 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88-host\") pod \"tuned-dw8c6\" (UID: \"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.461431 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.460895 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88-tmp\") pod \"tuned-dw8c6\" (UID: \"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.462327 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.460913 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-host-cni-bin\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.462327 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.460938 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e89cab18-de44-40e2-9486-0446676f8942-cni-binary-copy\") pod \"multus-additional-cni-plugins-k25xr\" (UID: \"e89cab18-de44-40e2-9486-0446676f8942\") " pod="openshift-multus/multus-additional-cni-plugins-k25xr" Jul 15 21:09:40.462327 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.460961 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-etc-openvswitch\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.462327 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.460978 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/beb5b136-86fb-4e57-9b27-3fc1079a9af3-ovnkube-script-lib\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.462327 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.460993 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88-run\") pod \"tuned-dw8c6\" (UID: \"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.462327 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.461049 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6zcx\" (UniqueName: \"kubernetes.io/projected/db9d02a9-e0aa-4a47-b3ef-b518f555b872-kube-api-access-r6zcx\") pod \"iptables-alerter-lmdct\" (UID: \"db9d02a9-e0aa-4a47-b3ef-b518f555b872\") " pod="openshift-network-operator/iptables-alerter-lmdct" Jul 15 21:09:40.462327 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.461068 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-run-openvswitch\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.462327 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.461083 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-host-var-lib-cni-bin\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.462327 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.461103 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88-etc-systemd\") pod \"tuned-dw8c6\" (UID: \"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.462327 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.461127 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88-etc-tuned\") pod \"tuned-dw8c6\" (UID: \"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.462327 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.461335 2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 21:09:40.498380 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.498353 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cpzjb" Jul 15 21:09:40.505766 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.505738 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cpzjb" Jul 15 21:09:40.545053 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.544962 2570 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 15 21:09:40.562068 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.562039 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9154423-994b-45e7-9cad-813087e03e31-metrics-certs\") pod \"network-metrics-daemon-89vwd\" (UID: \"e9154423-994b-45e7-9cad-813087e03e31\") " pod="openshift-multus/network-metrics-daemon-89vwd" Jul 15 21:09:40.562185 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:40.562073 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:09:40.562185 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.562090 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-run-systemd\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.562185 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.562119 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/beb5b136-86fb-4e57-9b27-3fc1079a9af3-ovnkube-config\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.562185 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:40.562154 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9154423-994b-45e7-9cad-813087e03e31-metrics-certs podName:e9154423-994b-45e7-9cad-813087e03e31 nodeName:}" failed. No retries permitted until 2026-07-15 21:09:41.062129558 +0000 UTC m=+2.956533624 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9154423-994b-45e7-9cad-813087e03e31-metrics-certs") pod "network-metrics-daemon-89vwd" (UID: "e9154423-994b-45e7-9cad-813087e03e31") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:09:40.562185 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.562170 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-multus-cni-dir\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.562495 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.562204 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-hostroot\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.562495 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.562228 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88-lib-modules\") pod \"tuned-dw8c6\" (UID: \"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.562495 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.562258 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq9n9\" (UniqueName: \"kubernetes.io/projected/b85e9808-cc68-4ebb-af04-6bd95b54a5c9-kube-api-access-fq9n9\") pod \"network-check-target-6p5nk\" (UID: \"b85e9808-cc68-4ebb-af04-6bd95b54a5c9\") " pod="openshift-network-diagnostics/network-check-target-6p5nk" Jul 15 21:09:40.562495 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.562282 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-var-lib-openvswitch\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.562495 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.562308 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvl4h\" (UniqueName: \"kubernetes.io/projected/654026cc-fb99-41cc-b6c4-6fbc09801960-kube-api-access-dvl4h\") pod \"node-ca-lkgf2\" (UID: \"654026cc-fb99-41cc-b6c4-6fbc09801960\") " pod="openshift-image-registry/node-ca-lkgf2" Jul 15 21:09:40.562495 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.562349 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7af6fe70-ffce-417d-9a8a-6df647daeb40-kubelet-dir\") pod \"aws-ebs-csi-driver-node-95tgp\" (UID: \"7af6fe70-ffce-417d-9a8a-6df647daeb40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95tgp" Jul 15 21:09:40.562495 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.562374 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7af6fe70-ffce-417d-9a8a-6df647daeb40-socket-dir\") pod \"aws-ebs-csi-driver-node-95tgp\" (UID: \"7af6fe70-ffce-417d-9a8a-6df647daeb40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95tgp" Jul 15 21:09:40.562495 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.562402 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7af6fe70-ffce-417d-9a8a-6df647daeb40-registration-dir\") pod \"aws-ebs-csi-driver-node-95tgp\" (UID: \"7af6fe70-ffce-417d-9a8a-6df647daeb40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95tgp" Jul 15 21:09:40.562495 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.562431 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e89cab18-de44-40e2-9486-0446676f8942-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k25xr\" (UID: \"e89cab18-de44-40e2-9486-0446676f8942\") " pod="openshift-multus/multus-additional-cni-plugins-k25xr" Jul 15 21:09:40.562495 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.562457 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-host-run-ovn-kubernetes\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.562495 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.562485 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/14f84a19-c09e-4724-892e-46796e611bd9-kubelet-config\") pod \"global-pull-secret-syncer-8c5ks\" (UID: \"14f84a19-c09e-4724-892e-46796e611bd9\") " pod="kube-system/global-pull-secret-syncer-8c5ks" Jul 15 21:09:40.563039 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.562509 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/835fb8bf-2d1b-47f8-b6ef-25d16a2cc774-tmp-dir\") pod \"node-resolver-pxkxm\" (UID: \"835fb8bf-2d1b-47f8-b6ef-25d16a2cc774\") " pod="openshift-dns/node-resolver-pxkxm" Jul 15 21:09:40.563039 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.562534 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-systemd-units\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.563039 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.562564 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7af6fe70-ffce-417d-9a8a-6df647daeb40-sys-fs\") pod \"aws-ebs-csi-driver-node-95tgp\" (UID: \"7af6fe70-ffce-417d-9a8a-6df647daeb40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95tgp" Jul 15 21:09:40.563039 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.562591 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d79x\" (UniqueName: \"kubernetes.io/projected/7af6fe70-ffce-417d-9a8a-6df647daeb40-kube-api-access-8d79x\") pod \"aws-ebs-csi-driver-node-95tgp\" (UID: \"7af6fe70-ffce-417d-9a8a-6df647daeb40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95tgp" Jul 15 21:09:40.563039 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.562624 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqm8s\" (UniqueName: \"kubernetes.io/projected/e9154423-994b-45e7-9cad-813087e03e31-kube-api-access-jqm8s\") pod \"network-metrics-daemon-89vwd\" (UID: \"e9154423-994b-45e7-9cad-813087e03e31\") " pod="openshift-multus/network-metrics-daemon-89vwd" Jul 15 21:09:40.563039 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.562652 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e89cab18-de44-40e2-9486-0446676f8942-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k25xr\" (UID: \"e89cab18-de44-40e2-9486-0446676f8942\") " pod="openshift-multus/multus-additional-cni-plugins-k25xr" Jul 15 21:09:40.563039 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.562679 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/beb5b136-86fb-4e57-9b27-3fc1079a9af3-ovn-node-metrics-cert\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.563039 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.562706 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-cni-binary-copy\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.563039 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.562732 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88-etc-kubernetes\") pod \"tuned-dw8c6\" (UID: \"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.563039 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.562757 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88-sys\") pod \"tuned-dw8c6\" (UID: \"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.563039 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.562768 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/beb5b136-86fb-4e57-9b27-3fc1079a9af3-ovnkube-config\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.563039 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.562788 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/db9d02a9-e0aa-4a47-b3ef-b518f555b872-iptables-alerter-script\") pod \"iptables-alerter-lmdct\" (UID: \"db9d02a9-e0aa-4a47-b3ef-b518f555b872\") " pod="openshift-network-operator/iptables-alerter-lmdct" Jul 15 21:09:40.563039 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.562827 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-host-slash\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.563039 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.562851 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-run-systemd\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.563039 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.562852 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-log-socket\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.563039 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.562892 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-log-socket\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.563039 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.562894 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-os-release\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.563630 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.562953 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-os-release\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.563630 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.562957 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-multus-socket-dir-parent\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.563630 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.562992 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-host-var-lib-cni-multus\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.563630 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.563016 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7adb30c9-2d57-4688-a7cd-0bbb70fcd152-konnectivity-ca\") pod \"konnectivity-agent-t6sjg\" (UID: \"7adb30c9-2d57-4688-a7cd-0bbb70fcd152\") " pod="kube-system/konnectivity-agent-t6sjg" Jul 15 21:09:40.563630 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.563042 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7af6fe70-ffce-417d-9a8a-6df647daeb40-device-dir\") pod \"aws-ebs-csi-driver-node-95tgp\" (UID: \"7af6fe70-ffce-417d-9a8a-6df647daeb40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95tgp" Jul 15 21:09:40.563630 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.563067 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-system-cni-dir\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.563630 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.563090 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-host-run-k8s-cni-cncf-io\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.563630 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.563112 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88-etc-sysctl-d\") pod \"tuned-dw8c6\" (UID: \"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.563630 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.563133 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-host-cni-netd\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.563630 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.563169 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-host-run-netns\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.563630 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.563174 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-multus-cni-dir\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.563630 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.563204 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-etc-kubernetes\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.563630 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.563228 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-systemd-units\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.563630 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.563234 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-host-run-netns\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.563630 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.563268 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-multus-conf-dir\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.563630 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.563299 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-multus-daemon-config\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.563630 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.563327 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-host-run-multus-certs\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.563630 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.563337 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88-lib-modules\") pod \"tuned-dw8c6\" (UID: \"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.564254 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.563355 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/14f84a19-c09e-4724-892e-46796e611bd9-dbus\") pod \"global-pull-secret-syncer-8c5ks\" (UID: \"14f84a19-c09e-4724-892e-46796e611bd9\") " pod="kube-system/global-pull-secret-syncer-8c5ks" Jul 15 21:09:40.564254 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.563404 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-var-lib-openvswitch\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.564254 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.563405 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e89cab18-de44-40e2-9486-0446676f8942-cnibin\") pod \"multus-additional-cni-plugins-k25xr\" (UID: \"e89cab18-de44-40e2-9486-0446676f8942\") " pod="openshift-multus/multus-additional-cni-plugins-k25xr" Jul 15 21:09:40.564254 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.563445 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e89cab18-de44-40e2-9486-0446676f8942-cnibin\") pod \"multus-additional-cni-plugins-k25xr\" (UID: \"e89cab18-de44-40e2-9486-0446676f8942\") " pod="openshift-multus/multus-additional-cni-plugins-k25xr" Jul 15 21:09:40.564254 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.563447 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e89cab18-de44-40e2-9486-0446676f8942-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k25xr\" (UID: \"e89cab18-de44-40e2-9486-0446676f8942\") " pod="openshift-multus/multus-additional-cni-plugins-k25xr" Jul 15 21:09:40.564254 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.563775 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-host-run-ovn-kubernetes\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.564254 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.563872 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e89cab18-de44-40e2-9486-0446676f8942-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k25xr\" (UID: \"e89cab18-de44-40e2-9486-0446676f8942\") " pod="openshift-multus/multus-additional-cni-plugins-k25xr" Jul 15 21:09:40.564254 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.564087 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-host-run-multus-certs\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.564254 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.564106 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-host-kubelet\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.564254 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.564140 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-etc-kubernetes\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.564254 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.564171 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxqnd\" (UniqueName: \"kubernetes.io/projected/beb5b136-86fb-4e57-9b27-3fc1079a9af3-kube-api-access-nxqnd\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.564254 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.564187 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88-etc-sysctl-d\") pod \"tuned-dw8c6\" (UID: \"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.564254 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.564199 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-cnibin\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.564254 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.564204 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-system-cni-dir\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.564254 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.564231 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/654026cc-fb99-41cc-b6c4-6fbc09801960-serviceca\") pod \"node-ca-lkgf2\" (UID: \"654026cc-fb99-41cc-b6c4-6fbc09801960\") " pod="openshift-image-registry/node-ca-lkgf2" Jul 15 21:09:40.564254 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.564245 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-host-run-k8s-cni-cncf-io\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.564254 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.564262 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksfnj\" (UniqueName: \"kubernetes.io/projected/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-kube-api-access-ksfnj\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.565096 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.564299 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-multus-conf-dir\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.565096 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.564323 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88-etc-sysctl-conf\") pod \"tuned-dw8c6\" (UID: \"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.565096 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.564369 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88-sys\") pod \"tuned-dw8c6\" (UID: \"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.565436 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.565029 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e89cab18-de44-40e2-9486-0446676f8942-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k25xr\" (UID: \"e89cab18-de44-40e2-9486-0446676f8942\") " pod="openshift-multus/multus-additional-cni-plugins-k25xr" Jul 15 21:09:40.565547 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.565412 2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 15 21:09:40.565547 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.565077 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-cni-binary-copy\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.565547 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.565093 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88-var-lib-kubelet\") pod \"tuned-dw8c6\" (UID: \"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.565547 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.565277 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-multus-socket-dir-parent\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.565547 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.565306 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-multus-daemon-config\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.565547 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.565332 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-host-var-lib-cni-multus\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.565547 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.565401 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-hostroot\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.565869 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.565548 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65mm2\" (UniqueName: \"kubernetes.io/projected/e89cab18-de44-40e2-9486-0446676f8942-kube-api-access-65mm2\") pod \"multus-additional-cni-plugins-k25xr\" (UID: \"e89cab18-de44-40e2-9486-0446676f8942\") " pod="openshift-multus/multus-additional-cni-plugins-k25xr" Jul 15 21:09:40.565869 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.565587 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-run-ovn\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.565869 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.565606 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-host-cni-netd\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.565869 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.565651 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/beb5b136-86fb-4e57-9b27-3fc1079a9af3-env-overrides\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.565869 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.565709 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-run-ovn\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.565869 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.565761 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-host-var-lib-kubelet\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.565869 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.564262 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-host-slash\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.568955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.565917 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e89cab18-de44-40e2-9486-0446676f8942-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k25xr\" (UID: \"e89cab18-de44-40e2-9486-0446676f8942\") " pod="openshift-multus/multus-additional-cni-plugins-k25xr" Jul 15 21:09:40.568955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.564306 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88-etc-kubernetes\") pod \"tuned-dw8c6\" (UID: \"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.568955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.566154 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88-host\") pod \"tuned-dw8c6\" (UID: \"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.568955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.567618 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88-tmp\") pod \"tuned-dw8c6\" (UID: \"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.568955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.566304 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-host-run-netns\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.568955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.566336 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/beb5b136-86fb-4e57-9b27-3fc1079a9af3-env-overrides\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.568955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.567656 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/654026cc-fb99-41cc-b6c4-6fbc09801960-host\") pod \"node-ca-lkgf2\" (UID: \"654026cc-fb99-41cc-b6c4-6fbc09801960\") " pod="openshift-image-registry/node-ca-lkgf2" Jul 15 21:09:40.568955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.566359 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88-host\") pod \"tuned-dw8c6\" (UID: \"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.568955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.566406 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-host-var-lib-kubelet\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.568955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.567692 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-host-cni-bin\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.568955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.565082 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88-var-lib-kubelet\") pod \"tuned-dw8c6\" (UID: \"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.568955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.566572 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88-etc-sysctl-conf\") pod \"tuned-dw8c6\" (UID: \"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.568955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.567728 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e89cab18-de44-40e2-9486-0446676f8942-cni-binary-copy\") pod \"multus-additional-cni-plugins-k25xr\" (UID: \"e89cab18-de44-40e2-9486-0446676f8942\") " pod="openshift-multus/multus-additional-cni-plugins-k25xr" Jul 15 21:09:40.568955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.567777 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-etc-openvswitch\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.568955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.567814 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/beb5b136-86fb-4e57-9b27-3fc1079a9af3-ovnkube-script-lib\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.568955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.567849 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88-run\") pod \"tuned-dw8c6\" (UID: \"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.568955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.567881 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6zcx\" (UniqueName: \"kubernetes.io/projected/db9d02a9-e0aa-4a47-b3ef-b518f555b872-kube-api-access-r6zcx\") pod \"iptables-alerter-lmdct\" (UID: \"db9d02a9-e0aa-4a47-b3ef-b518f555b872\") " pod="openshift-network-operator/iptables-alerter-lmdct" Jul 15 21:09:40.568955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.567914 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/835fb8bf-2d1b-47f8-b6ef-25d16a2cc774-hosts-file\") pod \"node-resolver-pxkxm\" (UID: \"835fb8bf-2d1b-47f8-b6ef-25d16a2cc774\") " pod="openshift-dns/node-resolver-pxkxm" Jul 15 21:09:40.569988 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.567946 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-run-openvswitch\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.569988 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.567977 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-host-var-lib-cni-bin\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.569988 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.568010 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88-etc-systemd\") pod \"tuned-dw8c6\" (UID: \"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.569988 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.568040 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88-etc-tuned\") pod \"tuned-dw8c6\" (UID: \"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.569988 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.568067 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/db9d02a9-e0aa-4a47-b3ef-b518f555b872-host-slash\") pod \"iptables-alerter-lmdct\" (UID: \"db9d02a9-e0aa-4a47-b3ef-b518f555b872\") " pod="openshift-network-operator/iptables-alerter-lmdct" Jul 15 21:09:40.569988 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.568098 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14f84a19-c09e-4724-892e-46796e611bd9-original-pull-secret\") pod \"global-pull-secret-syncer-8c5ks\" (UID: \"14f84a19-c09e-4724-892e-46796e611bd9\") " pod="kube-system/global-pull-secret-syncer-8c5ks" Jul 15 21:09:40.569988 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.568130 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-node-log\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.569988 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.568161 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7af6fe70-ffce-417d-9a8a-6df647daeb40-etc-selinux\") pod \"aws-ebs-csi-driver-node-95tgp\" (UID: \"7af6fe70-ffce-417d-9a8a-6df647daeb40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95tgp" Jul 15 21:09:40.569988 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.568167 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e89cab18-de44-40e2-9486-0446676f8942-cni-binary-copy\") pod \"multus-additional-cni-plugins-k25xr\" (UID: \"e89cab18-de44-40e2-9486-0446676f8942\") " pod="openshift-multus/multus-additional-cni-plugins-k25xr" Jul 15 21:09:40.569988 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.568193 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.569988 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.568221 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e89cab18-de44-40e2-9486-0446676f8942-system-cni-dir\") pod \"multus-additional-cni-plugins-k25xr\" (UID: \"e89cab18-de44-40e2-9486-0446676f8942\") " pod="openshift-multus/multus-additional-cni-plugins-k25xr" Jul 15 21:09:40.569988 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.568253 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e89cab18-de44-40e2-9486-0446676f8942-os-release\") pod \"multus-additional-cni-plugins-k25xr\" (UID: \"e89cab18-de44-40e2-9486-0446676f8942\") " pod="openshift-multus/multus-additional-cni-plugins-k25xr" Jul 15 21:09:40.569988 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.568293 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7adb30c9-2d57-4688-a7cd-0bbb70fcd152-agent-certs\") pod \"konnectivity-agent-t6sjg\" (UID: \"7adb30c9-2d57-4688-a7cd-0bbb70fcd152\") " pod="kube-system/konnectivity-agent-t6sjg" Jul 15 21:09:40.569988 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.568324 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88-etc-modprobe-d\") pod \"tuned-dw8c6\" (UID: \"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.569988 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.568367 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcsz4\" (UniqueName: \"kubernetes.io/projected/cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88-kube-api-access-jcsz4\") pod \"tuned-dw8c6\" (UID: \"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.569988 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.568399 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2ccv\" (UniqueName: \"kubernetes.io/projected/835fb8bf-2d1b-47f8-b6ef-25d16a2cc774-kube-api-access-p2ccv\") pod \"node-resolver-pxkxm\" (UID: \"835fb8bf-2d1b-47f8-b6ef-25d16a2cc774\") " pod="openshift-dns/node-resolver-pxkxm" Jul 15 21:09:40.569988 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.568433 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88-etc-sysconfig\") pod \"tuned-dw8c6\" (UID: \"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.570993 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.568547 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88-etc-sysconfig\") pod \"tuned-dw8c6\" (UID: \"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.570993 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.566913 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7adb30c9-2d57-4688-a7cd-0bbb70fcd152-konnectivity-ca\") pod \"konnectivity-agent-t6sjg\" (UID: \"7adb30c9-2d57-4688-a7cd-0bbb70fcd152\") " pod="kube-system/konnectivity-agent-t6sjg" Jul 15 21:09:40.570993 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.568617 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-etc-openvswitch\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.570993 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.566393 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-host-run-netns\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.570993 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.566485 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-host-kubelet\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.570993 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.566327 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-cnibin\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.570993 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.568727 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-host-cni-bin\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.570993 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.568744 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.570993 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.568779 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-node-log\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.570993 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.568848 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e89cab18-de44-40e2-9486-0446676f8942-system-cni-dir\") pod \"multus-additional-cni-plugins-k25xr\" (UID: \"e89cab18-de44-40e2-9486-0446676f8942\") " pod="openshift-multus/multus-additional-cni-plugins-k25xr" Jul 15 21:09:40.570993 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.568896 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e89cab18-de44-40e2-9486-0446676f8942-os-release\") pod \"multus-additional-cni-plugins-k25xr\" (UID: \"e89cab18-de44-40e2-9486-0446676f8942\") " pod="openshift-multus/multus-additional-cni-plugins-k25xr" Jul 15 21:09:40.570993 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.568896 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/db9d02a9-e0aa-4a47-b3ef-b518f555b872-iptables-alerter-script\") pod \"iptables-alerter-lmdct\" (UID: \"db9d02a9-e0aa-4a47-b3ef-b518f555b872\") " pod="openshift-network-operator/iptables-alerter-lmdct" Jul 15 21:09:40.570993 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.568898 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-host-var-lib-cni-bin\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.570993 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.568949 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88-etc-systemd\") pod \"tuned-dw8c6\" (UID: \"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.570993 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.569029 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/beb5b136-86fb-4e57-9b27-3fc1079a9af3-run-openvswitch\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.570993 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.569598 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88-etc-modprobe-d\") pod \"tuned-dw8c6\" (UID: \"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.570993 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.569651 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88-run\") pod \"tuned-dw8c6\" (UID: \"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.570993 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.569765 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/db9d02a9-e0aa-4a47-b3ef-b518f555b872-host-slash\") pod \"iptables-alerter-lmdct\" (UID: \"db9d02a9-e0aa-4a47-b3ef-b518f555b872\") " pod="openshift-network-operator/iptables-alerter-lmdct" Jul 15 21:09:40.571924 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.570104 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/beb5b136-86fb-4e57-9b27-3fc1079a9af3-ovnkube-script-lib\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.571924 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.570387 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/beb5b136-86fb-4e57-9b27-3fc1079a9af3-ovn-node-metrics-cert\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.573019 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.572541 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7adb30c9-2d57-4688-a7cd-0bbb70fcd152-agent-certs\") pod \"konnectivity-agent-t6sjg\" (UID: \"7adb30c9-2d57-4688-a7cd-0bbb70fcd152\") " pod="kube-system/konnectivity-agent-t6sjg" Jul 15 21:09:40.573177 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.573049 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88-tmp\") pod \"tuned-dw8c6\" (UID: \"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.573951 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.573928 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88-etc-tuned\") pod \"tuned-dw8c6\" (UID: \"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.574346 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.574318 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqm8s\" (UniqueName: \"kubernetes.io/projected/e9154423-994b-45e7-9cad-813087e03e31-kube-api-access-jqm8s\") pod \"network-metrics-daemon-89vwd\" (UID: \"e9154423-994b-45e7-9cad-813087e03e31\") " pod="openshift-multus/network-metrics-daemon-89vwd" Jul 15 21:09:40.576484 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.576440 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksfnj\" (UniqueName: \"kubernetes.io/projected/e8745d68-cd07-41f9-9c84-b0d1f12fa0c9-kube-api-access-ksfnj\") pod \"multus-hmhs5\" (UID: \"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9\") " pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.577022 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.576973 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxqnd\" (UniqueName: \"kubernetes.io/projected/beb5b136-86fb-4e57-9b27-3fc1079a9af3-kube-api-access-nxqnd\") pod \"ovnkube-node-nhzkw\" (UID: \"beb5b136-86fb-4e57-9b27-3fc1079a9af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.578488 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.578448 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6zcx\" (UniqueName: \"kubernetes.io/projected/db9d02a9-e0aa-4a47-b3ef-b518f555b872-kube-api-access-r6zcx\") pod \"iptables-alerter-lmdct\" (UID: \"db9d02a9-e0aa-4a47-b3ef-b518f555b872\") " pod="openshift-network-operator/iptables-alerter-lmdct" Jul 15 21:09:40.580387 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.580363 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65mm2\" (UniqueName: \"kubernetes.io/projected/e89cab18-de44-40e2-9486-0446676f8942-kube-api-access-65mm2\") pod \"multus-additional-cni-plugins-k25xr\" (UID: \"e89cab18-de44-40e2-9486-0446676f8942\") " pod="openshift-multus/multus-additional-cni-plugins-k25xr" Jul 15 21:09:40.580734 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.580713 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcsz4\" (UniqueName: \"kubernetes.io/projected/cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88-kube-api-access-jcsz4\") pod \"tuned-dw8c6\" (UID: \"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.587972 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.587925 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-113.ec2.internal" event={"ID":"b6cd2e073ae6c0ce5cef35d9bfb6314d","Type":"ContainerStarted","Data":"df1601bc71cb7a775533cd4a76aacf89046ae07d11fcf5ea6de2fb777ab95c23"} Jul 15 21:09:40.589581 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.589537 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-113.ec2.internal" event={"ID":"79cde544d17be45b537bc68d4a43ce88","Type":"ContainerStarted","Data":"a882bddbb4dc6b9ced0f4b60e56c233d23f3092f421b2833f9856db92cc8bfc3"} Jul 15 21:09:40.669318 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.669272 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/14f84a19-c09e-4724-892e-46796e611bd9-dbus\") pod \"global-pull-secret-syncer-8c5ks\" (UID: \"14f84a19-c09e-4724-892e-46796e611bd9\") " pod="kube-system/global-pull-secret-syncer-8c5ks" Jul 15 21:09:40.669503 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.669404 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/14f84a19-c09e-4724-892e-46796e611bd9-dbus\") pod \"global-pull-secret-syncer-8c5ks\" (UID: \"14f84a19-c09e-4724-892e-46796e611bd9\") " pod="kube-system/global-pull-secret-syncer-8c5ks" Jul 15 21:09:40.669503 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.669420 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/654026cc-fb99-41cc-b6c4-6fbc09801960-serviceca\") pod \"node-ca-lkgf2\" (UID: \"654026cc-fb99-41cc-b6c4-6fbc09801960\") " pod="openshift-image-registry/node-ca-lkgf2" Jul 15 21:09:40.669503 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.669457 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/654026cc-fb99-41cc-b6c4-6fbc09801960-host\") pod \"node-ca-lkgf2\" (UID: \"654026cc-fb99-41cc-b6c4-6fbc09801960\") " pod="openshift-image-registry/node-ca-lkgf2" Jul 15 21:09:40.669503 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.669489 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/835fb8bf-2d1b-47f8-b6ef-25d16a2cc774-hosts-file\") pod \"node-resolver-pxkxm\" (UID: \"835fb8bf-2d1b-47f8-b6ef-25d16a2cc774\") " pod="openshift-dns/node-resolver-pxkxm" Jul 15 21:09:40.669803 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.669519 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14f84a19-c09e-4724-892e-46796e611bd9-original-pull-secret\") pod \"global-pull-secret-syncer-8c5ks\" (UID: \"14f84a19-c09e-4724-892e-46796e611bd9\") " pod="kube-system/global-pull-secret-syncer-8c5ks" Jul 15 21:09:40.669803 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.669543 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7af6fe70-ffce-417d-9a8a-6df647daeb40-etc-selinux\") pod \"aws-ebs-csi-driver-node-95tgp\" (UID: \"7af6fe70-ffce-417d-9a8a-6df647daeb40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95tgp" Jul 15 21:09:40.669803 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.669572 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2ccv\" (UniqueName: \"kubernetes.io/projected/835fb8bf-2d1b-47f8-b6ef-25d16a2cc774-kube-api-access-p2ccv\") pod \"node-resolver-pxkxm\" (UID: \"835fb8bf-2d1b-47f8-b6ef-25d16a2cc774\") " pod="openshift-dns/node-resolver-pxkxm" Jul 15 21:09:40.669803 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.669574 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/654026cc-fb99-41cc-b6c4-6fbc09801960-host\") pod \"node-ca-lkgf2\" (UID: \"654026cc-fb99-41cc-b6c4-6fbc09801960\") " pod="openshift-image-registry/node-ca-lkgf2" Jul 15 21:09:40.669803 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.669588 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/835fb8bf-2d1b-47f8-b6ef-25d16a2cc774-hosts-file\") pod \"node-resolver-pxkxm\" (UID: \"835fb8bf-2d1b-47f8-b6ef-25d16a2cc774\") " pod="openshift-dns/node-resolver-pxkxm" Jul 15 21:09:40.669803 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.669637 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq9n9\" (UniqueName: \"kubernetes.io/projected/b85e9808-cc68-4ebb-af04-6bd95b54a5c9-kube-api-access-fq9n9\") pod \"network-check-target-6p5nk\" (UID: \"b85e9808-cc68-4ebb-af04-6bd95b54a5c9\") " pod="openshift-network-diagnostics/network-check-target-6p5nk" Jul 15 21:09:40.669803 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.669667 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvl4h\" (UniqueName: \"kubernetes.io/projected/654026cc-fb99-41cc-b6c4-6fbc09801960-kube-api-access-dvl4h\") pod \"node-ca-lkgf2\" (UID: \"654026cc-fb99-41cc-b6c4-6fbc09801960\") " pod="openshift-image-registry/node-ca-lkgf2" Jul 15 21:09:40.669803 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.669694 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7af6fe70-ffce-417d-9a8a-6df647daeb40-kubelet-dir\") pod \"aws-ebs-csi-driver-node-95tgp\" (UID: \"7af6fe70-ffce-417d-9a8a-6df647daeb40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95tgp" Jul 15 21:09:40.669803 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:40.669698 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 21:09:40.669803 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.669743 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7af6fe70-ffce-417d-9a8a-6df647daeb40-socket-dir\") pod \"aws-ebs-csi-driver-node-95tgp\" (UID: \"7af6fe70-ffce-417d-9a8a-6df647daeb40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95tgp" Jul 15 21:09:40.669803 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:40.669772 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14f84a19-c09e-4724-892e-46796e611bd9-original-pull-secret podName:14f84a19-c09e-4724-892e-46796e611bd9 nodeName:}" failed. No retries permitted until 2026-07-15 21:09:41.169749824 +0000 UTC m=+3.064153881 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14f84a19-c09e-4724-892e-46796e611bd9-original-pull-secret") pod "global-pull-secret-syncer-8c5ks" (UID: "14f84a19-c09e-4724-892e-46796e611bd9") : object "kube-system"/"original-pull-secret" not registered Jul 15 21:09:40.669803 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.669800 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7af6fe70-ffce-417d-9a8a-6df647daeb40-registration-dir\") pod \"aws-ebs-csi-driver-node-95tgp\" (UID: \"7af6fe70-ffce-417d-9a8a-6df647daeb40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95tgp" Jul 15 21:09:40.670504 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.669829 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/14f84a19-c09e-4724-892e-46796e611bd9-kubelet-config\") pod \"global-pull-secret-syncer-8c5ks\" (UID: \"14f84a19-c09e-4724-892e-46796e611bd9\") " pod="kube-system/global-pull-secret-syncer-8c5ks" Jul 15 21:09:40.670504 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.669834 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7af6fe70-ffce-417d-9a8a-6df647daeb40-etc-selinux\") pod \"aws-ebs-csi-driver-node-95tgp\" (UID: \"7af6fe70-ffce-417d-9a8a-6df647daeb40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95tgp" Jul 15 21:09:40.670504 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.669853 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/835fb8bf-2d1b-47f8-b6ef-25d16a2cc774-tmp-dir\") pod \"node-resolver-pxkxm\" (UID: \"835fb8bf-2d1b-47f8-b6ef-25d16a2cc774\") " pod="openshift-dns/node-resolver-pxkxm" Jul 15 21:09:40.670504 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.669870 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7af6fe70-ffce-417d-9a8a-6df647daeb40-socket-dir\") pod \"aws-ebs-csi-driver-node-95tgp\" (UID: \"7af6fe70-ffce-417d-9a8a-6df647daeb40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95tgp" Jul 15 21:09:40.670504 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.669879 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7af6fe70-ffce-417d-9a8a-6df647daeb40-sys-fs\") pod \"aws-ebs-csi-driver-node-95tgp\" (UID: \"7af6fe70-ffce-417d-9a8a-6df647daeb40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95tgp" Jul 15 21:09:40.670504 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.669879 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7af6fe70-ffce-417d-9a8a-6df647daeb40-kubelet-dir\") pod \"aws-ebs-csi-driver-node-95tgp\" (UID: \"7af6fe70-ffce-417d-9a8a-6df647daeb40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95tgp" Jul 15 21:09:40.670504 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.669921 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d79x\" (UniqueName: \"kubernetes.io/projected/7af6fe70-ffce-417d-9a8a-6df647daeb40-kube-api-access-8d79x\") pod \"aws-ebs-csi-driver-node-95tgp\" (UID: \"7af6fe70-ffce-417d-9a8a-6df647daeb40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95tgp" Jul 15 21:09:40.670504 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.669969 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7af6fe70-ffce-417d-9a8a-6df647daeb40-device-dir\") pod \"aws-ebs-csi-driver-node-95tgp\" (UID: \"7af6fe70-ffce-417d-9a8a-6df647daeb40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95tgp" Jul 15 21:09:40.670504 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.669988 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/654026cc-fb99-41cc-b6c4-6fbc09801960-serviceca\") pod \"node-ca-lkgf2\" (UID: \"654026cc-fb99-41cc-b6c4-6fbc09801960\") " pod="openshift-image-registry/node-ca-lkgf2" Jul 15 21:09:40.670504 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.670014 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7af6fe70-ffce-417d-9a8a-6df647daeb40-registration-dir\") pod \"aws-ebs-csi-driver-node-95tgp\" (UID: \"7af6fe70-ffce-417d-9a8a-6df647daeb40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95tgp" Jul 15 21:09:40.670504 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.670059 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/14f84a19-c09e-4724-892e-46796e611bd9-kubelet-config\") pod \"global-pull-secret-syncer-8c5ks\" (UID: \"14f84a19-c09e-4724-892e-46796e611bd9\") " pod="kube-system/global-pull-secret-syncer-8c5ks" Jul 15 21:09:40.670504 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.670071 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7af6fe70-ffce-417d-9a8a-6df647daeb40-sys-fs\") pod \"aws-ebs-csi-driver-node-95tgp\" (UID: \"7af6fe70-ffce-417d-9a8a-6df647daeb40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95tgp" Jul 15 21:09:40.670504 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.670120 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7af6fe70-ffce-417d-9a8a-6df647daeb40-device-dir\") pod \"aws-ebs-csi-driver-node-95tgp\" (UID: \"7af6fe70-ffce-417d-9a8a-6df647daeb40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95tgp" Jul 15 21:09:40.670504 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.670227 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/835fb8bf-2d1b-47f8-b6ef-25d16a2cc774-tmp-dir\") pod \"node-resolver-pxkxm\" (UID: \"835fb8bf-2d1b-47f8-b6ef-25d16a2cc774\") " pod="openshift-dns/node-resolver-pxkxm" Jul 15 21:09:40.679465 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:40.679409 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 21:09:40.679465 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:40.679435 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 21:09:40.679465 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:40.679449 2570 projected.go:196] Error preparing data for projected volume kube-api-access-fq9n9 for pod openshift-network-diagnostics/network-check-target-6p5nk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:09:40.679692 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:40.679513 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b85e9808-cc68-4ebb-af04-6bd95b54a5c9-kube-api-access-fq9n9 podName:b85e9808-cc68-4ebb-af04-6bd95b54a5c9 nodeName:}" failed. No retries permitted until 2026-07-15 21:09:41.179494391 +0000 UTC m=+3.073898459 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fq9n9" (UniqueName: "kubernetes.io/projected/b85e9808-cc68-4ebb-af04-6bd95b54a5c9-kube-api-access-fq9n9") pod "network-check-target-6p5nk" (UID: "b85e9808-cc68-4ebb-af04-6bd95b54a5c9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:09:40.681935 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.681902 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2ccv\" (UniqueName: \"kubernetes.io/projected/835fb8bf-2d1b-47f8-b6ef-25d16a2cc774-kube-api-access-p2ccv\") pod \"node-resolver-pxkxm\" (UID: \"835fb8bf-2d1b-47f8-b6ef-25d16a2cc774\") " pod="openshift-dns/node-resolver-pxkxm" Jul 15 21:09:40.682138 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.682114 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvl4h\" (UniqueName: \"kubernetes.io/projected/654026cc-fb99-41cc-b6c4-6fbc09801960-kube-api-access-dvl4h\") pod \"node-ca-lkgf2\" (UID: \"654026cc-fb99-41cc-b6c4-6fbc09801960\") " pod="openshift-image-registry/node-ca-lkgf2" Jul 15 21:09:40.682214 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.682120 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d79x\" (UniqueName: \"kubernetes.io/projected/7af6fe70-ffce-417d-9a8a-6df647daeb40-kube-api-access-8d79x\") pod \"aws-ebs-csi-driver-node-95tgp\" (UID: \"7af6fe70-ffce-417d-9a8a-6df647daeb40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95tgp" Jul 15 21:09:40.744566 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.744533 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k25xr" Jul 15 21:09:40.752355 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.752303 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:09:40.766184 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.766162 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" Jul 15 21:09:40.772286 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.772257 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hmhs5" Jul 15 21:09:40.781698 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.781674 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lmdct" Jul 15 21:09:40.795752 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.795553 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t6sjg" Jul 15 21:09:40.802472 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.802448 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pxkxm" Jul 15 21:09:40.812394 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.812359 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lkgf2" Jul 15 21:09:40.818325 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:40.818270 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95tgp" Jul 15 21:09:40.889015 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:40.888982 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcce0d8b8_12f2_4fbd_aaf9_1d880b69dc88.slice/crio-4b8942665fb465122d31502cf739cc0a25652f9930f2d47b2b786a02d082c621 WatchSource:0}: Error finding container 4b8942665fb465122d31502cf739cc0a25652f9930f2d47b2b786a02d082c621: Status 404 returned error can't find the container with id 4b8942665fb465122d31502cf739cc0a25652f9930f2d47b2b786a02d082c621 Jul 15 21:09:40.893480 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:40.893273 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeb5b136_86fb_4e57_9b27_3fc1079a9af3.slice/crio-0fed97fdd105ec1f24ecd70e11b7bfdfe227722fc5712fbebb4ccb73934b412b WatchSource:0}: Error finding container 0fed97fdd105ec1f24ecd70e11b7bfdfe227722fc5712fbebb4ccb73934b412b: Status 404 returned error can't find the container with id 0fed97fdd105ec1f24ecd70e11b7bfdfe227722fc5712fbebb4ccb73934b412b Jul 15 21:09:40.897877 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:40.897851 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8745d68_cd07_41f9_9c84_b0d1f12fa0c9.slice/crio-0f60b39fb3b3fffb07711627e24f15a6b115ab81bfe3ca8c937055b2899c6fd0 WatchSource:0}: Error finding container 0f60b39fb3b3fffb07711627e24f15a6b115ab81bfe3ca8c937055b2899c6fd0: Status 404 returned error can't find the container with id 0f60b39fb3b3fffb07711627e24f15a6b115ab81bfe3ca8c937055b2899c6fd0 Jul 15 21:09:40.899228 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:40.899208 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode89cab18_de44_40e2_9486_0446676f8942.slice/crio-68368f82d0a65bff7c8678e154c3cd828cc0434efe1eeedf4db3ecd6b2d1ea15 WatchSource:0}: Error finding container 68368f82d0a65bff7c8678e154c3cd828cc0434efe1eeedf4db3ecd6b2d1ea15: Status 404 returned error can't find the container with id 68368f82d0a65bff7c8678e154c3cd828cc0434efe1eeedf4db3ecd6b2d1ea15 Jul 15 21:09:40.900509 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:40.900444 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod835fb8bf_2d1b_47f8_b6ef_25d16a2cc774.slice/crio-ddecdd57dbdbccc2e41d7f9151fd2c15dc1cea9069e7e1cde8bd873e47f26a08 WatchSource:0}: Error finding container ddecdd57dbdbccc2e41d7f9151fd2c15dc1cea9069e7e1cde8bd873e47f26a08: Status 404 returned error can't find the container with id ddecdd57dbdbccc2e41d7f9151fd2c15dc1cea9069e7e1cde8bd873e47f26a08 Jul 15 21:09:40.901807 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:40.901696 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb9d02a9_e0aa_4a47_b3ef_b518f555b872.slice/crio-0faa2893ef26b91a72a9cab6c20e363129d35fb356518ec4c6867c3fd5a34ac1 WatchSource:0}: Error finding container 0faa2893ef26b91a72a9cab6c20e363129d35fb356518ec4c6867c3fd5a34ac1: Status 404 returned error can't find the container with id 0faa2893ef26b91a72a9cab6c20e363129d35fb356518ec4c6867c3fd5a34ac1 Jul 15 21:09:40.902642 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:40.902533 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7adb30c9_2d57_4688_a7cd_0bbb70fcd152.slice/crio-b2409f95256fb09c025a7a4b5c34d681f1b5577c72de78d5bc29f23e03ef4f6b WatchSource:0}: Error finding container b2409f95256fb09c025a7a4b5c34d681f1b5577c72de78d5bc29f23e03ef4f6b: Status 404 returned error can't find the container with id b2409f95256fb09c025a7a4b5c34d681f1b5577c72de78d5bc29f23e03ef4f6b Jul 15 21:09:40.904021 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:40.903637 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod654026cc_fb99_41cc_b6c4_6fbc09801960.slice/crio-5e126faf2babcc569e7bce1f30a3fcb21528f90c352a9faaab3ed2507d61524c WatchSource:0}: Error finding container 5e126faf2babcc569e7bce1f30a3fcb21528f90c352a9faaab3ed2507d61524c: Status 404 returned error can't find the container with id 5e126faf2babcc569e7bce1f30a3fcb21528f90c352a9faaab3ed2507d61524c Jul 15 21:09:40.904345 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:09:40.904321 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7af6fe70_ffce_417d_9a8a_6df647daeb40.slice/crio-fe594b20ebb4723dea37d5ddde4a6ade54d1c8b7d8d5a56088e444982ef1afff WatchSource:0}: Error finding container fe594b20ebb4723dea37d5ddde4a6ade54d1c8b7d8d5a56088e444982ef1afff: Status 404 returned error can't find the container with id fe594b20ebb4723dea37d5ddde4a6ade54d1c8b7d8d5a56088e444982ef1afff Jul 15 21:09:41.011866 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:41.011789 2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 21:09:41.074440 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:41.074341 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9154423-994b-45e7-9cad-813087e03e31-metrics-certs\") pod \"network-metrics-daemon-89vwd\" (UID: \"e9154423-994b-45e7-9cad-813087e03e31\") " pod="openshift-multus/network-metrics-daemon-89vwd" Jul 15 21:09:41.074578 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:41.074520 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:09:41.074622 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:41.074610 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9154423-994b-45e7-9cad-813087e03e31-metrics-certs podName:e9154423-994b-45e7-9cad-813087e03e31 nodeName:}" failed. No retries permitted until 2026-07-15 21:09:42.074588308 +0000 UTC m=+3.968992365 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9154423-994b-45e7-9cad-813087e03e31-metrics-certs") pod "network-metrics-daemon-89vwd" (UID: "e9154423-994b-45e7-9cad-813087e03e31") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:09:41.175355 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:41.175307 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14f84a19-c09e-4724-892e-46796e611bd9-original-pull-secret\") pod \"global-pull-secret-syncer-8c5ks\" (UID: \"14f84a19-c09e-4724-892e-46796e611bd9\") " pod="kube-system/global-pull-secret-syncer-8c5ks" Jul 15 21:09:41.175522 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:41.175499 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 21:09:41.175605 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:41.175582 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14f84a19-c09e-4724-892e-46796e611bd9-original-pull-secret podName:14f84a19-c09e-4724-892e-46796e611bd9 nodeName:}" failed. No retries permitted until 2026-07-15 21:09:42.175559994 +0000 UTC m=+4.069964049 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14f84a19-c09e-4724-892e-46796e611bd9-original-pull-secret") pod "global-pull-secret-syncer-8c5ks" (UID: "14f84a19-c09e-4724-892e-46796e611bd9") : object "kube-system"/"original-pull-secret" not registered Jul 15 21:09:41.276577 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:41.276287 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq9n9\" (UniqueName: \"kubernetes.io/projected/b85e9808-cc68-4ebb-af04-6bd95b54a5c9-kube-api-access-fq9n9\") pod \"network-check-target-6p5nk\" (UID: \"b85e9808-cc68-4ebb-af04-6bd95b54a5c9\") " pod="openshift-network-diagnostics/network-check-target-6p5nk" Jul 15 21:09:41.276577 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:41.276562 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 21:09:41.276577 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:41.276589 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 21:09:41.276853 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:41.276612 2570 projected.go:196] Error preparing data for projected volume kube-api-access-fq9n9 for pod openshift-network-diagnostics/network-check-target-6p5nk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:09:41.276853 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:41.276689 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b85e9808-cc68-4ebb-af04-6bd95b54a5c9-kube-api-access-fq9n9 podName:b85e9808-cc68-4ebb-af04-6bd95b54a5c9 nodeName:}" failed. No retries permitted until 2026-07-15 21:09:42.276662159 +0000 UTC m=+4.171066227 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fq9n9" (UniqueName: "kubernetes.io/projected/b85e9808-cc68-4ebb-af04-6bd95b54a5c9-kube-api-access-fq9n9") pod "network-check-target-6p5nk" (UID: "b85e9808-cc68-4ebb-af04-6bd95b54a5c9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:09:41.508970 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:41.508782 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 21:04:40 +0000 UTC" deadline="2028-01-30 23:38:03.641843024 +0000 UTC" Jul 15 21:09:41.508970 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:41.508848 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13538h28m22.13299952s" Jul 15 21:09:41.583695 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:41.583592 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6p5nk" Jul 15 21:09:41.583865 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:41.583728 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6p5nk" podUID="b85e9808-cc68-4ebb-af04-6bd95b54a5c9" Jul 15 21:09:41.595102 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:41.594807 2570 generic.go:356] "Generic (PLEG): container finished" podID="79cde544d17be45b537bc68d4a43ce88" containerID="d57e4197b6e64f2108d8e265ebe44226f5036458b9f9d556eba14ee236ce03fb" exitCode=0 Jul 15 21:09:41.595102 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:41.594901 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-113.ec2.internal" event={"ID":"79cde544d17be45b537bc68d4a43ce88","Type":"ContainerDied","Data":"d57e4197b6e64f2108d8e265ebe44226f5036458b9f9d556eba14ee236ce03fb"} Jul 15 21:09:41.597791 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:41.597720 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lkgf2" event={"ID":"654026cc-fb99-41cc-b6c4-6fbc09801960","Type":"ContainerStarted","Data":"5e126faf2babcc569e7bce1f30a3fcb21528f90c352a9faaab3ed2507d61524c"} Jul 15 21:09:41.599243 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:41.599174 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95tgp" event={"ID":"7af6fe70-ffce-417d-9a8a-6df647daeb40","Type":"ContainerStarted","Data":"fe594b20ebb4723dea37d5ddde4a6ade54d1c8b7d8d5a56088e444982ef1afff"} Jul 15 21:09:41.600881 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:41.600815 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lmdct" event={"ID":"db9d02a9-e0aa-4a47-b3ef-b518f555b872","Type":"ContainerStarted","Data":"0faa2893ef26b91a72a9cab6c20e363129d35fb356518ec4c6867c3fd5a34ac1"} Jul 15 21:09:41.603491 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:41.603421 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t6sjg" event={"ID":"7adb30c9-2d57-4688-a7cd-0bbb70fcd152","Type":"ContainerStarted","Data":"b2409f95256fb09c025a7a4b5c34d681f1b5577c72de78d5bc29f23e03ef4f6b"} Jul 15 21:09:41.605451 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:41.605382 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pxkxm" event={"ID":"835fb8bf-2d1b-47f8-b6ef-25d16a2cc774","Type":"ContainerStarted","Data":"ddecdd57dbdbccc2e41d7f9151fd2c15dc1cea9069e7e1cde8bd873e47f26a08"} Jul 15 21:09:41.608135 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:41.608058 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k25xr" event={"ID":"e89cab18-de44-40e2-9486-0446676f8942","Type":"ContainerStarted","Data":"68368f82d0a65bff7c8678e154c3cd828cc0434efe1eeedf4db3ecd6b2d1ea15"} Jul 15 21:09:41.609754 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:41.609643 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" event={"ID":"beb5b136-86fb-4e57-9b27-3fc1079a9af3","Type":"ContainerStarted","Data":"0fed97fdd105ec1f24ecd70e11b7bfdfe227722fc5712fbebb4ccb73934b412b"} Jul 15 21:09:41.611418 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:41.611392 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hmhs5" event={"ID":"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9","Type":"ContainerStarted","Data":"0f60b39fb3b3fffb07711627e24f15a6b115ab81bfe3ca8c937055b2899c6fd0"} Jul 15 21:09:41.612922 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:41.612861 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" event={"ID":"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88","Type":"ContainerStarted","Data":"4b8942665fb465122d31502cf739cc0a25652f9930f2d47b2b786a02d082c621"} Jul 15 21:09:42.084343 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:42.083756 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9154423-994b-45e7-9cad-813087e03e31-metrics-certs\") pod \"network-metrics-daemon-89vwd\" (UID: \"e9154423-994b-45e7-9cad-813087e03e31\") " pod="openshift-multus/network-metrics-daemon-89vwd" Jul 15 21:09:42.084343 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:42.083899 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:09:42.084343 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:42.083982 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9154423-994b-45e7-9cad-813087e03e31-metrics-certs podName:e9154423-994b-45e7-9cad-813087e03e31 nodeName:}" failed. No retries permitted until 2026-07-15 21:09:44.083943673 +0000 UTC m=+5.978347741 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9154423-994b-45e7-9cad-813087e03e31-metrics-certs") pod "network-metrics-daemon-89vwd" (UID: "e9154423-994b-45e7-9cad-813087e03e31") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:09:42.184430 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:42.184396 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14f84a19-c09e-4724-892e-46796e611bd9-original-pull-secret\") pod \"global-pull-secret-syncer-8c5ks\" (UID: \"14f84a19-c09e-4724-892e-46796e611bd9\") " pod="kube-system/global-pull-secret-syncer-8c5ks" Jul 15 21:09:42.184625 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:42.184587 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 21:09:42.184718 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:42.184648 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14f84a19-c09e-4724-892e-46796e611bd9-original-pull-secret podName:14f84a19-c09e-4724-892e-46796e611bd9 nodeName:}" failed. No retries permitted until 2026-07-15 21:09:44.184629362 +0000 UTC m=+6.079033410 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14f84a19-c09e-4724-892e-46796e611bd9-original-pull-secret") pod "global-pull-secret-syncer-8c5ks" (UID: "14f84a19-c09e-4724-892e-46796e611bd9") : object "kube-system"/"original-pull-secret" not registered Jul 15 21:09:42.285661 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:42.285552 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq9n9\" (UniqueName: \"kubernetes.io/projected/b85e9808-cc68-4ebb-af04-6bd95b54a5c9-kube-api-access-fq9n9\") pod \"network-check-target-6p5nk\" (UID: \"b85e9808-cc68-4ebb-af04-6bd95b54a5c9\") " pod="openshift-network-diagnostics/network-check-target-6p5nk" Jul 15 21:09:42.285839 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:42.285772 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 21:09:42.285839 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:42.285790 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 21:09:42.285839 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:42.285802 2570 projected.go:196] Error preparing data for projected volume kube-api-access-fq9n9 for pod openshift-network-diagnostics/network-check-target-6p5nk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:09:42.286001 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:42.285859 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b85e9808-cc68-4ebb-af04-6bd95b54a5c9-kube-api-access-fq9n9 podName:b85e9808-cc68-4ebb-af04-6bd95b54a5c9 nodeName:}" failed. No retries permitted until 2026-07-15 21:09:44.285841633 +0000 UTC m=+6.180245682 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fq9n9" (UniqueName: "kubernetes.io/projected/b85e9808-cc68-4ebb-af04-6bd95b54a5c9-kube-api-access-fq9n9") pod "network-check-target-6p5nk" (UID: "b85e9808-cc68-4ebb-af04-6bd95b54a5c9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:09:42.509436 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:42.509391 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 21:04:40 +0000 UTC" deadline="2028-03-05 22:03:49.811065967 +0000 UTC" Jul 15 21:09:42.509436 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:42.509431 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14376h54m7.301639218s" Jul 15 21:09:42.585566 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:42.585493 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8c5ks" Jul 15 21:09:42.585718 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:42.585634 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8c5ks" podUID="14f84a19-c09e-4724-892e-46796e611bd9" Jul 15 21:09:42.586013 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:42.585992 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89vwd" Jul 15 21:09:42.586140 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:42.586118 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89vwd" podUID="e9154423-994b-45e7-9cad-813087e03e31" Jul 15 21:09:42.624389 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:42.624326 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-113.ec2.internal" event={"ID":"b6cd2e073ae6c0ce5cef35d9bfb6314d","Type":"ContainerStarted","Data":"a52addd6328ad90da975c09fc649d84b6333801d68b0d729fcb172016a7ab061"} Jul 15 21:09:42.644152 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:42.644119 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-113.ec2.internal" event={"ID":"79cde544d17be45b537bc68d4a43ce88","Type":"ContainerStarted","Data":"4b2e23bf38de56a2152cf87ddee8655b2294881c4c18efc44a6710683591e39f"} Jul 15 21:09:42.660990 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:42.660338 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-113.ec2.internal" podStartSLOduration=3.6603148340000002 podStartE2EDuration="3.660314834s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:09:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:09:42.640187666 +0000 UTC m=+4.534591736" watchObservedRunningTime="2026-07-15 21:09:42.660314834 +0000 UTC m=+4.554718899" Jul 15 21:09:43.582934 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:43.582895 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6p5nk" Jul 15 21:09:43.583403 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:43.582996 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6p5nk" podUID="b85e9808-cc68-4ebb-af04-6bd95b54a5c9" Jul 15 21:09:44.102133 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:44.102020 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9154423-994b-45e7-9cad-813087e03e31-metrics-certs\") pod \"network-metrics-daemon-89vwd\" (UID: \"e9154423-994b-45e7-9cad-813087e03e31\") " pod="openshift-multus/network-metrics-daemon-89vwd" Jul 15 21:09:44.102344 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:44.102210 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:09:44.102344 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:44.102310 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9154423-994b-45e7-9cad-813087e03e31-metrics-certs podName:e9154423-994b-45e7-9cad-813087e03e31 nodeName:}" failed. No retries permitted until 2026-07-15 21:09:48.102268289 +0000 UTC m=+9.996672333 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9154423-994b-45e7-9cad-813087e03e31-metrics-certs") pod "network-metrics-daemon-89vwd" (UID: "e9154423-994b-45e7-9cad-813087e03e31") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:09:44.203340 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:44.203266 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14f84a19-c09e-4724-892e-46796e611bd9-original-pull-secret\") pod \"global-pull-secret-syncer-8c5ks\" (UID: \"14f84a19-c09e-4724-892e-46796e611bd9\") " pod="kube-system/global-pull-secret-syncer-8c5ks" Jul 15 21:09:44.203528 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:44.203506 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 21:09:44.203589 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:44.203569 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14f84a19-c09e-4724-892e-46796e611bd9-original-pull-secret podName:14f84a19-c09e-4724-892e-46796e611bd9 nodeName:}" failed. No retries permitted until 2026-07-15 21:09:48.203551977 +0000 UTC m=+10.097956025 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14f84a19-c09e-4724-892e-46796e611bd9-original-pull-secret") pod "global-pull-secret-syncer-8c5ks" (UID: "14f84a19-c09e-4724-892e-46796e611bd9") : object "kube-system"/"original-pull-secret" not registered Jul 15 21:09:44.304472 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:44.304432 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq9n9\" (UniqueName: \"kubernetes.io/projected/b85e9808-cc68-4ebb-af04-6bd95b54a5c9-kube-api-access-fq9n9\") pod \"network-check-target-6p5nk\" (UID: \"b85e9808-cc68-4ebb-af04-6bd95b54a5c9\") " pod="openshift-network-diagnostics/network-check-target-6p5nk" Jul 15 21:09:44.304641 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:44.304630 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 21:09:44.304701 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:44.304650 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 21:09:44.304701 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:44.304662 2570 projected.go:196] Error preparing data for projected volume kube-api-access-fq9n9 for pod openshift-network-diagnostics/network-check-target-6p5nk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:09:44.304851 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:44.304836 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b85e9808-cc68-4ebb-af04-6bd95b54a5c9-kube-api-access-fq9n9 podName:b85e9808-cc68-4ebb-af04-6bd95b54a5c9 nodeName:}" failed. No retries permitted until 2026-07-15 21:09:48.304810671 +0000 UTC m=+10.199214741 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fq9n9" (UniqueName: "kubernetes.io/projected/b85e9808-cc68-4ebb-af04-6bd95b54a5c9-kube-api-access-fq9n9") pod "network-check-target-6p5nk" (UID: "b85e9808-cc68-4ebb-af04-6bd95b54a5c9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:09:44.583488 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:44.583408 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8c5ks" Jul 15 21:09:44.583908 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:44.583549 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8c5ks" podUID="14f84a19-c09e-4724-892e-46796e611bd9" Jul 15 21:09:44.583908 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:44.583599 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89vwd" Jul 15 21:09:44.583908 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:44.583703 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89vwd" podUID="e9154423-994b-45e7-9cad-813087e03e31" Jul 15 21:09:45.583404 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:45.583133 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6p5nk" Jul 15 21:09:45.583404 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:45.583271 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6p5nk" podUID="b85e9808-cc68-4ebb-af04-6bd95b54a5c9" Jul 15 21:09:46.587487 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:46.586976 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89vwd" Jul 15 21:09:46.587487 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:46.587108 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89vwd" podUID="e9154423-994b-45e7-9cad-813087e03e31" Jul 15 21:09:46.587487 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:46.587223 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8c5ks" Jul 15 21:09:46.587487 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:46.587324 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8c5ks" podUID="14f84a19-c09e-4724-892e-46796e611bd9" Jul 15 21:09:47.584146 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:47.583544 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6p5nk" Jul 15 21:09:47.584146 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:47.583739 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6p5nk" podUID="b85e9808-cc68-4ebb-af04-6bd95b54a5c9" Jul 15 21:09:48.140673 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:48.140628 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9154423-994b-45e7-9cad-813087e03e31-metrics-certs\") pod \"network-metrics-daemon-89vwd\" (UID: \"e9154423-994b-45e7-9cad-813087e03e31\") " pod="openshift-multus/network-metrics-daemon-89vwd" Jul 15 21:09:48.141145 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:48.140833 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:09:48.141145 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:48.140916 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9154423-994b-45e7-9cad-813087e03e31-metrics-certs podName:e9154423-994b-45e7-9cad-813087e03e31 nodeName:}" failed. No retries permitted until 2026-07-15 21:09:56.140894703 +0000 UTC m=+18.035298747 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9154423-994b-45e7-9cad-813087e03e31-metrics-certs") pod "network-metrics-daemon-89vwd" (UID: "e9154423-994b-45e7-9cad-813087e03e31") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:09:48.241080 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:48.241040 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14f84a19-c09e-4724-892e-46796e611bd9-original-pull-secret\") pod \"global-pull-secret-syncer-8c5ks\" (UID: \"14f84a19-c09e-4724-892e-46796e611bd9\") " pod="kube-system/global-pull-secret-syncer-8c5ks" Jul 15 21:09:48.241267 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:48.241175 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 21:09:48.241267 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:48.241258 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14f84a19-c09e-4724-892e-46796e611bd9-original-pull-secret podName:14f84a19-c09e-4724-892e-46796e611bd9 nodeName:}" failed. No retries permitted until 2026-07-15 21:09:56.241235471 +0000 UTC m=+18.135639516 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14f84a19-c09e-4724-892e-46796e611bd9-original-pull-secret") pod "global-pull-secret-syncer-8c5ks" (UID: "14f84a19-c09e-4724-892e-46796e611bd9") : object "kube-system"/"original-pull-secret" not registered Jul 15 21:09:48.342193 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:48.342047 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq9n9\" (UniqueName: \"kubernetes.io/projected/b85e9808-cc68-4ebb-af04-6bd95b54a5c9-kube-api-access-fq9n9\") pod \"network-check-target-6p5nk\" (UID: \"b85e9808-cc68-4ebb-af04-6bd95b54a5c9\") " pod="openshift-network-diagnostics/network-check-target-6p5nk" Jul 15 21:09:48.342399 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:48.342235 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 21:09:48.342399 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:48.342258 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 21:09:48.342399 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:48.342269 2570 projected.go:196] Error preparing data for projected volume kube-api-access-fq9n9 for pod openshift-network-diagnostics/network-check-target-6p5nk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:09:48.342399 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:48.342352 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b85e9808-cc68-4ebb-af04-6bd95b54a5c9-kube-api-access-fq9n9 podName:b85e9808-cc68-4ebb-af04-6bd95b54a5c9 nodeName:}" failed. No retries permitted until 2026-07-15 21:09:56.342333447 +0000 UTC m=+18.236737510 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fq9n9" (UniqueName: "kubernetes.io/projected/b85e9808-cc68-4ebb-af04-6bd95b54a5c9-kube-api-access-fq9n9") pod "network-check-target-6p5nk" (UID: "b85e9808-cc68-4ebb-af04-6bd95b54a5c9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:09:48.584558 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:48.584001 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8c5ks" Jul 15 21:09:48.584558 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:48.584121 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8c5ks" podUID="14f84a19-c09e-4724-892e-46796e611bd9" Jul 15 21:09:48.584558 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:48.584173 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89vwd" Jul 15 21:09:48.584558 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:48.584339 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89vwd" podUID="e9154423-994b-45e7-9cad-813087e03e31" Jul 15 21:09:49.583729 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:49.583203 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6p5nk" Jul 15 21:09:49.583729 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:49.583359 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6p5nk" podUID="b85e9808-cc68-4ebb-af04-6bd95b54a5c9" Jul 15 21:09:50.582859 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:50.582821 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8c5ks" Jul 15 21:09:50.583030 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:50.582821 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89vwd" Jul 15 21:09:50.583030 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:50.582963 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8c5ks" podUID="14f84a19-c09e-4724-892e-46796e611bd9" Jul 15 21:09:50.583154 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:50.583089 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89vwd" podUID="e9154423-994b-45e7-9cad-813087e03e31" Jul 15 21:09:51.583102 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:51.583067 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6p5nk" Jul 15 21:09:51.583530 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:51.583195 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6p5nk" podUID="b85e9808-cc68-4ebb-af04-6bd95b54a5c9" Jul 15 21:09:52.583804 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:52.583764 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8c5ks" Jul 15 21:09:52.584249 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:52.583907 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8c5ks" podUID="14f84a19-c09e-4724-892e-46796e611bd9" Jul 15 21:09:52.584249 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:52.583962 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89vwd" Jul 15 21:09:52.584249 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:52.584080 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89vwd" podUID="e9154423-994b-45e7-9cad-813087e03e31" Jul 15 21:09:53.583045 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:53.583011 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6p5nk" Jul 15 21:09:53.583228 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:53.583145 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6p5nk" podUID="b85e9808-cc68-4ebb-af04-6bd95b54a5c9" Jul 15 21:09:54.583025 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:54.582986 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89vwd" Jul 15 21:09:54.583438 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:54.583129 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89vwd" podUID="e9154423-994b-45e7-9cad-813087e03e31" Jul 15 21:09:54.583492 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:54.582987 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8c5ks" Jul 15 21:09:54.583579 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:54.583557 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8c5ks" podUID="14f84a19-c09e-4724-892e-46796e611bd9" Jul 15 21:09:55.583709 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:55.583673 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6p5nk" Jul 15 21:09:55.584267 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:55.583801 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6p5nk" podUID="b85e9808-cc68-4ebb-af04-6bd95b54a5c9" Jul 15 21:09:56.204309 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:56.204249 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9154423-994b-45e7-9cad-813087e03e31-metrics-certs\") pod \"network-metrics-daemon-89vwd\" (UID: \"e9154423-994b-45e7-9cad-813087e03e31\") " pod="openshift-multus/network-metrics-daemon-89vwd" Jul 15 21:09:56.204493 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:56.204441 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:09:56.204551 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:56.204519 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9154423-994b-45e7-9cad-813087e03e31-metrics-certs podName:e9154423-994b-45e7-9cad-813087e03e31 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:12.204499013 +0000 UTC m=+34.098903056 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9154423-994b-45e7-9cad-813087e03e31-metrics-certs") pod "network-metrics-daemon-89vwd" (UID: "e9154423-994b-45e7-9cad-813087e03e31") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:09:56.305379 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:56.305341 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14f84a19-c09e-4724-892e-46796e611bd9-original-pull-secret\") pod \"global-pull-secret-syncer-8c5ks\" (UID: \"14f84a19-c09e-4724-892e-46796e611bd9\") " pod="kube-system/global-pull-secret-syncer-8c5ks" Jul 15 21:09:56.305562 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:56.305451 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 21:09:56.305562 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:56.305504 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14f84a19-c09e-4724-892e-46796e611bd9-original-pull-secret podName:14f84a19-c09e-4724-892e-46796e611bd9 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:12.305490813 +0000 UTC m=+34.199894856 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14f84a19-c09e-4724-892e-46796e611bd9-original-pull-secret") pod "global-pull-secret-syncer-8c5ks" (UID: "14f84a19-c09e-4724-892e-46796e611bd9") : object "kube-system"/"original-pull-secret" not registered Jul 15 21:09:56.406285 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:56.406245 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq9n9\" (UniqueName: \"kubernetes.io/projected/b85e9808-cc68-4ebb-af04-6bd95b54a5c9-kube-api-access-fq9n9\") pod \"network-check-target-6p5nk\" (UID: \"b85e9808-cc68-4ebb-af04-6bd95b54a5c9\") " pod="openshift-network-diagnostics/network-check-target-6p5nk" Jul 15 21:09:56.406459 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:56.406430 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 21:09:56.406459 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:56.406456 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 21:09:56.406568 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:56.406469 2570 projected.go:196] Error preparing data for projected volume kube-api-access-fq9n9 for pod openshift-network-diagnostics/network-check-target-6p5nk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:09:56.406568 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:56.406528 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b85e9808-cc68-4ebb-af04-6bd95b54a5c9-kube-api-access-fq9n9 podName:b85e9808-cc68-4ebb-af04-6bd95b54a5c9 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:12.406512393 +0000 UTC m=+34.300916436 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fq9n9" (UniqueName: "kubernetes.io/projected/b85e9808-cc68-4ebb-af04-6bd95b54a5c9-kube-api-access-fq9n9") pod "network-check-target-6p5nk" (UID: "b85e9808-cc68-4ebb-af04-6bd95b54a5c9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:09:56.582971 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:56.582928 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89vwd" Jul 15 21:09:56.583137 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:56.582928 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8c5ks" Jul 15 21:09:56.583137 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:56.583114 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89vwd" podUID="e9154423-994b-45e7-9cad-813087e03e31" Jul 15 21:09:56.583321 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:56.583277 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8c5ks" podUID="14f84a19-c09e-4724-892e-46796e611bd9" Jul 15 21:09:57.583482 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:57.583442 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6p5nk" Jul 15 21:09:57.583888 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:57.583559 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6p5nk" podUID="b85e9808-cc68-4ebb-af04-6bd95b54a5c9" Jul 15 21:09:58.584558 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:58.584523 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8c5ks" Jul 15 21:09:58.585001 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:58.584636 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8c5ks" podUID="14f84a19-c09e-4724-892e-46796e611bd9" Jul 15 21:09:58.585001 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:58.584688 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89vwd" Jul 15 21:09:58.585001 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:58.584767 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89vwd" podUID="e9154423-994b-45e7-9cad-813087e03e31" Jul 15 21:09:59.582984 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:09:59.582952 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6p5nk" Jul 15 21:09:59.583144 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:09:59.583066 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6p5nk" podUID="b85e9808-cc68-4ebb-af04-6bd95b54a5c9" Jul 15 21:10:00.583935 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:00.583549 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8c5ks" Jul 15 21:10:00.584768 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:00.584041 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8c5ks" podUID="14f84a19-c09e-4724-892e-46796e611bd9" Jul 15 21:10:00.584768 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:00.583610 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89vwd" Jul 15 21:10:00.584768 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:00.584160 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89vwd" podUID="e9154423-994b-45e7-9cad-813087e03e31" Jul 15 21:10:00.682223 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:00.682188 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95tgp" event={"ID":"7af6fe70-ffce-417d-9a8a-6df647daeb40","Type":"ContainerStarted","Data":"72754fc71e7897a3cfc688a4d85fdb425eb301e1af1c8f68bd192f446a11b8dc"} Jul 15 21:10:00.683845 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:00.683804 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t6sjg" event={"ID":"7adb30c9-2d57-4688-a7cd-0bbb70fcd152","Type":"ContainerStarted","Data":"adee14600e27f3c943551bdd5e5a8524ac2a866ba9284cb07e2a05595024ebfb"} Jul 15 21:10:00.685384 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:00.685360 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pxkxm" event={"ID":"835fb8bf-2d1b-47f8-b6ef-25d16a2cc774","Type":"ContainerStarted","Data":"3e89a16962f9d93e5d1f8a851222d00ccb6cbdf0b8f23d450106ff4fc55cd489"} Jul 15 21:10:00.687073 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:00.687045 2570 generic.go:356] "Generic (PLEG): container finished" podID="e89cab18-de44-40e2-9486-0446676f8942" containerID="347b330b7e9d1f3b8ece60aad27b2b659e7a7e013f538e64f5edf9bb67cc8a0e" exitCode=0 Jul 15 21:10:00.687184 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:00.687131 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k25xr" event={"ID":"e89cab18-de44-40e2-9486-0446676f8942","Type":"ContainerDied","Data":"347b330b7e9d1f3b8ece60aad27b2b659e7a7e013f538e64f5edf9bb67cc8a0e"} Jul 15 21:10:00.690562 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:00.690543 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nhzkw_beb5b136-86fb-4e57-9b27-3fc1079a9af3/ovn-acl-logging/0.log" Jul 15 21:10:00.690967 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:00.690945 2570 generic.go:356] "Generic (PLEG): container finished" podID="beb5b136-86fb-4e57-9b27-3fc1079a9af3" containerID="ff930597f23a14e59320012e84f105e4ef7bf587439efae306ee9018147fcaef" exitCode=1 Jul 15 21:10:00.691047 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:00.691011 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" event={"ID":"beb5b136-86fb-4e57-9b27-3fc1079a9af3","Type":"ContainerStarted","Data":"204cff59ca8aabf4315e4b067066a1de70f2b98c8fc9c2e58311dbaad2f81b21"} Jul 15 21:10:00.691107 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:00.691058 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" event={"ID":"beb5b136-86fb-4e57-9b27-3fc1079a9af3","Type":"ContainerStarted","Data":"fb7afc634fd8ca1c7629aeb0496590f0aa9598e42f783e9dc857e87c8ea69887"} Jul 15 21:10:00.691156 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:00.691106 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" event={"ID":"beb5b136-86fb-4e57-9b27-3fc1079a9af3","Type":"ContainerStarted","Data":"c3931c819114843364a7074b50f3b680137998eb422f81aba1d86e55224311d4"} Jul 15 21:10:00.691156 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:00.691139 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" event={"ID":"beb5b136-86fb-4e57-9b27-3fc1079a9af3","Type":"ContainerStarted","Data":"5571cface15b2e2cf4bd0306f29a61486a8c7cd404dab30850d74a81a9386b9b"} Jul 15 21:10:00.691252 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:00.691171 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" event={"ID":"beb5b136-86fb-4e57-9b27-3fc1079a9af3","Type":"ContainerDied","Data":"ff930597f23a14e59320012e84f105e4ef7bf587439efae306ee9018147fcaef"} Jul 15 21:10:00.691315 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:00.691229 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" event={"ID":"beb5b136-86fb-4e57-9b27-3fc1079a9af3","Type":"ContainerStarted","Data":"851025e4511b85a955abaceab1b584ae3d37c535ffea9074261a224cdfc4c99f"} Jul 15 21:10:00.692756 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:00.692712 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hmhs5" event={"ID":"e8745d68-cd07-41f9-9c84-b0d1f12fa0c9","Type":"ContainerStarted","Data":"4e2c1ef7ca27b76628e857861586b4c17e3f73b48a18036baac64b6120974b15"} Jul 15 21:10:00.694694 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:00.694671 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" event={"ID":"cce0d8b8-12f2-4fbd-aaf9-1d880b69dc88","Type":"ContainerStarted","Data":"b39bb10c72424ae59f47391cd88ea6739c45120161503a3b5e67782000b1f472"} Jul 15 21:10:00.696147 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:00.696124 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lkgf2" event={"ID":"654026cc-fb99-41cc-b6c4-6fbc09801960","Type":"ContainerStarted","Data":"28c1473d2345dba732c24f28459adecf1b311ef5501f6e6e3f10d3529ab108c4"} Jul 15 21:10:00.699803 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:00.699764 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-t6sjg" podStartSLOduration=11.138272931 podStartE2EDuration="21.699748846s" totalImagesPullingTime="10.561475915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:00.699339943 +0000 UTC m=+22.593744029" watchObservedRunningTime="2026-07-15 21:10:00.699748846 +0000 UTC m=+22.594152910" Jul 15 21:10:00.699975 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:00.699926 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-113.ec2.internal" podStartSLOduration=21.699910663 podStartE2EDuration="21.699910663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:09:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:09:42.660973965 +0000 UTC m=+4.555378031" watchObservedRunningTime="2026-07-15 21:10:00.699910663 +0000 UTC m=+22.594314727" Jul 15 21:10:00.722038 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:00.720701 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lkgf2" podStartSLOduration=2.796491341 podStartE2EDuration="21.720674549s" totalImagesPullingTime="18.924183208s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:00.719539414 +0000 UTC m=+22.613943482" watchObservedRunningTime="2026-07-15 21:10:00.720674549 +0000 UTC m=+22.615078617" Jul 15 21:10:00.777862 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:00.777814 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hmhs5" podStartSLOduration=3.445418467 podStartE2EDuration="22.777792377s" totalImagesPullingTime="19.33237391s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:09:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:00.777585936 +0000 UTC m=+22.671990002" watchObservedRunningTime="2026-07-15 21:10:00.777792377 +0000 UTC m=+22.672196444" Jul 15 21:10:00.836867 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:00.836821 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dw8c6" podStartSLOduration=2.893360659 podStartE2EDuration="21.836802747s" totalImagesPullingTime="18.943442088s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:00.800138512 +0000 UTC m=+22.694542576" watchObservedRunningTime="2026-07-15 21:10:00.836802747 +0000 UTC m=+22.731206812" Jul 15 21:10:00.837258 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:00.837230 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pxkxm" podStartSLOduration=2.907288254 podStartE2EDuration="21.837224872s" totalImagesPullingTime="18.929936618s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:00.826338152 +0000 UTC m=+22.720742237" watchObservedRunningTime="2026-07-15 21:10:00.837224872 +0000 UTC m=+22.731628936" Jul 15 21:10:01.092979 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:01.092958 2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 15 21:10:01.515995 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:01.515888 2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T21:10:01.092974627Z","UUID":"3fd51475-c789-4c32-bba5-a87e30f11b40","Handler":null,"Name":"","Endpoint":""} Jul 15 21:10:01.517883 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:01.517862 2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 15 21:10:01.518068 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:01.517904 2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 15 21:10:01.583617 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:01.583586 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6p5nk" Jul 15 21:10:01.583779 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:01.583690 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6p5nk" podUID="b85e9808-cc68-4ebb-af04-6bd95b54a5c9" Jul 15 21:10:01.700744 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:01.700707 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95tgp" event={"ID":"7af6fe70-ffce-417d-9a8a-6df647daeb40","Type":"ContainerStarted","Data":"0af47837d907ca0b1c25a8125aa012699c4d8c6169a3233a6512d88f4b6433ab"} Jul 15 21:10:01.702392 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:01.702356 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lmdct" event={"ID":"db9d02a9-e0aa-4a47-b3ef-b518f555b872","Type":"ContainerStarted","Data":"13500eb49d2e03c812e673e21acaa803d7f0956a9a9ea6677a9e3282e6c13641"} Jul 15 21:10:02.587440 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:02.587411 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89vwd" Jul 15 21:10:02.587440 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:02.587433 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8c5ks" Jul 15 21:10:02.587591 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:02.587520 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8c5ks" podUID="14f84a19-c09e-4724-892e-46796e611bd9" Jul 15 21:10:02.587656 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:02.587639 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89vwd" podUID="e9154423-994b-45e7-9cad-813087e03e31" Jul 15 21:10:02.706865 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:02.706831 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95tgp" event={"ID":"7af6fe70-ffce-417d-9a8a-6df647daeb40","Type":"ContainerStarted","Data":"787c57d41d90e1a3a50e08fdeb1665dbe368a12f67ad3eced6b4ce9c85e02227"} Jul 15 21:10:02.710117 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:02.710086 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nhzkw_beb5b136-86fb-4e57-9b27-3fc1079a9af3/ovn-acl-logging/0.log" Jul 15 21:10:02.710803 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:02.710766 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" event={"ID":"beb5b136-86fb-4e57-9b27-3fc1079a9af3","Type":"ContainerStarted","Data":"73e205a7dd36eb6a1256e6f83f3a0d9b2c85fa2e278e442ffd905905f8f6c9cc"} Jul 15 21:10:02.730801 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:02.730759 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lmdct" podStartSLOduration=5.8017553 podStartE2EDuration="24.730744846s" totalImagesPullingTime="18.928989546s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:09:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:01.720894281 +0000 UTC m=+23.615298347" watchObservedRunningTime="2026-07-15 21:10:02.730744846 +0000 UTC m=+24.625148910" Jul 15 21:10:02.731020 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:02.730999 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95tgp" podStartSLOduration=2.416633448 podStartE2EDuration="23.730992681s" totalImagesPullingTime="21.314359233s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:09:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:02.730609475 +0000 UTC m=+24.625013540" watchObservedRunningTime="2026-07-15 21:10:02.730992681 +0000 UTC m=+24.625396768" Jul 15 21:10:03.542338 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:03.542136 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-t6sjg" Jul 15 21:10:03.542862 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:03.542833 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-t6sjg" Jul 15 21:10:03.582729 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:03.582704 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6p5nk" Jul 15 21:10:03.582843 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:03.582799 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6p5nk" podUID="b85e9808-cc68-4ebb-af04-6bd95b54a5c9" Jul 15 21:10:03.713193 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:03.713137 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-t6sjg" Jul 15 21:10:03.713707 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:03.713690 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-t6sjg" Jul 15 21:10:04.582845 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:04.582815 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89vwd" Jul 15 21:10:04.583063 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:04.582816 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8c5ks" Jul 15 21:10:04.583063 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:04.582944 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89vwd" podUID="e9154423-994b-45e7-9cad-813087e03e31" Jul 15 21:10:04.583063 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:04.582988 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8c5ks" podUID="14f84a19-c09e-4724-892e-46796e611bd9" Jul 15 21:10:05.583553 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:05.583386 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6p5nk" Jul 15 21:10:05.584180 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:05.583622 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6p5nk" podUID="b85e9808-cc68-4ebb-af04-6bd95b54a5c9" Jul 15 21:10:05.721161 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:05.721127 2570 generic.go:356] "Generic (PLEG): container finished" podID="e89cab18-de44-40e2-9486-0446676f8942" containerID="dfaa77ea79fb9d76f05f458b343479522d6ff993007f174a8c6b28a3cb7a0ca4" exitCode=0 Jul 15 21:10:05.721364 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:05.721208 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k25xr" event={"ID":"e89cab18-de44-40e2-9486-0446676f8942","Type":"ContainerDied","Data":"dfaa77ea79fb9d76f05f458b343479522d6ff993007f174a8c6b28a3cb7a0ca4"} Jul 15 21:10:05.724583 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:05.724565 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nhzkw_beb5b136-86fb-4e57-9b27-3fc1079a9af3/ovn-acl-logging/0.log" Jul 15 21:10:05.724892 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:05.724875 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" event={"ID":"beb5b136-86fb-4e57-9b27-3fc1079a9af3","Type":"ContainerStarted","Data":"79cad3ac868380f18f0b7bfef534ff7c7e5ed13c2cac4aac01bd06d9e9186807"} Jul 15 21:10:05.725191 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:05.725171 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:10:05.725273 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:05.725222 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:10:05.725273 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:05.725253 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:10:05.725396 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:05.725338 2570 scope.go:117] "RemoveContainer" containerID="ff930597f23a14e59320012e84f105e4ef7bf587439efae306ee9018147fcaef" Jul 15 21:10:05.740544 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:05.740525 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:10:05.740630 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:05.740619 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:10:06.583467 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:06.583440 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89vwd" Jul 15 21:10:06.583603 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:06.583555 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89vwd" podUID="e9154423-994b-45e7-9cad-813087e03e31" Jul 15 21:10:06.583878 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:06.583610 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8c5ks" Jul 15 21:10:06.583878 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:06.583697 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8c5ks" podUID="14f84a19-c09e-4724-892e-46796e611bd9" Jul 15 21:10:06.730788 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:06.730765 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nhzkw_beb5b136-86fb-4e57-9b27-3fc1079a9af3/ovn-acl-logging/0.log" Jul 15 21:10:06.731097 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:06.731078 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" event={"ID":"beb5b136-86fb-4e57-9b27-3fc1079a9af3","Type":"ContainerStarted","Data":"36d0ff03564ba6a5b478cb3d7d79517e825e5b3676bf59f67c0282f4d35692d7"} Jul 15 21:10:06.764727 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:06.764680 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" podStartSLOduration=9.783199624 podStartE2EDuration="28.764661886s" totalImagesPullingTime="18.981462262s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:09:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:06.763568791 +0000 UTC m=+28.657972856" watchObservedRunningTime="2026-07-15 21:10:06.764661886 +0000 UTC m=+28.659065950" Jul 15 21:10:07.488351 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:07.488250 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8c5ks"] Jul 15 21:10:07.488475 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:07.488415 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8c5ks" Jul 15 21:10:07.488530 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:07.488509 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8c5ks" podUID="14f84a19-c09e-4724-892e-46796e611bd9" Jul 15 21:10:07.491729 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:07.491698 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-89vwd"] Jul 15 21:10:07.491860 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:07.491827 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89vwd" Jul 15 21:10:07.492005 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:07.491981 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89vwd" podUID="e9154423-994b-45e7-9cad-813087e03e31" Jul 15 21:10:07.492342 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:07.492320 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6p5nk"] Jul 15 21:10:07.492425 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:07.492413 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6p5nk" Jul 15 21:10:07.492506 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:07.492490 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6p5nk" podUID="b85e9808-cc68-4ebb-af04-6bd95b54a5c9" Jul 15 21:10:07.735619 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:07.735576 2570 generic.go:356] "Generic (PLEG): container finished" podID="e89cab18-de44-40e2-9486-0446676f8942" containerID="42cbd040e3960303670b8c79d3c07bc310e04ad81ced0709c64477d20600192e" exitCode=0 Jul 15 21:10:07.735619 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:07.735613 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k25xr" event={"ID":"e89cab18-de44-40e2-9486-0446676f8942","Type":"ContainerDied","Data":"42cbd040e3960303670b8c79d3c07bc310e04ad81ced0709c64477d20600192e"} Jul 15 21:10:09.582957 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:09.582777 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8c5ks" Jul 15 21:10:09.583697 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:09.582836 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89vwd" Jul 15 21:10:09.583697 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:09.583053 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8c5ks" podUID="14f84a19-c09e-4724-892e-46796e611bd9" Jul 15 21:10:09.583697 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:09.582836 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6p5nk" Jul 15 21:10:09.583697 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:09.583117 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89vwd" podUID="e9154423-994b-45e7-9cad-813087e03e31" Jul 15 21:10:09.583697 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:09.583179 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6p5nk" podUID="b85e9808-cc68-4ebb-af04-6bd95b54a5c9" Jul 15 21:10:09.742632 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:09.742601 2570 generic.go:356] "Generic (PLEG): container finished" podID="e89cab18-de44-40e2-9486-0446676f8942" containerID="f0eaea1bd8afadd765537daca9fa96434cfbc5c1292fe9a18a6846034cb66e4e" exitCode=0 Jul 15 21:10:09.742771 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:09.742650 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k25xr" event={"ID":"e89cab18-de44-40e2-9486-0446676f8942","Type":"ContainerDied","Data":"f0eaea1bd8afadd765537daca9fa96434cfbc5c1292fe9a18a6846034cb66e4e"} Jul 15 21:10:11.583263 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:11.583226 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6p5nk" Jul 15 21:10:11.583684 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:11.583275 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8c5ks" Jul 15 21:10:11.583684 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:11.583370 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6p5nk" podUID="b85e9808-cc68-4ebb-af04-6bd95b54a5c9" Jul 15 21:10:11.583684 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:11.583416 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89vwd" Jul 15 21:10:11.583684 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:11.583519 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8c5ks" podUID="14f84a19-c09e-4724-892e-46796e611bd9" Jul 15 21:10:11.583684 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:11.583619 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89vwd" podUID="e9154423-994b-45e7-9cad-813087e03e31" Jul 15 21:10:12.222226 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.222186 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9154423-994b-45e7-9cad-813087e03e31-metrics-certs\") pod \"network-metrics-daemon-89vwd\" (UID: \"e9154423-994b-45e7-9cad-813087e03e31\") " pod="openshift-multus/network-metrics-daemon-89vwd" Jul 15 21:10:12.222515 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:12.222337 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:10:12.222515 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:12.222401 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9154423-994b-45e7-9cad-813087e03e31-metrics-certs podName:e9154423-994b-45e7-9cad-813087e03e31 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:44.22238294 +0000 UTC m=+66.116786984 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9154423-994b-45e7-9cad-813087e03e31-metrics-certs") pod "network-metrics-daemon-89vwd" (UID: "e9154423-994b-45e7-9cad-813087e03e31") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:10:12.323080 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.323043 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14f84a19-c09e-4724-892e-46796e611bd9-original-pull-secret\") pod \"global-pull-secret-syncer-8c5ks\" (UID: \"14f84a19-c09e-4724-892e-46796e611bd9\") " pod="kube-system/global-pull-secret-syncer-8c5ks" Jul 15 21:10:12.323240 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:12.323169 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 21:10:12.323284 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:12.323244 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14f84a19-c09e-4724-892e-46796e611bd9-original-pull-secret podName:14f84a19-c09e-4724-892e-46796e611bd9 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:44.323222769 +0000 UTC m=+66.217626825 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14f84a19-c09e-4724-892e-46796e611bd9-original-pull-secret") pod "global-pull-secret-syncer-8c5ks" (UID: "14f84a19-c09e-4724-892e-46796e611bd9") : object "kube-system"/"original-pull-secret" not registered Jul 15 21:10:12.423758 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.423724 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq9n9\" (UniqueName: \"kubernetes.io/projected/b85e9808-cc68-4ebb-af04-6bd95b54a5c9-kube-api-access-fq9n9\") pod \"network-check-target-6p5nk\" (UID: \"b85e9808-cc68-4ebb-af04-6bd95b54a5c9\") " pod="openshift-network-diagnostics/network-check-target-6p5nk" Jul 15 21:10:12.423937 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:12.423868 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 21:10:12.423937 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:12.423884 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 21:10:12.423937 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:12.423893 2570 projected.go:196] Error preparing data for projected volume kube-api-access-fq9n9 for pod openshift-network-diagnostics/network-check-target-6p5nk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:10:12.424071 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:12.423946 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b85e9808-cc68-4ebb-af04-6bd95b54a5c9-kube-api-access-fq9n9 podName:b85e9808-cc68-4ebb-af04-6bd95b54a5c9 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:44.423933975 +0000 UTC m=+66.318338021 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fq9n9" (UniqueName: "kubernetes.io/projected/b85e9808-cc68-4ebb-af04-6bd95b54a5c9-kube-api-access-fq9n9") pod "network-check-target-6p5nk" (UID: "b85e9808-cc68-4ebb-af04-6bd95b54a5c9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:10:12.897857 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.897770 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-113.ec2.internal" event="NodeReady" Jul 15 21:10:12.898266 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.897939 2570 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 15 21:10:12.940880 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.940838 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vk5n4"] Jul 15 21:10:12.943415 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.943394 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-79778fcf46-l49zk"] Jul 15 21:10:12.943576 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.943534 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vk5n4" Jul 15 21:10:12.945281 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.945261 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79778fcf46-l49zk" Jul 15 21:10:12.946483 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.946464 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 15 21:10:12.946587 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.946469 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 15 21:10:12.946663 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.946472 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-4dwpr\"" Jul 15 21:10:12.947388 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.947368 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 15 21:10:12.947712 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.947695 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 15 21:10:12.947984 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.947958 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 15 21:10:12.948169 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.948143 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9mpjn\"" Jul 15 21:10:12.954606 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.954586 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 15 21:10:12.954700 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.954628 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zqgn5"] Jul 15 21:10:12.956410 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.956391 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-txm4n"] Jul 15 21:10:12.956607 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.956586 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zqgn5" Jul 15 21:10:12.958331 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.958273 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qfckd"] Jul 15 21:10:12.958687 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.958667 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-txm4n" Jul 15 21:10:12.960449 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.960421 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-c5zg9"] Jul 15 21:10:12.960988 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.960512 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qfckd" Jul 15 21:10:12.962626 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.962599 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-bk2j8"] Jul 15 21:10:12.964188 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.962745 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-c5zg9" Jul 15 21:10:12.964506 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.964489 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-ghgrt"] Jul 15 21:10:12.964863 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.964725 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 15 21:10:12.965040 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.965015 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 15 21:10:12.965178 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.965163 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-bk2j8" Jul 15 21:10:12.965476 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.965456 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 15 21:10:12.965971 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.965953 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 15 21:10:12.966062 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.965984 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-j5js8\"" Jul 15 21:10:12.966420 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.966404 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 15 21:10:12.966510 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.966422 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 15 21:10:12.967418 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.967403 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tmgwf"] Jul 15 21:10:12.967633 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.967615 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 15 21:10:12.967860 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.967510 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-ghgrt" Jul 15 21:10:12.968866 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.968849 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 15 21:10:12.969133 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.969117 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 15 21:10:12.969376 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.969176 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 15 21:10:12.969559 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.969524 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 15 21:10:12.969664 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.969571 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 15 21:10:12.969664 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.969650 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 15 21:10:12.970149 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.970017 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 15 21:10:12.970149 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.970028 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-9qv44\"" Jul 15 21:10:12.970386 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.970367 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 15 21:10:12.970493 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.970477 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-rbx7k\"" Jul 15 21:10:12.970692 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.970675 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 15 21:10:12.970879 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.970865 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 15 21:10:12.971518 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.971500 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-g5pxf\"" Jul 15 21:10:12.971613 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.971597 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-4ntd5\"" Jul 15 21:10:12.971800 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.971781 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-c72cs\"" Jul 15 21:10:12.971901 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.971790 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 15 21:10:12.971901 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.971841 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 15 21:10:12.972117 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.972101 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79778fcf46-l49zk"] Jul 15 21:10:12.972207 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.972138 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vk5n4"] Jul 15 21:10:12.972265 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.972211 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tmgwf" Jul 15 21:10:12.974449 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.974432 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zqgn5"] Jul 15 21:10:12.976935 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.976912 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 15 21:10:12.977035 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.976935 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 15 21:10:12.978103 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.978032 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-txm4n"] Jul 15 21:10:12.978208 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.978154 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-v4zn5\"" Jul 15 21:10:12.978404 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.978383 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 15 21:10:12.978502 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.978410 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 15 21:10:12.980124 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.979393 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 15 21:10:12.980124 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.979899 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 15 21:10:12.984429 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.984408 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tmgwf"] Jul 15 21:10:12.987994 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.987970 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-ghgrt"] Jul 15 21:10:12.989089 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.989066 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 15 21:10:12.989592 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.989542 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-bk2j8"] Jul 15 21:10:12.991433 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.991413 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lr4hr"] Jul 15 21:10:12.993035 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.993005 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 15 21:10:12.994252 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.994238 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-59ff8f8888-cmlk2"] Jul 15 21:10:12.994406 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.994387 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lr4hr" Jul 15 21:10:12.995966 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.995944 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8pvn9"] Jul 15 21:10:12.996093 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.996078 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-59ff8f8888-cmlk2" Jul 15 21:10:12.997076 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.997055 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 15 21:10:12.997163 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.997097 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xcfql\"" Jul 15 21:10:12.997234 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.997222 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 15 21:10:12.997975 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.997956 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-chhhx"] Jul 15 21:10:12.998384 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.998358 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 15 21:10:12.998522 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.998507 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 15 21:10:12.998981 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.998954 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8pvn9" Jul 15 21:10:12.999117 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.999098 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 15 21:10:12.999208 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.998987 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 15 21:10:12.999274 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.998985 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-v8bmm\"" Jul 15 21:10:12.999358 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.998999 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 15 21:10:12.999358 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.999063 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 15 21:10:12.999614 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.999595 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qfckd"] Jul 15 21:10:12.999698 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.999632 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-c5zg9"] Jul 15 21:10:12.999698 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.999652 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-chhhx"] Jul 15 21:10:12.999773 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:12.999713 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-chhhx" Jul 15 21:10:13.001510 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.001493 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8pvn9"] Jul 15 21:10:13.002892 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.002828 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lr4hr"] Jul 15 21:10:13.003236 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.003076 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-59ff8f8888-cmlk2"] Jul 15 21:10:13.004003 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.003983 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9kxvh\"" Jul 15 21:10:13.004094 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.004012 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 15 21:10:13.004094 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.004064 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 21:10:13.004201 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.004101 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 21:10:13.004260 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.004206 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-zf7v7\"" Jul 15 21:10:13.004347 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.004332 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 15 21:10:13.004414 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.004362 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 15 21:10:13.128587 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.128548 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/50d11f79-1eac-4ad4-8151-9b5dd54cd284-trusted-ca\") pod \"console-operator-7866497494-c5zg9\" (UID: \"50d11f79-1eac-4ad4-8151-9b5dd54cd284\") " pod="openshift-console-operator/console-operator-7866497494-c5zg9" Jul 15 21:10:13.128587 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.128583 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-tmgwf\" (UID: \"dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tmgwf" Jul 15 21:10:13.128823 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.128616 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-registry-certificates\") pod \"image-registry-79778fcf46-l49zk\" (UID: \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\") " pod="openshift-image-registry/image-registry-79778fcf46-l49zk" Jul 15 21:10:13.128823 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.128645 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6c4352ba-2395-4d2c-b984-1af71646d3ae-stats-auth\") pod \"router-default-59ff8f8888-cmlk2\" (UID: \"6c4352ba-2395-4d2c-b984-1af71646d3ae\") " pod="openshift-ingress/router-default-59ff8f8888-cmlk2" Jul 15 21:10:13.128823 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.128672 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hn7c\" (UniqueName: \"kubernetes.io/projected/4498916d-507d-4f9a-94d3-b9fb0b68c4aa-kube-api-access-5hn7c\") pod \"kube-storage-version-migrator-operator-799cb7f958-txm4n\" (UID: \"4498916d-507d-4f9a-94d3-b9fb0b68c4aa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-txm4n" Jul 15 21:10:13.128823 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.128690 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65k4l\" (UniqueName: \"kubernetes.io/projected/004e0571-8f51-4fb2-b25b-8946eaf65f05-kube-api-access-65k4l\") pod \"ingress-canary-8pvn9\" (UID: \"004e0571-8f51-4fb2-b25b-8946eaf65f05\") " pod="openshift-ingress-canary/ingress-canary-8pvn9" Jul 15 21:10:13.128823 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.128705 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk9cd\" (UniqueName: \"kubernetes.io/projected/e8c2a4fd-b530-4bac-b9fa-6682ab28dde1-kube-api-access-tk9cd\") pod \"dns-default-lr4hr\" (UID: \"e8c2a4fd-b530-4bac-b9fa-6682ab28dde1\") " pod="openshift-dns/dns-default-lr4hr" Jul 15 21:10:13.128823 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.128727 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7e943fc-fff4-4503-b81e-a56f9f640700-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-ghgrt\" (UID: \"e7e943fc-fff4-4503-b81e-a56f9f640700\") " pod="openshift-insights/insights-operator-68d9dd94cf-ghgrt" Jul 15 21:10:13.129065 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.128827 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcvsc\" (UniqueName: \"kubernetes.io/projected/5b6d3fc4-cf24-4721-af75-6082139bc6c4-kube-api-access-rcvsc\") pod \"service-ca-operator-7695fc6c8c-zqgn5\" (UID: \"5b6d3fc4-cf24-4721-af75-6082139bc6c4\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zqgn5" Jul 15 21:10:13.129065 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.128858 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5vp8\" (UniqueName: \"kubernetes.io/projected/e7e943fc-fff4-4503-b81e-a56f9f640700-kube-api-access-k5vp8\") pod \"insights-operator-68d9dd94cf-ghgrt\" (UID: \"e7e943fc-fff4-4503-b81e-a56f9f640700\") " pod="openshift-insights/insights-operator-68d9dd94cf-ghgrt" Jul 15 21:10:13.129065 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.128875 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7e943fc-fff4-4503-b81e-a56f9f640700-tmp\") pod \"insights-operator-68d9dd94cf-ghgrt\" (UID: \"e7e943fc-fff4-4503-b81e-a56f9f640700\") " pod="openshift-insights/insights-operator-68d9dd94cf-ghgrt" Jul 15 21:10:13.129065 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.128897 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jxsm\" (UniqueName: \"kubernetes.io/projected/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-kube-api-access-4jxsm\") pod \"image-registry-79778fcf46-l49zk\" (UID: \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\") " pod="openshift-image-registry/image-registry-79778fcf46-l49zk" Jul 15 21:10:13.129065 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.128930 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-installation-pull-secrets\") pod \"image-registry-79778fcf46-l49zk\" (UID: \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\") " pod="openshift-image-registry/image-registry-79778fcf46-l49zk" Jul 15 21:10:13.129065 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.128960 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6c4352ba-2395-4d2c-b984-1af71646d3ae-default-certificate\") pod \"router-default-59ff8f8888-cmlk2\" (UID: \"6c4352ba-2395-4d2c-b984-1af71646d3ae\") " pod="openshift-ingress/router-default-59ff8f8888-cmlk2" Jul 15 21:10:13.129065 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.128990 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2-nginx-conf\") pod \"networking-console-plugin-6cf856758c-bk2j8\" (UID: \"f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-bk2j8" Jul 15 21:10:13.129065 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.129017 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7e943fc-fff4-4503-b81e-a56f9f640700-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-ghgrt\" (UID: \"e7e943fc-fff4-4503-b81e-a56f9f640700\") " pod="openshift-insights/insights-operator-68d9dd94cf-ghgrt" Jul 15 21:10:13.129065 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.129043 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kqmk\" (UniqueName: \"kubernetes.io/projected/50d11f79-1eac-4ad4-8151-9b5dd54cd284-kube-api-access-6kqmk\") pod \"console-operator-7866497494-c5zg9\" (UID: \"50d11f79-1eac-4ad4-8151-9b5dd54cd284\") " pod="openshift-console-operator/console-operator-7866497494-c5zg9" Jul 15 21:10:13.129065 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.129060 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgwzq\" (UniqueName: \"kubernetes.io/projected/e7f566a4-c5c1-43ce-a62b-fc01ed526059-kube-api-access-fgwzq\") pod \"cluster-monitoring-operator-5f7f494dd4-qfckd\" (UID: \"e7f566a4-c5c1-43ce-a62b-fc01ed526059\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qfckd" Jul 15 21:10:13.129488 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.129082 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-ca-trust-extracted\") pod \"image-registry-79778fcf46-l49zk\" (UID: \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\") " pod="openshift-image-registry/image-registry-79778fcf46-l49zk" Jul 15 21:10:13.129488 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.129112 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn46r\" (UniqueName: \"kubernetes.io/projected/65f1d8af-0b24-4b0b-860c-bedf0546a60b-kube-api-access-gn46r\") pod \"network-check-source-869dcfcdcd-chhhx\" (UID: \"65f1d8af-0b24-4b0b-860c-bedf0546a60b\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-chhhx" Jul 15 21:10:13.129488 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.129157 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4498916d-507d-4f9a-94d3-b9fb0b68c4aa-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-txm4n\" (UID: \"4498916d-507d-4f9a-94d3-b9fb0b68c4aa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-txm4n" Jul 15 21:10:13.129488 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.129207 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw7lc\" (UniqueName: \"kubernetes.io/projected/53febc71-9f61-4c4b-9001-64dc254e3188-kube-api-access-cw7lc\") pod \"volume-data-source-validator-78495597f6-vk5n4\" (UID: \"53febc71-9f61-4c4b-9001-64dc254e3188\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vk5n4" Jul 15 21:10:13.129488 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.129252 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e7e943fc-fff4-4503-b81e-a56f9f640700-serving-cert\") pod \"insights-operator-68d9dd94cf-ghgrt\" (UID: \"e7e943fc-fff4-4503-b81e-a56f9f640700\") " pod="openshift-insights/insights-operator-68d9dd94cf-ghgrt" Jul 15 21:10:13.129488 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.129281 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e7f566a4-c5c1-43ce-a62b-fc01ed526059-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-qfckd\" (UID: \"e7f566a4-c5c1-43ce-a62b-fc01ed526059\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qfckd" Jul 15 21:10:13.129488 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.129314 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c4352ba-2395-4d2c-b984-1af71646d3ae-service-ca-bundle\") pod \"router-default-59ff8f8888-cmlk2\" (UID: \"6c4352ba-2395-4d2c-b984-1af71646d3ae\") " pod="openshift-ingress/router-default-59ff8f8888-cmlk2" Jul 15 21:10:13.129488 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.129333 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8c2a4fd-b530-4bac-b9fa-6682ab28dde1-tmp-dir\") pod \"dns-default-lr4hr\" (UID: \"e8c2a4fd-b530-4bac-b9fa-6682ab28dde1\") " pod="openshift-dns/dns-default-lr4hr" Jul 15 21:10:13.129488 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.129368 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4498916d-507d-4f9a-94d3-b9fb0b68c4aa-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-txm4n\" (UID: \"4498916d-507d-4f9a-94d3-b9fb0b68c4aa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-txm4n" Jul 15 21:10:13.129488 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.129416 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/50d11f79-1eac-4ad4-8151-9b5dd54cd284-config\") pod \"console-operator-7866497494-c5zg9\" (UID: \"50d11f79-1eac-4ad4-8151-9b5dd54cd284\") " pod="openshift-console-operator/console-operator-7866497494-c5zg9" Jul 15 21:10:13.129488 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.129438 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/004e0571-8f51-4fb2-b25b-8946eaf65f05-cert\") pod \"ingress-canary-8pvn9\" (UID: \"004e0571-8f51-4fb2-b25b-8946eaf65f05\") " pod="openshift-ingress-canary/ingress-canary-8pvn9" Jul 15 21:10:13.129488 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.129453 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7f566a4-c5c1-43ce-a62b-fc01ed526059-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-qfckd\" (UID: \"e7f566a4-c5c1-43ce-a62b-fc01ed526059\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qfckd" Jul 15 21:10:13.129488 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.129475 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm5cj\" (UniqueName: \"kubernetes.io/projected/dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5-kube-api-access-pm5cj\") pod \"cluster-samples-operator-65db858894-tmgwf\" (UID: \"dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tmgwf" Jul 15 21:10:13.129488 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.129496 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76h4h\" (UniqueName: \"kubernetes.io/projected/6c4352ba-2395-4d2c-b984-1af71646d3ae-kube-api-access-76h4h\") pod \"router-default-59ff8f8888-cmlk2\" (UID: \"6c4352ba-2395-4d2c-b984-1af71646d3ae\") " pod="openshift-ingress/router-default-59ff8f8888-cmlk2" Jul 15 21:10:13.130118 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.129540 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5b6d3fc4-cf24-4721-af75-6082139bc6c4-serving-cert\") pod \"service-ca-operator-7695fc6c8c-zqgn5\" (UID: \"5b6d3fc4-cf24-4721-af75-6082139bc6c4\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zqgn5" Jul 15 21:10:13.130118 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.129578 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-image-registry-private-configuration\") pod \"image-registry-79778fcf46-l49zk\" (UID: \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\") " pod="openshift-image-registry/image-registry-79778fcf46-l49zk" Jul 15 21:10:13.130118 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.129608 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-bk2j8\" (UID: \"f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-bk2j8" Jul 15 21:10:13.130118 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.129636 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e7e943fc-fff4-4503-b81e-a56f9f640700-snapshots\") pod \"insights-operator-68d9dd94cf-ghgrt\" (UID: \"e7e943fc-fff4-4503-b81e-a56f9f640700\") " pod="openshift-insights/insights-operator-68d9dd94cf-ghgrt" Jul 15 21:10:13.130118 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.129665 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/50d11f79-1eac-4ad4-8151-9b5dd54cd284-serving-cert\") pod \"console-operator-7866497494-c5zg9\" (UID: \"50d11f79-1eac-4ad4-8151-9b5dd54cd284\") " pod="openshift-console-operator/console-operator-7866497494-c5zg9" Jul 15 21:10:13.130118 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.129688 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-trusted-ca\") pod \"image-registry-79778fcf46-l49zk\" (UID: \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\") " pod="openshift-image-registry/image-registry-79778fcf46-l49zk" Jul 15 21:10:13.130118 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.129730 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-bound-sa-token\") pod \"image-registry-79778fcf46-l49zk\" (UID: \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\") " pod="openshift-image-registry/image-registry-79778fcf46-l49zk" Jul 15 21:10:13.130118 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.129757 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e8c2a4fd-b530-4bac-b9fa-6682ab28dde1-config-volume\") pod \"dns-default-lr4hr\" (UID: \"e8c2a4fd-b530-4bac-b9fa-6682ab28dde1\") " pod="openshift-dns/dns-default-lr4hr" Jul 15 21:10:13.130118 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.129784 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5b6d3fc4-cf24-4721-af75-6082139bc6c4-config\") pod \"service-ca-operator-7695fc6c8c-zqgn5\" (UID: \"5b6d3fc4-cf24-4721-af75-6082139bc6c4\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zqgn5" Jul 15 21:10:13.130118 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.129807 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8c2a4fd-b530-4bac-b9fa-6682ab28dde1-metrics-tls\") pod \"dns-default-lr4hr\" (UID: \"e8c2a4fd-b530-4bac-b9fa-6682ab28dde1\") " pod="openshift-dns/dns-default-lr4hr" Jul 15 21:10:13.130118 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.129823 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c4352ba-2395-4d2c-b984-1af71646d3ae-metrics-certs\") pod \"router-default-59ff8f8888-cmlk2\" (UID: \"6c4352ba-2395-4d2c-b984-1af71646d3ae\") " pod="openshift-ingress/router-default-59ff8f8888-cmlk2" Jul 15 21:10:13.130118 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.129845 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-registry-tls\") pod \"image-registry-79778fcf46-l49zk\" (UID: \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\") " pod="openshift-image-registry/image-registry-79778fcf46-l49zk" Jul 15 21:10:13.230686 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.230601 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/50d11f79-1eac-4ad4-8151-9b5dd54cd284-serving-cert\") pod \"console-operator-7866497494-c5zg9\" (UID: \"50d11f79-1eac-4ad4-8151-9b5dd54cd284\") " pod="openshift-console-operator/console-operator-7866497494-c5zg9" Jul 15 21:10:13.230686 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.230643 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-trusted-ca\") pod \"image-registry-79778fcf46-l49zk\" (UID: \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\") " pod="openshift-image-registry/image-registry-79778fcf46-l49zk" Jul 15 21:10:13.230686 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.230670 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-bound-sa-token\") pod \"image-registry-79778fcf46-l49zk\" (UID: \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\") " pod="openshift-image-registry/image-registry-79778fcf46-l49zk" Jul 15 21:10:13.230952 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.230691 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e8c2a4fd-b530-4bac-b9fa-6682ab28dde1-config-volume\") pod \"dns-default-lr4hr\" (UID: \"e8c2a4fd-b530-4bac-b9fa-6682ab28dde1\") " pod="openshift-dns/dns-default-lr4hr" Jul 15 21:10:13.230952 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.230713 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5b6d3fc4-cf24-4721-af75-6082139bc6c4-config\") pod \"service-ca-operator-7695fc6c8c-zqgn5\" (UID: \"5b6d3fc4-cf24-4721-af75-6082139bc6c4\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zqgn5" Jul 15 21:10:13.230952 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.230734 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8c2a4fd-b530-4bac-b9fa-6682ab28dde1-metrics-tls\") pod \"dns-default-lr4hr\" (UID: \"e8c2a4fd-b530-4bac-b9fa-6682ab28dde1\") " pod="openshift-dns/dns-default-lr4hr" Jul 15 21:10:13.230952 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.230759 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c4352ba-2395-4d2c-b984-1af71646d3ae-metrics-certs\") pod \"router-default-59ff8f8888-cmlk2\" (UID: \"6c4352ba-2395-4d2c-b984-1af71646d3ae\") " pod="openshift-ingress/router-default-59ff8f8888-cmlk2" Jul 15 21:10:13.230952 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.230787 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-registry-tls\") pod \"image-registry-79778fcf46-l49zk\" (UID: \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\") " pod="openshift-image-registry/image-registry-79778fcf46-l49zk" Jul 15 21:10:13.230952 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.230815 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/50d11f79-1eac-4ad4-8151-9b5dd54cd284-trusted-ca\") pod \"console-operator-7866497494-c5zg9\" (UID: \"50d11f79-1eac-4ad4-8151-9b5dd54cd284\") " pod="openshift-console-operator/console-operator-7866497494-c5zg9" Jul 15 21:10:13.230952 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.230851 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-tmgwf\" (UID: \"dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tmgwf" Jul 15 21:10:13.230952 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.230894 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-registry-certificates\") pod \"image-registry-79778fcf46-l49zk\" (UID: \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\") " pod="openshift-image-registry/image-registry-79778fcf46-l49zk" Jul 15 21:10:13.230952 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.230918 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6c4352ba-2395-4d2c-b984-1af71646d3ae-stats-auth\") pod \"router-default-59ff8f8888-cmlk2\" (UID: \"6c4352ba-2395-4d2c-b984-1af71646d3ae\") " pod="openshift-ingress/router-default-59ff8f8888-cmlk2" Jul 15 21:10:13.230952 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.230942 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hn7c\" (UniqueName: \"kubernetes.io/projected/4498916d-507d-4f9a-94d3-b9fb0b68c4aa-kube-api-access-5hn7c\") pod \"kube-storage-version-migrator-operator-799cb7f958-txm4n\" (UID: \"4498916d-507d-4f9a-94d3-b9fb0b68c4aa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-txm4n" Jul 15 21:10:13.231457 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.230981 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65k4l\" (UniqueName: \"kubernetes.io/projected/004e0571-8f51-4fb2-b25b-8946eaf65f05-kube-api-access-65k4l\") pod \"ingress-canary-8pvn9\" (UID: \"004e0571-8f51-4fb2-b25b-8946eaf65f05\") " pod="openshift-ingress-canary/ingress-canary-8pvn9" Jul 15 21:10:13.231457 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.231006 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk9cd\" (UniqueName: \"kubernetes.io/projected/e8c2a4fd-b530-4bac-b9fa-6682ab28dde1-kube-api-access-tk9cd\") pod \"dns-default-lr4hr\" (UID: \"e8c2a4fd-b530-4bac-b9fa-6682ab28dde1\") " pod="openshift-dns/dns-default-lr4hr" Jul 15 21:10:13.231457 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.231042 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7e943fc-fff4-4503-b81e-a56f9f640700-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-ghgrt\" (UID: \"e7e943fc-fff4-4503-b81e-a56f9f640700\") " pod="openshift-insights/insights-operator-68d9dd94cf-ghgrt" Jul 15 21:10:13.231457 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.231097 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcvsc\" (UniqueName: \"kubernetes.io/projected/5b6d3fc4-cf24-4721-af75-6082139bc6c4-kube-api-access-rcvsc\") pod \"service-ca-operator-7695fc6c8c-zqgn5\" (UID: \"5b6d3fc4-cf24-4721-af75-6082139bc6c4\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zqgn5" Jul 15 21:10:13.231457 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.231121 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5vp8\" (UniqueName: \"kubernetes.io/projected/e7e943fc-fff4-4503-b81e-a56f9f640700-kube-api-access-k5vp8\") pod \"insights-operator-68d9dd94cf-ghgrt\" (UID: \"e7e943fc-fff4-4503-b81e-a56f9f640700\") " pod="openshift-insights/insights-operator-68d9dd94cf-ghgrt" Jul 15 21:10:13.231457 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.231145 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7e943fc-fff4-4503-b81e-a56f9f640700-tmp\") pod \"insights-operator-68d9dd94cf-ghgrt\" (UID: \"e7e943fc-fff4-4503-b81e-a56f9f640700\") " pod="openshift-insights/insights-operator-68d9dd94cf-ghgrt" Jul 15 21:10:13.231457 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.231169 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jxsm\" (UniqueName: \"kubernetes.io/projected/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-kube-api-access-4jxsm\") pod \"image-registry-79778fcf46-l49zk\" (UID: \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\") " pod="openshift-image-registry/image-registry-79778fcf46-l49zk" Jul 15 21:10:13.231457 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.231199 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-installation-pull-secrets\") pod \"image-registry-79778fcf46-l49zk\" (UID: \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\") " pod="openshift-image-registry/image-registry-79778fcf46-l49zk" Jul 15 21:10:13.231457 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.231225 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6c4352ba-2395-4d2c-b984-1af71646d3ae-default-certificate\") pod \"router-default-59ff8f8888-cmlk2\" (UID: \"6c4352ba-2395-4d2c-b984-1af71646d3ae\") " pod="openshift-ingress/router-default-59ff8f8888-cmlk2" Jul 15 21:10:13.231457 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.231259 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2-nginx-conf\") pod \"networking-console-plugin-6cf856758c-bk2j8\" (UID: \"f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-bk2j8" Jul 15 21:10:13.231457 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.231287 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7e943fc-fff4-4503-b81e-a56f9f640700-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-ghgrt\" (UID: \"e7e943fc-fff4-4503-b81e-a56f9f640700\") " pod="openshift-insights/insights-operator-68d9dd94cf-ghgrt" Jul 15 21:10:13.231457 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.231338 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kqmk\" (UniqueName: \"kubernetes.io/projected/50d11f79-1eac-4ad4-8151-9b5dd54cd284-kube-api-access-6kqmk\") pod \"console-operator-7866497494-c5zg9\" (UID: \"50d11f79-1eac-4ad4-8151-9b5dd54cd284\") " pod="openshift-console-operator/console-operator-7866497494-c5zg9" Jul 15 21:10:13.231457 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.231368 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgwzq\" (UniqueName: \"kubernetes.io/projected/e7f566a4-c5c1-43ce-a62b-fc01ed526059-kube-api-access-fgwzq\") pod \"cluster-monitoring-operator-5f7f494dd4-qfckd\" (UID: \"e7f566a4-c5c1-43ce-a62b-fc01ed526059\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qfckd" Jul 15 21:10:13.231457 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.231400 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-ca-trust-extracted\") pod \"image-registry-79778fcf46-l49zk\" (UID: \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\") " pod="openshift-image-registry/image-registry-79778fcf46-l49zk" Jul 15 21:10:13.231457 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.231410 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e8c2a4fd-b530-4bac-b9fa-6682ab28dde1-config-volume\") pod \"dns-default-lr4hr\" (UID: \"e8c2a4fd-b530-4bac-b9fa-6682ab28dde1\") " pod="openshift-dns/dns-default-lr4hr" Jul 15 21:10:13.231457 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.231436 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn46r\" (UniqueName: \"kubernetes.io/projected/65f1d8af-0b24-4b0b-860c-bedf0546a60b-kube-api-access-gn46r\") pod \"network-check-source-869dcfcdcd-chhhx\" (UID: \"65f1d8af-0b24-4b0b-860c-bedf0546a60b\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-chhhx" Jul 15 21:10:13.232199 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.231436 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5b6d3fc4-cf24-4721-af75-6082139bc6c4-config\") pod \"service-ca-operator-7695fc6c8c-zqgn5\" (UID: \"5b6d3fc4-cf24-4721-af75-6082139bc6c4\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zqgn5" Jul 15 21:10:13.232199 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.231464 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4498916d-507d-4f9a-94d3-b9fb0b68c4aa-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-txm4n\" (UID: \"4498916d-507d-4f9a-94d3-b9fb0b68c4aa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-txm4n" Jul 15 21:10:13.232199 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.231529 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cw7lc\" (UniqueName: \"kubernetes.io/projected/53febc71-9f61-4c4b-9001-64dc254e3188-kube-api-access-cw7lc\") pod \"volume-data-source-validator-78495597f6-vk5n4\" (UID: \"53febc71-9f61-4c4b-9001-64dc254e3188\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vk5n4" Jul 15 21:10:13.232199 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.231581 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e7e943fc-fff4-4503-b81e-a56f9f640700-serving-cert\") pod \"insights-operator-68d9dd94cf-ghgrt\" (UID: \"e7e943fc-fff4-4503-b81e-a56f9f640700\") " pod="openshift-insights/insights-operator-68d9dd94cf-ghgrt" Jul 15 21:10:13.232199 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.231613 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e7f566a4-c5c1-43ce-a62b-fc01ed526059-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-qfckd\" (UID: \"e7f566a4-c5c1-43ce-a62b-fc01ed526059\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qfckd" Jul 15 21:10:13.232199 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.231645 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c4352ba-2395-4d2c-b984-1af71646d3ae-service-ca-bundle\") pod \"router-default-59ff8f8888-cmlk2\" (UID: \"6c4352ba-2395-4d2c-b984-1af71646d3ae\") " pod="openshift-ingress/router-default-59ff8f8888-cmlk2" Jul 15 21:10:13.232199 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.231673 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8c2a4fd-b530-4bac-b9fa-6682ab28dde1-tmp-dir\") pod \"dns-default-lr4hr\" (UID: \"e8c2a4fd-b530-4bac-b9fa-6682ab28dde1\") " pod="openshift-dns/dns-default-lr4hr" Jul 15 21:10:13.232199 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.231698 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4498916d-507d-4f9a-94d3-b9fb0b68c4aa-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-txm4n\" (UID: \"4498916d-507d-4f9a-94d3-b9fb0b68c4aa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-txm4n" Jul 15 21:10:13.232199 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.231727 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/50d11f79-1eac-4ad4-8151-9b5dd54cd284-config\") pod \"console-operator-7866497494-c5zg9\" (UID: \"50d11f79-1eac-4ad4-8151-9b5dd54cd284\") " pod="openshift-console-operator/console-operator-7866497494-c5zg9" Jul 15 21:10:13.232199 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.231755 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/004e0571-8f51-4fb2-b25b-8946eaf65f05-cert\") pod \"ingress-canary-8pvn9\" (UID: \"004e0571-8f51-4fb2-b25b-8946eaf65f05\") " pod="openshift-ingress-canary/ingress-canary-8pvn9" Jul 15 21:10:13.232199 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.231783 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7f566a4-c5c1-43ce-a62b-fc01ed526059-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-qfckd\" (UID: \"e7f566a4-c5c1-43ce-a62b-fc01ed526059\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qfckd" Jul 15 21:10:13.232199 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.231814 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-trusted-ca\") pod \"image-registry-79778fcf46-l49zk\" (UID: \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\") " pod="openshift-image-registry/image-registry-79778fcf46-l49zk" Jul 15 21:10:13.232199 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.231857 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm5cj\" (UniqueName: \"kubernetes.io/projected/dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5-kube-api-access-pm5cj\") pod \"cluster-samples-operator-65db858894-tmgwf\" (UID: \"dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tmgwf" Jul 15 21:10:13.232199 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.231891 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76h4h\" (UniqueName: \"kubernetes.io/projected/6c4352ba-2395-4d2c-b984-1af71646d3ae-kube-api-access-76h4h\") pod \"router-default-59ff8f8888-cmlk2\" (UID: \"6c4352ba-2395-4d2c-b984-1af71646d3ae\") " pod="openshift-ingress/router-default-59ff8f8888-cmlk2" Jul 15 21:10:13.232199 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.231945 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5b6d3fc4-cf24-4721-af75-6082139bc6c4-serving-cert\") pod \"service-ca-operator-7695fc6c8c-zqgn5\" (UID: \"5b6d3fc4-cf24-4721-af75-6082139bc6c4\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zqgn5" Jul 15 21:10:13.232199 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.231967 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/50d11f79-1eac-4ad4-8151-9b5dd54cd284-trusted-ca\") pod \"console-operator-7866497494-c5zg9\" (UID: \"50d11f79-1eac-4ad4-8151-9b5dd54cd284\") " pod="openshift-console-operator/console-operator-7866497494-c5zg9" Jul 15 21:10:13.232988 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.231978 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-image-registry-private-configuration\") pod \"image-registry-79778fcf46-l49zk\" (UID: \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\") " pod="openshift-image-registry/image-registry-79778fcf46-l49zk" Jul 15 21:10:13.232988 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.232009 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-bk2j8\" (UID: \"f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-bk2j8" Jul 15 21:10:13.232988 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:13.231551 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 21:10:13.232988 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.232052 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e7e943fc-fff4-4503-b81e-a56f9f640700-snapshots\") pod \"insights-operator-68d9dd94cf-ghgrt\" (UID: \"e7e943fc-fff4-4503-b81e-a56f9f640700\") " pod="openshift-insights/insights-operator-68d9dd94cf-ghgrt" Jul 15 21:10:13.232988 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:13.232106 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c4352ba-2395-4d2c-b984-1af71646d3ae-metrics-certs podName:6c4352ba-2395-4d2c-b984-1af71646d3ae nodeName:}" failed. No retries permitted until 2026-07-15 21:10:13.732086984 +0000 UTC m=+35.626491027 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6c4352ba-2395-4d2c-b984-1af71646d3ae-metrics-certs") pod "router-default-59ff8f8888-cmlk2" (UID: "6c4352ba-2395-4d2c-b984-1af71646d3ae") : secret "router-metrics-certs-default" not found Jul 15 21:10:13.232988 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.232241 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7e943fc-fff4-4503-b81e-a56f9f640700-tmp\") pod \"insights-operator-68d9dd94cf-ghgrt\" (UID: \"e7e943fc-fff4-4503-b81e-a56f9f640700\") " pod="openshift-insights/insights-operator-68d9dd94cf-ghgrt" Jul 15 21:10:13.232988 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.232629 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e7e943fc-fff4-4503-b81e-a56f9f640700-snapshots\") pod \"insights-operator-68d9dd94cf-ghgrt\" (UID: \"e7e943fc-fff4-4503-b81e-a56f9f640700\") " pod="openshift-insights/insights-operator-68d9dd94cf-ghgrt" Jul 15 21:10:13.232988 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:13.232698 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 21:10:13.232988 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.232697 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7e943fc-fff4-4503-b81e-a56f9f640700-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-ghgrt\" (UID: \"e7e943fc-fff4-4503-b81e-a56f9f640700\") " pod="openshift-insights/insights-operator-68d9dd94cf-ghgrt" Jul 15 21:10:13.232988 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:13.232775 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8c2a4fd-b530-4bac-b9fa-6682ab28dde1-metrics-tls podName:e8c2a4fd-b530-4bac-b9fa-6682ab28dde1 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:13.732757261 +0000 UTC m=+35.627161307 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e8c2a4fd-b530-4bac-b9fa-6682ab28dde1-metrics-tls") pod "dns-default-lr4hr" (UID: "e8c2a4fd-b530-4bac-b9fa-6682ab28dde1") : secret "dns-default-metrics-tls" not found Jul 15 21:10:13.233507 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.233441 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-ca-trust-extracted\") pod \"image-registry-79778fcf46-l49zk\" (UID: \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\") " pod="openshift-image-registry/image-registry-79778fcf46-l49zk" Jul 15 21:10:13.233913 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:13.233727 2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 21:10:13.233913 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:13.233794 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2-networking-console-plugin-cert podName:f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:13.733777241 +0000 UTC m=+35.628181285 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-bk2j8" (UID: "f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2") : secret "networking-console-plugin-cert" not found Jul 15 21:10:13.233913 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.233792 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e7f566a4-c5c1-43ce-a62b-fc01ed526059-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-qfckd\" (UID: \"e7f566a4-c5c1-43ce-a62b-fc01ed526059\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qfckd" Jul 15 21:10:13.234125 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.234060 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8c2a4fd-b530-4bac-b9fa-6682ab28dde1-tmp-dir\") pod \"dns-default-lr4hr\" (UID: \"e8c2a4fd-b530-4bac-b9fa-6682ab28dde1\") " pod="openshift-dns/dns-default-lr4hr" Jul 15 21:10:13.236749 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.234415 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-registry-certificates\") pod \"image-registry-79778fcf46-l49zk\" (UID: \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\") " pod="openshift-image-registry/image-registry-79778fcf46-l49zk" Jul 15 21:10:13.236749 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:13.234519 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6c4352ba-2395-4d2c-b984-1af71646d3ae-service-ca-bundle podName:6c4352ba-2395-4d2c-b984-1af71646d3ae nodeName:}" failed. No retries permitted until 2026-07-15 21:10:13.73450353 +0000 UTC m=+35.628907666 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6c4352ba-2395-4d2c-b984-1af71646d3ae-service-ca-bundle") pod "router-default-59ff8f8888-cmlk2" (UID: "6c4352ba-2395-4d2c-b984-1af71646d3ae") : configmap references non-existent config key: service-ca.crt Jul 15 21:10:13.236749 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:13.231769 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 21:10:13.236749 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:13.234602 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79778fcf46-l49zk: secret "image-registry-tls" not found Jul 15 21:10:13.236749 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:13.234662 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-registry-tls podName:8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a nodeName:}" failed. No retries permitted until 2026-07-15 21:10:13.734646873 +0000 UTC m=+35.629050919 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-registry-tls") pod "image-registry-79778fcf46-l49zk" (UID: "8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a") : secret "image-registry-tls" not found Jul 15 21:10:13.236749 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.235165 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2-nginx-conf\") pod \"networking-console-plugin-6cf856758c-bk2j8\" (UID: \"f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-bk2j8" Jul 15 21:10:13.236749 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.235257 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/50d11f79-1eac-4ad4-8151-9b5dd54cd284-config\") pod \"console-operator-7866497494-c5zg9\" (UID: \"50d11f79-1eac-4ad4-8151-9b5dd54cd284\") " pod="openshift-console-operator/console-operator-7866497494-c5zg9" Jul 15 21:10:13.236749 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:13.231833 2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 21:10:13.236749 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:13.235348 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5-samples-operator-tls podName:dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:13.735332675 +0000 UTC m=+35.629736718 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5-samples-operator-tls") pod "cluster-samples-operator-65db858894-tmgwf" (UID: "dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5") : secret "samples-operator-tls" not found Jul 15 21:10:13.236749 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.236185 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4498916d-507d-4f9a-94d3-b9fb0b68c4aa-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-txm4n\" (UID: \"4498916d-507d-4f9a-94d3-b9fb0b68c4aa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-txm4n" Jul 15 21:10:13.236749 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.236216 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e7e943fc-fff4-4503-b81e-a56f9f640700-serving-cert\") pod \"insights-operator-68d9dd94cf-ghgrt\" (UID: \"e7e943fc-fff4-4503-b81e-a56f9f640700\") " pod="openshift-insights/insights-operator-68d9dd94cf-ghgrt" Jul 15 21:10:13.236749 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:13.236377 2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 21:10:13.236749 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:13.236432 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7f566a4-c5c1-43ce-a62b-fc01ed526059-cluster-monitoring-operator-tls podName:e7f566a4-c5c1-43ce-a62b-fc01ed526059 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:13.736419795 +0000 UTC m=+35.630823841 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e7f566a4-c5c1-43ce-a62b-fc01ed526059-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-qfckd" (UID: "e7f566a4-c5c1-43ce-a62b-fc01ed526059") : secret "cluster-monitoring-operator-tls" not found Jul 15 21:10:13.236749 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.236619 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-image-registry-private-configuration\") pod \"image-registry-79778fcf46-l49zk\" (UID: \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\") " pod="openshift-image-registry/image-registry-79778fcf46-l49zk" Jul 15 21:10:13.236749 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.236649 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5b6d3fc4-cf24-4721-af75-6082139bc6c4-serving-cert\") pod \"service-ca-operator-7695fc6c8c-zqgn5\" (UID: \"5b6d3fc4-cf24-4721-af75-6082139bc6c4\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zqgn5" Jul 15 21:10:13.237591 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.236754 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7e943fc-fff4-4503-b81e-a56f9f640700-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-ghgrt\" (UID: \"e7e943fc-fff4-4503-b81e-a56f9f640700\") " pod="openshift-insights/insights-operator-68d9dd94cf-ghgrt" Jul 15 21:10:13.237591 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.236731 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/50d11f79-1eac-4ad4-8151-9b5dd54cd284-serving-cert\") pod \"console-operator-7866497494-c5zg9\" (UID: \"50d11f79-1eac-4ad4-8151-9b5dd54cd284\") " pod="openshift-console-operator/console-operator-7866497494-c5zg9" Jul 15 21:10:13.239034 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.239002 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6c4352ba-2395-4d2c-b984-1af71646d3ae-default-certificate\") pod \"router-default-59ff8f8888-cmlk2\" (UID: \"6c4352ba-2395-4d2c-b984-1af71646d3ae\") " pod="openshift-ingress/router-default-59ff8f8888-cmlk2" Jul 15 21:10:13.239133 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.239033 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-installation-pull-secrets\") pod \"image-registry-79778fcf46-l49zk\" (UID: \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\") " pod="openshift-image-registry/image-registry-79778fcf46-l49zk" Jul 15 21:10:13.239347 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.239329 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/004e0571-8f51-4fb2-b25b-8946eaf65f05-cert\") pod \"ingress-canary-8pvn9\" (UID: \"004e0571-8f51-4fb2-b25b-8946eaf65f05\") " pod="openshift-ingress-canary/ingress-canary-8pvn9" Jul 15 21:10:13.239392 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.239334 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4498916d-507d-4f9a-94d3-b9fb0b68c4aa-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-txm4n\" (UID: \"4498916d-507d-4f9a-94d3-b9fb0b68c4aa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-txm4n" Jul 15 21:10:13.239594 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.239574 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6c4352ba-2395-4d2c-b984-1af71646d3ae-stats-auth\") pod \"router-default-59ff8f8888-cmlk2\" (UID: \"6c4352ba-2395-4d2c-b984-1af71646d3ae\") " pod="openshift-ingress/router-default-59ff8f8888-cmlk2" Jul 15 21:10:13.260216 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.260184 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm5cj\" (UniqueName: \"kubernetes.io/projected/dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5-kube-api-access-pm5cj\") pod \"cluster-samples-operator-65db858894-tmgwf\" (UID: \"dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tmgwf" Jul 15 21:10:13.260456 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.260436 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kqmk\" (UniqueName: \"kubernetes.io/projected/50d11f79-1eac-4ad4-8151-9b5dd54cd284-kube-api-access-6kqmk\") pod \"console-operator-7866497494-c5zg9\" (UID: \"50d11f79-1eac-4ad4-8151-9b5dd54cd284\") " pod="openshift-console-operator/console-operator-7866497494-c5zg9" Jul 15 21:10:13.260681 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.260630 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-bound-sa-token\") pod \"image-registry-79778fcf46-l49zk\" (UID: \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\") " pod="openshift-image-registry/image-registry-79778fcf46-l49zk" Jul 15 21:10:13.261283 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.261237 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcvsc\" (UniqueName: \"kubernetes.io/projected/5b6d3fc4-cf24-4721-af75-6082139bc6c4-kube-api-access-rcvsc\") pod \"service-ca-operator-7695fc6c8c-zqgn5\" (UID: \"5b6d3fc4-cf24-4721-af75-6082139bc6c4\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zqgn5" Jul 15 21:10:13.262016 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.261426 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76h4h\" (UniqueName: \"kubernetes.io/projected/6c4352ba-2395-4d2c-b984-1af71646d3ae-kube-api-access-76h4h\") pod \"router-default-59ff8f8888-cmlk2\" (UID: \"6c4352ba-2395-4d2c-b984-1af71646d3ae\") " pod="openshift-ingress/router-default-59ff8f8888-cmlk2" Jul 15 21:10:13.262016 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.261977 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5vp8\" (UniqueName: \"kubernetes.io/projected/e7e943fc-fff4-4503-b81e-a56f9f640700-kube-api-access-k5vp8\") pod \"insights-operator-68d9dd94cf-ghgrt\" (UID: \"e7e943fc-fff4-4503-b81e-a56f9f640700\") " pod="openshift-insights/insights-operator-68d9dd94cf-ghgrt" Jul 15 21:10:13.262322 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.262198 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65k4l\" (UniqueName: \"kubernetes.io/projected/004e0571-8f51-4fb2-b25b-8946eaf65f05-kube-api-access-65k4l\") pod \"ingress-canary-8pvn9\" (UID: \"004e0571-8f51-4fb2-b25b-8946eaf65f05\") " pod="openshift-ingress-canary/ingress-canary-8pvn9" Jul 15 21:10:13.263581 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.263553 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk9cd\" (UniqueName: \"kubernetes.io/projected/e8c2a4fd-b530-4bac-b9fa-6682ab28dde1-kube-api-access-tk9cd\") pod \"dns-default-lr4hr\" (UID: \"e8c2a4fd-b530-4bac-b9fa-6682ab28dde1\") " pod="openshift-dns/dns-default-lr4hr" Jul 15 21:10:13.263977 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.263958 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hn7c\" (UniqueName: \"kubernetes.io/projected/4498916d-507d-4f9a-94d3-b9fb0b68c4aa-kube-api-access-5hn7c\") pod \"kube-storage-version-migrator-operator-799cb7f958-txm4n\" (UID: \"4498916d-507d-4f9a-94d3-b9fb0b68c4aa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-txm4n" Jul 15 21:10:13.264405 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.264388 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw7lc\" (UniqueName: \"kubernetes.io/projected/53febc71-9f61-4c4b-9001-64dc254e3188-kube-api-access-cw7lc\") pod \"volume-data-source-validator-78495597f6-vk5n4\" (UID: \"53febc71-9f61-4c4b-9001-64dc254e3188\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vk5n4" Jul 15 21:10:13.265526 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.265506 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn46r\" (UniqueName: \"kubernetes.io/projected/65f1d8af-0b24-4b0b-860c-bedf0546a60b-kube-api-access-gn46r\") pod \"network-check-source-869dcfcdcd-chhhx\" (UID: \"65f1d8af-0b24-4b0b-860c-bedf0546a60b\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-chhhx" Jul 15 21:10:13.266167 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.266139 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgwzq\" (UniqueName: \"kubernetes.io/projected/e7f566a4-c5c1-43ce-a62b-fc01ed526059-kube-api-access-fgwzq\") pod \"cluster-monitoring-operator-5f7f494dd4-qfckd\" (UID: \"e7f566a4-c5c1-43ce-a62b-fc01ed526059\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qfckd" Jul 15 21:10:13.268579 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.268535 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jxsm\" (UniqueName: \"kubernetes.io/projected/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-kube-api-access-4jxsm\") pod \"image-registry-79778fcf46-l49zk\" (UID: \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\") " pod="openshift-image-registry/image-registry-79778fcf46-l49zk" Jul 15 21:10:13.275566 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.275545 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zqgn5" Jul 15 21:10:13.293958 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.293931 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-txm4n" Jul 15 21:10:13.310933 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.310911 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-c5zg9" Jul 15 21:10:13.326013 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.325989 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-ghgrt" Jul 15 21:10:13.353607 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.353583 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8pvn9" Jul 15 21:10:13.360348 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.360329 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-chhhx" Jul 15 21:10:13.557516 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.557434 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vk5n4" Jul 15 21:10:13.583845 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.583788 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89vwd" Jul 15 21:10:13.584041 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.583806 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6p5nk" Jul 15 21:10:13.584041 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.583806 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8c5ks" Jul 15 21:10:13.586529 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.586505 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 21:10:13.586647 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.586527 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f2pnr\"" Jul 15 21:10:13.586647 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.586571 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s56kw\"" Jul 15 21:10:13.586647 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.586532 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 21:10:13.738897 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.737448 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c4352ba-2395-4d2c-b984-1af71646d3ae-service-ca-bundle\") pod \"router-default-59ff8f8888-cmlk2\" (UID: \"6c4352ba-2395-4d2c-b984-1af71646d3ae\") " pod="openshift-ingress/router-default-59ff8f8888-cmlk2" Jul 15 21:10:13.738897 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.737737 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7f566a4-c5c1-43ce-a62b-fc01ed526059-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-qfckd\" (UID: \"e7f566a4-c5c1-43ce-a62b-fc01ed526059\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qfckd" Jul 15 21:10:13.738897 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.737801 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-bk2j8\" (UID: \"f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-bk2j8" Jul 15 21:10:13.738897 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.737840 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8c2a4fd-b530-4bac-b9fa-6682ab28dde1-metrics-tls\") pod \"dns-default-lr4hr\" (UID: \"e8c2a4fd-b530-4bac-b9fa-6682ab28dde1\") " pod="openshift-dns/dns-default-lr4hr" Jul 15 21:10:13.738897 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.737877 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c4352ba-2395-4d2c-b984-1af71646d3ae-metrics-certs\") pod \"router-default-59ff8f8888-cmlk2\" (UID: \"6c4352ba-2395-4d2c-b984-1af71646d3ae\") " pod="openshift-ingress/router-default-59ff8f8888-cmlk2" Jul 15 21:10:13.738897 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.737905 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-registry-tls\") pod \"image-registry-79778fcf46-l49zk\" (UID: \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\") " pod="openshift-image-registry/image-registry-79778fcf46-l49zk" Jul 15 21:10:13.738897 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.737936 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-tmgwf\" (UID: \"dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tmgwf" Jul 15 21:10:13.738897 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:13.738134 2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 21:10:13.738897 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:13.738191 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5-samples-operator-tls podName:dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:14.738172904 +0000 UTC m=+36.632576966 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5-samples-operator-tls") pod "cluster-samples-operator-65db858894-tmgwf" (UID: "dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5") : secret "samples-operator-tls" not found Jul 15 21:10:13.738897 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:13.738409 2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 21:10:13.738897 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:13.738467 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2-networking-console-plugin-cert podName:f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:14.73844879 +0000 UTC m=+36.632852833 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-bk2j8" (UID: "f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2") : secret "networking-console-plugin-cert" not found Jul 15 21:10:13.738897 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:13.738539 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6c4352ba-2395-4d2c-b984-1af71646d3ae-service-ca-bundle podName:6c4352ba-2395-4d2c-b984-1af71646d3ae nodeName:}" failed. No retries permitted until 2026-07-15 21:10:14.738528534 +0000 UTC m=+36.632932577 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6c4352ba-2395-4d2c-b984-1af71646d3ae-service-ca-bundle") pod "router-default-59ff8f8888-cmlk2" (UID: "6c4352ba-2395-4d2c-b984-1af71646d3ae") : configmap references non-existent config key: service-ca.crt Jul 15 21:10:13.738897 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:13.738598 2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 21:10:13.738897 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:13.738607 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 21:10:13.738897 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:13.738631 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7f566a4-c5c1-43ce-a62b-fc01ed526059-cluster-monitoring-operator-tls podName:e7f566a4-c5c1-43ce-a62b-fc01ed526059 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:14.738620724 +0000 UTC m=+36.633024771 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e7f566a4-c5c1-43ce-a62b-fc01ed526059-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-qfckd" (UID: "e7f566a4-c5c1-43ce-a62b-fc01ed526059") : secret "cluster-monitoring-operator-tls" not found Jul 15 21:10:13.739544 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:13.738650 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8c2a4fd-b530-4bac-b9fa-6682ab28dde1-metrics-tls podName:e8c2a4fd-b530-4bac-b9fa-6682ab28dde1 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:14.738637104 +0000 UTC m=+36.633041147 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e8c2a4fd-b530-4bac-b9fa-6682ab28dde1-metrics-tls") pod "dns-default-lr4hr" (UID: "e8c2a4fd-b530-4bac-b9fa-6682ab28dde1") : secret "dns-default-metrics-tls" not found Jul 15 21:10:13.739544 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:13.738709 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 21:10:13.739544 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:13.738741 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c4352ba-2395-4d2c-b984-1af71646d3ae-metrics-certs podName:6c4352ba-2395-4d2c-b984-1af71646d3ae nodeName:}" failed. No retries permitted until 2026-07-15 21:10:14.738730776 +0000 UTC m=+36.633134835 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6c4352ba-2395-4d2c-b984-1af71646d3ae-metrics-certs") pod "router-default-59ff8f8888-cmlk2" (UID: "6c4352ba-2395-4d2c-b984-1af71646d3ae") : secret "router-metrics-certs-default" not found Jul 15 21:10:13.739544 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:13.738802 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 21:10:13.739544 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:13.738813 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79778fcf46-l49zk: secret "image-registry-tls" not found Jul 15 21:10:13.739544 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:13.738847 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-registry-tls podName:8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a nodeName:}" failed. No retries permitted until 2026-07-15 21:10:14.738834759 +0000 UTC m=+36.633238803 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-registry-tls") pod "image-registry-79778fcf46-l49zk" (UID: "8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a") : secret "image-registry-tls" not found Jul 15 21:10:13.966770 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.966741 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-chhhx"] Jul 15 21:10:13.973109 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.973042 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-txm4n"] Jul 15 21:10:13.978706 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.978678 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zqgn5"] Jul 15 21:10:13.984122 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.984099 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vk5n4"] Jul 15 21:10:13.987422 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.987400 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8pvn9"] Jul 15 21:10:13.988486 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.988466 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-c5zg9"] Jul 15 21:10:13.991269 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:13.991248 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-ghgrt"] Jul 15 21:10:13.995009 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:10:13.994971 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7e943fc_fff4_4503_b81e_a56f9f640700.slice/crio-52972e4540a8b3dd7ba662afbf12333ac3280822ee3e576751b935586e9ee6ba WatchSource:0}: Error finding container 52972e4540a8b3dd7ba662afbf12333ac3280822ee3e576751b935586e9ee6ba: Status 404 returned error can't find the container with id 52972e4540a8b3dd7ba662afbf12333ac3280822ee3e576751b935586e9ee6ba Jul 15 21:10:13.995656 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:10:13.995622 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50d11f79_1eac_4ad4_8151_9b5dd54cd284.slice/crio-f3c1631b758af4f9e25c543bac56c725d494e66ac1102f50f9baf5a20e47494b WatchSource:0}: Error finding container f3c1631b758af4f9e25c543bac56c725d494e66ac1102f50f9baf5a20e47494b: Status 404 returned error can't find the container with id f3c1631b758af4f9e25c543bac56c725d494e66ac1102f50f9baf5a20e47494b Jul 15 21:10:13.996868 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:10:13.996833 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod004e0571_8f51_4fb2_b25b_8946eaf65f05.slice/crio-70fdc377af0c67d21eb4f957e1dde9c5eec99021cfdc7a8c847e23aa93bf8ea4 WatchSource:0}: Error finding container 70fdc377af0c67d21eb4f957e1dde9c5eec99021cfdc7a8c847e23aa93bf8ea4: Status 404 returned error can't find the container with id 70fdc377af0c67d21eb4f957e1dde9c5eec99021cfdc7a8c847e23aa93bf8ea4 Jul 15 21:10:14.001918 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:10:14.001730 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b6d3fc4_cf24_4721_af75_6082139bc6c4.slice/crio-64147b3c9e25b99fdd684db89417ecdee76310d2687e2d50cf359ff3fe0bba27 WatchSource:0}: Error finding container 64147b3c9e25b99fdd684db89417ecdee76310d2687e2d50cf359ff3fe0bba27: Status 404 returned error can't find the container with id 64147b3c9e25b99fdd684db89417ecdee76310d2687e2d50cf359ff3fe0bba27 Jul 15 21:10:14.002578 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:10:14.002509 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53febc71_9f61_4c4b_9001_64dc254e3188.slice/crio-26008ddd64ef0bc6a571ec4a1cf8b2ae8c6b62cbc88638bc007d9dc4c6ce0c06 WatchSource:0}: Error finding container 26008ddd64ef0bc6a571ec4a1cf8b2ae8c6b62cbc88638bc007d9dc4c6ce0c06: Status 404 returned error can't find the container with id 26008ddd64ef0bc6a571ec4a1cf8b2ae8c6b62cbc88638bc007d9dc4c6ce0c06 Jul 15 21:10:14.759504 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:14.759468 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c4352ba-2395-4d2c-b984-1af71646d3ae-service-ca-bundle\") pod \"router-default-59ff8f8888-cmlk2\" (UID: \"6c4352ba-2395-4d2c-b984-1af71646d3ae\") " pod="openshift-ingress/router-default-59ff8f8888-cmlk2" Jul 15 21:10:14.759681 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:14.759526 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7f566a4-c5c1-43ce-a62b-fc01ed526059-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-qfckd\" (UID: \"e7f566a4-c5c1-43ce-a62b-fc01ed526059\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qfckd" Jul 15 21:10:14.759681 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:14.759569 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-bk2j8\" (UID: \"f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-bk2j8" Jul 15 21:10:14.759681 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:14.759607 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8c2a4fd-b530-4bac-b9fa-6682ab28dde1-metrics-tls\") pod \"dns-default-lr4hr\" (UID: \"e8c2a4fd-b530-4bac-b9fa-6682ab28dde1\") " pod="openshift-dns/dns-default-lr4hr" Jul 15 21:10:14.759681 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:14.759632 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c4352ba-2395-4d2c-b984-1af71646d3ae-metrics-certs\") pod \"router-default-59ff8f8888-cmlk2\" (UID: \"6c4352ba-2395-4d2c-b984-1af71646d3ae\") " pod="openshift-ingress/router-default-59ff8f8888-cmlk2" Jul 15 21:10:14.759681 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:14.759659 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-registry-tls\") pod \"image-registry-79778fcf46-l49zk\" (UID: \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\") " pod="openshift-image-registry/image-registry-79778fcf46-l49zk" Jul 15 21:10:14.760018 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:14.759700 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-tmgwf\" (UID: \"dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tmgwf" Jul 15 21:10:14.760018 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:14.759927 2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 21:10:14.760018 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:14.759989 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5-samples-operator-tls podName:dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:16.759971215 +0000 UTC m=+38.654375264 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5-samples-operator-tls") pod "cluster-samples-operator-65db858894-tmgwf" (UID: "dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5") : secret "samples-operator-tls" not found Jul 15 21:10:14.760442 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:14.760422 2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 21:10:14.760539 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:14.760476 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2-networking-console-plugin-cert podName:f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:16.760462258 +0000 UTC m=+38.654866303 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-bk2j8" (UID: "f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2") : secret "networking-console-plugin-cert" not found Jul 15 21:10:14.760539 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:14.760480 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 21:10:14.760539 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:14.760494 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79778fcf46-l49zk: secret "image-registry-tls" not found Jul 15 21:10:14.760539 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:14.760529 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-registry-tls podName:8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a nodeName:}" failed. No retries permitted until 2026-07-15 21:10:16.760518099 +0000 UTC m=+38.654922147 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-registry-tls") pod "image-registry-79778fcf46-l49zk" (UID: "8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a") : secret "image-registry-tls" not found Jul 15 21:10:14.760539 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:14.760422 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 21:10:14.760787 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:14.760560 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8c2a4fd-b530-4bac-b9fa-6682ab28dde1-metrics-tls podName:e8c2a4fd-b530-4bac-b9fa-6682ab28dde1 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:16.760551136 +0000 UTC m=+38.654955184 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e8c2a4fd-b530-4bac-b9fa-6682ab28dde1-metrics-tls") pod "dns-default-lr4hr" (UID: "e8c2a4fd-b530-4bac-b9fa-6682ab28dde1") : secret "dns-default-metrics-tls" not found Jul 15 21:10:14.760787 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:14.760575 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6c4352ba-2395-4d2c-b984-1af71646d3ae-service-ca-bundle podName:6c4352ba-2395-4d2c-b984-1af71646d3ae nodeName:}" failed. No retries permitted until 2026-07-15 21:10:16.760567102 +0000 UTC m=+38.654971152 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6c4352ba-2395-4d2c-b984-1af71646d3ae-service-ca-bundle") pod "router-default-59ff8f8888-cmlk2" (UID: "6c4352ba-2395-4d2c-b984-1af71646d3ae") : configmap references non-existent config key: service-ca.crt Jul 15 21:10:14.760787 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:14.760531 2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 21:10:14.760787 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:14.760600 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 21:10:14.760787 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:14.760604 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7f566a4-c5c1-43ce-a62b-fc01ed526059-cluster-monitoring-operator-tls podName:e7f566a4-c5c1-43ce-a62b-fc01ed526059 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:16.760596652 +0000 UTC m=+38.655000698 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e7f566a4-c5c1-43ce-a62b-fc01ed526059-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-qfckd" (UID: "e7f566a4-c5c1-43ce-a62b-fc01ed526059") : secret "cluster-monitoring-operator-tls" not found Jul 15 21:10:14.760787 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:14.760629 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c4352ba-2395-4d2c-b984-1af71646d3ae-metrics-certs podName:6c4352ba-2395-4d2c-b984-1af71646d3ae nodeName:}" failed. No retries permitted until 2026-07-15 21:10:16.760620469 +0000 UTC m=+38.655024524 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6c4352ba-2395-4d2c-b984-1af71646d3ae-metrics-certs") pod "router-default-59ff8f8888-cmlk2" (UID: "6c4352ba-2395-4d2c-b984-1af71646d3ae") : secret "router-metrics-certs-default" not found Jul 15 21:10:14.767433 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:14.767404 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-txm4n" event={"ID":"4498916d-507d-4f9a-94d3-b9fb0b68c4aa","Type":"ContainerStarted","Data":"3d50c296043110fc45193bf00f5b9e7859828af02873d3ed7085d4ecb9843537"} Jul 15 21:10:14.770632 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:14.770607 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-chhhx" event={"ID":"65f1d8af-0b24-4b0b-860c-bedf0546a60b","Type":"ContainerStarted","Data":"d4fe770948d03ce159ddf19e4345e005573bdddfd1e87b9c158ca0a609d79f20"} Jul 15 21:10:14.773256 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:14.773191 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-ghgrt" event={"ID":"e7e943fc-fff4-4503-b81e-a56f9f640700","Type":"ContainerStarted","Data":"52972e4540a8b3dd7ba662afbf12333ac3280822ee3e576751b935586e9ee6ba"} Jul 15 21:10:14.775137 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:14.775074 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zqgn5" event={"ID":"5b6d3fc4-cf24-4721-af75-6082139bc6c4","Type":"ContainerStarted","Data":"64147b3c9e25b99fdd684db89417ecdee76310d2687e2d50cf359ff3fe0bba27"} Jul 15 21:10:14.781822 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:14.780822 2570 generic.go:356] "Generic (PLEG): container finished" podID="e89cab18-de44-40e2-9486-0446676f8942" containerID="d2c6944f587a8cd156a2bfb38f62be6181ea404005ae96f02361b5db57e30669" exitCode=0 Jul 15 21:10:14.781822 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:14.780903 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k25xr" event={"ID":"e89cab18-de44-40e2-9486-0446676f8942","Type":"ContainerDied","Data":"d2c6944f587a8cd156a2bfb38f62be6181ea404005ae96f02361b5db57e30669"} Jul 15 21:10:14.785115 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:14.785050 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8pvn9" event={"ID":"004e0571-8f51-4fb2-b25b-8946eaf65f05","Type":"ContainerStarted","Data":"70fdc377af0c67d21eb4f957e1dde9c5eec99021cfdc7a8c847e23aa93bf8ea4"} Jul 15 21:10:14.797233 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:14.797172 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-c5zg9" event={"ID":"50d11f79-1eac-4ad4-8151-9b5dd54cd284","Type":"ContainerStarted","Data":"f3c1631b758af4f9e25c543bac56c725d494e66ac1102f50f9baf5a20e47494b"} Jul 15 21:10:14.802415 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:14.802343 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vk5n4" event={"ID":"53febc71-9f61-4c4b-9001-64dc254e3188","Type":"ContainerStarted","Data":"26008ddd64ef0bc6a571ec4a1cf8b2ae8c6b62cbc88638bc007d9dc4c6ce0c06"} Jul 15 21:10:15.814405 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:15.814153 2570 generic.go:356] "Generic (PLEG): container finished" podID="e89cab18-de44-40e2-9486-0446676f8942" containerID="285e698a46b868b285c851f10297dcbbfbba484e7e91ef9ad6f5cc23015642dd" exitCode=0 Jul 15 21:10:15.814847 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:15.814466 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k25xr" event={"ID":"e89cab18-de44-40e2-9486-0446676f8942","Type":"ContainerDied","Data":"285e698a46b868b285c851f10297dcbbfbba484e7e91ef9ad6f5cc23015642dd"} Jul 15 21:10:16.783401 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:16.783361 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-registry-tls\") pod \"image-registry-79778fcf46-l49zk\" (UID: \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\") " pod="openshift-image-registry/image-registry-79778fcf46-l49zk" Jul 15 21:10:16.783589 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:16.783415 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-tmgwf\" (UID: \"dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tmgwf" Jul 15 21:10:16.783589 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:16.783528 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 21:10:16.783589 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:16.783553 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79778fcf46-l49zk: secret "image-registry-tls" not found Jul 15 21:10:16.783717 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:16.783537 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c4352ba-2395-4d2c-b984-1af71646d3ae-service-ca-bundle\") pod \"router-default-59ff8f8888-cmlk2\" (UID: \"6c4352ba-2395-4d2c-b984-1af71646d3ae\") " pod="openshift-ingress/router-default-59ff8f8888-cmlk2" Jul 15 21:10:16.783717 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:16.783601 2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 21:10:16.783717 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:16.783618 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-registry-tls podName:8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a nodeName:}" failed. No retries permitted until 2026-07-15 21:10:20.783596712 +0000 UTC m=+42.678000776 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-registry-tls") pod "image-registry-79778fcf46-l49zk" (UID: "8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a") : secret "image-registry-tls" not found Jul 15 21:10:16.783717 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:16.783702 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6c4352ba-2395-4d2c-b984-1af71646d3ae-service-ca-bundle podName:6c4352ba-2395-4d2c-b984-1af71646d3ae nodeName:}" failed. No retries permitted until 2026-07-15 21:10:20.783681407 +0000 UTC m=+42.678085466 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6c4352ba-2395-4d2c-b984-1af71646d3ae-service-ca-bundle") pod "router-default-59ff8f8888-cmlk2" (UID: "6c4352ba-2395-4d2c-b984-1af71646d3ae") : configmap references non-existent config key: service-ca.crt Jul 15 21:10:16.783884 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:16.783729 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5-samples-operator-tls podName:dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:20.783719249 +0000 UTC m=+42.678123307 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5-samples-operator-tls") pod "cluster-samples-operator-65db858894-tmgwf" (UID: "dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5") : secret "samples-operator-tls" not found Jul 15 21:10:16.783884 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:16.783774 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7f566a4-c5c1-43ce-a62b-fc01ed526059-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-qfckd\" (UID: \"e7f566a4-c5c1-43ce-a62b-fc01ed526059\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qfckd" Jul 15 21:10:16.783884 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:16.783825 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-bk2j8\" (UID: \"f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-bk2j8" Jul 15 21:10:16.783884 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:16.783865 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8c2a4fd-b530-4bac-b9fa-6682ab28dde1-metrics-tls\") pod \"dns-default-lr4hr\" (UID: \"e8c2a4fd-b530-4bac-b9fa-6682ab28dde1\") " pod="openshift-dns/dns-default-lr4hr" Jul 15 21:10:16.784057 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:16.783889 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c4352ba-2395-4d2c-b984-1af71646d3ae-metrics-certs\") pod \"router-default-59ff8f8888-cmlk2\" (UID: \"6c4352ba-2395-4d2c-b984-1af71646d3ae\") " pod="openshift-ingress/router-default-59ff8f8888-cmlk2" Jul 15 21:10:16.784057 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:16.783961 2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 21:10:16.784057 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:16.783995 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 21:10:16.784057 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:16.784002 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2-networking-console-plugin-cert podName:f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:20.78398834 +0000 UTC m=+42.678392409 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-bk2j8" (UID: "f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2") : secret "networking-console-plugin-cert" not found Jul 15 21:10:16.784057 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:16.784036 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c4352ba-2395-4d2c-b984-1af71646d3ae-metrics-certs podName:6c4352ba-2395-4d2c-b984-1af71646d3ae nodeName:}" failed. No retries permitted until 2026-07-15 21:10:20.784025254 +0000 UTC m=+42.678429303 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6c4352ba-2395-4d2c-b984-1af71646d3ae-metrics-certs") pod "router-default-59ff8f8888-cmlk2" (UID: "6c4352ba-2395-4d2c-b984-1af71646d3ae") : secret "router-metrics-certs-default" not found Jul 15 21:10:16.784057 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:16.784053 2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 21:10:16.784272 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:16.784078 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7f566a4-c5c1-43ce-a62b-fc01ed526059-cluster-monitoring-operator-tls podName:e7f566a4-c5c1-43ce-a62b-fc01ed526059 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:20.784070725 +0000 UTC m=+42.678474768 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e7f566a4-c5c1-43ce-a62b-fc01ed526059-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-qfckd" (UID: "e7f566a4-c5c1-43ce-a62b-fc01ed526059") : secret "cluster-monitoring-operator-tls" not found Jul 15 21:10:16.784272 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:16.784098 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 21:10:16.784272 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:16.784126 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8c2a4fd-b530-4bac-b9fa-6682ab28dde1-metrics-tls podName:e8c2a4fd-b530-4bac-b9fa-6682ab28dde1 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:20.784116808 +0000 UTC m=+42.678520852 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e8c2a4fd-b530-4bac-b9fa-6682ab28dde1-metrics-tls") pod "dns-default-lr4hr" (UID: "e8c2a4fd-b530-4bac-b9fa-6682ab28dde1") : secret "dns-default-metrics-tls" not found Jul 15 21:10:16.822778 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:16.822740 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k25xr" event={"ID":"e89cab18-de44-40e2-9486-0446676f8942","Type":"ContainerStarted","Data":"cf6281b2c6b6fae4d7c467ff7602bf6f6cf3aef4fd6774b42d82eb8c2aecec54"} Jul 15 21:10:16.825759 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:16.825728 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vk5n4" event={"ID":"53febc71-9f61-4c4b-9001-64dc254e3188","Type":"ContainerStarted","Data":"d5211681de478360d5c2e8406e9bbe2fcee94476605388a32d400627cde50572"} Jul 15 21:10:16.850932 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:16.850875 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-k25xr" podStartSLOduration=8.897603092 podStartE2EDuration="38.850856585s" totalImagesPullingTime="29.953253493s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:09:38 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:16.849410492 +0000 UTC m=+38.743814785" watchObservedRunningTime="2026-07-15 21:10:16.850856585 +0000 UTC m=+38.745260655" Jul 15 21:10:16.867227 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:16.866999 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vk5n4" podStartSLOduration=26.757331339 podStartE2EDuration="28.866979322s" totalImagesPullingTime="2.109647983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:09:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:16.866050672 +0000 UTC m=+38.760454740" watchObservedRunningTime="2026-07-15 21:10:16.866979322 +0000 UTC m=+38.761383386" Jul 15 21:10:20.825620 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:20.825575 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c4352ba-2395-4d2c-b984-1af71646d3ae-service-ca-bundle\") pod \"router-default-59ff8f8888-cmlk2\" (UID: \"6c4352ba-2395-4d2c-b984-1af71646d3ae\") " pod="openshift-ingress/router-default-59ff8f8888-cmlk2" Jul 15 21:10:20.826279 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:20.825640 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7f566a4-c5c1-43ce-a62b-fc01ed526059-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-qfckd\" (UID: \"e7f566a4-c5c1-43ce-a62b-fc01ed526059\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qfckd" Jul 15 21:10:20.826279 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:20.825681 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-bk2j8\" (UID: \"f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-bk2j8" Jul 15 21:10:20.826279 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:20.825710 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8c2a4fd-b530-4bac-b9fa-6682ab28dde1-metrics-tls\") pod \"dns-default-lr4hr\" (UID: \"e8c2a4fd-b530-4bac-b9fa-6682ab28dde1\") " pod="openshift-dns/dns-default-lr4hr" Jul 15 21:10:20.826279 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:20.825755 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c4352ba-2395-4d2c-b984-1af71646d3ae-metrics-certs\") pod \"router-default-59ff8f8888-cmlk2\" (UID: \"6c4352ba-2395-4d2c-b984-1af71646d3ae\") " pod="openshift-ingress/router-default-59ff8f8888-cmlk2" Jul 15 21:10:20.826279 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:20.825789 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6c4352ba-2395-4d2c-b984-1af71646d3ae-service-ca-bundle podName:6c4352ba-2395-4d2c-b984-1af71646d3ae nodeName:}" failed. No retries permitted until 2026-07-15 21:10:28.825761761 +0000 UTC m=+50.720165814 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6c4352ba-2395-4d2c-b984-1af71646d3ae-service-ca-bundle") pod "router-default-59ff8f8888-cmlk2" (UID: "6c4352ba-2395-4d2c-b984-1af71646d3ae") : configmap references non-existent config key: service-ca.crt Jul 15 21:10:20.826279 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:20.825815 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 21:10:20.826279 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:20.825827 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 21:10:20.826279 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:20.825846 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-registry-tls\") pod \"image-registry-79778fcf46-l49zk\" (UID: \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\") " pod="openshift-image-registry/image-registry-79778fcf46-l49zk" Jul 15 21:10:20.826279 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:20.825863 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c4352ba-2395-4d2c-b984-1af71646d3ae-metrics-certs podName:6c4352ba-2395-4d2c-b984-1af71646d3ae nodeName:}" failed. No retries permitted until 2026-07-15 21:10:28.825848069 +0000 UTC m=+50.720252121 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6c4352ba-2395-4d2c-b984-1af71646d3ae-metrics-certs") pod "router-default-59ff8f8888-cmlk2" (UID: "6c4352ba-2395-4d2c-b984-1af71646d3ae") : secret "router-metrics-certs-default" not found Jul 15 21:10:20.826279 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:20.825884 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8c2a4fd-b530-4bac-b9fa-6682ab28dde1-metrics-tls podName:e8c2a4fd-b530-4bac-b9fa-6682ab28dde1 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:28.825875393 +0000 UTC m=+50.720279451 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e8c2a4fd-b530-4bac-b9fa-6682ab28dde1-metrics-tls") pod "dns-default-lr4hr" (UID: "e8c2a4fd-b530-4bac-b9fa-6682ab28dde1") : secret "dns-default-metrics-tls" not found Jul 15 21:10:20.826279 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:20.825884 2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 21:10:20.826279 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:20.825914 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 21:10:20.826279 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:20.825914 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-tmgwf\" (UID: \"dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tmgwf" Jul 15 21:10:20.826279 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:20.825923 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79778fcf46-l49zk: secret "image-registry-tls" not found Jul 15 21:10:20.826279 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:20.825891 2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 21:10:20.826279 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:20.825945 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2-networking-console-plugin-cert podName:f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:28.82593038 +0000 UTC m=+50.720334434 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-bk2j8" (UID: "f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2") : secret "networking-console-plugin-cert" not found Jul 15 21:10:20.826279 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:20.825966 2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 21:10:20.827322 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:20.825993 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5-samples-operator-tls podName:dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:28.825986985 +0000 UTC m=+50.720391032 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5-samples-operator-tls") pod "cluster-samples-operator-65db858894-tmgwf" (UID: "dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5") : secret "samples-operator-tls" not found Jul 15 21:10:20.827322 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:20.826010 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-registry-tls podName:8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a nodeName:}" failed. No retries permitted until 2026-07-15 21:10:28.826005292 +0000 UTC m=+50.720409336 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-registry-tls") pod "image-registry-79778fcf46-l49zk" (UID: "8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a") : secret "image-registry-tls" not found Jul 15 21:10:20.827322 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:20.826033 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7f566a4-c5c1-43ce-a62b-fc01ed526059-cluster-monitoring-operator-tls podName:e7f566a4-c5c1-43ce-a62b-fc01ed526059 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:28.826024425 +0000 UTC m=+50.720428710 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e7f566a4-c5c1-43ce-a62b-fc01ed526059-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-qfckd" (UID: "e7f566a4-c5c1-43ce-a62b-fc01ed526059") : secret "cluster-monitoring-operator-tls" not found Jul 15 21:10:21.844105 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:21.843028 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8pvn9" event={"ID":"004e0571-8f51-4fb2-b25b-8946eaf65f05","Type":"ContainerStarted","Data":"7b68561fa21c92e5be878136ad684dfd0c6d99d419f5a35eadde097e0d6b0eaf"} Jul 15 21:10:21.846356 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:21.845691 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c5zg9_50d11f79-1eac-4ad4-8151-9b5dd54cd284/console-operator/0.log" Jul 15 21:10:21.846356 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:21.845726 2570 generic.go:356] "Generic (PLEG): container finished" podID="50d11f79-1eac-4ad4-8151-9b5dd54cd284" containerID="f2f0780805c80f92b78b7ff83e1cb50603e9beb2f5c76bc2441f6e781d8af4c1" exitCode=255 Jul 15 21:10:21.846356 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:21.845794 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-c5zg9" event={"ID":"50d11f79-1eac-4ad4-8151-9b5dd54cd284","Type":"ContainerDied","Data":"f2f0780805c80f92b78b7ff83e1cb50603e9beb2f5c76bc2441f6e781d8af4c1"} Jul 15 21:10:21.846356 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:21.846084 2570 scope.go:117] "RemoveContainer" containerID="f2f0780805c80f92b78b7ff83e1cb50603e9beb2f5c76bc2441f6e781d8af4c1" Jul 15 21:10:21.853746 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:21.853129 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-txm4n" event={"ID":"4498916d-507d-4f9a-94d3-b9fb0b68c4aa","Type":"ContainerStarted","Data":"049c0c0bf1e4a1ca1085532c5d192427e66579997049c947565e7a7bbac297d9"} Jul 15 21:10:21.855678 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:21.855258 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-chhhx" event={"ID":"65f1d8af-0b24-4b0b-860c-bedf0546a60b","Type":"ContainerStarted","Data":"c291e37f21e7bc81d07fdf24d051fec76b445f79669071cc526470b0ca35c689"} Jul 15 21:10:21.857104 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:21.857052 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-ghgrt" event={"ID":"e7e943fc-fff4-4503-b81e-a56f9f640700","Type":"ContainerStarted","Data":"66d6659753da646b80a24d2a57ade6a78d5d2e436de570af247dc5d7a76d02e8"} Jul 15 21:10:21.859958 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:21.858933 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zqgn5" event={"ID":"5b6d3fc4-cf24-4721-af75-6082139bc6c4","Type":"ContainerStarted","Data":"68c804a08d02ae7bcc55c80c2ef3773c26304c838d43779aa7bcf18a28b3a293"} Jul 15 21:10:21.894374 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:21.893646 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-txm4n" podStartSLOduration=26.392602625 podStartE2EDuration="33.893625369s" totalImagesPullingTime="7.501022744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:09:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:21.893414306 +0000 UTC m=+43.787818372" watchObservedRunningTime="2026-07-15 21:10:21.893625369 +0000 UTC m=+43.788029436" Jul 15 21:10:21.894374 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:21.894028 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8pvn9" podStartSLOduration=2.391670367 podStartE2EDuration="9.894021667s" totalImagesPullingTime="7.5023513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:10:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:21.863467769 +0000 UTC m=+43.757871840" watchObservedRunningTime="2026-07-15 21:10:21.894021667 +0000 UTC m=+43.788425733" Jul 15 21:10:21.917323 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:21.917109 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zqgn5" podStartSLOduration=26.417100566 podStartE2EDuration="33.91708772s" totalImagesPullingTime="7.499987154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:09:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:21.915523025 +0000 UTC m=+43.809927091" watchObservedRunningTime="2026-07-15 21:10:21.91708772 +0000 UTC m=+43.811491766" Jul 15 21:10:21.932676 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:21.932628 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-chhhx" podStartSLOduration=26.423516793 podStartE2EDuration="33.932612893s" totalImagesPullingTime="7.5090961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:09:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:21.931190844 +0000 UTC m=+43.825594937" watchObservedRunningTime="2026-07-15 21:10:21.932612893 +0000 UTC m=+43.827016957" Jul 15 21:10:21.965985 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:21.965907 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-ghgrt" podStartSLOduration=26.462379079 podStartE2EDuration="33.965885184s" totalImagesPullingTime="7.503506105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:09:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:21.964497397 +0000 UTC m=+43.858901463" watchObservedRunningTime="2026-07-15 21:10:21.965885184 +0000 UTC m=+43.860289250" Jul 15 21:10:22.864787 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:22.864756 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c5zg9_50d11f79-1eac-4ad4-8151-9b5dd54cd284/console-operator/1.log" Jul 15 21:10:22.865260 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:22.865240 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c5zg9_50d11f79-1eac-4ad4-8151-9b5dd54cd284/console-operator/0.log" Jul 15 21:10:22.865330 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:22.865285 2570 generic.go:356] "Generic (PLEG): container finished" podID="50d11f79-1eac-4ad4-8151-9b5dd54cd284" containerID="9ee4614ca2ca212f8320de61f21c0c84e90fa3658f5fc312b906fb7ce43d83a2" exitCode=255 Jul 15 21:10:22.865434 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:22.865409 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-c5zg9" event={"ID":"50d11f79-1eac-4ad4-8151-9b5dd54cd284","Type":"ContainerDied","Data":"9ee4614ca2ca212f8320de61f21c0c84e90fa3658f5fc312b906fb7ce43d83a2"} Jul 15 21:10:22.865527 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:22.865483 2570 scope.go:117] "RemoveContainer" containerID="f2f0780805c80f92b78b7ff83e1cb50603e9beb2f5c76bc2441f6e781d8af4c1" Jul 15 21:10:22.865691 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:22.865674 2570 scope.go:117] "RemoveContainer" containerID="9ee4614ca2ca212f8320de61f21c0c84e90fa3658f5fc312b906fb7ce43d83a2" Jul 15 21:10:22.865881 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:22.865858 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-c5zg9_openshift-console-operator(50d11f79-1eac-4ad4-8151-9b5dd54cd284)\"" pod="openshift-console-operator/console-operator-7866497494-c5zg9" podUID="50d11f79-1eac-4ad4-8151-9b5dd54cd284" Jul 15 21:10:22.950759 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:22.950722 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cpztv"] Jul 15 21:10:22.969435 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:22.969409 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cpztv" Jul 15 21:10:22.972763 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:22.972736 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cpztv"] Jul 15 21:10:22.978873 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:22.978851 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 15 21:10:22.978984 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:22.978901 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 15 21:10:22.978984 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:22.978852 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nj8l9\"" Jul 15 21:10:23.048199 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:23.048166 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c74a5d7d-85ae-4321-8b64-803a463e0284-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cpztv\" (UID: \"c74a5d7d-85ae-4321-8b64-803a463e0284\") " pod="openshift-insights/insights-runtime-extractor-cpztv" Jul 15 21:10:23.048404 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:23.048354 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c74a5d7d-85ae-4321-8b64-803a463e0284-crio-socket\") pod \"insights-runtime-extractor-cpztv\" (UID: \"c74a5d7d-85ae-4321-8b64-803a463e0284\") " pod="openshift-insights/insights-runtime-extractor-cpztv" Jul 15 21:10:23.048404 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:23.048398 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pms9j\" (UniqueName: \"kubernetes.io/projected/c74a5d7d-85ae-4321-8b64-803a463e0284-kube-api-access-pms9j\") pod \"insights-runtime-extractor-cpztv\" (UID: \"c74a5d7d-85ae-4321-8b64-803a463e0284\") " pod="openshift-insights/insights-runtime-extractor-cpztv" Jul 15 21:10:23.048513 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:23.048456 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c74a5d7d-85ae-4321-8b64-803a463e0284-data-volume\") pod \"insights-runtime-extractor-cpztv\" (UID: \"c74a5d7d-85ae-4321-8b64-803a463e0284\") " pod="openshift-insights/insights-runtime-extractor-cpztv" Jul 15 21:10:23.048566 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:23.048517 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c74a5d7d-85ae-4321-8b64-803a463e0284-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cpztv\" (UID: \"c74a5d7d-85ae-4321-8b64-803a463e0284\") " pod="openshift-insights/insights-runtime-extractor-cpztv" Jul 15 21:10:23.149352 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:23.149236 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c74a5d7d-85ae-4321-8b64-803a463e0284-crio-socket\") pod \"insights-runtime-extractor-cpztv\" (UID: \"c74a5d7d-85ae-4321-8b64-803a463e0284\") " pod="openshift-insights/insights-runtime-extractor-cpztv" Jul 15 21:10:23.149352 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:23.149332 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pms9j\" (UniqueName: \"kubernetes.io/projected/c74a5d7d-85ae-4321-8b64-803a463e0284-kube-api-access-pms9j\") pod \"insights-runtime-extractor-cpztv\" (UID: \"c74a5d7d-85ae-4321-8b64-803a463e0284\") " pod="openshift-insights/insights-runtime-extractor-cpztv" Jul 15 21:10:23.149592 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:23.149369 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c74a5d7d-85ae-4321-8b64-803a463e0284-data-volume\") pod \"insights-runtime-extractor-cpztv\" (UID: \"c74a5d7d-85ae-4321-8b64-803a463e0284\") " pod="openshift-insights/insights-runtime-extractor-cpztv" Jul 15 21:10:23.149592 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:23.149382 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c74a5d7d-85ae-4321-8b64-803a463e0284-crio-socket\") pod \"insights-runtime-extractor-cpztv\" (UID: \"c74a5d7d-85ae-4321-8b64-803a463e0284\") " pod="openshift-insights/insights-runtime-extractor-cpztv" Jul 15 21:10:23.149592 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:23.149410 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c74a5d7d-85ae-4321-8b64-803a463e0284-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cpztv\" (UID: \"c74a5d7d-85ae-4321-8b64-803a463e0284\") " pod="openshift-insights/insights-runtime-extractor-cpztv" Jul 15 21:10:23.149592 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:23.149481 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c74a5d7d-85ae-4321-8b64-803a463e0284-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cpztv\" (UID: \"c74a5d7d-85ae-4321-8b64-803a463e0284\") " pod="openshift-insights/insights-runtime-extractor-cpztv" Jul 15 21:10:23.149592 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:23.149555 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 21:10:23.149851 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:23.149632 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c74a5d7d-85ae-4321-8b64-803a463e0284-kube-rbac-proxy-cm podName:c74a5d7d-85ae-4321-8b64-803a463e0284 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:23.64961442 +0000 UTC m=+45.544018464 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c74a5d7d-85ae-4321-8b64-803a463e0284-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cpztv" (UID: "c74a5d7d-85ae-4321-8b64-803a463e0284") : configmap "kube-rbac-proxy" not found Jul 15 21:10:23.149851 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:23.149632 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 21:10:23.149851 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:23.149664 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c74a5d7d-85ae-4321-8b64-803a463e0284-insights-runtime-extractor-tls podName:c74a5d7d-85ae-4321-8b64-803a463e0284 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:23.649658058 +0000 UTC m=+45.544062105 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c74a5d7d-85ae-4321-8b64-803a463e0284-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cpztv" (UID: "c74a5d7d-85ae-4321-8b64-803a463e0284") : secret "insights-runtime-extractor-tls" not found Jul 15 21:10:23.149851 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:23.149758 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c74a5d7d-85ae-4321-8b64-803a463e0284-data-volume\") pod \"insights-runtime-extractor-cpztv\" (UID: \"c74a5d7d-85ae-4321-8b64-803a463e0284\") " pod="openshift-insights/insights-runtime-extractor-cpztv" Jul 15 21:10:23.161026 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:23.160998 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pms9j\" (UniqueName: \"kubernetes.io/projected/c74a5d7d-85ae-4321-8b64-803a463e0284-kube-api-access-pms9j\") pod \"insights-runtime-extractor-cpztv\" (UID: \"c74a5d7d-85ae-4321-8b64-803a463e0284\") " pod="openshift-insights/insights-runtime-extractor-cpztv" Jul 15 21:10:23.311278 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:23.311226 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-c5zg9" Jul 15 21:10:23.311278 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:23.311285 2570 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-c5zg9" Jul 15 21:10:23.654100 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:23.654059 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c74a5d7d-85ae-4321-8b64-803a463e0284-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cpztv\" (UID: \"c74a5d7d-85ae-4321-8b64-803a463e0284\") " pod="openshift-insights/insights-runtime-extractor-cpztv" Jul 15 21:10:23.654272 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:23.654228 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 21:10:23.654338 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:23.654322 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c74a5d7d-85ae-4321-8b64-803a463e0284-insights-runtime-extractor-tls podName:c74a5d7d-85ae-4321-8b64-803a463e0284 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:24.654284663 +0000 UTC m=+46.548688729 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c74a5d7d-85ae-4321-8b64-803a463e0284-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cpztv" (UID: "c74a5d7d-85ae-4321-8b64-803a463e0284") : secret "insights-runtime-extractor-tls" not found Jul 15 21:10:23.654382 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:23.654371 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c74a5d7d-85ae-4321-8b64-803a463e0284-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cpztv\" (UID: \"c74a5d7d-85ae-4321-8b64-803a463e0284\") " pod="openshift-insights/insights-runtime-extractor-cpztv" Jul 15 21:10:23.654517 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:23.654499 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 21:10:23.654564 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:23.654555 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c74a5d7d-85ae-4321-8b64-803a463e0284-kube-rbac-proxy-cm podName:c74a5d7d-85ae-4321-8b64-803a463e0284 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:24.654541862 +0000 UTC m=+46.548945906 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c74a5d7d-85ae-4321-8b64-803a463e0284-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cpztv" (UID: "c74a5d7d-85ae-4321-8b64-803a463e0284") : configmap "kube-rbac-proxy" not found Jul 15 21:10:23.869548 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:23.869521 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c5zg9_50d11f79-1eac-4ad4-8151-9b5dd54cd284/console-operator/1.log" Jul 15 21:10:23.869907 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:23.869836 2570 scope.go:117] "RemoveContainer" containerID="9ee4614ca2ca212f8320de61f21c0c84e90fa3658f5fc312b906fb7ce43d83a2" Jul 15 21:10:23.869993 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:23.869972 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-c5zg9_openshift-console-operator(50d11f79-1eac-4ad4-8151-9b5dd54cd284)\"" pod="openshift-console-operator/console-operator-7866497494-c5zg9" podUID="50d11f79-1eac-4ad4-8151-9b5dd54cd284" Jul 15 21:10:24.663857 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:24.663820 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c74a5d7d-85ae-4321-8b64-803a463e0284-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cpztv\" (UID: \"c74a5d7d-85ae-4321-8b64-803a463e0284\") " pod="openshift-insights/insights-runtime-extractor-cpztv" Jul 15 21:10:24.664075 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:24.663886 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c74a5d7d-85ae-4321-8b64-803a463e0284-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cpztv\" (UID: \"c74a5d7d-85ae-4321-8b64-803a463e0284\") " pod="openshift-insights/insights-runtime-extractor-cpztv" Jul 15 21:10:24.664075 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:24.663973 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 21:10:24.664075 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:24.664048 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 21:10:24.664075 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:24.664073 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c74a5d7d-85ae-4321-8b64-803a463e0284-kube-rbac-proxy-cm podName:c74a5d7d-85ae-4321-8b64-803a463e0284 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:26.6640513 +0000 UTC m=+48.558455348 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c74a5d7d-85ae-4321-8b64-803a463e0284-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cpztv" (UID: "c74a5d7d-85ae-4321-8b64-803a463e0284") : configmap "kube-rbac-proxy" not found Jul 15 21:10:24.664323 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:24.664096 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c74a5d7d-85ae-4321-8b64-803a463e0284-insights-runtime-extractor-tls podName:c74a5d7d-85ae-4321-8b64-803a463e0284 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:26.664083381 +0000 UTC m=+48.558487424 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c74a5d7d-85ae-4321-8b64-803a463e0284-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cpztv" (UID: "c74a5d7d-85ae-4321-8b64-803a463e0284") : secret "insights-runtime-extractor-tls" not found Jul 15 21:10:24.873089 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:24.873053 2570 scope.go:117] "RemoveContainer" containerID="9ee4614ca2ca212f8320de61f21c0c84e90fa3658f5fc312b906fb7ce43d83a2" Jul 15 21:10:24.873507 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:24.873285 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-c5zg9_openshift-console-operator(50d11f79-1eac-4ad4-8151-9b5dd54cd284)\"" pod="openshift-console-operator/console-operator-7866497494-c5zg9" podUID="50d11f79-1eac-4ad4-8151-9b5dd54cd284" Jul 15 21:10:25.153058 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:25.153030 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pxkxm_835fb8bf-2d1b-47f8-b6ef-25d16a2cc774/dns-node-resolver/0.log" Jul 15 21:10:25.950997 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:25.950969 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lkgf2_654026cc-fb99-41cc-b6c4-6fbc09801960/node-ca/0.log" Jul 15 21:10:26.548938 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:26.548910 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8pvn9_004e0571-8f51-4fb2-b25b-8946eaf65f05/serve-healthcheck-canary/0.log" Jul 15 21:10:26.680902 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:26.680864 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c74a5d7d-85ae-4321-8b64-803a463e0284-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cpztv\" (UID: \"c74a5d7d-85ae-4321-8b64-803a463e0284\") " pod="openshift-insights/insights-runtime-extractor-cpztv" Jul 15 21:10:26.681086 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:26.680935 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c74a5d7d-85ae-4321-8b64-803a463e0284-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cpztv\" (UID: \"c74a5d7d-85ae-4321-8b64-803a463e0284\") " pod="openshift-insights/insights-runtime-extractor-cpztv" Jul 15 21:10:26.681086 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:26.681003 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 21:10:26.681086 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:26.681059 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c74a5d7d-85ae-4321-8b64-803a463e0284-kube-rbac-proxy-cm podName:c74a5d7d-85ae-4321-8b64-803a463e0284 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:30.681045666 +0000 UTC m=+52.575449712 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c74a5d7d-85ae-4321-8b64-803a463e0284-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cpztv" (UID: "c74a5d7d-85ae-4321-8b64-803a463e0284") : configmap "kube-rbac-proxy" not found Jul 15 21:10:26.681252 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:26.681108 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 21:10:26.681252 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:26.681194 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c74a5d7d-85ae-4321-8b64-803a463e0284-insights-runtime-extractor-tls podName:c74a5d7d-85ae-4321-8b64-803a463e0284 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:30.681174328 +0000 UTC m=+52.575578376 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c74a5d7d-85ae-4321-8b64-803a463e0284-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cpztv" (UID: "c74a5d7d-85ae-4321-8b64-803a463e0284") : secret "insights-runtime-extractor-tls" not found Jul 15 21:10:28.900229 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:28.900197 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c4352ba-2395-4d2c-b984-1af71646d3ae-service-ca-bundle\") pod \"router-default-59ff8f8888-cmlk2\" (UID: \"6c4352ba-2395-4d2c-b984-1af71646d3ae\") " pod="openshift-ingress/router-default-59ff8f8888-cmlk2" Jul 15 21:10:28.900672 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:28.900235 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7f566a4-c5c1-43ce-a62b-fc01ed526059-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-qfckd\" (UID: \"e7f566a4-c5c1-43ce-a62b-fc01ed526059\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qfckd" Jul 15 21:10:28.900672 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:28.900270 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-bk2j8\" (UID: \"f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-bk2j8" Jul 15 21:10:28.900672 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:28.900317 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8c2a4fd-b530-4bac-b9fa-6682ab28dde1-metrics-tls\") pod \"dns-default-lr4hr\" (UID: \"e8c2a4fd-b530-4bac-b9fa-6682ab28dde1\") " pod="openshift-dns/dns-default-lr4hr" Jul 15 21:10:28.900672 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:28.900376 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6c4352ba-2395-4d2c-b984-1af71646d3ae-service-ca-bundle podName:6c4352ba-2395-4d2c-b984-1af71646d3ae nodeName:}" failed. No retries permitted until 2026-07-15 21:10:44.90035858 +0000 UTC m=+66.794762626 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6c4352ba-2395-4d2c-b984-1af71646d3ae-service-ca-bundle") pod "router-default-59ff8f8888-cmlk2" (UID: "6c4352ba-2395-4d2c-b984-1af71646d3ae") : configmap references non-existent config key: service-ca.crt Jul 15 21:10:28.900672 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:28.900385 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 21:10:28.900672 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:28.900406 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c4352ba-2395-4d2c-b984-1af71646d3ae-metrics-certs\") pod \"router-default-59ff8f8888-cmlk2\" (UID: \"6c4352ba-2395-4d2c-b984-1af71646d3ae\") " pod="openshift-ingress/router-default-59ff8f8888-cmlk2" Jul 15 21:10:28.900672 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:28.900433 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8c2a4fd-b530-4bac-b9fa-6682ab28dde1-metrics-tls podName:e8c2a4fd-b530-4bac-b9fa-6682ab28dde1 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:44.900418434 +0000 UTC m=+66.794822497 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e8c2a4fd-b530-4bac-b9fa-6682ab28dde1-metrics-tls") pod "dns-default-lr4hr" (UID: "e8c2a4fd-b530-4bac-b9fa-6682ab28dde1") : secret "dns-default-metrics-tls" not found Jul 15 21:10:28.900672 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:28.900385 2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 21:10:28.900672 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:28.900461 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-registry-tls\") pod \"image-registry-79778fcf46-l49zk\" (UID: \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\") " pod="openshift-image-registry/image-registry-79778fcf46-l49zk" Jul 15 21:10:28.900672 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:28.900507 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 21:10:28.900672 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:28.900515 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79778fcf46-l49zk: secret "image-registry-tls" not found Jul 15 21:10:28.900672 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:28.900467 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 21:10:28.900672 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:28.900524 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7f566a4-c5c1-43ce-a62b-fc01ed526059-cluster-monitoring-operator-tls podName:e7f566a4-c5c1-43ce-a62b-fc01ed526059 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:44.900506578 +0000 UTC m=+66.794910625 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e7f566a4-c5c1-43ce-a62b-fc01ed526059-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-qfckd" (UID: "e7f566a4-c5c1-43ce-a62b-fc01ed526059") : secret "cluster-monitoring-operator-tls" not found Jul 15 21:10:28.900672 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:28.900542 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-registry-tls podName:8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a nodeName:}" failed. No retries permitted until 2026-07-15 21:10:44.900531923 +0000 UTC m=+66.794935968 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-registry-tls") pod "image-registry-79778fcf46-l49zk" (UID: "8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a") : secret "image-registry-tls" not found Jul 15 21:10:28.900672 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:28.900556 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-tmgwf\" (UID: \"dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tmgwf" Jul 15 21:10:28.901146 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:28.900578 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c4352ba-2395-4d2c-b984-1af71646d3ae-metrics-certs podName:6c4352ba-2395-4d2c-b984-1af71646d3ae nodeName:}" failed. No retries permitted until 2026-07-15 21:10:44.900558815 +0000 UTC m=+66.794962871 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6c4352ba-2395-4d2c-b984-1af71646d3ae-metrics-certs") pod "router-default-59ff8f8888-cmlk2" (UID: "6c4352ba-2395-4d2c-b984-1af71646d3ae") : secret "router-metrics-certs-default" not found Jul 15 21:10:28.901146 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:28.900598 2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 21:10:28.901146 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:28.900465 2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 21:10:28.901146 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:28.900624 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5-samples-operator-tls podName:dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:44.900618227 +0000 UTC m=+66.795022269 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5-samples-operator-tls") pod "cluster-samples-operator-65db858894-tmgwf" (UID: "dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5") : secret "samples-operator-tls" not found Jul 15 21:10:28.901146 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:28.900642 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2-networking-console-plugin-cert podName:f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:44.900630407 +0000 UTC m=+66.795034449 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-bk2j8" (UID: "f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2") : secret "networking-console-plugin-cert" not found Jul 15 21:10:30.733759 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:30.733722 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c74a5d7d-85ae-4321-8b64-803a463e0284-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cpztv\" (UID: \"c74a5d7d-85ae-4321-8b64-803a463e0284\") " pod="openshift-insights/insights-runtime-extractor-cpztv" Jul 15 21:10:30.734159 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:30.733782 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c74a5d7d-85ae-4321-8b64-803a463e0284-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cpztv\" (UID: \"c74a5d7d-85ae-4321-8b64-803a463e0284\") " pod="openshift-insights/insights-runtime-extractor-cpztv" Jul 15 21:10:30.734159 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:30.733946 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 21:10:30.734159 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:10:30.734028 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c74a5d7d-85ae-4321-8b64-803a463e0284-insights-runtime-extractor-tls podName:c74a5d7d-85ae-4321-8b64-803a463e0284 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:38.73400622 +0000 UTC m=+60.628410263 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c74a5d7d-85ae-4321-8b64-803a463e0284-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cpztv" (UID: "c74a5d7d-85ae-4321-8b64-803a463e0284") : secret "insights-runtime-extractor-tls" not found Jul 15 21:10:30.734406 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:30.734384 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c74a5d7d-85ae-4321-8b64-803a463e0284-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cpztv\" (UID: \"c74a5d7d-85ae-4321-8b64-803a463e0284\") " pod="openshift-insights/insights-runtime-extractor-cpztv" Jul 15 21:10:37.753965 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:37.753939 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nhzkw" Jul 15 21:10:38.584201 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:38.584169 2570 scope.go:117] "RemoveContainer" containerID="9ee4614ca2ca212f8320de61f21c0c84e90fa3658f5fc312b906fb7ce43d83a2" Jul 15 21:10:38.811242 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:38.811203 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c74a5d7d-85ae-4321-8b64-803a463e0284-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cpztv\" (UID: \"c74a5d7d-85ae-4321-8b64-803a463e0284\") " pod="openshift-insights/insights-runtime-extractor-cpztv" Jul 15 21:10:38.813528 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:38.813497 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c74a5d7d-85ae-4321-8b64-803a463e0284-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cpztv\" (UID: \"c74a5d7d-85ae-4321-8b64-803a463e0284\") " pod="openshift-insights/insights-runtime-extractor-cpztv" Jul 15 21:10:38.883545 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:38.883470 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nj8l9\"" Jul 15 21:10:38.891655 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:38.891636 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cpztv" Jul 15 21:10:38.917614 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:38.917579 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c5zg9_50d11f79-1eac-4ad4-8151-9b5dd54cd284/console-operator/1.log" Jul 15 21:10:38.917752 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:38.917639 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-c5zg9" event={"ID":"50d11f79-1eac-4ad4-8151-9b5dd54cd284","Type":"ContainerStarted","Data":"7cde99054b78b43c71d06eeb8a2a257406b86bfe1767d37de742c39328e8b202"} Jul 15 21:10:38.917938 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:38.917911 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-c5zg9" Jul 15 21:10:38.937905 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:38.937859 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-c5zg9" podStartSLOduration=43.434260349 podStartE2EDuration="50.937843373s" totalImagesPullingTime="7.503583024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:09:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:38.936828904 +0000 UTC m=+60.831232971" watchObservedRunningTime="2026-07-15 21:10:38.937843373 +0000 UTC m=+60.832247497" Jul 15 21:10:39.027251 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:39.027219 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cpztv"] Jul 15 21:10:39.030278 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:10:39.030254 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc74a5d7d_85ae_4321_8b64_803a463e0284.slice/crio-b9d939ad359f1dd9b565565e31a0d343696edeccc2ea1b7a4c53526ab9c31fb3 WatchSource:0}: Error finding container b9d939ad359f1dd9b565565e31a0d343696edeccc2ea1b7a4c53526ab9c31fb3: Status 404 returned error can't find the container with id b9d939ad359f1dd9b565565e31a0d343696edeccc2ea1b7a4c53526ab9c31fb3 Jul 15 21:10:39.533001 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:39.532934 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-c5zg9" Jul 15 21:10:39.923119 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:39.923066 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cpztv" event={"ID":"c74a5d7d-85ae-4321-8b64-803a463e0284","Type":"ContainerStarted","Data":"b9d939ad359f1dd9b565565e31a0d343696edeccc2ea1b7a4c53526ab9c31fb3"} Jul 15 21:10:43.938991 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:43.938950 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cpztv" event={"ID":"c74a5d7d-85ae-4321-8b64-803a463e0284","Type":"ContainerStarted","Data":"a406d2f78cfbfce02a9a50f13194127fcf0c51c60b29096ffc7bf24e23873128"} Jul 15 21:10:44.261585 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:44.261546 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9154423-994b-45e7-9cad-813087e03e31-metrics-certs\") pod \"network-metrics-daemon-89vwd\" (UID: \"e9154423-994b-45e7-9cad-813087e03e31\") " pod="openshift-multus/network-metrics-daemon-89vwd" Jul 15 21:10:44.264604 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:44.264580 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 21:10:44.274040 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:44.274017 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9154423-994b-45e7-9cad-813087e03e31-metrics-certs\") pod \"network-metrics-daemon-89vwd\" (UID: \"e9154423-994b-45e7-9cad-813087e03e31\") " pod="openshift-multus/network-metrics-daemon-89vwd" Jul 15 21:10:44.362036 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:44.362004 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14f84a19-c09e-4724-892e-46796e611bd9-original-pull-secret\") pod \"global-pull-secret-syncer-8c5ks\" (UID: \"14f84a19-c09e-4724-892e-46796e611bd9\") " pod="kube-system/global-pull-secret-syncer-8c5ks" Jul 15 21:10:44.364644 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:44.364601 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 21:10:44.374861 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:44.374828 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14f84a19-c09e-4724-892e-46796e611bd9-original-pull-secret\") pod \"global-pull-secret-syncer-8c5ks\" (UID: \"14f84a19-c09e-4724-892e-46796e611bd9\") " pod="kube-system/global-pull-secret-syncer-8c5ks" Jul 15 21:10:44.462694 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:44.462658 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq9n9\" (UniqueName: \"kubernetes.io/projected/b85e9808-cc68-4ebb-af04-6bd95b54a5c9-kube-api-access-fq9n9\") pod \"network-check-target-6p5nk\" (UID: \"b85e9808-cc68-4ebb-af04-6bd95b54a5c9\") " pod="openshift-network-diagnostics/network-check-target-6p5nk" Jul 15 21:10:44.465383 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:44.465361 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq9n9\" (UniqueName: \"kubernetes.io/projected/b85e9808-cc68-4ebb-af04-6bd95b54a5c9-kube-api-access-fq9n9\") pod \"network-check-target-6p5nk\" (UID: \"b85e9808-cc68-4ebb-af04-6bd95b54a5c9\") " pod="openshift-network-diagnostics/network-check-target-6p5nk" Jul 15 21:10:44.498832 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:44.498798 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f2pnr\"" Jul 15 21:10:44.507046 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:44.507016 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89vwd" Jul 15 21:10:44.509205 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:44.509177 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8c5ks" Jul 15 21:10:44.510804 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:44.510762 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s56kw\"" Jul 15 21:10:44.513906 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:44.513848 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6p5nk" Jul 15 21:10:44.694274 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:44.694249 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-89vwd"] Jul 15 21:10:44.696084 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:10:44.696054 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9154423_994b_45e7_9cad_813087e03e31.slice/crio-8813d92f9aaa465dd67bae585ecb76b72eff11ace2064bdb699e7d5614d8ed49 WatchSource:0}: Error finding container 8813d92f9aaa465dd67bae585ecb76b72eff11ace2064bdb699e7d5614d8ed49: Status 404 returned error can't find the container with id 8813d92f9aaa465dd67bae585ecb76b72eff11ace2064bdb699e7d5614d8ed49 Jul 15 21:10:44.714752 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:44.714722 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8c5ks"] Jul 15 21:10:44.719060 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:10:44.719027 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14f84a19_c09e_4724_892e_46796e611bd9.slice/crio-428dd45b32c06d0c88d3ed48b8a2dd6a49aba2cd25e4a16278908e40e95fa942 WatchSource:0}: Error finding container 428dd45b32c06d0c88d3ed48b8a2dd6a49aba2cd25e4a16278908e40e95fa942: Status 404 returned error can't find the container with id 428dd45b32c06d0c88d3ed48b8a2dd6a49aba2cd25e4a16278908e40e95fa942 Jul 15 21:10:44.749146 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:44.749095 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6p5nk"] Jul 15 21:10:44.753077 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:10:44.753050 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb85e9808_cc68_4ebb_af04_6bd95b54a5c9.slice/crio-4641ffe785b7da10de3938dc480b43225abd3a068e366f4c8a2891fb24f549cb WatchSource:0}: Error finding container 4641ffe785b7da10de3938dc480b43225abd3a068e366f4c8a2891fb24f549cb: Status 404 returned error can't find the container with id 4641ffe785b7da10de3938dc480b43225abd3a068e366f4c8a2891fb24f549cb Jul 15 21:10:44.944099 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:44.944026 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8c5ks" event={"ID":"14f84a19-c09e-4724-892e-46796e611bd9","Type":"ContainerStarted","Data":"428dd45b32c06d0c88d3ed48b8a2dd6a49aba2cd25e4a16278908e40e95fa942"} Jul 15 21:10:44.946632 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:44.946201 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6p5nk" event={"ID":"b85e9808-cc68-4ebb-af04-6bd95b54a5c9","Type":"ContainerStarted","Data":"e05245f5cfe3a44fe4c216f5fdd52fc8d47a0a2378ab06c7cf0db5de35aab685"} Jul 15 21:10:44.946632 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:44.946255 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6p5nk" event={"ID":"b85e9808-cc68-4ebb-af04-6bd95b54a5c9","Type":"ContainerStarted","Data":"4641ffe785b7da10de3938dc480b43225abd3a068e366f4c8a2891fb24f549cb"} Jul 15 21:10:44.946632 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:44.946532 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6p5nk" Jul 15 21:10:44.949376 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:44.949334 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-89vwd" event={"ID":"e9154423-994b-45e7-9cad-813087e03e31","Type":"ContainerStarted","Data":"8813d92f9aaa465dd67bae585ecb76b72eff11ace2064bdb699e7d5614d8ed49"} Jul 15 21:10:44.968164 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:44.968112 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-bk2j8\" (UID: \"f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-bk2j8" Jul 15 21:10:44.968327 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:44.968180 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8c2a4fd-b530-4bac-b9fa-6682ab28dde1-metrics-tls\") pod \"dns-default-lr4hr\" (UID: \"e8c2a4fd-b530-4bac-b9fa-6682ab28dde1\") " pod="openshift-dns/dns-default-lr4hr" Jul 15 21:10:44.968327 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:44.968210 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c4352ba-2395-4d2c-b984-1af71646d3ae-metrics-certs\") pod \"router-default-59ff8f8888-cmlk2\" (UID: \"6c4352ba-2395-4d2c-b984-1af71646d3ae\") " pod="openshift-ingress/router-default-59ff8f8888-cmlk2" Jul 15 21:10:44.968327 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:44.968240 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-registry-tls\") pod \"image-registry-79778fcf46-l49zk\" (UID: \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\") " pod="openshift-image-registry/image-registry-79778fcf46-l49zk" Jul 15 21:10:44.968327 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:44.968274 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-tmgwf\" (UID: \"dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tmgwf" Jul 15 21:10:44.969115 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:44.968519 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c4352ba-2395-4d2c-b984-1af71646d3ae-service-ca-bundle\") pod \"router-default-59ff8f8888-cmlk2\" (UID: \"6c4352ba-2395-4d2c-b984-1af71646d3ae\") " pod="openshift-ingress/router-default-59ff8f8888-cmlk2" Jul 15 21:10:44.969115 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:44.968600 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7f566a4-c5c1-43ce-a62b-fc01ed526059-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-qfckd\" (UID: \"e7f566a4-c5c1-43ce-a62b-fc01ed526059\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qfckd" Jul 15 21:10:44.969401 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:44.969379 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c4352ba-2395-4d2c-b984-1af71646d3ae-service-ca-bundle\") pod \"router-default-59ff8f8888-cmlk2\" (UID: \"6c4352ba-2395-4d2c-b984-1af71646d3ae\") " pod="openshift-ingress/router-default-59ff8f8888-cmlk2" Jul 15 21:10:44.970649 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:44.969779 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6p5nk" podStartSLOduration=65.969759649 podStartE2EDuration="1m5.969759649s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:09:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:44.968123123 +0000 UTC m=+66.862527216" watchObservedRunningTime="2026-07-15 21:10:44.969759649 +0000 UTC m=+66.864163715" Jul 15 21:10:44.971225 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:44.971181 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-bk2j8\" (UID: \"f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-bk2j8" Jul 15 21:10:44.972094 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:44.972066 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c4352ba-2395-4d2c-b984-1af71646d3ae-metrics-certs\") pod \"router-default-59ff8f8888-cmlk2\" (UID: \"6c4352ba-2395-4d2c-b984-1af71646d3ae\") " pod="openshift-ingress/router-default-59ff8f8888-cmlk2" Jul 15 21:10:44.972188 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:44.972156 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-registry-tls\") pod \"image-registry-79778fcf46-l49zk\" (UID: \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\") " pod="openshift-image-registry/image-registry-79778fcf46-l49zk" Jul 15 21:10:44.972508 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:44.972481 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-tmgwf\" (UID: \"dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tmgwf" Jul 15 21:10:44.973173 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:44.973150 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8c2a4fd-b530-4bac-b9fa-6682ab28dde1-metrics-tls\") pod \"dns-default-lr4hr\" (UID: \"e8c2a4fd-b530-4bac-b9fa-6682ab28dde1\") " pod="openshift-dns/dns-default-lr4hr" Jul 15 21:10:44.973509 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:44.973487 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7f566a4-c5c1-43ce-a62b-fc01ed526059-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-qfckd\" (UID: \"e7f566a4-c5c1-43ce-a62b-fc01ed526059\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qfckd" Jul 15 21:10:45.071323 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:45.071232 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9mpjn\"" Jul 15 21:10:45.078891 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:45.078863 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79778fcf46-l49zk" Jul 15 21:10:45.104592 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:45.104564 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-g5pxf\"" Jul 15 21:10:45.112094 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:45.112064 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qfckd" Jul 15 21:10:45.122492 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:45.122458 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-4ntd5\"" Jul 15 21:10:45.129565 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:45.129536 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-bk2j8" Jul 15 21:10:45.135370 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:45.135273 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-v4zn5\"" Jul 15 21:10:45.143882 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:45.143353 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tmgwf" Jul 15 21:10:45.147024 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:45.146998 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xcfql\"" Jul 15 21:10:45.149660 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:45.149475 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-v8bmm\"" Jul 15 21:10:45.151530 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:45.151495 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lr4hr" Jul 15 21:10:45.157985 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:45.157905 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-59ff8f8888-cmlk2" Jul 15 21:10:45.269381 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:45.269285 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79778fcf46-l49zk"] Jul 15 21:10:45.289314 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:10:45.289243 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b82b3c5_e8f6_4ddb_8d79_cae2a62ae19a.slice/crio-42c638418800c4621d021dfbd89c83951f706294ebd7575bb943decda9f77536 WatchSource:0}: Error finding container 42c638418800c4621d021dfbd89c83951f706294ebd7575bb943decda9f77536: Status 404 returned error can't find the container with id 42c638418800c4621d021dfbd89c83951f706294ebd7575bb943decda9f77536 Jul 15 21:10:45.329951 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:45.329648 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qfckd"] Jul 15 21:10:45.336199 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:10:45.335982 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7f566a4_c5c1_43ce_a62b_fc01ed526059.slice/crio-c986bc0831f933726e4c73b5334f18b7343b947477c00ef64294bb0898e04d86 WatchSource:0}: Error finding container c986bc0831f933726e4c73b5334f18b7343b947477c00ef64294bb0898e04d86: Status 404 returned error can't find the container with id c986bc0831f933726e4c73b5334f18b7343b947477c00ef64294bb0898e04d86 Jul 15 21:10:45.369143 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:45.369108 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-bk2j8"] Jul 15 21:10:45.416675 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:45.416641 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-59ff8f8888-cmlk2"] Jul 15 21:10:45.419036 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:10:45.419012 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c4352ba_2395_4d2c_b984_1af71646d3ae.slice/crio-dd52d40d5d2e80c760fc65c0de4b59aa23db6a30a81fb4c1adf90507146b7e8b WatchSource:0}: Error finding container dd52d40d5d2e80c760fc65c0de4b59aa23db6a30a81fb4c1adf90507146b7e8b: Status 404 returned error can't find the container with id dd52d40d5d2e80c760fc65c0de4b59aa23db6a30a81fb4c1adf90507146b7e8b Jul 15 21:10:45.423150 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:45.423081 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tmgwf"] Jul 15 21:10:45.449141 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:45.449065 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lr4hr"] Jul 15 21:10:45.462124 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:10:45.462099 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8c2a4fd_b530_4bac_b9fa_6682ab28dde1.slice/crio-175739e35c7260edda66892ec3e0e041eb0035d27fd016a15352a696744f896e WatchSource:0}: Error finding container 175739e35c7260edda66892ec3e0e041eb0035d27fd016a15352a696744f896e: Status 404 returned error can't find the container with id 175739e35c7260edda66892ec3e0e041eb0035d27fd016a15352a696744f896e Jul 15 21:10:45.957025 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:45.956977 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-bk2j8" event={"ID":"f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2","Type":"ContainerStarted","Data":"195dc391339b83f86f32d51e042f945c1963f391144e7781ff271b2e481235eb"} Jul 15 21:10:45.958889 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:45.958843 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lr4hr" event={"ID":"e8c2a4fd-b530-4bac-b9fa-6682ab28dde1","Type":"ContainerStarted","Data":"175739e35c7260edda66892ec3e0e041eb0035d27fd016a15352a696744f896e"} Jul 15 21:10:45.961053 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:45.961024 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-59ff8f8888-cmlk2" event={"ID":"6c4352ba-2395-4d2c-b984-1af71646d3ae","Type":"ContainerStarted","Data":"fc38cc5b2c4f572b8d33489debe881ff71b35ed674d2bf9f276fb8cb3639ac5e"} Jul 15 21:10:45.961171 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:45.961074 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-59ff8f8888-cmlk2" event={"ID":"6c4352ba-2395-4d2c-b984-1af71646d3ae","Type":"ContainerStarted","Data":"dd52d40d5d2e80c760fc65c0de4b59aa23db6a30a81fb4c1adf90507146b7e8b"} Jul 15 21:10:45.962911 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:45.962886 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tmgwf" event={"ID":"dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5","Type":"ContainerStarted","Data":"7ec5c44c68588ca518304d1340997c39d361a8db676681b3bfa272e40f235583"} Jul 15 21:10:45.964793 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:45.964768 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qfckd" event={"ID":"e7f566a4-c5c1-43ce-a62b-fc01ed526059","Type":"ContainerStarted","Data":"c986bc0831f933726e4c73b5334f18b7343b947477c00ef64294bb0898e04d86"} Jul 15 21:10:45.967536 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:45.967153 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79778fcf46-l49zk" event={"ID":"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a","Type":"ContainerStarted","Data":"cff7b36e252fd2c19e3b0fc8ef07dc7051d1f18c17f9bd2d3ca72740f8f4bbae"} Jul 15 21:10:45.967536 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:45.967199 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-79778fcf46-l49zk" Jul 15 21:10:45.967536 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:45.967231 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79778fcf46-l49zk" event={"ID":"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a","Type":"ContainerStarted","Data":"42c638418800c4621d021dfbd89c83951f706294ebd7575bb943decda9f77536"} Jul 15 21:10:46.001795 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:46.001731 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-59ff8f8888-cmlk2" podStartSLOduration=58.001708445 podStartE2EDuration="58.001708445s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:09:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:46.000620042 +0000 UTC m=+67.895024132" watchObservedRunningTime="2026-07-15 21:10:46.001708445 +0000 UTC m=+67.896112512" Jul 15 21:10:46.056812 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:46.056752 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-79778fcf46-l49zk" podStartSLOduration=67.056728707 podStartE2EDuration="1m7.056728707s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:09:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:46.051087751 +0000 UTC m=+67.945491817" watchObservedRunningTime="2026-07-15 21:10:46.056728707 +0000 UTC m=+67.951132773" Jul 15 21:10:46.158996 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:46.158915 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-59ff8f8888-cmlk2" Jul 15 21:10:46.161961 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:46.161701 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-59ff8f8888-cmlk2" Jul 15 21:10:46.971866 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:46.971829 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-59ff8f8888-cmlk2" Jul 15 21:10:46.973919 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:46.973897 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-59ff8f8888-cmlk2" Jul 15 21:10:52.025937 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:52.025474 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8c5ks" event={"ID":"14f84a19-c09e-4724-892e-46796e611bd9","Type":"ContainerStarted","Data":"eba910bdebd331179c82faa814983273221eda1cd562d5d1e0e27d056d5f94c8"} Jul 15 21:10:52.030377 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:52.029707 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tmgwf" event={"ID":"dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5","Type":"ContainerStarted","Data":"84966ffac6d6d087eaf0ed57b40a7e95cf939775cd491b3ec5991b3f8452ab0b"} Jul 15 21:10:52.033371 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:52.032815 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qfckd" event={"ID":"e7f566a4-c5c1-43ce-a62b-fc01ed526059","Type":"ContainerStarted","Data":"bd2e03e2be2e82cc3e74ab94b590a112dd74c4e74fbcc39869e00ca497533b00"} Jul 15 21:10:52.045200 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:52.042206 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cpztv" event={"ID":"c74a5d7d-85ae-4321-8b64-803a463e0284","Type":"ContainerStarted","Data":"8d3e0e12b7c075e070c48b6f0de0ff0f8d2d5326080318390794c8c2539e3476"} Jul 15 21:10:52.055609 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:52.055056 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-bk2j8" event={"ID":"f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2","Type":"ContainerStarted","Data":"eab843c1fc526ff0d64ace16750dc7b247881ce38df59e06c763cc62f217194a"} Jul 15 21:10:52.064802 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:52.061398 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-89vwd" event={"ID":"e9154423-994b-45e7-9cad-813087e03e31","Type":"ContainerStarted","Data":"d5e0a160c4e00d058c4cd0c0b0f155f4f72de851afa96fc0b1b0b2cf60c009f0"} Jul 15 21:10:52.064802 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:52.063835 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lr4hr" event={"ID":"e8c2a4fd-b530-4bac-b9fa-6682ab28dde1","Type":"ContainerStarted","Data":"87673ea83bd903377d6287ee9d9e6b41775ba71f863a7bc4ee89ef37ccef956e"} Jul 15 21:10:52.072170 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:52.068112 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qfckd" podStartSLOduration=57.650660727 podStartE2EDuration="1m4.068092444s" totalImagesPullingTime="6.417431717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:09:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:52.067790299 +0000 UTC m=+73.962194367" watchObservedRunningTime="2026-07-15 21:10:52.068092444 +0000 UTC m=+73.962496507" Jul 15 21:10:52.072170 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:52.068632 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8c5ks" podStartSLOduration=66.01645292 podStartE2EDuration="1m13.068618324s" totalImagesPullingTime="7.052165404s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:52.046101021 +0000 UTC m=+73.940505111" watchObservedRunningTime="2026-07-15 21:10:52.068618324 +0000 UTC m=+73.963022390" Jul 15 21:10:52.092874 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:52.092823 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-bk2j8" podStartSLOduration=57.699415265 podStartE2EDuration="1m4.092801525s" totalImagesPullingTime="6.39338626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:09:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:52.091025888 +0000 UTC m=+73.985429954" watchObservedRunningTime="2026-07-15 21:10:52.092801525 +0000 UTC m=+73.987205593" Jul 15 21:10:52.325161 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:52.325128 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6fb9b877c4-c79tp"] Jul 15 21:10:52.344924 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:52.344893 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fb9b877c4-c79tp" Jul 15 21:10:52.348915 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:52.348878 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 15 21:10:52.349310 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:52.349267 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 15 21:10:52.349848 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:52.349576 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 15 21:10:52.349848 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:52.349743 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 15 21:10:52.350266 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:52.350092 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 15 21:10:52.350266 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:52.350118 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 15 21:10:52.350266 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:52.350092 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 15 21:10:52.350564 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:52.350542 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fb9b877c4-c79tp"] Jul 15 21:10:52.352324 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:52.352282 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-64fj2\"" Jul 15 21:10:52.434492 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:52.434462 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7549\" (UniqueName: \"kubernetes.io/projected/d30e3d12-33c6-4dee-bcae-5957ecdbc25b-kube-api-access-d7549\") pod \"console-6fb9b877c4-c79tp\" (UID: \"d30e3d12-33c6-4dee-bcae-5957ecdbc25b\") " pod="openshift-console/console-6fb9b877c4-c79tp" Jul 15 21:10:52.434642 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:52.434511 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d30e3d12-33c6-4dee-bcae-5957ecdbc25b-console-serving-cert\") pod \"console-6fb9b877c4-c79tp\" (UID: \"d30e3d12-33c6-4dee-bcae-5957ecdbc25b\") " pod="openshift-console/console-6fb9b877c4-c79tp" Jul 15 21:10:52.434642 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:52.434585 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d30e3d12-33c6-4dee-bcae-5957ecdbc25b-oauth-serving-cert\") pod \"console-6fb9b877c4-c79tp\" (UID: \"d30e3d12-33c6-4dee-bcae-5957ecdbc25b\") " pod="openshift-console/console-6fb9b877c4-c79tp" Jul 15 21:10:52.434642 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:52.434628 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d30e3d12-33c6-4dee-bcae-5957ecdbc25b-console-oauth-config\") pod \"console-6fb9b877c4-c79tp\" (UID: \"d30e3d12-33c6-4dee-bcae-5957ecdbc25b\") " pod="openshift-console/console-6fb9b877c4-c79tp" Jul 15 21:10:52.434741 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:52.434656 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d30e3d12-33c6-4dee-bcae-5957ecdbc25b-console-config\") pod \"console-6fb9b877c4-c79tp\" (UID: \"d30e3d12-33c6-4dee-bcae-5957ecdbc25b\") " pod="openshift-console/console-6fb9b877c4-c79tp" Jul 15 21:10:52.434741 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:52.434677 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d30e3d12-33c6-4dee-bcae-5957ecdbc25b-service-ca\") pod \"console-6fb9b877c4-c79tp\" (UID: \"d30e3d12-33c6-4dee-bcae-5957ecdbc25b\") " pod="openshift-console/console-6fb9b877c4-c79tp" Jul 15 21:10:52.535391 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:52.535354 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d30e3d12-33c6-4dee-bcae-5957ecdbc25b-console-serving-cert\") pod \"console-6fb9b877c4-c79tp\" (UID: \"d30e3d12-33c6-4dee-bcae-5957ecdbc25b\") " pod="openshift-console/console-6fb9b877c4-c79tp" Jul 15 21:10:52.535587 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:52.535406 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d30e3d12-33c6-4dee-bcae-5957ecdbc25b-oauth-serving-cert\") pod \"console-6fb9b877c4-c79tp\" (UID: \"d30e3d12-33c6-4dee-bcae-5957ecdbc25b\") " pod="openshift-console/console-6fb9b877c4-c79tp" Jul 15 21:10:52.535587 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:52.535449 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d30e3d12-33c6-4dee-bcae-5957ecdbc25b-console-oauth-config\") pod \"console-6fb9b877c4-c79tp\" (UID: \"d30e3d12-33c6-4dee-bcae-5957ecdbc25b\") " pod="openshift-console/console-6fb9b877c4-c79tp" Jul 15 21:10:52.535587 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:52.535476 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d30e3d12-33c6-4dee-bcae-5957ecdbc25b-console-config\") pod \"console-6fb9b877c4-c79tp\" (UID: \"d30e3d12-33c6-4dee-bcae-5957ecdbc25b\") " pod="openshift-console/console-6fb9b877c4-c79tp" Jul 15 21:10:52.535587 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:52.535497 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d30e3d12-33c6-4dee-bcae-5957ecdbc25b-service-ca\") pod \"console-6fb9b877c4-c79tp\" (UID: \"d30e3d12-33c6-4dee-bcae-5957ecdbc25b\") " pod="openshift-console/console-6fb9b877c4-c79tp" Jul 15 21:10:52.535587 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:52.535544 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7549\" (UniqueName: \"kubernetes.io/projected/d30e3d12-33c6-4dee-bcae-5957ecdbc25b-kube-api-access-d7549\") pod \"console-6fb9b877c4-c79tp\" (UID: \"d30e3d12-33c6-4dee-bcae-5957ecdbc25b\") " pod="openshift-console/console-6fb9b877c4-c79tp" Jul 15 21:10:52.536399 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:52.536370 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d30e3d12-33c6-4dee-bcae-5957ecdbc25b-service-ca\") pod \"console-6fb9b877c4-c79tp\" (UID: \"d30e3d12-33c6-4dee-bcae-5957ecdbc25b\") " pod="openshift-console/console-6fb9b877c4-c79tp" Jul 15 21:10:52.536541 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:52.536454 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d30e3d12-33c6-4dee-bcae-5957ecdbc25b-console-config\") pod \"console-6fb9b877c4-c79tp\" (UID: \"d30e3d12-33c6-4dee-bcae-5957ecdbc25b\") " pod="openshift-console/console-6fb9b877c4-c79tp" Jul 15 21:10:52.536541 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:52.536454 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d30e3d12-33c6-4dee-bcae-5957ecdbc25b-oauth-serving-cert\") pod \"console-6fb9b877c4-c79tp\" (UID: \"d30e3d12-33c6-4dee-bcae-5957ecdbc25b\") " pod="openshift-console/console-6fb9b877c4-c79tp" Jul 15 21:10:52.538250 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:52.538229 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d30e3d12-33c6-4dee-bcae-5957ecdbc25b-console-serving-cert\") pod \"console-6fb9b877c4-c79tp\" (UID: \"d30e3d12-33c6-4dee-bcae-5957ecdbc25b\") " pod="openshift-console/console-6fb9b877c4-c79tp" Jul 15 21:10:52.538250 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:52.538251 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d30e3d12-33c6-4dee-bcae-5957ecdbc25b-console-oauth-config\") pod \"console-6fb9b877c4-c79tp\" (UID: \"d30e3d12-33c6-4dee-bcae-5957ecdbc25b\") " pod="openshift-console/console-6fb9b877c4-c79tp" Jul 15 21:10:52.545376 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:52.545353 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7549\" (UniqueName: \"kubernetes.io/projected/d30e3d12-33c6-4dee-bcae-5957ecdbc25b-kube-api-access-d7549\") pod \"console-6fb9b877c4-c79tp\" (UID: \"d30e3d12-33c6-4dee-bcae-5957ecdbc25b\") " pod="openshift-console/console-6fb9b877c4-c79tp" Jul 15 21:10:52.655885 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:52.655775 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fb9b877c4-c79tp" Jul 15 21:10:52.843038 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:52.843001 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fb9b877c4-c79tp"] Jul 15 21:10:52.846547 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:10:52.846519 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd30e3d12_33c6_4dee_bcae_5957ecdbc25b.slice/crio-999d5738a86c0f5e4b23c0768f566759704a6b593bd2d947b6b38b07349c69fd WatchSource:0}: Error finding container 999d5738a86c0f5e4b23c0768f566759704a6b593bd2d947b6b38b07349c69fd: Status 404 returned error can't find the container with id 999d5738a86c0f5e4b23c0768f566759704a6b593bd2d947b6b38b07349c69fd Jul 15 21:10:53.071128 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:53.071041 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fb9b877c4-c79tp" event={"ID":"d30e3d12-33c6-4dee-bcae-5957ecdbc25b","Type":"ContainerStarted","Data":"999d5738a86c0f5e4b23c0768f566759704a6b593bd2d947b6b38b07349c69fd"} Jul 15 21:10:53.073123 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:53.073086 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tmgwf" event={"ID":"dc6b76d8-4b0e-48cb-a332-3c52fe17f9c5","Type":"ContainerStarted","Data":"576ca7076cccb8553a3a966c8c440ff5b14a0b217c9ec7668601c6a0870980b4"} Jul 15 21:10:53.075396 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:53.075370 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-89vwd" event={"ID":"e9154423-994b-45e7-9cad-813087e03e31","Type":"ContainerStarted","Data":"efa3606ad42bdf616a9117f22792a0de6012ebc495023430bffa0b8e99219d0a"} Jul 15 21:10:53.078271 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:53.078245 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lr4hr" event={"ID":"e8c2a4fd-b530-4bac-b9fa-6682ab28dde1","Type":"ContainerStarted","Data":"aaffdeffb4f806687f069d53693bbd1ea0e82a708a3c1c8cbaa9ffb30d8c3f85"} Jul 15 21:10:53.092244 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:53.092198 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tmgwf" podStartSLOduration=58.809250495 podStartE2EDuration="1m5.092182157s" totalImagesPullingTime="6.282931662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:09:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:53.091348382 +0000 UTC m=+74.985752474" watchObservedRunningTime="2026-07-15 21:10:53.092182157 +0000 UTC m=+74.986586221" Jul 15 21:10:53.110783 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:53.110737 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lr4hr" podStartSLOduration=34.787844911 podStartE2EDuration="41.110716693s" totalImagesPullingTime="6.322871782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:10:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:53.10882601 +0000 UTC m=+75.003230112" watchObservedRunningTime="2026-07-15 21:10:53.110716693 +0000 UTC m=+75.005120759" Jul 15 21:10:53.126770 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:53.126693 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-89vwd" podStartSLOduration=67.921848461 podStartE2EDuration="1m14.126670933s" totalImagesPullingTime="6.204822472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:53.124842101 +0000 UTC m=+75.019246187" watchObservedRunningTime="2026-07-15 21:10:53.126670933 +0000 UTC m=+75.021074992" Jul 15 21:10:54.082729 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:54.082698 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lr4hr" Jul 15 21:10:58.101133 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:58.101095 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fb9b877c4-c79tp" event={"ID":"d30e3d12-33c6-4dee-bcae-5957ecdbc25b","Type":"ContainerStarted","Data":"a23ae00650bc740b3d9c014554706ee68a896161fac89ce4269c5d9bc7bb151e"} Jul 15 21:10:58.103304 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:58.103263 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cpztv" event={"ID":"c74a5d7d-85ae-4321-8b64-803a463e0284","Type":"ContainerStarted","Data":"d23d8746fb897af9a8516a36314f888447b310fdb685114a1118de4f5a94d8e7"} Jul 15 21:10:58.119594 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:58.119541 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6fb9b877c4-c79tp" podStartSLOduration=1.461922475 podStartE2EDuration="6.119525997s" totalImagesPullingTime="4.657603522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:10:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:58.118094896 +0000 UTC m=+80.012498981" watchObservedRunningTime="2026-07-15 21:10:58.119525997 +0000 UTC m=+80.013930055" Jul 15 21:10:58.138580 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:10:58.138530 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cpztv" podStartSLOduration=17.881998198 podStartE2EDuration="36.138514317s" totalImagesPullingTime="18.256516119s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:10:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:58.137306727 +0000 UTC m=+80.031710783" watchObservedRunningTime="2026-07-15 21:10:58.138514317 +0000 UTC m=+80.032918382" Jul 15 21:11:00.675712 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:00.675595 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-4d4dd"] Jul 15 21:11:00.678627 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:00.678608 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-4d4dd" Jul 15 21:11:00.681173 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:00.681150 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 15 21:11:00.681318 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:00.681151 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 15 21:11:00.681318 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:00.681199 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 15 21:11:00.681952 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:00.681935 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-vtdnt\"" Jul 15 21:11:00.691110 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:00.691089 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-4d4dd"] Jul 15 21:11:00.811876 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:00.811844 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f2a470a-da11-4c99-b7ce-1c54dfb287ca-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-4d4dd\" (UID: \"1f2a470a-da11-4c99-b7ce-1c54dfb287ca\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4d4dd" Jul 15 21:11:00.811876 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:00.811879 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9xml\" (UniqueName: \"kubernetes.io/projected/1f2a470a-da11-4c99-b7ce-1c54dfb287ca-kube-api-access-r9xml\") pod \"prometheus-operator-64785b6675-4d4dd\" (UID: \"1f2a470a-da11-4c99-b7ce-1c54dfb287ca\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4d4dd" Jul 15 21:11:00.812083 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:00.811907 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f2a470a-da11-4c99-b7ce-1c54dfb287ca-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-4d4dd\" (UID: \"1f2a470a-da11-4c99-b7ce-1c54dfb287ca\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4d4dd" Jul 15 21:11:00.812083 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:00.811961 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f2a470a-da11-4c99-b7ce-1c54dfb287ca-metrics-client-ca\") pod \"prometheus-operator-64785b6675-4d4dd\" (UID: \"1f2a470a-da11-4c99-b7ce-1c54dfb287ca\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4d4dd" Jul 15 21:11:00.912753 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:00.912715 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f2a470a-da11-4c99-b7ce-1c54dfb287ca-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-4d4dd\" (UID: \"1f2a470a-da11-4c99-b7ce-1c54dfb287ca\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4d4dd" Jul 15 21:11:00.912753 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:00.912751 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9xml\" (UniqueName: \"kubernetes.io/projected/1f2a470a-da11-4c99-b7ce-1c54dfb287ca-kube-api-access-r9xml\") pod \"prometheus-operator-64785b6675-4d4dd\" (UID: \"1f2a470a-da11-4c99-b7ce-1c54dfb287ca\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4d4dd" Jul 15 21:11:00.912972 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:00.912772 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f2a470a-da11-4c99-b7ce-1c54dfb287ca-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-4d4dd\" (UID: \"1f2a470a-da11-4c99-b7ce-1c54dfb287ca\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4d4dd" Jul 15 21:11:00.912972 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:00.912806 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f2a470a-da11-4c99-b7ce-1c54dfb287ca-metrics-client-ca\") pod \"prometheus-operator-64785b6675-4d4dd\" (UID: \"1f2a470a-da11-4c99-b7ce-1c54dfb287ca\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4d4dd" Jul 15 21:11:00.913584 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:00.913561 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f2a470a-da11-4c99-b7ce-1c54dfb287ca-metrics-client-ca\") pod \"prometheus-operator-64785b6675-4d4dd\" (UID: \"1f2a470a-da11-4c99-b7ce-1c54dfb287ca\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4d4dd" Jul 15 21:11:00.915264 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:00.915245 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f2a470a-da11-4c99-b7ce-1c54dfb287ca-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-4d4dd\" (UID: \"1f2a470a-da11-4c99-b7ce-1c54dfb287ca\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4d4dd" Jul 15 21:11:00.915457 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:00.915436 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f2a470a-da11-4c99-b7ce-1c54dfb287ca-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-4d4dd\" (UID: \"1f2a470a-da11-4c99-b7ce-1c54dfb287ca\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4d4dd" Jul 15 21:11:00.921262 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:00.921235 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9xml\" (UniqueName: \"kubernetes.io/projected/1f2a470a-da11-4c99-b7ce-1c54dfb287ca-kube-api-access-r9xml\") pod \"prometheus-operator-64785b6675-4d4dd\" (UID: \"1f2a470a-da11-4c99-b7ce-1c54dfb287ca\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4d4dd" Jul 15 21:11:00.987323 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:00.987215 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-4d4dd" Jul 15 21:11:01.090532 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:01.090507 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lr4hr" Jul 15 21:11:01.130941 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:01.130920 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-4d4dd"] Jul 15 21:11:01.133310 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:11:01.133260 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f2a470a_da11_4c99_b7ce_1c54dfb287ca.slice/crio-9506a5289b01516dee76a9418ee65f3af47dff79b936e3dba9c998a881fe762d WatchSource:0}: Error finding container 9506a5289b01516dee76a9418ee65f3af47dff79b936e3dba9c998a881fe762d: Status 404 returned error can't find the container with id 9506a5289b01516dee76a9418ee65f3af47dff79b936e3dba9c998a881fe762d Jul 15 21:11:02.120086 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:02.120056 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-4d4dd" event={"ID":"1f2a470a-da11-4c99-b7ce-1c54dfb287ca","Type":"ContainerStarted","Data":"9506a5289b01516dee76a9418ee65f3af47dff79b936e3dba9c998a881fe762d"} Jul 15 21:11:02.656502 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:02.656451 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6fb9b877c4-c79tp" Jul 15 21:11:02.656692 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:02.656538 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6fb9b877c4-c79tp" Jul 15 21:11:02.661821 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:02.661794 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6fb9b877c4-c79tp" Jul 15 21:11:03.125589 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:03.125550 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-4d4dd" event={"ID":"1f2a470a-da11-4c99-b7ce-1c54dfb287ca","Type":"ContainerStarted","Data":"8120b5ae7f866c404ec7fef5eac5885bff89c1e108886faa1363806546928c86"} Jul 15 21:11:03.126075 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:03.125617 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-4d4dd" event={"ID":"1f2a470a-da11-4c99-b7ce-1c54dfb287ca","Type":"ContainerStarted","Data":"b4b005468270081e74c7e3c227545c736664e27406a5a35cdd67c85a77171a66"} Jul 15 21:11:03.129378 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:03.129353 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6fb9b877c4-c79tp" Jul 15 21:11:03.142439 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:03.142374 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-4d4dd" podStartSLOduration=1.540241917 podStartE2EDuration="3.142355192s" totalImagesPullingTime="1.602113275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:11:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:11:03.142032423 +0000 UTC m=+85.036436489" watchObservedRunningTime="2026-07-15 21:11:03.142355192 +0000 UTC m=+85.036759258" Jul 15 21:11:05.071327 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.071284 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-2nm8d"] Jul 15 21:11:05.073798 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.073781 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2nm8d" Jul 15 21:11:05.076021 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.076000 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 15 21:11:05.076157 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.076041 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 15 21:11:05.076262 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.076247 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-slkjw\"" Jul 15 21:11:05.103204 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.103177 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-2nm8d"] Jul 15 21:11:05.136817 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.136787 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9nxsl"] Jul 15 21:11:05.139034 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.139008 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9nxsl" Jul 15 21:11:05.142033 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.142013 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 15 21:11:05.142413 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.142384 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-phnng\"" Jul 15 21:11:05.142511 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.142452 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 15 21:11:05.142558 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.142541 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 15 21:11:05.150612 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.150590 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhgjx\" (UniqueName: \"kubernetes.io/projected/08da11a5-939f-4b2d-b706-9e497c9b0b12-kube-api-access-lhgjx\") pod \"openshift-state-metrics-84bd68b896-2nm8d\" (UID: \"08da11a5-939f-4b2d-b706-9e497c9b0b12\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2nm8d" Jul 15 21:11:05.150723 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.150640 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/08da11a5-939f-4b2d-b706-9e497c9b0b12-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-2nm8d\" (UID: \"08da11a5-939f-4b2d-b706-9e497c9b0b12\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2nm8d" Jul 15 21:11:05.150774 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.150744 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/08da11a5-939f-4b2d-b706-9e497c9b0b12-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-2nm8d\" (UID: \"08da11a5-939f-4b2d-b706-9e497c9b0b12\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2nm8d" Jul 15 21:11:05.150811 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.150780 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08da11a5-939f-4b2d-b706-9e497c9b0b12-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-2nm8d\" (UID: \"08da11a5-939f-4b2d-b706-9e497c9b0b12\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2nm8d" Jul 15 21:11:05.251141 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.251110 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ec004af-c7f8-4b94-b119-80ceadcd191e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9nxsl\" (UID: \"7ec004af-c7f8-4b94-b119-80ceadcd191e\") " pod="openshift-monitoring/node-exporter-9nxsl" Jul 15 21:11:05.251311 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.251150 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/08da11a5-939f-4b2d-b706-9e497c9b0b12-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-2nm8d\" (UID: \"08da11a5-939f-4b2d-b706-9e497c9b0b12\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2nm8d" Jul 15 21:11:05.251311 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.251167 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7ec004af-c7f8-4b94-b119-80ceadcd191e-root\") pod \"node-exporter-9nxsl\" (UID: \"7ec004af-c7f8-4b94-b119-80ceadcd191e\") " pod="openshift-monitoring/node-exporter-9nxsl" Jul 15 21:11:05.251311 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.251242 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ec004af-c7f8-4b94-b119-80ceadcd191e-sys\") pod \"node-exporter-9nxsl\" (UID: \"7ec004af-c7f8-4b94-b119-80ceadcd191e\") " pod="openshift-monitoring/node-exporter-9nxsl" Jul 15 21:11:05.251409 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:11:05.251280 2570 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 15 21:11:05.251445 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.251285 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/08da11a5-939f-4b2d-b706-9e497c9b0b12-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-2nm8d\" (UID: \"08da11a5-939f-4b2d-b706-9e497c9b0b12\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2nm8d" Jul 15 21:11:05.251445 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:11:05.251424 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08da11a5-939f-4b2d-b706-9e497c9b0b12-openshift-state-metrics-tls podName:08da11a5-939f-4b2d-b706-9e497c9b0b12 nodeName:}" failed. No retries permitted until 2026-07-15 21:11:05.751407285 +0000 UTC m=+87.645811328 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/08da11a5-939f-4b2d-b706-9e497c9b0b12-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-2nm8d" (UID: "08da11a5-939f-4b2d-b706-9e497c9b0b12") : secret "openshift-state-metrics-tls" not found Jul 15 21:11:05.251550 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.251464 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08da11a5-939f-4b2d-b706-9e497c9b0b12-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-2nm8d\" (UID: \"08da11a5-939f-4b2d-b706-9e497c9b0b12\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2nm8d" Jul 15 21:11:05.251550 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.251487 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7ec004af-c7f8-4b94-b119-80ceadcd191e-node-exporter-textfile\") pod \"node-exporter-9nxsl\" (UID: \"7ec004af-c7f8-4b94-b119-80ceadcd191e\") " pod="openshift-monitoring/node-exporter-9nxsl" Jul 15 21:11:05.251550 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.251505 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7ec004af-c7f8-4b94-b119-80ceadcd191e-node-exporter-wtmp\") pod \"node-exporter-9nxsl\" (UID: \"7ec004af-c7f8-4b94-b119-80ceadcd191e\") " pod="openshift-monitoring/node-exporter-9nxsl" Jul 15 21:11:05.251550 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.251533 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7ec004af-c7f8-4b94-b119-80ceadcd191e-node-exporter-accelerators-collector-config\") pod \"node-exporter-9nxsl\" (UID: \"7ec004af-c7f8-4b94-b119-80ceadcd191e\") " pod="openshift-monitoring/node-exporter-9nxsl" Jul 15 21:11:05.251733 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.251589 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7ec004af-c7f8-4b94-b119-80ceadcd191e-node-exporter-tls\") pod \"node-exporter-9nxsl\" (UID: \"7ec004af-c7f8-4b94-b119-80ceadcd191e\") " pod="openshift-monitoring/node-exporter-9nxsl" Jul 15 21:11:05.251733 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.251644 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ec004af-c7f8-4b94-b119-80ceadcd191e-metrics-client-ca\") pod \"node-exporter-9nxsl\" (UID: \"7ec004af-c7f8-4b94-b119-80ceadcd191e\") " pod="openshift-monitoring/node-exporter-9nxsl" Jul 15 21:11:05.251821 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.251737 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jg4k\" (UniqueName: \"kubernetes.io/projected/7ec004af-c7f8-4b94-b119-80ceadcd191e-kube-api-access-5jg4k\") pod \"node-exporter-9nxsl\" (UID: \"7ec004af-c7f8-4b94-b119-80ceadcd191e\") " pod="openshift-monitoring/node-exporter-9nxsl" Jul 15 21:11:05.251821 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.251768 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhgjx\" (UniqueName: \"kubernetes.io/projected/08da11a5-939f-4b2d-b706-9e497c9b0b12-kube-api-access-lhgjx\") pod \"openshift-state-metrics-84bd68b896-2nm8d\" (UID: \"08da11a5-939f-4b2d-b706-9e497c9b0b12\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2nm8d" Jul 15 21:11:05.252250 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.252227 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08da11a5-939f-4b2d-b706-9e497c9b0b12-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-2nm8d\" (UID: \"08da11a5-939f-4b2d-b706-9e497c9b0b12\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2nm8d" Jul 15 21:11:05.253660 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.253641 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/08da11a5-939f-4b2d-b706-9e497c9b0b12-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-2nm8d\" (UID: \"08da11a5-939f-4b2d-b706-9e497c9b0b12\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2nm8d" Jul 15 21:11:05.270869 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.270837 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhgjx\" (UniqueName: \"kubernetes.io/projected/08da11a5-939f-4b2d-b706-9e497c9b0b12-kube-api-access-lhgjx\") pod \"openshift-state-metrics-84bd68b896-2nm8d\" (UID: \"08da11a5-939f-4b2d-b706-9e497c9b0b12\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2nm8d" Jul 15 21:11:05.352930 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.352893 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ec004af-c7f8-4b94-b119-80ceadcd191e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9nxsl\" (UID: \"7ec004af-c7f8-4b94-b119-80ceadcd191e\") " pod="openshift-monitoring/node-exporter-9nxsl" Jul 15 21:11:05.353105 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.352953 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7ec004af-c7f8-4b94-b119-80ceadcd191e-root\") pod \"node-exporter-9nxsl\" (UID: \"7ec004af-c7f8-4b94-b119-80ceadcd191e\") " pod="openshift-monitoring/node-exporter-9nxsl" Jul 15 21:11:05.353105 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.353007 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ec004af-c7f8-4b94-b119-80ceadcd191e-sys\") pod \"node-exporter-9nxsl\" (UID: \"7ec004af-c7f8-4b94-b119-80ceadcd191e\") " pod="openshift-monitoring/node-exporter-9nxsl" Jul 15 21:11:05.353105 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.353034 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7ec004af-c7f8-4b94-b119-80ceadcd191e-root\") pod \"node-exporter-9nxsl\" (UID: \"7ec004af-c7f8-4b94-b119-80ceadcd191e\") " pod="openshift-monitoring/node-exporter-9nxsl" Jul 15 21:11:05.353105 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.353039 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7ec004af-c7f8-4b94-b119-80ceadcd191e-node-exporter-textfile\") pod \"node-exporter-9nxsl\" (UID: \"7ec004af-c7f8-4b94-b119-80ceadcd191e\") " pod="openshift-monitoring/node-exporter-9nxsl" Jul 15 21:11:05.353357 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.353109 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7ec004af-c7f8-4b94-b119-80ceadcd191e-node-exporter-wtmp\") pod \"node-exporter-9nxsl\" (UID: \"7ec004af-c7f8-4b94-b119-80ceadcd191e\") " pod="openshift-monitoring/node-exporter-9nxsl" Jul 15 21:11:05.353357 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.353123 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ec004af-c7f8-4b94-b119-80ceadcd191e-sys\") pod \"node-exporter-9nxsl\" (UID: \"7ec004af-c7f8-4b94-b119-80ceadcd191e\") " pod="openshift-monitoring/node-exporter-9nxsl" Jul 15 21:11:05.353357 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.353142 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7ec004af-c7f8-4b94-b119-80ceadcd191e-node-exporter-accelerators-collector-config\") pod \"node-exporter-9nxsl\" (UID: \"7ec004af-c7f8-4b94-b119-80ceadcd191e\") " pod="openshift-monitoring/node-exporter-9nxsl" Jul 15 21:11:05.353357 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.353175 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7ec004af-c7f8-4b94-b119-80ceadcd191e-node-exporter-tls\") pod \"node-exporter-9nxsl\" (UID: \"7ec004af-c7f8-4b94-b119-80ceadcd191e\") " pod="openshift-monitoring/node-exporter-9nxsl" Jul 15 21:11:05.353357 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.353199 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ec004af-c7f8-4b94-b119-80ceadcd191e-metrics-client-ca\") pod \"node-exporter-9nxsl\" (UID: \"7ec004af-c7f8-4b94-b119-80ceadcd191e\") " pod="openshift-monitoring/node-exporter-9nxsl" Jul 15 21:11:05.353357 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.353252 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7ec004af-c7f8-4b94-b119-80ceadcd191e-node-exporter-wtmp\") pod \"node-exporter-9nxsl\" (UID: \"7ec004af-c7f8-4b94-b119-80ceadcd191e\") " pod="openshift-monitoring/node-exporter-9nxsl" Jul 15 21:11:05.353357 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.353261 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jg4k\" (UniqueName: \"kubernetes.io/projected/7ec004af-c7f8-4b94-b119-80ceadcd191e-kube-api-access-5jg4k\") pod \"node-exporter-9nxsl\" (UID: \"7ec004af-c7f8-4b94-b119-80ceadcd191e\") " pod="openshift-monitoring/node-exporter-9nxsl" Jul 15 21:11:05.353720 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.353702 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7ec004af-c7f8-4b94-b119-80ceadcd191e-node-exporter-textfile\") pod \"node-exporter-9nxsl\" (UID: \"7ec004af-c7f8-4b94-b119-80ceadcd191e\") " pod="openshift-monitoring/node-exporter-9nxsl" Jul 15 21:11:05.353771 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.353730 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7ec004af-c7f8-4b94-b119-80ceadcd191e-node-exporter-accelerators-collector-config\") pod \"node-exporter-9nxsl\" (UID: \"7ec004af-c7f8-4b94-b119-80ceadcd191e\") " pod="openshift-monitoring/node-exporter-9nxsl" Jul 15 21:11:05.353929 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.353907 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ec004af-c7f8-4b94-b119-80ceadcd191e-metrics-client-ca\") pod \"node-exporter-9nxsl\" (UID: \"7ec004af-c7f8-4b94-b119-80ceadcd191e\") " pod="openshift-monitoring/node-exporter-9nxsl" Jul 15 21:11:05.355525 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.355499 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ec004af-c7f8-4b94-b119-80ceadcd191e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9nxsl\" (UID: \"7ec004af-c7f8-4b94-b119-80ceadcd191e\") " pod="openshift-monitoring/node-exporter-9nxsl" Jul 15 21:11:05.355622 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.355597 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7ec004af-c7f8-4b94-b119-80ceadcd191e-node-exporter-tls\") pod \"node-exporter-9nxsl\" (UID: \"7ec004af-c7f8-4b94-b119-80ceadcd191e\") " pod="openshift-monitoring/node-exporter-9nxsl" Jul 15 21:11:05.361863 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.361843 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jg4k\" (UniqueName: \"kubernetes.io/projected/7ec004af-c7f8-4b94-b119-80ceadcd191e-kube-api-access-5jg4k\") pod \"node-exporter-9nxsl\" (UID: \"7ec004af-c7f8-4b94-b119-80ceadcd191e\") " pod="openshift-monitoring/node-exporter-9nxsl" Jul 15 21:11:05.448198 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.448167 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9nxsl" Jul 15 21:11:05.458552 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:11:05.458526 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ec004af_c7f8_4b94_b119_80ceadcd191e.slice/crio-24e741b273073bf645dcdc56dfb9df77c50b57cf97af7205588a113aab7ff109 WatchSource:0}: Error finding container 24e741b273073bf645dcdc56dfb9df77c50b57cf97af7205588a113aab7ff109: Status 404 returned error can't find the container with id 24e741b273073bf645dcdc56dfb9df77c50b57cf97af7205588a113aab7ff109 Jul 15 21:11:05.757942 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.757852 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/08da11a5-939f-4b2d-b706-9e497c9b0b12-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-2nm8d\" (UID: \"08da11a5-939f-4b2d-b706-9e497c9b0b12\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2nm8d" Jul 15 21:11:05.760109 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.760078 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/08da11a5-939f-4b2d-b706-9e497c9b0b12-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-2nm8d\" (UID: \"08da11a5-939f-4b2d-b706-9e497c9b0b12\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2nm8d" Jul 15 21:11:05.983098 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:05.983061 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2nm8d" Jul 15 21:11:06.135553 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:06.135515 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-2nm8d"] Jul 15 21:11:06.138967 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:11:06.138756 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08da11a5_939f_4b2d_b706_9e497c9b0b12.slice/crio-9729756af74e1270b83b02d7e93c2bf5f754d48214d790140ee5a7749400a750 WatchSource:0}: Error finding container 9729756af74e1270b83b02d7e93c2bf5f754d48214d790140ee5a7749400a750: Status 404 returned error can't find the container with id 9729756af74e1270b83b02d7e93c2bf5f754d48214d790140ee5a7749400a750 Jul 15 21:11:06.140527 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:06.140045 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9nxsl" event={"ID":"7ec004af-c7f8-4b94-b119-80ceadcd191e","Type":"ContainerStarted","Data":"24e741b273073bf645dcdc56dfb9df77c50b57cf97af7205588a113aab7ff109"} Jul 15 21:11:06.978480 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:06.978444 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-79778fcf46-l49zk" Jul 15 21:11:07.149202 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:07.149167 2570 generic.go:356] "Generic (PLEG): container finished" podID="7ec004af-c7f8-4b94-b119-80ceadcd191e" containerID="4e66599433be5f45003477d5e2a5c31e85b591478d23e9e68981410999c3cf2e" exitCode=0 Jul 15 21:11:07.149676 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:07.149255 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9nxsl" event={"ID":"7ec004af-c7f8-4b94-b119-80ceadcd191e","Type":"ContainerDied","Data":"4e66599433be5f45003477d5e2a5c31e85b591478d23e9e68981410999c3cf2e"} Jul 15 21:11:07.151604 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:07.151577 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2nm8d" event={"ID":"08da11a5-939f-4b2d-b706-9e497c9b0b12","Type":"ContainerStarted","Data":"82de629b059935d4af081f3fddc36b0ab8f849163dd0ba36ef7128569bd9dde7"} Jul 15 21:11:07.151721 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:07.151636 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2nm8d" event={"ID":"08da11a5-939f-4b2d-b706-9e497c9b0b12","Type":"ContainerStarted","Data":"75eeffbdf3008c16b7ba0e202b8ab6639e3be4884c9b1a26c44319b622287f2d"} Jul 15 21:11:07.151721 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:07.151666 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2nm8d" event={"ID":"08da11a5-939f-4b2d-b706-9e497c9b0b12","Type":"ContainerStarted","Data":"9729756af74e1270b83b02d7e93c2bf5f754d48214d790140ee5a7749400a750"} Jul 15 21:11:08.157211 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:08.157176 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9nxsl" event={"ID":"7ec004af-c7f8-4b94-b119-80ceadcd191e","Type":"ContainerStarted","Data":"10b75b6002959e8a53b49a70bd57b9aa5a4156628d42ab9d1db84059c7381a9f"} Jul 15 21:11:08.157690 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:08.157238 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9nxsl" event={"ID":"7ec004af-c7f8-4b94-b119-80ceadcd191e","Type":"ContainerStarted","Data":"b8eed19550d58ce527f780bb63271d76983b27c7688197c2c47b56d4230223cc"} Jul 15 21:11:08.159229 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:08.159206 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2nm8d" event={"ID":"08da11a5-939f-4b2d-b706-9e497c9b0b12","Type":"ContainerStarted","Data":"f55d0f67f250451d6f9fdb235e772a1e62381797f24440343e0945556e8b56ab"} Jul 15 21:11:08.186230 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:08.186184 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9nxsl" podStartSLOduration=2.062250185 podStartE2EDuration="3.186170101s" totalImagesPullingTime="1.056853374s" totalInitContainerRuntime="67.066542ms" isStatefulPod=true podCreationTimestamp="2026-07-15 21:11:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:11:08.186068296 +0000 UTC m=+90.080472385" watchObservedRunningTime="2026-07-15 21:11:08.186170101 +0000 UTC m=+90.080574170" Jul 15 21:11:08.210143 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:08.210113 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-b47559bdf-cgv8n"] Jul 15 21:11:08.212190 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:08.212143 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2nm8d" podStartSLOduration=2.238881802 podStartE2EDuration="3.212126643s" totalImagesPullingTime="973.244841ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:11:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:11:08.212005177 +0000 UTC m=+90.106409272" watchObservedRunningTime="2026-07-15 21:11:08.212126643 +0000 UTC m=+90.106530707" Jul 15 21:11:08.217496 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:08.217471 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-b47559bdf-cgv8n" Jul 15 21:11:08.220065 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:08.220014 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 15 21:11:08.220065 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:08.220032 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 15 21:11:08.220258 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:08.220241 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 15 21:11:08.220360 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:08.220284 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 15 21:11:08.220360 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:08.220243 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 15 21:11:08.220510 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:08.220497 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-rcnf7\"" Jul 15 21:11:08.220633 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:08.220615 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bib5aa6gcrr2t\"" Jul 15 21:11:08.228105 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:08.228084 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-b47559bdf-cgv8n"] Jul 15 21:11:08.280478 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:08.280449 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3269cef9-f9ab-41d1-b81a-9f9d177c4f43-secret-thanos-querier-tls\") pod \"thanos-querier-b47559bdf-cgv8n\" (UID: \"3269cef9-f9ab-41d1-b81a-9f9d177c4f43\") " pod="openshift-monitoring/thanos-querier-b47559bdf-cgv8n" Jul 15 21:11:08.280623 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:08.280509 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3269cef9-f9ab-41d1-b81a-9f9d177c4f43-secret-grpc-tls\") pod \"thanos-querier-b47559bdf-cgv8n\" (UID: \"3269cef9-f9ab-41d1-b81a-9f9d177c4f43\") " pod="openshift-monitoring/thanos-querier-b47559bdf-cgv8n" Jul 15 21:11:08.280685 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:08.280626 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3269cef9-f9ab-41d1-b81a-9f9d177c4f43-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-b47559bdf-cgv8n\" (UID: \"3269cef9-f9ab-41d1-b81a-9f9d177c4f43\") " pod="openshift-monitoring/thanos-querier-b47559bdf-cgv8n" Jul 15 21:11:08.280685 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:08.280664 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3269cef9-f9ab-41d1-b81a-9f9d177c4f43-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-b47559bdf-cgv8n\" (UID: \"3269cef9-f9ab-41d1-b81a-9f9d177c4f43\") " pod="openshift-monitoring/thanos-querier-b47559bdf-cgv8n" Jul 15 21:11:08.280805 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:08.280691 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp86t\" (UniqueName: \"kubernetes.io/projected/3269cef9-f9ab-41d1-b81a-9f9d177c4f43-kube-api-access-kp86t\") pod \"thanos-querier-b47559bdf-cgv8n\" (UID: \"3269cef9-f9ab-41d1-b81a-9f9d177c4f43\") " pod="openshift-monitoring/thanos-querier-b47559bdf-cgv8n" Jul 15 21:11:08.280950 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:08.280933 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3269cef9-f9ab-41d1-b81a-9f9d177c4f43-metrics-client-ca\") pod \"thanos-querier-b47559bdf-cgv8n\" (UID: \"3269cef9-f9ab-41d1-b81a-9f9d177c4f43\") " pod="openshift-monitoring/thanos-querier-b47559bdf-cgv8n" Jul 15 21:11:08.280989 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:08.280968 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3269cef9-f9ab-41d1-b81a-9f9d177c4f43-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-b47559bdf-cgv8n\" (UID: \"3269cef9-f9ab-41d1-b81a-9f9d177c4f43\") " pod="openshift-monitoring/thanos-querier-b47559bdf-cgv8n" Jul 15 21:11:08.281030 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:08.280988 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3269cef9-f9ab-41d1-b81a-9f9d177c4f43-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-b47559bdf-cgv8n\" (UID: \"3269cef9-f9ab-41d1-b81a-9f9d177c4f43\") " pod="openshift-monitoring/thanos-querier-b47559bdf-cgv8n" Jul 15 21:11:08.381712 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:08.381678 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3269cef9-f9ab-41d1-b81a-9f9d177c4f43-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-b47559bdf-cgv8n\" (UID: \"3269cef9-f9ab-41d1-b81a-9f9d177c4f43\") " pod="openshift-monitoring/thanos-querier-b47559bdf-cgv8n" Jul 15 21:11:08.381712 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:08.381713 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3269cef9-f9ab-41d1-b81a-9f9d177c4f43-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-b47559bdf-cgv8n\" (UID: \"3269cef9-f9ab-41d1-b81a-9f9d177c4f43\") " pod="openshift-monitoring/thanos-querier-b47559bdf-cgv8n" Jul 15 21:11:08.381921 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:08.381732 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp86t\" (UniqueName: \"kubernetes.io/projected/3269cef9-f9ab-41d1-b81a-9f9d177c4f43-kube-api-access-kp86t\") pod \"thanos-querier-b47559bdf-cgv8n\" (UID: \"3269cef9-f9ab-41d1-b81a-9f9d177c4f43\") " pod="openshift-monitoring/thanos-querier-b47559bdf-cgv8n" Jul 15 21:11:08.381921 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:08.381764 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3269cef9-f9ab-41d1-b81a-9f9d177c4f43-metrics-client-ca\") pod \"thanos-querier-b47559bdf-cgv8n\" (UID: \"3269cef9-f9ab-41d1-b81a-9f9d177c4f43\") " pod="openshift-monitoring/thanos-querier-b47559bdf-cgv8n" Jul 15 21:11:08.381921 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:08.381785 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3269cef9-f9ab-41d1-b81a-9f9d177c4f43-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-b47559bdf-cgv8n\" (UID: \"3269cef9-f9ab-41d1-b81a-9f9d177c4f43\") " pod="openshift-monitoring/thanos-querier-b47559bdf-cgv8n" Jul 15 21:11:08.381921 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:08.381801 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3269cef9-f9ab-41d1-b81a-9f9d177c4f43-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-b47559bdf-cgv8n\" (UID: \"3269cef9-f9ab-41d1-b81a-9f9d177c4f43\") " pod="openshift-monitoring/thanos-querier-b47559bdf-cgv8n" Jul 15 21:11:08.381921 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:08.381830 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3269cef9-f9ab-41d1-b81a-9f9d177c4f43-secret-thanos-querier-tls\") pod \"thanos-querier-b47559bdf-cgv8n\" (UID: \"3269cef9-f9ab-41d1-b81a-9f9d177c4f43\") " pod="openshift-monitoring/thanos-querier-b47559bdf-cgv8n" Jul 15 21:11:08.381921 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:08.381857 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3269cef9-f9ab-41d1-b81a-9f9d177c4f43-secret-grpc-tls\") pod \"thanos-querier-b47559bdf-cgv8n\" (UID: \"3269cef9-f9ab-41d1-b81a-9f9d177c4f43\") " pod="openshift-monitoring/thanos-querier-b47559bdf-cgv8n" Jul 15 21:11:08.382693 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:08.382665 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3269cef9-f9ab-41d1-b81a-9f9d177c4f43-metrics-client-ca\") pod \"thanos-querier-b47559bdf-cgv8n\" (UID: \"3269cef9-f9ab-41d1-b81a-9f9d177c4f43\") " pod="openshift-monitoring/thanos-querier-b47559bdf-cgv8n" Jul 15 21:11:08.384515 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:08.384489 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3269cef9-f9ab-41d1-b81a-9f9d177c4f43-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-b47559bdf-cgv8n\" (UID: \"3269cef9-f9ab-41d1-b81a-9f9d177c4f43\") " pod="openshift-monitoring/thanos-querier-b47559bdf-cgv8n" Jul 15 21:11:08.384759 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:08.384737 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3269cef9-f9ab-41d1-b81a-9f9d177c4f43-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-b47559bdf-cgv8n\" (UID: \"3269cef9-f9ab-41d1-b81a-9f9d177c4f43\") " pod="openshift-monitoring/thanos-querier-b47559bdf-cgv8n" Jul 15 21:11:08.384822 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:08.384788 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3269cef9-f9ab-41d1-b81a-9f9d177c4f43-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-b47559bdf-cgv8n\" (UID: \"3269cef9-f9ab-41d1-b81a-9f9d177c4f43\") " pod="openshift-monitoring/thanos-querier-b47559bdf-cgv8n" Jul 15 21:11:08.384894 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:08.384867 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3269cef9-f9ab-41d1-b81a-9f9d177c4f43-secret-thanos-querier-tls\") pod \"thanos-querier-b47559bdf-cgv8n\" (UID: \"3269cef9-f9ab-41d1-b81a-9f9d177c4f43\") " pod="openshift-monitoring/thanos-querier-b47559bdf-cgv8n" Jul 15 21:11:08.384960 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:08.384936 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3269cef9-f9ab-41d1-b81a-9f9d177c4f43-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-b47559bdf-cgv8n\" (UID: \"3269cef9-f9ab-41d1-b81a-9f9d177c4f43\") " pod="openshift-monitoring/thanos-querier-b47559bdf-cgv8n" Jul 15 21:11:08.385055 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:08.385040 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3269cef9-f9ab-41d1-b81a-9f9d177c4f43-secret-grpc-tls\") pod \"thanos-querier-b47559bdf-cgv8n\" (UID: \"3269cef9-f9ab-41d1-b81a-9f9d177c4f43\") " pod="openshift-monitoring/thanos-querier-b47559bdf-cgv8n" Jul 15 21:11:08.389773 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:08.389749 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp86t\" (UniqueName: \"kubernetes.io/projected/3269cef9-f9ab-41d1-b81a-9f9d177c4f43-kube-api-access-kp86t\") pod \"thanos-querier-b47559bdf-cgv8n\" (UID: \"3269cef9-f9ab-41d1-b81a-9f9d177c4f43\") " pod="openshift-monitoring/thanos-querier-b47559bdf-cgv8n" Jul 15 21:11:08.526612 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:08.526532 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-b47559bdf-cgv8n" Jul 15 21:11:08.657949 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:08.657919 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-b47559bdf-cgv8n"] Jul 15 21:11:08.661061 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:11:08.661036 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3269cef9_f9ab_41d1_b81a_9f9d177c4f43.slice/crio-122a04b64097ab3dd2cdf48e5b2b112ffa662d751355ad8959940e59217ccf74 WatchSource:0}: Error finding container 122a04b64097ab3dd2cdf48e5b2b112ffa662d751355ad8959940e59217ccf74: Status 404 returned error can't find the container with id 122a04b64097ab3dd2cdf48e5b2b112ffa662d751355ad8959940e59217ccf74 Jul 15 21:11:09.164637 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:09.164600 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b47559bdf-cgv8n" event={"ID":"3269cef9-f9ab-41d1-b81a-9f9d177c4f43","Type":"ContainerStarted","Data":"122a04b64097ab3dd2cdf48e5b2b112ffa662d751355ad8959940e59217ccf74"} Jul 15 21:11:09.838707 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:09.838670 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-24jkr"] Jul 15 21:11:09.841752 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:09.841725 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-24jkr" Jul 15 21:11:09.843958 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:09.843922 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-7vpwp\"" Jul 15 21:11:09.843958 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:09.843923 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 15 21:11:09.852958 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:09.852933 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-24jkr"] Jul 15 21:11:09.997506 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:09.997474 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d406ed2e-c831-4cc7-b75c-ee0d77e14001-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-24jkr\" (UID: \"d406ed2e-c831-4cc7-b75c-ee0d77e14001\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-24jkr" Jul 15 21:11:09.997689 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:09.997599 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssgxv\" (UniqueName: \"kubernetes.io/projected/d406ed2e-c831-4cc7-b75c-ee0d77e14001-kube-api-access-ssgxv\") pod \"monitoring-plugin-5f68df7f58-24jkr\" (UID: \"d406ed2e-c831-4cc7-b75c-ee0d77e14001\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-24jkr" Jul 15 21:11:10.098829 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:10.098745 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssgxv\" (UniqueName: \"kubernetes.io/projected/d406ed2e-c831-4cc7-b75c-ee0d77e14001-kube-api-access-ssgxv\") pod \"monitoring-plugin-5f68df7f58-24jkr\" (UID: \"d406ed2e-c831-4cc7-b75c-ee0d77e14001\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-24jkr" Jul 15 21:11:10.098829 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:10.098795 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d406ed2e-c831-4cc7-b75c-ee0d77e14001-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-24jkr\" (UID: \"d406ed2e-c831-4cc7-b75c-ee0d77e14001\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-24jkr" Jul 15 21:11:10.101829 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:10.101806 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d406ed2e-c831-4cc7-b75c-ee0d77e14001-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-24jkr\" (UID: \"d406ed2e-c831-4cc7-b75c-ee0d77e14001\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-24jkr" Jul 15 21:11:10.110223 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:10.110184 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssgxv\" (UniqueName: \"kubernetes.io/projected/d406ed2e-c831-4cc7-b75c-ee0d77e14001-kube-api-access-ssgxv\") pod \"monitoring-plugin-5f68df7f58-24jkr\" (UID: \"d406ed2e-c831-4cc7-b75c-ee0d77e14001\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-24jkr" Jul 15 21:11:10.153082 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:10.153047 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-24jkr" Jul 15 21:11:10.564723 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:10.564698 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-24jkr"] Jul 15 21:11:10.568714 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:11:10.568689 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd406ed2e_c831_4cc7_b75c_ee0d77e14001.slice/crio-3b1c1853af21df75c0607b81e85439c9ad4711263091b77c0dadfc3d4d5e520a WatchSource:0}: Error finding container 3b1c1853af21df75c0607b81e85439c9ad4711263091b77c0dadfc3d4d5e520a: Status 404 returned error can't find the container with id 3b1c1853af21df75c0607b81e85439c9ad4711263091b77c0dadfc3d4d5e520a Jul 15 21:11:11.177140 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:11.177102 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-24jkr" event={"ID":"d406ed2e-c831-4cc7-b75c-ee0d77e14001","Type":"ContainerStarted","Data":"3b1c1853af21df75c0607b81e85439c9ad4711263091b77c0dadfc3d4d5e520a"} Jul 15 21:11:11.179803 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:11.179775 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b47559bdf-cgv8n" event={"ID":"3269cef9-f9ab-41d1-b81a-9f9d177c4f43","Type":"ContainerStarted","Data":"d0a309e0da0cb6de25d111b227a164468e92683ba1d6967725c96a4abd63e9b6"} Jul 15 21:11:11.179928 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:11.179857 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b47559bdf-cgv8n" event={"ID":"3269cef9-f9ab-41d1-b81a-9f9d177c4f43","Type":"ContainerStarted","Data":"d89b2876fbe78a00803d176e2fe6500fd73361042456487183e09e236de7bdd0"} Jul 15 21:11:11.179928 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:11.179904 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b47559bdf-cgv8n" event={"ID":"3269cef9-f9ab-41d1-b81a-9f9d177c4f43","Type":"ContainerStarted","Data":"9fecf8b44ff091e9fa72bf127e4f45af0c614302c435eab4551decbf276b74b2"} Jul 15 21:11:11.527077 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:11.527046 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-79778fcf46-l49zk"] Jul 15 21:11:12.187225 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:12.186494 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-24jkr" event={"ID":"d406ed2e-c831-4cc7-b75c-ee0d77e14001","Type":"ContainerStarted","Data":"11a624ffde88299f965530eca61a6bf26660311ffeabe1e436e8431fed12a2b0"} Jul 15 21:11:12.187723 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:12.187344 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-24jkr" Jul 15 21:11:12.190789 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:12.190710 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b47559bdf-cgv8n" event={"ID":"3269cef9-f9ab-41d1-b81a-9f9d177c4f43","Type":"ContainerStarted","Data":"80e2e5c6bf3ec43107b161c6d8ec9f76350f00c0b69511d28fb10e8eb76eaca4"} Jul 15 21:11:12.190789 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:12.190766 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b47559bdf-cgv8n" event={"ID":"3269cef9-f9ab-41d1-b81a-9f9d177c4f43","Type":"ContainerStarted","Data":"01446e7c00b9b08cab01c0cc195e9574864bf0267d4b7baa9039d31ddcb4e471"} Jul 15 21:11:12.190984 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:12.190794 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b47559bdf-cgv8n" event={"ID":"3269cef9-f9ab-41d1-b81a-9f9d177c4f43","Type":"ContainerStarted","Data":"611446a4cc614f18bac2dc58a84737d3030f8426cb0386101ee12ff37ad2b521"} Jul 15 21:11:12.190984 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:12.190902 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-b47559bdf-cgv8n" Jul 15 21:11:12.193125 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:12.193101 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-24jkr" Jul 15 21:11:12.207423 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:12.207371 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-24jkr" podStartSLOduration=1.835706633 podStartE2EDuration="3.20735527s" totalImagesPullingTime="1.371648637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:11:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:11:12.205710562 +0000 UTC m=+94.100114624" watchObservedRunningTime="2026-07-15 21:11:12.20735527 +0000 UTC m=+94.101759403" Jul 15 21:11:12.229575 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:12.229525 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-b47559bdf-cgv8n" podStartSLOduration=1.8107990379999999 podStartE2EDuration="4.229507958s" totalImagesPullingTime="2.41870892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:11:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:11:12.228698458 +0000 UTC m=+94.123102557" watchObservedRunningTime="2026-07-15 21:11:12.229507958 +0000 UTC m=+94.123912079" Jul 15 21:11:15.970267 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:15.970229 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6p5nk" Jul 15 21:11:18.201394 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:18.201368 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-b47559bdf-cgv8n" Jul 15 21:11:20.686904 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:20.686868 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fb9b877c4-c79tp"] Jul 15 21:11:33.279976 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:33.279940 2570 generic.go:356] "Generic (PLEG): container finished" podID="4498916d-507d-4f9a-94d3-b9fb0b68c4aa" containerID="049c0c0bf1e4a1ca1085532c5d192427e66579997049c947565e7a7bbac297d9" exitCode=0 Jul 15 21:11:33.280379 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:33.280014 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-txm4n" event={"ID":"4498916d-507d-4f9a-94d3-b9fb0b68c4aa","Type":"ContainerDied","Data":"049c0c0bf1e4a1ca1085532c5d192427e66579997049c947565e7a7bbac297d9"} Jul 15 21:11:33.280379 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:33.280367 2570 scope.go:117] "RemoveContainer" containerID="049c0c0bf1e4a1ca1085532c5d192427e66579997049c947565e7a7bbac297d9" Jul 15 21:11:34.285493 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:34.285461 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-txm4n" event={"ID":"4498916d-507d-4f9a-94d3-b9fb0b68c4aa","Type":"ContainerStarted","Data":"8efe10ae98bd3a48f14975e9f328309e268eee61120b24b27d54594885938104"} Jul 15 21:11:36.554638 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:36.554592 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-79778fcf46-l49zk" podUID="8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a" containerName="registry" containerID="cri-o://cff7b36e252fd2c19e3b0fc8ef07dc7051d1f18c17f9bd2d3ca72740f8f4bbae" gracePeriod=30 Jul 15 21:11:36.822764 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:36.822741 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79778fcf46-l49zk" Jul 15 21:11:36.932577 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:36.932539 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-installation-pull-secrets\") pod \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\" (UID: \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\") " Jul 15 21:11:36.932577 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:36.932586 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-registry-tls\") pod \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\" (UID: \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\") " Jul 15 21:11:36.932826 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:36.932619 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-registry-certificates\") pod \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\" (UID: \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\") " Jul 15 21:11:36.932826 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:36.932643 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-trusted-ca\") pod \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\" (UID: \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\") " Jul 15 21:11:36.932826 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:36.932660 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-image-registry-private-configuration\") pod \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\" (UID: \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\") " Jul 15 21:11:36.932826 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:36.932694 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jxsm\" (UniqueName: \"kubernetes.io/projected/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-kube-api-access-4jxsm\") pod \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\" (UID: \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\") " Jul 15 21:11:36.932826 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:36.932730 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-bound-sa-token\") pod \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\" (UID: \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\") " Jul 15 21:11:36.932826 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:36.932767 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-ca-trust-extracted\") pod \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\" (UID: \"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a\") " Jul 15 21:11:36.933122 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:36.933066 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a" (UID: "8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:11:36.933278 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:36.933235 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a" (UID: "8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:11:36.935351 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:36.935312 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-kube-api-access-4jxsm" (OuterVolumeSpecName: "kube-api-access-4jxsm") pod "8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a" (UID: "8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a"). InnerVolumeSpecName "kube-api-access-4jxsm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:11:36.935488 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:36.935455 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a" (UID: "8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:11:36.935559 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:36.935524 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a" (UID: "8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:11:36.935612 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:36.935588 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a" (UID: "8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:11:36.935612 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:36.935580 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a" (UID: "8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:11:36.943770 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:36.943731 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a" (UID: "8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:11:37.033652 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:37.033613 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jxsm\" (UniqueName: \"kubernetes.io/projected/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-kube-api-access-4jxsm\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:11:37.033652 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:37.033644 2570 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-bound-sa-token\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:11:37.033652 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:37.033653 2570 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-ca-trust-extracted\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:11:37.033652 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:37.033662 2570 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-installation-pull-secrets\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:11:37.033966 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:37.033670 2570 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-registry-tls\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:11:37.033966 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:37.033679 2570 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-registry-certificates\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:11:37.033966 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:37.033687 2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-trusted-ca\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:11:37.033966 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:37.033696 2570 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a-image-registry-private-configuration\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:11:37.297689 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:37.297654 2570 generic.go:356] "Generic (PLEG): container finished" podID="8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a" containerID="cff7b36e252fd2c19e3b0fc8ef07dc7051d1f18c17f9bd2d3ca72740f8f4bbae" exitCode=0 Jul 15 21:11:37.297865 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:37.297703 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79778fcf46-l49zk" Jul 15 21:11:37.297865 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:37.297725 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79778fcf46-l49zk" event={"ID":"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a","Type":"ContainerDied","Data":"cff7b36e252fd2c19e3b0fc8ef07dc7051d1f18c17f9bd2d3ca72740f8f4bbae"} Jul 15 21:11:37.297865 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:37.297765 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79778fcf46-l49zk" event={"ID":"8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a","Type":"ContainerDied","Data":"42c638418800c4621d021dfbd89c83951f706294ebd7575bb943decda9f77536"} Jul 15 21:11:37.297865 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:37.297786 2570 scope.go:117] "RemoveContainer" containerID="cff7b36e252fd2c19e3b0fc8ef07dc7051d1f18c17f9bd2d3ca72740f8f4bbae" Jul 15 21:11:37.306492 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:37.306476 2570 scope.go:117] "RemoveContainer" containerID="cff7b36e252fd2c19e3b0fc8ef07dc7051d1f18c17f9bd2d3ca72740f8f4bbae" Jul 15 21:11:37.306751 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:11:37.306732 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cff7b36e252fd2c19e3b0fc8ef07dc7051d1f18c17f9bd2d3ca72740f8f4bbae\": container with ID starting with cff7b36e252fd2c19e3b0fc8ef07dc7051d1f18c17f9bd2d3ca72740f8f4bbae not found: ID does not exist" containerID="cff7b36e252fd2c19e3b0fc8ef07dc7051d1f18c17f9bd2d3ca72740f8f4bbae" Jul 15 21:11:37.306816 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:37.306761 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cff7b36e252fd2c19e3b0fc8ef07dc7051d1f18c17f9bd2d3ca72740f8f4bbae"} err="failed to get container status \"cff7b36e252fd2c19e3b0fc8ef07dc7051d1f18c17f9bd2d3ca72740f8f4bbae\": rpc error: code = NotFound desc = could not find container \"cff7b36e252fd2c19e3b0fc8ef07dc7051d1f18c17f9bd2d3ca72740f8f4bbae\": container with ID starting with cff7b36e252fd2c19e3b0fc8ef07dc7051d1f18c17f9bd2d3ca72740f8f4bbae not found: ID does not exist" Jul 15 21:11:37.318488 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:37.318458 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-79778fcf46-l49zk"] Jul 15 21:11:37.322491 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:37.322468 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-79778fcf46-l49zk"] Jul 15 21:11:38.589239 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:38.589199 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a" path="/var/lib/kubelet/pods/8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a/volumes" Jul 15 21:11:45.707749 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:45.707691 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6fb9b877c4-c79tp" podUID="d30e3d12-33c6-4dee-bcae-5957ecdbc25b" containerName="console" containerID="cri-o://a23ae00650bc740b3d9c014554706ee68a896161fac89ce4269c5d9bc7bb151e" gracePeriod=15 Jul 15 21:11:45.947497 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:45.947471 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fb9b877c4-c79tp" Jul 15 21:11:46.007210 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:46.007114 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7549\" (UniqueName: \"kubernetes.io/projected/d30e3d12-33c6-4dee-bcae-5957ecdbc25b-kube-api-access-d7549\") pod \"d30e3d12-33c6-4dee-bcae-5957ecdbc25b\" (UID: \"d30e3d12-33c6-4dee-bcae-5957ecdbc25b\") " Jul 15 21:11:46.007210 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:46.007175 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d30e3d12-33c6-4dee-bcae-5957ecdbc25b-service-ca\") pod \"d30e3d12-33c6-4dee-bcae-5957ecdbc25b\" (UID: \"d30e3d12-33c6-4dee-bcae-5957ecdbc25b\") " Jul 15 21:11:46.007452 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:46.007220 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d30e3d12-33c6-4dee-bcae-5957ecdbc25b-console-oauth-config\") pod \"d30e3d12-33c6-4dee-bcae-5957ecdbc25b\" (UID: \"d30e3d12-33c6-4dee-bcae-5957ecdbc25b\") " Jul 15 21:11:46.007452 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:46.007255 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d30e3d12-33c6-4dee-bcae-5957ecdbc25b-console-serving-cert\") pod \"d30e3d12-33c6-4dee-bcae-5957ecdbc25b\" (UID: \"d30e3d12-33c6-4dee-bcae-5957ecdbc25b\") " Jul 15 21:11:46.007452 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:46.007282 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d30e3d12-33c6-4dee-bcae-5957ecdbc25b-oauth-serving-cert\") pod \"d30e3d12-33c6-4dee-bcae-5957ecdbc25b\" (UID: \"d30e3d12-33c6-4dee-bcae-5957ecdbc25b\") " Jul 15 21:11:46.007452 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:46.007356 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d30e3d12-33c6-4dee-bcae-5957ecdbc25b-console-config\") pod \"d30e3d12-33c6-4dee-bcae-5957ecdbc25b\" (UID: \"d30e3d12-33c6-4dee-bcae-5957ecdbc25b\") " Jul 15 21:11:46.007727 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:46.007679 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d30e3d12-33c6-4dee-bcae-5957ecdbc25b-service-ca" (OuterVolumeSpecName: "service-ca") pod "d30e3d12-33c6-4dee-bcae-5957ecdbc25b" (UID: "d30e3d12-33c6-4dee-bcae-5957ecdbc25b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:11:46.007832 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:46.007741 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d30e3d12-33c6-4dee-bcae-5957ecdbc25b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d30e3d12-33c6-4dee-bcae-5957ecdbc25b" (UID: "d30e3d12-33c6-4dee-bcae-5957ecdbc25b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:11:46.007832 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:46.007804 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d30e3d12-33c6-4dee-bcae-5957ecdbc25b-console-config" (OuterVolumeSpecName: "console-config") pod "d30e3d12-33c6-4dee-bcae-5957ecdbc25b" (UID: "d30e3d12-33c6-4dee-bcae-5957ecdbc25b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:11:46.009516 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:46.009486 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d30e3d12-33c6-4dee-bcae-5957ecdbc25b-kube-api-access-d7549" (OuterVolumeSpecName: "kube-api-access-d7549") pod "d30e3d12-33c6-4dee-bcae-5957ecdbc25b" (UID: "d30e3d12-33c6-4dee-bcae-5957ecdbc25b"). InnerVolumeSpecName "kube-api-access-d7549". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:11:46.009769 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:46.009751 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d30e3d12-33c6-4dee-bcae-5957ecdbc25b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d30e3d12-33c6-4dee-bcae-5957ecdbc25b" (UID: "d30e3d12-33c6-4dee-bcae-5957ecdbc25b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:11:46.009828 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:46.009778 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d30e3d12-33c6-4dee-bcae-5957ecdbc25b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d30e3d12-33c6-4dee-bcae-5957ecdbc25b" (UID: "d30e3d12-33c6-4dee-bcae-5957ecdbc25b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:11:46.108923 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:46.108892 2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d30e3d12-33c6-4dee-bcae-5957ecdbc25b-console-config\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:11:46.108923 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:46.108917 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7549\" (UniqueName: \"kubernetes.io/projected/d30e3d12-33c6-4dee-bcae-5957ecdbc25b-kube-api-access-d7549\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:11:46.108923 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:46.108928 2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d30e3d12-33c6-4dee-bcae-5957ecdbc25b-service-ca\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:11:46.109142 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:46.108938 2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d30e3d12-33c6-4dee-bcae-5957ecdbc25b-console-oauth-config\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:11:46.109142 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:46.108947 2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d30e3d12-33c6-4dee-bcae-5957ecdbc25b-console-serving-cert\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:11:46.109142 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:46.108955 2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d30e3d12-33c6-4dee-bcae-5957ecdbc25b-oauth-serving-cert\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:11:46.332537 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:46.332505 2570 generic.go:356] "Generic (PLEG): container finished" podID="d30e3d12-33c6-4dee-bcae-5957ecdbc25b" containerID="a23ae00650bc740b3d9c014554706ee68a896161fac89ce4269c5d9bc7bb151e" exitCode=0 Jul 15 21:11:46.332726 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:46.332556 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fb9b877c4-c79tp" Jul 15 21:11:46.332726 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:46.332559 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fb9b877c4-c79tp" event={"ID":"d30e3d12-33c6-4dee-bcae-5957ecdbc25b","Type":"ContainerDied","Data":"a23ae00650bc740b3d9c014554706ee68a896161fac89ce4269c5d9bc7bb151e"} Jul 15 21:11:46.332726 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:46.332670 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fb9b877c4-c79tp" event={"ID":"d30e3d12-33c6-4dee-bcae-5957ecdbc25b","Type":"ContainerDied","Data":"999d5738a86c0f5e4b23c0768f566759704a6b593bd2d947b6b38b07349c69fd"} Jul 15 21:11:46.332726 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:46.332690 2570 scope.go:117] "RemoveContainer" containerID="a23ae00650bc740b3d9c014554706ee68a896161fac89ce4269c5d9bc7bb151e" Jul 15 21:11:46.341195 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:46.341174 2570 scope.go:117] "RemoveContainer" containerID="a23ae00650bc740b3d9c014554706ee68a896161fac89ce4269c5d9bc7bb151e" Jul 15 21:11:46.341502 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:11:46.341460 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a23ae00650bc740b3d9c014554706ee68a896161fac89ce4269c5d9bc7bb151e\": container with ID starting with a23ae00650bc740b3d9c014554706ee68a896161fac89ce4269c5d9bc7bb151e not found: ID does not exist" containerID="a23ae00650bc740b3d9c014554706ee68a896161fac89ce4269c5d9bc7bb151e" Jul 15 21:11:46.341567 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:46.341511 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a23ae00650bc740b3d9c014554706ee68a896161fac89ce4269c5d9bc7bb151e"} err="failed to get container status \"a23ae00650bc740b3d9c014554706ee68a896161fac89ce4269c5d9bc7bb151e\": rpc error: code = NotFound desc = could not find container \"a23ae00650bc740b3d9c014554706ee68a896161fac89ce4269c5d9bc7bb151e\": container with ID starting with a23ae00650bc740b3d9c014554706ee68a896161fac89ce4269c5d9bc7bb151e not found: ID does not exist" Jul 15 21:11:46.352778 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:46.352752 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fb9b877c4-c79tp"] Jul 15 21:11:46.358156 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:46.358135 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6fb9b877c4-c79tp"] Jul 15 21:11:46.589036 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:46.588959 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d30e3d12-33c6-4dee-bcae-5957ecdbc25b" path="/var/lib/kubelet/pods/d30e3d12-33c6-4dee-bcae-5957ecdbc25b/volumes" Jul 15 21:11:52.358442 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:52.358408 2570 generic.go:356] "Generic (PLEG): container finished" podID="5b6d3fc4-cf24-4721-af75-6082139bc6c4" containerID="68c804a08d02ae7bcc55c80c2ef3773c26304c838d43779aa7bcf18a28b3a293" exitCode=0 Jul 15 21:11:52.358948 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:52.358461 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zqgn5" event={"ID":"5b6d3fc4-cf24-4721-af75-6082139bc6c4","Type":"ContainerDied","Data":"68c804a08d02ae7bcc55c80c2ef3773c26304c838d43779aa7bcf18a28b3a293"} Jul 15 21:11:52.358948 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:52.358857 2570 scope.go:117] "RemoveContainer" containerID="68c804a08d02ae7bcc55c80c2ef3773c26304c838d43779aa7bcf18a28b3a293" Jul 15 21:11:53.368378 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:53.368346 2570 generic.go:356] "Generic (PLEG): container finished" podID="e7e943fc-fff4-4503-b81e-a56f9f640700" containerID="66d6659753da646b80a24d2a57ade6a78d5d2e436de570af247dc5d7a76d02e8" exitCode=0 Jul 15 21:11:53.368789 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:53.368423 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-ghgrt" event={"ID":"e7e943fc-fff4-4503-b81e-a56f9f640700","Type":"ContainerDied","Data":"66d6659753da646b80a24d2a57ade6a78d5d2e436de570af247dc5d7a76d02e8"} Jul 15 21:11:53.368789 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:53.368784 2570 scope.go:117] "RemoveContainer" containerID="66d6659753da646b80a24d2a57ade6a78d5d2e436de570af247dc5d7a76d02e8" Jul 15 21:11:53.370213 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:53.370194 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zqgn5" event={"ID":"5b6d3fc4-cf24-4721-af75-6082139bc6c4","Type":"ContainerStarted","Data":"d5080b666662d8ffc58de9e44a999d7a7e5a7576d56cef2ca3cbbf0ae04479d1"} Jul 15 21:11:54.375997 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:11:54.375961 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-ghgrt" event={"ID":"e7e943fc-fff4-4503-b81e-a56f9f640700","Type":"ContainerStarted","Data":"f6e80fa44d24e924597c40a941202a42ee4c06680ff99946b225c960c4633943"} Jul 15 21:12:26.909313 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:26.909272 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 21:12:26.909911 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:26.909893 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a" containerName="registry" Jul 15 21:12:26.910006 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:26.909913 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a" containerName="registry" Jul 15 21:12:26.910006 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:26.909943 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d30e3d12-33c6-4dee-bcae-5957ecdbc25b" containerName="console" Jul 15 21:12:26.910006 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:26.909951 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d30e3d12-33c6-4dee-bcae-5957ecdbc25b" containerName="console" Jul 15 21:12:26.910160 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:26.910039 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d30e3d12-33c6-4dee-bcae-5957ecdbc25b" containerName="console" Jul 15 21:12:26.910160 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:26.910055 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b82b3c5-e8f6-4ddb-8d79-cae2a62ae19a" containerName="registry" Jul 15 21:12:26.916467 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:26.916440 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:12:26.919532 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:26.919512 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 15 21:12:26.919642 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:26.919515 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-v5md2\"" Jul 15 21:12:26.919642 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:26.919596 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 15 21:12:26.919729 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:26.919716 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 15 21:12:26.919795 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:26.919780 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 15 21:12:26.920067 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:26.920051 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 15 21:12:26.920116 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:26.920098 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 15 21:12:26.920163 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:26.920098 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 15 21:12:26.920361 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:26.920344 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 15 21:12:26.926160 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:26.926143 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 15 21:12:26.933650 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:26.933627 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 21:12:26.952898 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:26.952867 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/56145ec8-9dab-444d-879e-84a06571d7e0-config-volume\") pod \"alertmanager-main-0\" (UID: \"56145ec8-9dab-444d-879e-84a06571d7e0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:12:26.953029 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:26.952901 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/56145ec8-9dab-444d-879e-84a06571d7e0-web-config\") pod \"alertmanager-main-0\" (UID: \"56145ec8-9dab-444d-879e-84a06571d7e0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:12:26.953029 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:26.952935 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/56145ec8-9dab-444d-879e-84a06571d7e0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"56145ec8-9dab-444d-879e-84a06571d7e0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:12:26.953029 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:26.952990 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/56145ec8-9dab-444d-879e-84a06571d7e0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"56145ec8-9dab-444d-879e-84a06571d7e0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:12:26.953154 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:26.953054 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/56145ec8-9dab-444d-879e-84a06571d7e0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"56145ec8-9dab-444d-879e-84a06571d7e0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:12:26.953154 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:26.953079 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/56145ec8-9dab-444d-879e-84a06571d7e0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"56145ec8-9dab-444d-879e-84a06571d7e0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:12:26.953154 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:26.953097 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf4gw\" (UniqueName: \"kubernetes.io/projected/56145ec8-9dab-444d-879e-84a06571d7e0-kube-api-access-mf4gw\") pod \"alertmanager-main-0\" (UID: \"56145ec8-9dab-444d-879e-84a06571d7e0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:12:26.953154 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:26.953126 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56145ec8-9dab-444d-879e-84a06571d7e0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"56145ec8-9dab-444d-879e-84a06571d7e0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:12:26.953325 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:26.953171 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/56145ec8-9dab-444d-879e-84a06571d7e0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"56145ec8-9dab-444d-879e-84a06571d7e0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:12:26.953325 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:26.953199 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/56145ec8-9dab-444d-879e-84a06571d7e0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"56145ec8-9dab-444d-879e-84a06571d7e0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:12:26.953325 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:26.953225 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/56145ec8-9dab-444d-879e-84a06571d7e0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"56145ec8-9dab-444d-879e-84a06571d7e0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:12:26.953325 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:26.953264 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/56145ec8-9dab-444d-879e-84a06571d7e0-config-out\") pod \"alertmanager-main-0\" (UID: \"56145ec8-9dab-444d-879e-84a06571d7e0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:12:26.953325 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:26.953316 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56145ec8-9dab-444d-879e-84a06571d7e0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"56145ec8-9dab-444d-879e-84a06571d7e0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:12:27.054075 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:27.054036 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/56145ec8-9dab-444d-879e-84a06571d7e0-config-volume\") pod \"alertmanager-main-0\" (UID: \"56145ec8-9dab-444d-879e-84a06571d7e0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:12:27.054265 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:27.054082 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/56145ec8-9dab-444d-879e-84a06571d7e0-web-config\") pod \"alertmanager-main-0\" (UID: \"56145ec8-9dab-444d-879e-84a06571d7e0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:12:27.054265 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:27.054115 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/56145ec8-9dab-444d-879e-84a06571d7e0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"56145ec8-9dab-444d-879e-84a06571d7e0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:12:27.054265 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:27.054139 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/56145ec8-9dab-444d-879e-84a06571d7e0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"56145ec8-9dab-444d-879e-84a06571d7e0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:12:27.054265 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:27.054172 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/56145ec8-9dab-444d-879e-84a06571d7e0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"56145ec8-9dab-444d-879e-84a06571d7e0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:12:27.054265 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:27.054191 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/56145ec8-9dab-444d-879e-84a06571d7e0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"56145ec8-9dab-444d-879e-84a06571d7e0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:12:27.054265 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:27.054215 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mf4gw\" (UniqueName: \"kubernetes.io/projected/56145ec8-9dab-444d-879e-84a06571d7e0-kube-api-access-mf4gw\") pod \"alertmanager-main-0\" (UID: \"56145ec8-9dab-444d-879e-84a06571d7e0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:12:27.054265 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:27.054245 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56145ec8-9dab-444d-879e-84a06571d7e0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"56145ec8-9dab-444d-879e-84a06571d7e0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:12:27.054675 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:27.054338 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/56145ec8-9dab-444d-879e-84a06571d7e0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"56145ec8-9dab-444d-879e-84a06571d7e0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:12:27.054675 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:27.054368 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/56145ec8-9dab-444d-879e-84a06571d7e0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"56145ec8-9dab-444d-879e-84a06571d7e0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:12:27.054675 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:27.054393 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/56145ec8-9dab-444d-879e-84a06571d7e0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"56145ec8-9dab-444d-879e-84a06571d7e0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:12:27.054675 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:27.054422 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/56145ec8-9dab-444d-879e-84a06571d7e0-config-out\") pod \"alertmanager-main-0\" (UID: \"56145ec8-9dab-444d-879e-84a06571d7e0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:12:27.054675 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:27.054448 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56145ec8-9dab-444d-879e-84a06571d7e0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"56145ec8-9dab-444d-879e-84a06571d7e0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:12:27.055203 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:27.055174 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56145ec8-9dab-444d-879e-84a06571d7e0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"56145ec8-9dab-444d-879e-84a06571d7e0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:12:27.056353 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:27.055329 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/56145ec8-9dab-444d-879e-84a06571d7e0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"56145ec8-9dab-444d-879e-84a06571d7e0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:12:27.056487 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:27.056275 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56145ec8-9dab-444d-879e-84a06571d7e0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"56145ec8-9dab-444d-879e-84a06571d7e0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:12:27.057347 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:27.057281 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/56145ec8-9dab-444d-879e-84a06571d7e0-config-volume\") pod \"alertmanager-main-0\" (UID: \"56145ec8-9dab-444d-879e-84a06571d7e0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:12:27.057813 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:27.057763 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/56145ec8-9dab-444d-879e-84a06571d7e0-config-out\") pod \"alertmanager-main-0\" (UID: \"56145ec8-9dab-444d-879e-84a06571d7e0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:12:27.057919 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:27.057838 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/56145ec8-9dab-444d-879e-84a06571d7e0-web-config\") pod \"alertmanager-main-0\" (UID: \"56145ec8-9dab-444d-879e-84a06571d7e0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:12:27.057997 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:27.057972 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/56145ec8-9dab-444d-879e-84a06571d7e0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"56145ec8-9dab-444d-879e-84a06571d7e0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:12:27.058161 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:27.058141 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/56145ec8-9dab-444d-879e-84a06571d7e0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"56145ec8-9dab-444d-879e-84a06571d7e0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:12:27.058225 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:27.058146 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/56145ec8-9dab-444d-879e-84a06571d7e0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"56145ec8-9dab-444d-879e-84a06571d7e0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:12:27.058358 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:27.058337 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/56145ec8-9dab-444d-879e-84a06571d7e0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"56145ec8-9dab-444d-879e-84a06571d7e0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:12:27.058762 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:27.058744 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/56145ec8-9dab-444d-879e-84a06571d7e0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"56145ec8-9dab-444d-879e-84a06571d7e0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:12:27.058849 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:27.058835 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/56145ec8-9dab-444d-879e-84a06571d7e0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"56145ec8-9dab-444d-879e-84a06571d7e0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:12:27.066547 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:27.066526 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf4gw\" (UniqueName: \"kubernetes.io/projected/56145ec8-9dab-444d-879e-84a06571d7e0-kube-api-access-mf4gw\") pod \"alertmanager-main-0\" (UID: \"56145ec8-9dab-444d-879e-84a06571d7e0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:12:27.225854 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:27.225772 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 15 21:12:27.366771 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:27.366745 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 21:12:27.369305 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:12:27.369259 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56145ec8_9dab_444d_879e_84a06571d7e0.slice/crio-91200e50e96c6a9d97bbae39e3e0748ad3028f3c9b2f74876ca4bdf3f0272674 WatchSource:0}: Error finding container 91200e50e96c6a9d97bbae39e3e0748ad3028f3c9b2f74876ca4bdf3f0272674: Status 404 returned error can't find the container with id 91200e50e96c6a9d97bbae39e3e0748ad3028f3c9b2f74876ca4bdf3f0272674 Jul 15 21:12:27.520345 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:27.520246 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"56145ec8-9dab-444d-879e-84a06571d7e0","Type":"ContainerStarted","Data":"91200e50e96c6a9d97bbae39e3e0748ad3028f3c9b2f74876ca4bdf3f0272674"} Jul 15 21:12:28.525265 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:28.525229 2570 generic.go:356] "Generic (PLEG): container finished" podID="56145ec8-9dab-444d-879e-84a06571d7e0" containerID="12c0301530bd1a932e0b5bc510f7b97dfc5f4af6c39071a773052ca9821879f0" exitCode=0 Jul 15 21:12:28.525265 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:28.525269 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"56145ec8-9dab-444d-879e-84a06571d7e0","Type":"ContainerDied","Data":"12c0301530bd1a932e0b5bc510f7b97dfc5f4af6c39071a773052ca9821879f0"} Jul 15 21:12:30.538865 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:30.538775 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"56145ec8-9dab-444d-879e-84a06571d7e0","Type":"ContainerStarted","Data":"ced7787e7af090efe4e4476ccae95f78fdd7573a5138da939ad1985c931400a6"} Jul 15 21:12:30.538865 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:30.538841 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"56145ec8-9dab-444d-879e-84a06571d7e0","Type":"ContainerStarted","Data":"476d8492ad831b8b900cae18d681ac238f6181065d38fa0c5075d2d230a96720"} Jul 15 21:12:30.539253 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:30.538870 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"56145ec8-9dab-444d-879e-84a06571d7e0","Type":"ContainerStarted","Data":"67e55efe05dbc56a6cbd47d7736547d058828f142023292b1af107bd7a772c22"} Jul 15 21:12:30.539253 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:30.538895 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"56145ec8-9dab-444d-879e-84a06571d7e0","Type":"ContainerStarted","Data":"cc89caa1f89a0123e34d65c08d815ba2125bb8fbbdb5aacef0cbb2598c239927"} Jul 15 21:12:30.539253 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:30.538917 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"56145ec8-9dab-444d-879e-84a06571d7e0","Type":"ContainerStarted","Data":"fe246cefc365e5341613aa9659173f84cf713effa9ffd2c4b3d70a51363ac66b"} Jul 15 21:12:30.539253 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:30.538940 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"56145ec8-9dab-444d-879e-84a06571d7e0","Type":"ContainerStarted","Data":"b531c3696130a342c027bbf9f688cc7e0e21df4c20f3fa0b1c48a13ba077161d"} Jul 15 21:12:30.571467 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:12:30.571398 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.12659002 podStartE2EDuration="4.571376134s" totalImagesPullingTime="2.429377379s" totalInitContainerRuntime="15.408735ms" isStatefulPod=false podCreationTimestamp="2026-07-15 21:12:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:12:30.569073331 +0000 UTC m=+172.463477409" watchObservedRunningTime="2026-07-15 21:12:30.571376134 +0000 UTC m=+172.465780202" Jul 15 21:14:38.455268 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:14:38.455237 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c5zg9_50d11f79-1eac-4ad4-8151-9b5dd54cd284/console-operator/1.log" Jul 15 21:14:38.460102 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:14:38.460076 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c5zg9_50d11f79-1eac-4ad4-8151-9b5dd54cd284/console-operator/1.log" Jul 15 21:14:38.463147 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:14:38.463122 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nhzkw_beb5b136-86fb-4e57-9b27-3fc1079a9af3/ovn-acl-logging/0.log" Jul 15 21:14:38.466934 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:14:38.466915 2570 kubelet.go:1648] "Image garbage collection succeeded" Jul 15 21:14:38.468357 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:14:38.468336 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nhzkw_beb5b136-86fb-4e57-9b27-3fc1079a9af3/ovn-acl-logging/0.log" Jul 15 21:15:02.591505 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:02.591473 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfgt5"] Jul 15 21:15:02.594738 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:02.594723 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfgt5" Jul 15 21:15:02.600917 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:02.600886 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 15 21:15:02.601413 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:02.601071 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-srgtj\"" Jul 15 21:15:02.601494 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:02.601478 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 15 21:15:02.612403 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:02.612377 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfgt5"] Jul 15 21:15:02.762651 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:02.762613 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1dd63c55-00c6-4015-b4f0-ccc18284b4a2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfgt5\" (UID: \"1dd63c55-00c6-4015-b4f0-ccc18284b4a2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfgt5" Jul 15 21:15:02.762841 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:02.762683 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1dd63c55-00c6-4015-b4f0-ccc18284b4a2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfgt5\" (UID: \"1dd63c55-00c6-4015-b4f0-ccc18284b4a2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfgt5" Jul 15 21:15:02.762841 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:02.762749 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnqxj\" (UniqueName: \"kubernetes.io/projected/1dd63c55-00c6-4015-b4f0-ccc18284b4a2-kube-api-access-bnqxj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfgt5\" (UID: \"1dd63c55-00c6-4015-b4f0-ccc18284b4a2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfgt5" Jul 15 21:15:02.863398 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:02.863312 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnqxj\" (UniqueName: \"kubernetes.io/projected/1dd63c55-00c6-4015-b4f0-ccc18284b4a2-kube-api-access-bnqxj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfgt5\" (UID: \"1dd63c55-00c6-4015-b4f0-ccc18284b4a2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfgt5" Jul 15 21:15:02.863398 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:02.863358 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1dd63c55-00c6-4015-b4f0-ccc18284b4a2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfgt5\" (UID: \"1dd63c55-00c6-4015-b4f0-ccc18284b4a2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfgt5" Jul 15 21:15:02.863578 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:02.863404 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1dd63c55-00c6-4015-b4f0-ccc18284b4a2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfgt5\" (UID: \"1dd63c55-00c6-4015-b4f0-ccc18284b4a2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfgt5" Jul 15 21:15:02.863728 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:02.863710 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1dd63c55-00c6-4015-b4f0-ccc18284b4a2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfgt5\" (UID: \"1dd63c55-00c6-4015-b4f0-ccc18284b4a2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfgt5" Jul 15 21:15:02.863796 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:02.863777 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1dd63c55-00c6-4015-b4f0-ccc18284b4a2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfgt5\" (UID: \"1dd63c55-00c6-4015-b4f0-ccc18284b4a2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfgt5" Jul 15 21:15:02.887359 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:02.887334 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnqxj\" (UniqueName: \"kubernetes.io/projected/1dd63c55-00c6-4015-b4f0-ccc18284b4a2-kube-api-access-bnqxj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfgt5\" (UID: \"1dd63c55-00c6-4015-b4f0-ccc18284b4a2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfgt5" Jul 15 21:15:02.903901 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:02.903879 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfgt5" Jul 15 21:15:03.037581 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:03.037557 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfgt5"] Jul 15 21:15:03.040045 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:15:03.040011 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dd63c55_00c6_4015_b4f0_ccc18284b4a2.slice/crio-b5081a2b38696e981bfa7fa9ed35f32ec50fcec40668680817a23946b06781e4 WatchSource:0}: Error finding container b5081a2b38696e981bfa7fa9ed35f32ec50fcec40668680817a23946b06781e4: Status 404 returned error can't find the container with id b5081a2b38696e981bfa7fa9ed35f32ec50fcec40668680817a23946b06781e4 Jul 15 21:15:03.042044 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:03.042026 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 21:15:03.158761 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:03.158664 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfgt5" event={"ID":"1dd63c55-00c6-4015-b4f0-ccc18284b4a2","Type":"ContainerStarted","Data":"b5081a2b38696e981bfa7fa9ed35f32ec50fcec40668680817a23946b06781e4"} Jul 15 21:15:05.091787 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:05.091754 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-srtdq"] Jul 15 21:15:05.095165 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:05.095142 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-srtdq" Jul 15 21:15:05.099422 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:05.099399 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-69spv\"" Jul 15 21:15:05.099539 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:05.099400 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 15 21:15:05.102258 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:05.102229 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 15 21:15:05.140240 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:05.140211 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-srtdq"] Jul 15 21:15:05.284890 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:05.284847 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8ef56a08-447b-4424-a219-4346d84309ce-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-srtdq\" (UID: \"8ef56a08-447b-4424-a219-4346d84309ce\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-srtdq" Jul 15 21:15:05.285084 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:05.285014 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8f8z\" (UniqueName: \"kubernetes.io/projected/8ef56a08-447b-4424-a219-4346d84309ce-kube-api-access-n8f8z\") pod \"cert-manager-cainjector-559cdd8c87-srtdq\" (UID: \"8ef56a08-447b-4424-a219-4346d84309ce\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-srtdq" Jul 15 21:15:05.385831 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:05.385761 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8f8z\" (UniqueName: \"kubernetes.io/projected/8ef56a08-447b-4424-a219-4346d84309ce-kube-api-access-n8f8z\") pod \"cert-manager-cainjector-559cdd8c87-srtdq\" (UID: \"8ef56a08-447b-4424-a219-4346d84309ce\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-srtdq" Jul 15 21:15:05.385831 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:05.385808 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8ef56a08-447b-4424-a219-4346d84309ce-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-srtdq\" (UID: \"8ef56a08-447b-4424-a219-4346d84309ce\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-srtdq" Jul 15 21:15:05.401315 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:05.401268 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8ef56a08-447b-4424-a219-4346d84309ce-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-srtdq\" (UID: \"8ef56a08-447b-4424-a219-4346d84309ce\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-srtdq" Jul 15 21:15:05.401463 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:05.401431 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8f8z\" (UniqueName: \"kubernetes.io/projected/8ef56a08-447b-4424-a219-4346d84309ce-kube-api-access-n8f8z\") pod \"cert-manager-cainjector-559cdd8c87-srtdq\" (UID: \"8ef56a08-447b-4424-a219-4346d84309ce\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-srtdq" Jul 15 21:15:05.421135 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:05.421106 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-srtdq" Jul 15 21:15:05.559430 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:05.559403 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-srtdq"] Jul 15 21:15:05.562247 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:15:05.562220 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ef56a08_447b_4424_a219_4346d84309ce.slice/crio-b8b8b2beccf68446bbc2f4b827e5daeb139ec97c00e6768ce43220ccddab722d WatchSource:0}: Error finding container b8b8b2beccf68446bbc2f4b827e5daeb139ec97c00e6768ce43220ccddab722d: Status 404 returned error can't find the container with id b8b8b2beccf68446bbc2f4b827e5daeb139ec97c00e6768ce43220ccddab722d Jul 15 21:15:06.176418 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:06.176378 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-srtdq" event={"ID":"8ef56a08-447b-4424-a219-4346d84309ce","Type":"ContainerStarted","Data":"b8b8b2beccf68446bbc2f4b827e5daeb139ec97c00e6768ce43220ccddab722d"} Jul 15 21:15:11.202782 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:11.202744 2570 generic.go:356] "Generic (PLEG): container finished" podID="1dd63c55-00c6-4015-b4f0-ccc18284b4a2" containerID="f181231c16da02daaaa290d5d1ab0bd8793ac7115d3e1c989a373da8924ba24d" exitCode=0 Jul 15 21:15:11.203209 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:11.202835 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfgt5" event={"ID":"1dd63c55-00c6-4015-b4f0-ccc18284b4a2","Type":"ContainerDied","Data":"f181231c16da02daaaa290d5d1ab0bd8793ac7115d3e1c989a373da8924ba24d"} Jul 15 21:15:11.204615 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:11.204587 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-srtdq" event={"ID":"8ef56a08-447b-4424-a219-4346d84309ce","Type":"ContainerStarted","Data":"a4736698bdbf8c55df89a34788ef76f9b22e7ab9e7b75f137912f55cabab384f"} Jul 15 21:15:11.262283 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:11.262182 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-srtdq" podStartSLOduration=0.806011229 podStartE2EDuration="6.262166197s" totalImagesPullingTime="5.456154968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:15:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:15:11.261488405 +0000 UTC m=+333.155892470" watchObservedRunningTime="2026-07-15 21:15:11.262166197 +0000 UTC m=+333.156570261" Jul 15 21:15:13.215037 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:13.215004 2570 generic.go:356] "Generic (PLEG): container finished" podID="1dd63c55-00c6-4015-b4f0-ccc18284b4a2" containerID="dae492fe73c9590bb8e5ee897deca56f2d4faf60b50409bfa689ed66c688a8ee" exitCode=0 Jul 15 21:15:13.215430 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:13.215052 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfgt5" event={"ID":"1dd63c55-00c6-4015-b4f0-ccc18284b4a2","Type":"ContainerDied","Data":"dae492fe73c9590bb8e5ee897deca56f2d4faf60b50409bfa689ed66c688a8ee"} Jul 15 21:15:21.255042 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:21.255003 2570 generic.go:356] "Generic (PLEG): container finished" podID="1dd63c55-00c6-4015-b4f0-ccc18284b4a2" containerID="5c17a0d16dc75594f7e68f7b51772712fe12e246d7f27c0033188a4f0e9009e3" exitCode=0 Jul 15 21:15:21.255467 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:21.255091 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfgt5" event={"ID":"1dd63c55-00c6-4015-b4f0-ccc18284b4a2","Type":"ContainerDied","Data":"5c17a0d16dc75594f7e68f7b51772712fe12e246d7f27c0033188a4f0e9009e3"} Jul 15 21:15:22.385085 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:22.385065 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfgt5" Jul 15 21:15:22.416697 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:22.416667 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1dd63c55-00c6-4015-b4f0-ccc18284b4a2-util\") pod \"1dd63c55-00c6-4015-b4f0-ccc18284b4a2\" (UID: \"1dd63c55-00c6-4015-b4f0-ccc18284b4a2\") " Jul 15 21:15:22.416836 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:22.416726 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1dd63c55-00c6-4015-b4f0-ccc18284b4a2-bundle\") pod \"1dd63c55-00c6-4015-b4f0-ccc18284b4a2\" (UID: \"1dd63c55-00c6-4015-b4f0-ccc18284b4a2\") " Jul 15 21:15:22.416836 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:22.416755 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnqxj\" (UniqueName: \"kubernetes.io/projected/1dd63c55-00c6-4015-b4f0-ccc18284b4a2-kube-api-access-bnqxj\") pod \"1dd63c55-00c6-4015-b4f0-ccc18284b4a2\" (UID: \"1dd63c55-00c6-4015-b4f0-ccc18284b4a2\") " Jul 15 21:15:22.417132 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:22.417102 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dd63c55-00c6-4015-b4f0-ccc18284b4a2-bundle" (OuterVolumeSpecName: "bundle") pod "1dd63c55-00c6-4015-b4f0-ccc18284b4a2" (UID: "1dd63c55-00c6-4015-b4f0-ccc18284b4a2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:15:22.419032 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:22.419007 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dd63c55-00c6-4015-b4f0-ccc18284b4a2-kube-api-access-bnqxj" (OuterVolumeSpecName: "kube-api-access-bnqxj") pod "1dd63c55-00c6-4015-b4f0-ccc18284b4a2" (UID: "1dd63c55-00c6-4015-b4f0-ccc18284b4a2"). InnerVolumeSpecName "kube-api-access-bnqxj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:15:22.423404 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:22.423365 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dd63c55-00c6-4015-b4f0-ccc18284b4a2-util" (OuterVolumeSpecName: "util") pod "1dd63c55-00c6-4015-b4f0-ccc18284b4a2" (UID: "1dd63c55-00c6-4015-b4f0-ccc18284b4a2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:15:22.517771 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:22.517686 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnqxj\" (UniqueName: \"kubernetes.io/projected/1dd63c55-00c6-4015-b4f0-ccc18284b4a2-kube-api-access-bnqxj\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:15:22.517771 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:22.517716 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1dd63c55-00c6-4015-b4f0-ccc18284b4a2-util\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:15:22.517771 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:22.517726 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1dd63c55-00c6-4015-b4f0-ccc18284b4a2-bundle\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:15:23.264795 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:23.264770 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfgt5" Jul 15 21:15:23.264966 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:23.264771 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkfgt5" event={"ID":"1dd63c55-00c6-4015-b4f0-ccc18284b4a2","Type":"ContainerDied","Data":"b5081a2b38696e981bfa7fa9ed35f32ec50fcec40668680817a23946b06781e4"} Jul 15 21:15:23.264966 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:23.264884 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b5081a2b38696e981bfa7fa9ed35f32ec50fcec40668680817a23946b06781e4" Jul 15 21:15:28.343400 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:28.343365 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9hd6s"] Jul 15 21:15:28.343838 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:28.343725 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dd63c55-00c6-4015-b4f0-ccc18284b4a2" containerName="util" Jul 15 21:15:28.343838 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:28.343737 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dd63c55-00c6-4015-b4f0-ccc18284b4a2" containerName="util" Jul 15 21:15:28.343838 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:28.343754 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dd63c55-00c6-4015-b4f0-ccc18284b4a2" containerName="extract" Jul 15 21:15:28.343838 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:28.343760 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dd63c55-00c6-4015-b4f0-ccc18284b4a2" containerName="extract" Jul 15 21:15:28.343838 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:28.343767 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dd63c55-00c6-4015-b4f0-ccc18284b4a2" containerName="pull" Jul 15 21:15:28.343838 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:28.343773 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dd63c55-00c6-4015-b4f0-ccc18284b4a2" containerName="pull" Jul 15 21:15:28.343838 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:28.343824 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1dd63c55-00c6-4015-b4f0-ccc18284b4a2" containerName="extract" Jul 15 21:15:28.412258 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:28.412225 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9hd6s"] Jul 15 21:15:28.412429 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:28.412339 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9hd6s" Jul 15 21:15:28.414854 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:28.414833 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 15 21:15:28.414956 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:28.414928 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-wcxw7\"" Jul 15 21:15:28.415716 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:28.415702 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 15 21:15:28.469255 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:28.469223 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1023110-f2cb-477c-a7e5-8f06998ee99a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9hd6s\" (UID: \"f1023110-f2cb-477c-a7e5-8f06998ee99a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9hd6s" Jul 15 21:15:28.469432 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:28.469265 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h478l\" (UniqueName: \"kubernetes.io/projected/f1023110-f2cb-477c-a7e5-8f06998ee99a-kube-api-access-h478l\") pod \"openshift-lws-operator-fd8ccff4c-9hd6s\" (UID: \"f1023110-f2cb-477c-a7e5-8f06998ee99a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9hd6s" Jul 15 21:15:28.570412 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:28.570382 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1023110-f2cb-477c-a7e5-8f06998ee99a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9hd6s\" (UID: \"f1023110-f2cb-477c-a7e5-8f06998ee99a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9hd6s" Jul 15 21:15:28.570556 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:28.570426 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h478l\" (UniqueName: \"kubernetes.io/projected/f1023110-f2cb-477c-a7e5-8f06998ee99a-kube-api-access-h478l\") pod \"openshift-lws-operator-fd8ccff4c-9hd6s\" (UID: \"f1023110-f2cb-477c-a7e5-8f06998ee99a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9hd6s" Jul 15 21:15:28.570765 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:28.570747 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1023110-f2cb-477c-a7e5-8f06998ee99a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9hd6s\" (UID: \"f1023110-f2cb-477c-a7e5-8f06998ee99a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9hd6s" Jul 15 21:15:28.578773 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:28.578752 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h478l\" (UniqueName: \"kubernetes.io/projected/f1023110-f2cb-477c-a7e5-8f06998ee99a-kube-api-access-h478l\") pod \"openshift-lws-operator-fd8ccff4c-9hd6s\" (UID: \"f1023110-f2cb-477c-a7e5-8f06998ee99a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9hd6s" Jul 15 21:15:28.721400 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:28.721327 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9hd6s" Jul 15 21:15:28.860108 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:28.860083 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9hd6s"] Jul 15 21:15:28.862193 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:15:28.862161 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1023110_f2cb_477c_a7e5_8f06998ee99a.slice/crio-d55dc9e36660e7d70e816afdee0bb81634033347a1e1efb880478ba1b7408f65 WatchSource:0}: Error finding container d55dc9e36660e7d70e816afdee0bb81634033347a1e1efb880478ba1b7408f65: Status 404 returned error can't find the container with id d55dc9e36660e7d70e816afdee0bb81634033347a1e1efb880478ba1b7408f65 Jul 15 21:15:29.290930 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:29.290896 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9hd6s" event={"ID":"f1023110-f2cb-477c-a7e5-8f06998ee99a","Type":"ContainerStarted","Data":"d55dc9e36660e7d70e816afdee0bb81634033347a1e1efb880478ba1b7408f65"} Jul 15 21:15:31.301333 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:31.301276 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9hd6s" event={"ID":"f1023110-f2cb-477c-a7e5-8f06998ee99a","Type":"ContainerStarted","Data":"4c3efe2f7590cda74286475bcd7efa2c93fc2f72b8e4eca82a426b6098e4c518"} Jul 15 21:15:31.315669 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:31.315616 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9hd6s" podStartSLOduration=1.43672692 podStartE2EDuration="3.315598529s" totalImagesPullingTime="1.878871609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:15:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:15:31.315545909 +0000 UTC m=+353.209949975" watchObservedRunningTime="2026-07-15 21:15:31.315598529 +0000 UTC m=+353.210002595" Jul 15 21:15:48.290742 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:48.290705 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-6zkfh"] Jul 15 21:15:48.293251 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:48.293233 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-6zkfh" Jul 15 21:15:48.297919 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:48.297892 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 15 21:15:48.298046 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:48.297926 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 15 21:15:48.298298 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:48.298271 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 15 21:15:48.298408 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:48.298274 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 15 21:15:48.298408 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:48.298347 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-l72zx\"" Jul 15 21:15:48.314878 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:48.314851 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-6zkfh"] Jul 15 21:15:48.449393 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:48.449359 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/81822492-d2d6-475e-b44f-7dda6d558b4f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d5d77c45b-6zkfh\" (UID: \"81822492-d2d6-475e-b44f-7dda6d558b4f\") " pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-6zkfh" Jul 15 21:15:48.449561 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:48.449403 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81822492-d2d6-475e-b44f-7dda6d558b4f-tmp\") pod \"opendatahub-operator-controller-manager-7d5d77c45b-6zkfh\" (UID: \"81822492-d2d6-475e-b44f-7dda6d558b4f\") " pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-6zkfh" Jul 15 21:15:48.449561 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:48.449501 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81822492-d2d6-475e-b44f-7dda6d558b4f-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d5d77c45b-6zkfh\" (UID: \"81822492-d2d6-475e-b44f-7dda6d558b4f\") " pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-6zkfh" Jul 15 21:15:48.449561 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:48.449555 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/81822492-d2d6-475e-b44f-7dda6d558b4f-manifests\") pod \"opendatahub-operator-controller-manager-7d5d77c45b-6zkfh\" (UID: \"81822492-d2d6-475e-b44f-7dda6d558b4f\") " pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-6zkfh" Jul 15 21:15:48.449664 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:48.449577 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dlsx\" (UniqueName: \"kubernetes.io/projected/81822492-d2d6-475e-b44f-7dda6d558b4f-kube-api-access-4dlsx\") pod \"opendatahub-operator-controller-manager-7d5d77c45b-6zkfh\" (UID: \"81822492-d2d6-475e-b44f-7dda6d558b4f\") " pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-6zkfh" Jul 15 21:15:48.550439 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:48.550357 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/81822492-d2d6-475e-b44f-7dda6d558b4f-manifests\") pod \"opendatahub-operator-controller-manager-7d5d77c45b-6zkfh\" (UID: \"81822492-d2d6-475e-b44f-7dda6d558b4f\") " pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-6zkfh" Jul 15 21:15:48.550439 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:48.550395 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dlsx\" (UniqueName: \"kubernetes.io/projected/81822492-d2d6-475e-b44f-7dda6d558b4f-kube-api-access-4dlsx\") pod \"opendatahub-operator-controller-manager-7d5d77c45b-6zkfh\" (UID: \"81822492-d2d6-475e-b44f-7dda6d558b4f\") " pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-6zkfh" Jul 15 21:15:48.550439 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:48.550423 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/81822492-d2d6-475e-b44f-7dda6d558b4f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d5d77c45b-6zkfh\" (UID: \"81822492-d2d6-475e-b44f-7dda6d558b4f\") " pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-6zkfh" Jul 15 21:15:48.550869 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:48.550447 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81822492-d2d6-475e-b44f-7dda6d558b4f-tmp\") pod \"opendatahub-operator-controller-manager-7d5d77c45b-6zkfh\" (UID: \"81822492-d2d6-475e-b44f-7dda6d558b4f\") " pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-6zkfh" Jul 15 21:15:48.550869 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:48.550480 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81822492-d2d6-475e-b44f-7dda6d558b4f-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d5d77c45b-6zkfh\" (UID: \"81822492-d2d6-475e-b44f-7dda6d558b4f\") " pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-6zkfh" Jul 15 21:15:48.550976 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:48.550872 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/81822492-d2d6-475e-b44f-7dda6d558b4f-manifests\") pod \"opendatahub-operator-controller-manager-7d5d77c45b-6zkfh\" (UID: \"81822492-d2d6-475e-b44f-7dda6d558b4f\") " pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-6zkfh" Jul 15 21:15:48.552777 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:48.552755 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81822492-d2d6-475e-b44f-7dda6d558b4f-tmp\") pod \"opendatahub-operator-controller-manager-7d5d77c45b-6zkfh\" (UID: \"81822492-d2d6-475e-b44f-7dda6d558b4f\") " pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-6zkfh" Jul 15 21:15:48.552926 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:48.552907 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81822492-d2d6-475e-b44f-7dda6d558b4f-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d5d77c45b-6zkfh\" (UID: \"81822492-d2d6-475e-b44f-7dda6d558b4f\") " pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-6zkfh" Jul 15 21:15:48.553089 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:48.553071 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/81822492-d2d6-475e-b44f-7dda6d558b4f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d5d77c45b-6zkfh\" (UID: \"81822492-d2d6-475e-b44f-7dda6d558b4f\") " pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-6zkfh" Jul 15 21:15:48.559420 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:48.559399 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dlsx\" (UniqueName: \"kubernetes.io/projected/81822492-d2d6-475e-b44f-7dda6d558b4f-kube-api-access-4dlsx\") pod \"opendatahub-operator-controller-manager-7d5d77c45b-6zkfh\" (UID: \"81822492-d2d6-475e-b44f-7dda6d558b4f\") " pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-6zkfh" Jul 15 21:15:48.603684 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:48.603657 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-6zkfh" Jul 15 21:15:48.750967 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:48.750936 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-6zkfh"] Jul 15 21:15:48.754400 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:15:48.754370 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81822492_d2d6_475e_b44f_7dda6d558b4f.slice/crio-b308b43f16b434ad808f540dad7c8ba6250eaa96a3005c5820e26f169eeeff81 WatchSource:0}: Error finding container b308b43f16b434ad808f540dad7c8ba6250eaa96a3005c5820e26f169eeeff81: Status 404 returned error can't find the container with id b308b43f16b434ad808f540dad7c8ba6250eaa96a3005c5820e26f169eeeff81 Jul 15 21:15:49.384110 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:49.384032 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-6zkfh" event={"ID":"81822492-d2d6-475e-b44f-7dda6d558b4f","Type":"ContainerStarted","Data":"b308b43f16b434ad808f540dad7c8ba6250eaa96a3005c5820e26f169eeeff81"} Jul 15 21:15:52.402568 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:52.402527 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-6zkfh" event={"ID":"81822492-d2d6-475e-b44f-7dda6d558b4f","Type":"ContainerStarted","Data":"8c9e5581c21ada35312a179e6db2d7adfb426186201a38bea866698316277c58"} Jul 15 21:15:53.408418 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:53.408383 2570 generic.go:356] "Generic (PLEG): container finished" podID="81822492-d2d6-475e-b44f-7dda6d558b4f" containerID="8c9e5581c21ada35312a179e6db2d7adfb426186201a38bea866698316277c58" exitCode=0 Jul 15 21:15:53.408811 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:53.408468 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-6zkfh" event={"ID":"81822492-d2d6-475e-b44f-7dda6d558b4f","Type":"ContainerDied","Data":"8c9e5581c21ada35312a179e6db2d7adfb426186201a38bea866698316277c58"} Jul 15 21:15:54.414685 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:54.414649 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-6zkfh" event={"ID":"81822492-d2d6-475e-b44f-7dda6d558b4f","Type":"ContainerStarted","Data":"0abab0ecc6b0db552bc350a42fcce35cf82e489f423020f37c783c305eed8df5"} Jul 15 21:15:54.415074 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:54.414784 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-6zkfh" Jul 15 21:15:54.437854 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:15:54.437807 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-6zkfh" podStartSLOduration=1.67742714 podStartE2EDuration="6.437793147s" totalImagesPullingTime="3.761701667s" totalInitContainerRuntime="998.66434ms" isStatefulPod=false podCreationTimestamp="2026-07-15 21:15:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:15:54.435848433 +0000 UTC m=+376.330252498" watchObservedRunningTime="2026-07-15 21:15:54.437793147 +0000 UTC m=+376.332197274" Jul 15 21:16:05.421043 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:05.421011 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7d5d77c45b-6zkfh" Jul 15 21:16:08.066801 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:08.066768 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5cbf464cb7-8mjpx"] Jul 15 21:16:08.069376 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:08.069354 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5cbf464cb7-8mjpx" Jul 15 21:16:08.072466 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:08.072439 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 15 21:16:08.073438 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:08.073422 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-bw8sk\"" Jul 15 21:16:08.076502 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:08.076482 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 15 21:16:08.082825 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:08.082805 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5cbf464cb7-8mjpx"] Jul 15 21:16:08.122545 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:08.122514 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1da9bba7-0ba9-4ab6-91b7-2dcf2893e401-tls-certs\") pod \"kube-auth-proxy-5cbf464cb7-8mjpx\" (UID: \"1da9bba7-0ba9-4ab6-91b7-2dcf2893e401\") " pod="openshift-ingress/kube-auth-proxy-5cbf464cb7-8mjpx" Jul 15 21:16:08.122706 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:08.122551 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1da9bba7-0ba9-4ab6-91b7-2dcf2893e401-tmp\") pod \"kube-auth-proxy-5cbf464cb7-8mjpx\" (UID: \"1da9bba7-0ba9-4ab6-91b7-2dcf2893e401\") " pod="openshift-ingress/kube-auth-proxy-5cbf464cb7-8mjpx" Jul 15 21:16:08.122706 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:08.122612 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssdj8\" (UniqueName: \"kubernetes.io/projected/1da9bba7-0ba9-4ab6-91b7-2dcf2893e401-kube-api-access-ssdj8\") pod \"kube-auth-proxy-5cbf464cb7-8mjpx\" (UID: \"1da9bba7-0ba9-4ab6-91b7-2dcf2893e401\") " pod="openshift-ingress/kube-auth-proxy-5cbf464cb7-8mjpx" Jul 15 21:16:08.163725 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:08.163690 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-x7ftv"] Jul 15 21:16:08.165996 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:08.165980 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-x7ftv" Jul 15 21:16:08.168383 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:08.168360 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 15 21:16:08.168487 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:08.168467 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-gwrql\"" Jul 15 21:16:08.179088 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:08.179067 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-x7ftv"] Jul 15 21:16:08.223867 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:08.223836 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssdj8\" (UniqueName: \"kubernetes.io/projected/1da9bba7-0ba9-4ab6-91b7-2dcf2893e401-kube-api-access-ssdj8\") pod \"kube-auth-proxy-5cbf464cb7-8mjpx\" (UID: \"1da9bba7-0ba9-4ab6-91b7-2dcf2893e401\") " pod="openshift-ingress/kube-auth-proxy-5cbf464cb7-8mjpx" Jul 15 21:16:08.224055 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:08.223883 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb2d27e1-d593-477a-9312-1f56a7c3d795-cert\") pod \"odh-model-controller-7998c67dc4-x7ftv\" (UID: \"fb2d27e1-d593-477a-9312-1f56a7c3d795\") " pod="opendatahub/odh-model-controller-7998c67dc4-x7ftv" Jul 15 21:16:08.224055 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:08.223918 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1da9bba7-0ba9-4ab6-91b7-2dcf2893e401-tls-certs\") pod \"kube-auth-proxy-5cbf464cb7-8mjpx\" (UID: \"1da9bba7-0ba9-4ab6-91b7-2dcf2893e401\") " pod="openshift-ingress/kube-auth-proxy-5cbf464cb7-8mjpx" Jul 15 21:16:08.224055 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:08.223941 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1da9bba7-0ba9-4ab6-91b7-2dcf2893e401-tmp\") pod \"kube-auth-proxy-5cbf464cb7-8mjpx\" (UID: \"1da9bba7-0ba9-4ab6-91b7-2dcf2893e401\") " pod="openshift-ingress/kube-auth-proxy-5cbf464cb7-8mjpx" Jul 15 21:16:08.224055 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:08.223960 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kkgr\" (UniqueName: \"kubernetes.io/projected/fb2d27e1-d593-477a-9312-1f56a7c3d795-kube-api-access-5kkgr\") pod \"odh-model-controller-7998c67dc4-x7ftv\" (UID: \"fb2d27e1-d593-477a-9312-1f56a7c3d795\") " pod="opendatahub/odh-model-controller-7998c67dc4-x7ftv" Jul 15 21:16:08.226284 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:08.226253 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1da9bba7-0ba9-4ab6-91b7-2dcf2893e401-tmp\") pod \"kube-auth-proxy-5cbf464cb7-8mjpx\" (UID: \"1da9bba7-0ba9-4ab6-91b7-2dcf2893e401\") " pod="openshift-ingress/kube-auth-proxy-5cbf464cb7-8mjpx" Jul 15 21:16:08.226587 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:08.226564 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1da9bba7-0ba9-4ab6-91b7-2dcf2893e401-tls-certs\") pod \"kube-auth-proxy-5cbf464cb7-8mjpx\" (UID: \"1da9bba7-0ba9-4ab6-91b7-2dcf2893e401\") " pod="openshift-ingress/kube-auth-proxy-5cbf464cb7-8mjpx" Jul 15 21:16:08.237902 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:08.237879 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssdj8\" (UniqueName: \"kubernetes.io/projected/1da9bba7-0ba9-4ab6-91b7-2dcf2893e401-kube-api-access-ssdj8\") pod \"kube-auth-proxy-5cbf464cb7-8mjpx\" (UID: \"1da9bba7-0ba9-4ab6-91b7-2dcf2893e401\") " pod="openshift-ingress/kube-auth-proxy-5cbf464cb7-8mjpx" Jul 15 21:16:08.324799 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:08.324768 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb2d27e1-d593-477a-9312-1f56a7c3d795-cert\") pod \"odh-model-controller-7998c67dc4-x7ftv\" (UID: \"fb2d27e1-d593-477a-9312-1f56a7c3d795\") " pod="opendatahub/odh-model-controller-7998c67dc4-x7ftv" Jul 15 21:16:08.324977 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:08.324846 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kkgr\" (UniqueName: \"kubernetes.io/projected/fb2d27e1-d593-477a-9312-1f56a7c3d795-kube-api-access-5kkgr\") pod \"odh-model-controller-7998c67dc4-x7ftv\" (UID: \"fb2d27e1-d593-477a-9312-1f56a7c3d795\") " pod="opendatahub/odh-model-controller-7998c67dc4-x7ftv" Jul 15 21:16:08.324977 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:16:08.324908 2570 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 15 21:16:08.325098 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:16:08.324980 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb2d27e1-d593-477a-9312-1f56a7c3d795-cert podName:fb2d27e1-d593-477a-9312-1f56a7c3d795 nodeName:}" failed. No retries permitted until 2026-07-15 21:16:08.824963739 +0000 UTC m=+390.719367782 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fb2d27e1-d593-477a-9312-1f56a7c3d795-cert") pod "odh-model-controller-7998c67dc4-x7ftv" (UID: "fb2d27e1-d593-477a-9312-1f56a7c3d795") : secret "odh-model-controller-webhook-cert" not found Jul 15 21:16:08.334435 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:08.334408 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kkgr\" (UniqueName: \"kubernetes.io/projected/fb2d27e1-d593-477a-9312-1f56a7c3d795-kube-api-access-5kkgr\") pod \"odh-model-controller-7998c67dc4-x7ftv\" (UID: \"fb2d27e1-d593-477a-9312-1f56a7c3d795\") " pod="opendatahub/odh-model-controller-7998c67dc4-x7ftv" Jul 15 21:16:08.379236 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:08.379198 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5cbf464cb7-8mjpx" Jul 15 21:16:08.526174 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:08.526152 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5cbf464cb7-8mjpx"] Jul 15 21:16:08.528449 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:16:08.528425 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1da9bba7_0ba9_4ab6_91b7_2dcf2893e401.slice/crio-855ce5d5b7992d73edba5d0cf7dd5955c8c150ecd280167ab21306853851a4b4 WatchSource:0}: Error finding container 855ce5d5b7992d73edba5d0cf7dd5955c8c150ecd280167ab21306853851a4b4: Status 404 returned error can't find the container with id 855ce5d5b7992d73edba5d0cf7dd5955c8c150ecd280167ab21306853851a4b4 Jul 15 21:16:08.828247 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:08.828213 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb2d27e1-d593-477a-9312-1f56a7c3d795-cert\") pod \"odh-model-controller-7998c67dc4-x7ftv\" (UID: \"fb2d27e1-d593-477a-9312-1f56a7c3d795\") " pod="opendatahub/odh-model-controller-7998c67dc4-x7ftv" Jul 15 21:16:08.828412 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:16:08.828371 2570 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 15 21:16:08.828454 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:16:08.828433 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb2d27e1-d593-477a-9312-1f56a7c3d795-cert podName:fb2d27e1-d593-477a-9312-1f56a7c3d795 nodeName:}" failed. No retries permitted until 2026-07-15 21:16:09.828418496 +0000 UTC m=+391.722822542 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fb2d27e1-d593-477a-9312-1f56a7c3d795-cert") pod "odh-model-controller-7998c67dc4-x7ftv" (UID: "fb2d27e1-d593-477a-9312-1f56a7c3d795") : secret "odh-model-controller-webhook-cert" not found Jul 15 21:16:09.148796 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.148717 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-69s79"] Jul 15 21:16:09.151303 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.151265 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-69s79" Jul 15 21:16:09.153692 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.153668 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 15 21:16:09.153810 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.153710 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-b2ksr\"" Jul 15 21:16:09.174107 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.174070 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-69s79"] Jul 15 21:16:09.230865 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.230834 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzc9k\" (UniqueName: \"kubernetes.io/projected/e6a40d93-34b1-4cf6-93af-ec693a017d18-kube-api-access-zzc9k\") pod \"model-serving-api-54d89bd5fc-69s79\" (UID: \"e6a40d93-34b1-4cf6-93af-ec693a017d18\") " pod="opendatahub/model-serving-api-54d89bd5fc-69s79" Jul 15 21:16:09.230999 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.230911 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6a40d93-34b1-4cf6-93af-ec693a017d18-tls-certs\") pod \"model-serving-api-54d89bd5fc-69s79\" (UID: \"e6a40d93-34b1-4cf6-93af-ec693a017d18\") " pod="opendatahub/model-serving-api-54d89bd5fc-69s79" Jul 15 21:16:09.331878 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.331837 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6a40d93-34b1-4cf6-93af-ec693a017d18-tls-certs\") pod \"model-serving-api-54d89bd5fc-69s79\" (UID: \"e6a40d93-34b1-4cf6-93af-ec693a017d18\") " pod="opendatahub/model-serving-api-54d89bd5fc-69s79" Jul 15 21:16:09.332063 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.331976 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzc9k\" (UniqueName: \"kubernetes.io/projected/e6a40d93-34b1-4cf6-93af-ec693a017d18-kube-api-access-zzc9k\") pod \"model-serving-api-54d89bd5fc-69s79\" (UID: \"e6a40d93-34b1-4cf6-93af-ec693a017d18\") " pod="opendatahub/model-serving-api-54d89bd5fc-69s79" Jul 15 21:16:09.334924 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.334897 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6a40d93-34b1-4cf6-93af-ec693a017d18-tls-certs\") pod \"model-serving-api-54d89bd5fc-69s79\" (UID: \"e6a40d93-34b1-4cf6-93af-ec693a017d18\") " pod="opendatahub/model-serving-api-54d89bd5fc-69s79" Jul 15 21:16:09.347664 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.347605 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzc9k\" (UniqueName: \"kubernetes.io/projected/e6a40d93-34b1-4cf6-93af-ec693a017d18-kube-api-access-zzc9k\") pod \"model-serving-api-54d89bd5fc-69s79\" (UID: \"e6a40d93-34b1-4cf6-93af-ec693a017d18\") " pod="opendatahub/model-serving-api-54d89bd5fc-69s79" Jul 15 21:16:09.466020 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.465936 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-69s79" Jul 15 21:16:09.474371 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.474337 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-rw6jw"] Jul 15 21:16:09.477307 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.477242 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rw6jw" Jul 15 21:16:09.480166 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.479745 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 15 21:16:09.480166 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.479796 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 15 21:16:09.480166 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.479796 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 15 21:16:09.480166 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.480007 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 15 21:16:09.480783 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.480619 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-z655w\"" Jul 15 21:16:09.493651 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.493586 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-rw6jw"] Jul 15 21:16:09.499728 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.499622 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5cbf464cb7-8mjpx" event={"ID":"1da9bba7-0ba9-4ab6-91b7-2dcf2893e401","Type":"ContainerStarted","Data":"855ce5d5b7992d73edba5d0cf7dd5955c8c150ecd280167ab21306853851a4b4"} Jul 15 21:16:09.533383 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.533329 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9352769e-41e5-4d9e-bec8-da6e57d09a2f-local-certs\") pod \"istiod-openshift-gateway-7574459656-rw6jw\" (UID: \"9352769e-41e5-4d9e-bec8-da6e57d09a2f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rw6jw" Jul 15 21:16:09.533525 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.533387 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9352769e-41e5-4d9e-bec8-da6e57d09a2f-istio-token\") pod \"istiod-openshift-gateway-7574459656-rw6jw\" (UID: \"9352769e-41e5-4d9e-bec8-da6e57d09a2f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rw6jw" Jul 15 21:16:09.533693 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.533670 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9352769e-41e5-4d9e-bec8-da6e57d09a2f-cacerts\") pod \"istiod-openshift-gateway-7574459656-rw6jw\" (UID: \"9352769e-41e5-4d9e-bec8-da6e57d09a2f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rw6jw" Jul 15 21:16:09.533908 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.533758 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9352769e-41e5-4d9e-bec8-da6e57d09a2f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-rw6jw\" (UID: \"9352769e-41e5-4d9e-bec8-da6e57d09a2f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rw6jw" Jul 15 21:16:09.533908 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.533807 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9352769e-41e5-4d9e-bec8-da6e57d09a2f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-rw6jw\" (UID: \"9352769e-41e5-4d9e-bec8-da6e57d09a2f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rw6jw" Jul 15 21:16:09.533908 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.533858 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5l5w\" (UniqueName: \"kubernetes.io/projected/9352769e-41e5-4d9e-bec8-da6e57d09a2f-kube-api-access-c5l5w\") pod \"istiod-openshift-gateway-7574459656-rw6jw\" (UID: \"9352769e-41e5-4d9e-bec8-da6e57d09a2f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rw6jw" Jul 15 21:16:09.534078 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.533937 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9352769e-41e5-4d9e-bec8-da6e57d09a2f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-rw6jw\" (UID: \"9352769e-41e5-4d9e-bec8-da6e57d09a2f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rw6jw" Jul 15 21:16:09.635364 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.635327 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9352769e-41e5-4d9e-bec8-da6e57d09a2f-local-certs\") pod \"istiod-openshift-gateway-7574459656-rw6jw\" (UID: \"9352769e-41e5-4d9e-bec8-da6e57d09a2f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rw6jw" Jul 15 21:16:09.635559 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.635373 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9352769e-41e5-4d9e-bec8-da6e57d09a2f-istio-token\") pod \"istiod-openshift-gateway-7574459656-rw6jw\" (UID: \"9352769e-41e5-4d9e-bec8-da6e57d09a2f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rw6jw" Jul 15 21:16:09.635559 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.635398 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9352769e-41e5-4d9e-bec8-da6e57d09a2f-cacerts\") pod \"istiod-openshift-gateway-7574459656-rw6jw\" (UID: \"9352769e-41e5-4d9e-bec8-da6e57d09a2f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rw6jw" Jul 15 21:16:09.635559 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.635444 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9352769e-41e5-4d9e-bec8-da6e57d09a2f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-rw6jw\" (UID: \"9352769e-41e5-4d9e-bec8-da6e57d09a2f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rw6jw" Jul 15 21:16:09.635559 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.635490 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9352769e-41e5-4d9e-bec8-da6e57d09a2f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-rw6jw\" (UID: \"9352769e-41e5-4d9e-bec8-da6e57d09a2f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rw6jw" Jul 15 21:16:09.635559 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.635518 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5l5w\" (UniqueName: \"kubernetes.io/projected/9352769e-41e5-4d9e-bec8-da6e57d09a2f-kube-api-access-c5l5w\") pod \"istiod-openshift-gateway-7574459656-rw6jw\" (UID: \"9352769e-41e5-4d9e-bec8-da6e57d09a2f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rw6jw" Jul 15 21:16:09.635808 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.635573 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9352769e-41e5-4d9e-bec8-da6e57d09a2f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-rw6jw\" (UID: \"9352769e-41e5-4d9e-bec8-da6e57d09a2f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rw6jw" Jul 15 21:16:09.636622 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.636568 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9352769e-41e5-4d9e-bec8-da6e57d09a2f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-rw6jw\" (UID: \"9352769e-41e5-4d9e-bec8-da6e57d09a2f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rw6jw" Jul 15 21:16:09.638183 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.638109 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-69s79"] Jul 15 21:16:09.638647 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.638620 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9352769e-41e5-4d9e-bec8-da6e57d09a2f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-rw6jw\" (UID: \"9352769e-41e5-4d9e-bec8-da6e57d09a2f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rw6jw" Jul 15 21:16:09.638803 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.638783 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9352769e-41e5-4d9e-bec8-da6e57d09a2f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-rw6jw\" (UID: \"9352769e-41e5-4d9e-bec8-da6e57d09a2f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rw6jw" Jul 15 21:16:09.639141 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.639121 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9352769e-41e5-4d9e-bec8-da6e57d09a2f-local-certs\") pod \"istiod-openshift-gateway-7574459656-rw6jw\" (UID: \"9352769e-41e5-4d9e-bec8-da6e57d09a2f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rw6jw" Jul 15 21:16:09.639219 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.639178 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9352769e-41e5-4d9e-bec8-da6e57d09a2f-cacerts\") pod \"istiod-openshift-gateway-7574459656-rw6jw\" (UID: \"9352769e-41e5-4d9e-bec8-da6e57d09a2f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rw6jw" Jul 15 21:16:09.640867 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:16:09.640840 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6a40d93_34b1_4cf6_93af_ec693a017d18.slice/crio-b0f2fe15266ed4249768a74f711b774b1e26ce2fd81e4a210ca79a7163ab904e WatchSource:0}: Error finding container b0f2fe15266ed4249768a74f711b774b1e26ce2fd81e4a210ca79a7163ab904e: Status 404 returned error can't find the container with id b0f2fe15266ed4249768a74f711b774b1e26ce2fd81e4a210ca79a7163ab904e Jul 15 21:16:09.644531 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.644500 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9352769e-41e5-4d9e-bec8-da6e57d09a2f-istio-token\") pod \"istiod-openshift-gateway-7574459656-rw6jw\" (UID: \"9352769e-41e5-4d9e-bec8-da6e57d09a2f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rw6jw" Jul 15 21:16:09.645984 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.645958 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5l5w\" (UniqueName: \"kubernetes.io/projected/9352769e-41e5-4d9e-bec8-da6e57d09a2f-kube-api-access-c5l5w\") pod \"istiod-openshift-gateway-7574459656-rw6jw\" (UID: \"9352769e-41e5-4d9e-bec8-da6e57d09a2f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rw6jw" Jul 15 21:16:09.820608 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.820523 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rw6jw" Jul 15 21:16:09.838100 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.838068 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb2d27e1-d593-477a-9312-1f56a7c3d795-cert\") pod \"odh-model-controller-7998c67dc4-x7ftv\" (UID: \"fb2d27e1-d593-477a-9312-1f56a7c3d795\") " pod="opendatahub/odh-model-controller-7998c67dc4-x7ftv" Jul 15 21:16:09.841380 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.841356 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb2d27e1-d593-477a-9312-1f56a7c3d795-cert\") pod \"odh-model-controller-7998c67dc4-x7ftv\" (UID: \"fb2d27e1-d593-477a-9312-1f56a7c3d795\") " pod="opendatahub/odh-model-controller-7998c67dc4-x7ftv" Jul 15 21:16:09.978530 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.978499 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-x7ftv" Jul 15 21:16:09.978952 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:09.978929 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-rw6jw"] Jul 15 21:16:09.981145 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:16:09.981084 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9352769e_41e5_4d9e_bec8_da6e57d09a2f.slice/crio-4fb434935c59f4d192d5e5b7a6de216abcdbde7e1d13364eb540212de2a62195 WatchSource:0}: Error finding container 4fb434935c59f4d192d5e5b7a6de216abcdbde7e1d13364eb540212de2a62195: Status 404 returned error can't find the container with id 4fb434935c59f4d192d5e5b7a6de216abcdbde7e1d13364eb540212de2a62195 Jul 15 21:16:10.144651 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:10.144624 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-x7ftv"] Jul 15 21:16:10.147464 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:16:10.147434 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb2d27e1_d593_477a_9312_1f56a7c3d795.slice/crio-85cedd389ad877fe3324764f71547992c37f28c9e9fa2ab40edc814c20c4e307 WatchSource:0}: Error finding container 85cedd389ad877fe3324764f71547992c37f28c9e9fa2ab40edc814c20c4e307: Status 404 returned error can't find the container with id 85cedd389ad877fe3324764f71547992c37f28c9e9fa2ab40edc814c20c4e307 Jul 15 21:16:10.508405 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:10.508245 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-x7ftv" event={"ID":"fb2d27e1-d593-477a-9312-1f56a7c3d795","Type":"ContainerStarted","Data":"85cedd389ad877fe3324764f71547992c37f28c9e9fa2ab40edc814c20c4e307"} Jul 15 21:16:10.510795 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:10.510741 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rw6jw" event={"ID":"9352769e-41e5-4d9e-bec8-da6e57d09a2f","Type":"ContainerStarted","Data":"4fb434935c59f4d192d5e5b7a6de216abcdbde7e1d13364eb540212de2a62195"} Jul 15 21:16:10.512332 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:10.512306 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-69s79" event={"ID":"e6a40d93-34b1-4cf6-93af-ec693a017d18","Type":"ContainerStarted","Data":"b0f2fe15266ed4249768a74f711b774b1e26ce2fd81e4a210ca79a7163ab904e"} Jul 15 21:16:12.526336 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:12.526240 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5cbf464cb7-8mjpx" event={"ID":"1da9bba7-0ba9-4ab6-91b7-2dcf2893e401","Type":"ContainerStarted","Data":"bf388f6ad7bcbbe8c6190c58256a4a6a278c925d4853b6e75b7ec2d94426ae55"} Jul 15 21:16:12.528076 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:12.528034 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-69s79" event={"ID":"e6a40d93-34b1-4cf6-93af-ec693a017d18","Type":"ContainerStarted","Data":"6bdb9fd9eccfa0955c6f6c73c372a56cae1cba5ca94926b64a645fa133a596bb"} Jul 15 21:16:12.528221 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:12.528114 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-69s79" Jul 15 21:16:12.544306 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:12.544105 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5cbf464cb7-8mjpx" podStartSLOduration=1.5428143319999998 podStartE2EDuration="4.544082031s" totalImagesPullingTime="3.001267699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:16:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:16:12.541914507 +0000 UTC m=+394.436318597" watchObservedRunningTime="2026-07-15 21:16:12.544082031 +0000 UTC m=+394.438486103" Jul 15 21:16:12.562446 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:12.562386 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-69s79" podStartSLOduration=1.675289217 podStartE2EDuration="3.562364558s" totalImagesPullingTime="1.887075341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:16:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:16:12.560207253 +0000 UTC m=+394.454611318" watchObservedRunningTime="2026-07-15 21:16:12.562364558 +0000 UTC m=+394.456768628" Jul 15 21:16:14.540621 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:14.540580 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-x7ftv" event={"ID":"fb2d27e1-d593-477a-9312-1f56a7c3d795","Type":"ContainerStarted","Data":"6b88d12f51488acb3fc6dda7d40a0a1b369f0f46b49f46a4472891852d497739"} Jul 15 21:16:14.541070 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:14.540700 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-x7ftv" Jul 15 21:16:14.559713 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:14.559647 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-x7ftv" podStartSLOduration=2.805536614 podStartE2EDuration="6.559625341s" totalImagesPullingTime="3.754088727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:16:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:16:14.556926388 +0000 UTC m=+396.451330473" watchObservedRunningTime="2026-07-15 21:16:14.559625341 +0000 UTC m=+396.454029408" Jul 15 21:16:19.777914 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:19.777874 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-76phf"] Jul 15 21:16:19.781786 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:19.781764 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-76phf" Jul 15 21:16:19.786254 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:19.786233 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-5mq7s\"" Jul 15 21:16:19.786426 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:19.786312 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 15 21:16:19.798830 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:19.798804 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-76phf"] Jul 15 21:16:19.801084 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:19.801063 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-plf56"] Jul 15 21:16:19.804398 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:19.804379 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-plf56" Jul 15 21:16:19.810026 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:19.809996 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-qgls4\"" Jul 15 21:16:19.810155 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:19.810028 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 15 21:16:19.819677 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:19.819653 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-plf56"] Jul 15 21:16:19.832752 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:19.832723 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/745fbddc-5ba4-47bc-82ec-5d2459817186-cert\") pod \"kserve-controller-manager-d6f4b65b8-76phf\" (UID: \"745fbddc-5ba4-47bc-82ec-5d2459817186\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-76phf" Jul 15 21:16:19.832752 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:19.832760 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e5c5696-4755-4ff0-80cd-8353cd79ed37-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-plf56\" (UID: \"9e5c5696-4755-4ff0-80cd-8353cd79ed37\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-plf56" Jul 15 21:16:19.832924 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:19.832788 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzvw7\" (UniqueName: \"kubernetes.io/projected/745fbddc-5ba4-47bc-82ec-5d2459817186-kube-api-access-jzvw7\") pod \"kserve-controller-manager-d6f4b65b8-76phf\" (UID: \"745fbddc-5ba4-47bc-82ec-5d2459817186\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-76phf" Jul 15 21:16:19.832924 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:19.832886 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t5w6\" (UniqueName: \"kubernetes.io/projected/9e5c5696-4755-4ff0-80cd-8353cd79ed37-kube-api-access-4t5w6\") pod \"llmisvc-controller-manager-777c6bd7d5-plf56\" (UID: \"9e5c5696-4755-4ff0-80cd-8353cd79ed37\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-plf56" Jul 15 21:16:19.933526 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:19.933486 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t5w6\" (UniqueName: \"kubernetes.io/projected/9e5c5696-4755-4ff0-80cd-8353cd79ed37-kube-api-access-4t5w6\") pod \"llmisvc-controller-manager-777c6bd7d5-plf56\" (UID: \"9e5c5696-4755-4ff0-80cd-8353cd79ed37\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-plf56" Jul 15 21:16:19.933718 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:19.933581 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/745fbddc-5ba4-47bc-82ec-5d2459817186-cert\") pod \"kserve-controller-manager-d6f4b65b8-76phf\" (UID: \"745fbddc-5ba4-47bc-82ec-5d2459817186\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-76phf" Jul 15 21:16:19.933718 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:19.933618 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e5c5696-4755-4ff0-80cd-8353cd79ed37-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-plf56\" (UID: \"9e5c5696-4755-4ff0-80cd-8353cd79ed37\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-plf56" Jul 15 21:16:19.933718 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:19.933662 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzvw7\" (UniqueName: \"kubernetes.io/projected/745fbddc-5ba4-47bc-82ec-5d2459817186-kube-api-access-jzvw7\") pod \"kserve-controller-manager-d6f4b65b8-76phf\" (UID: \"745fbddc-5ba4-47bc-82ec-5d2459817186\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-76phf" Jul 15 21:16:19.933881 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:16:19.933749 2570 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 15 21:16:19.933881 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:16:19.933824 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e5c5696-4755-4ff0-80cd-8353cd79ed37-cert podName:9e5c5696-4755-4ff0-80cd-8353cd79ed37 nodeName:}" failed. No retries permitted until 2026-07-15 21:16:20.433803054 +0000 UTC m=+402.328207097 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9e5c5696-4755-4ff0-80cd-8353cd79ed37-cert") pod "llmisvc-controller-manager-777c6bd7d5-plf56" (UID: "9e5c5696-4755-4ff0-80cd-8353cd79ed37") : secret "llmisvc-webhook-server-cert" not found Jul 15 21:16:19.936119 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:19.936094 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/745fbddc-5ba4-47bc-82ec-5d2459817186-cert\") pod \"kserve-controller-manager-d6f4b65b8-76phf\" (UID: \"745fbddc-5ba4-47bc-82ec-5d2459817186\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-76phf" Jul 15 21:16:19.949870 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:19.949839 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t5w6\" (UniqueName: \"kubernetes.io/projected/9e5c5696-4755-4ff0-80cd-8353cd79ed37-kube-api-access-4t5w6\") pod \"llmisvc-controller-manager-777c6bd7d5-plf56\" (UID: \"9e5c5696-4755-4ff0-80cd-8353cd79ed37\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-plf56" Jul 15 21:16:19.949999 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:19.949955 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzvw7\" (UniqueName: \"kubernetes.io/projected/745fbddc-5ba4-47bc-82ec-5d2459817186-kube-api-access-jzvw7\") pod \"kserve-controller-manager-d6f4b65b8-76phf\" (UID: \"745fbddc-5ba4-47bc-82ec-5d2459817186\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-76phf" Jul 15 21:16:20.092386 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:20.092341 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-76phf" Jul 15 21:16:20.283591 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:20.283563 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-76phf"] Jul 15 21:16:20.286324 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:16:20.286279 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod745fbddc_5ba4_47bc_82ec_5d2459817186.slice/crio-32114cd1bdc8950c25ee6602b7963858927df59f97847deeb3ba7c47b4c179c6 WatchSource:0}: Error finding container 32114cd1bdc8950c25ee6602b7963858927df59f97847deeb3ba7c47b4c179c6: Status 404 returned error can't find the container with id 32114cd1bdc8950c25ee6602b7963858927df59f97847deeb3ba7c47b4c179c6 Jul 15 21:16:20.438537 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:20.438457 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e5c5696-4755-4ff0-80cd-8353cd79ed37-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-plf56\" (UID: \"9e5c5696-4755-4ff0-80cd-8353cd79ed37\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-plf56" Jul 15 21:16:20.440824 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:20.440806 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e5c5696-4755-4ff0-80cd-8353cd79ed37-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-plf56\" (UID: \"9e5c5696-4755-4ff0-80cd-8353cd79ed37\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-plf56" Jul 15 21:16:20.572441 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:20.572404 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-76phf" event={"ID":"745fbddc-5ba4-47bc-82ec-5d2459817186","Type":"ContainerStarted","Data":"32114cd1bdc8950c25ee6602b7963858927df59f97847deeb3ba7c47b4c179c6"} Jul 15 21:16:20.714482 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:20.714390 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-plf56" Jul 15 21:16:20.821208 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:20.821169 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tp4th"] Jul 15 21:16:20.826460 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:20.826435 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tp4th" Jul 15 21:16:20.830274 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:20.830242 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-xtqcv\"" Jul 15 21:16:20.864832 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:20.864802 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tp4th"] Jul 15 21:16:20.873846 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:20.873824 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-plf56"] Jul 15 21:16:20.875624 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:16:20.875602 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9e5c5696_4755_4ff0_80cd_8353cd79ed37.slice/crio-0945a6fa0c50039e9dc2a340418524c7f5aea4f9e56751a4cdab3af75268bb5e WatchSource:0}: Error finding container 0945a6fa0c50039e9dc2a340418524c7f5aea4f9e56751a4cdab3af75268bb5e: Status 404 returned error can't find the container with id 0945a6fa0c50039e9dc2a340418524c7f5aea4f9e56751a4cdab3af75268bb5e Jul 15 21:16:20.942392 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:20.942355 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/114cde3d-fb10-4a66-a029-152d6e5b54c7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tp4th\" (UID: \"114cde3d-fb10-4a66-a029-152d6e5b54c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tp4th" Jul 15 21:16:20.942392 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:20.942393 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/114cde3d-fb10-4a66-a029-152d6e5b54c7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tp4th\" (UID: \"114cde3d-fb10-4a66-a029-152d6e5b54c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tp4th" Jul 15 21:16:20.942570 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:20.942411 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/114cde3d-fb10-4a66-a029-152d6e5b54c7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tp4th\" (UID: \"114cde3d-fb10-4a66-a029-152d6e5b54c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tp4th" Jul 15 21:16:20.942607 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:20.942570 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/114cde3d-fb10-4a66-a029-152d6e5b54c7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tp4th\" (UID: \"114cde3d-fb10-4a66-a029-152d6e5b54c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tp4th" Jul 15 21:16:20.942640 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:20.942627 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/114cde3d-fb10-4a66-a029-152d6e5b54c7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tp4th\" (UID: \"114cde3d-fb10-4a66-a029-152d6e5b54c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tp4th" Jul 15 21:16:20.942673 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:20.942654 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/114cde3d-fb10-4a66-a029-152d6e5b54c7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tp4th\" (UID: \"114cde3d-fb10-4a66-a029-152d6e5b54c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tp4th" Jul 15 21:16:20.942705 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:20.942686 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/114cde3d-fb10-4a66-a029-152d6e5b54c7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tp4th\" (UID: \"114cde3d-fb10-4a66-a029-152d6e5b54c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tp4th" Jul 15 21:16:20.942764 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:20.942747 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpkkl\" (UniqueName: \"kubernetes.io/projected/114cde3d-fb10-4a66-a029-152d6e5b54c7-kube-api-access-xpkkl\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tp4th\" (UID: \"114cde3d-fb10-4a66-a029-152d6e5b54c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tp4th" Jul 15 21:16:20.942835 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:20.942780 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/114cde3d-fb10-4a66-a029-152d6e5b54c7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tp4th\" (UID: \"114cde3d-fb10-4a66-a029-152d6e5b54c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tp4th" Jul 15 21:16:21.043592 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:21.043502 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/114cde3d-fb10-4a66-a029-152d6e5b54c7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tp4th\" (UID: \"114cde3d-fb10-4a66-a029-152d6e5b54c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tp4th" Jul 15 21:16:21.043592 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:21.043547 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/114cde3d-fb10-4a66-a029-152d6e5b54c7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tp4th\" (UID: \"114cde3d-fb10-4a66-a029-152d6e5b54c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tp4th" Jul 15 21:16:21.043592 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:21.043575 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/114cde3d-fb10-4a66-a029-152d6e5b54c7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tp4th\" (UID: \"114cde3d-fb10-4a66-a029-152d6e5b54c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tp4th" Jul 15 21:16:21.043878 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:21.043727 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/114cde3d-fb10-4a66-a029-152d6e5b54c7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tp4th\" (UID: \"114cde3d-fb10-4a66-a029-152d6e5b54c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tp4th" Jul 15 21:16:21.043878 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:21.043766 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/114cde3d-fb10-4a66-a029-152d6e5b54c7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tp4th\" (UID: \"114cde3d-fb10-4a66-a029-152d6e5b54c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tp4th" Jul 15 21:16:21.043878 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:21.043791 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/114cde3d-fb10-4a66-a029-152d6e5b54c7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tp4th\" (UID: \"114cde3d-fb10-4a66-a029-152d6e5b54c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tp4th" Jul 15 21:16:21.043878 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:21.043825 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/114cde3d-fb10-4a66-a029-152d6e5b54c7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tp4th\" (UID: \"114cde3d-fb10-4a66-a029-152d6e5b54c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tp4th" Jul 15 21:16:21.043878 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:21.043867 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpkkl\" (UniqueName: \"kubernetes.io/projected/114cde3d-fb10-4a66-a029-152d6e5b54c7-kube-api-access-xpkkl\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tp4th\" (UID: \"114cde3d-fb10-4a66-a029-152d6e5b54c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tp4th" Jul 15 21:16:21.044124 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:21.043901 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/114cde3d-fb10-4a66-a029-152d6e5b54c7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tp4th\" (UID: \"114cde3d-fb10-4a66-a029-152d6e5b54c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tp4th" Jul 15 21:16:21.044124 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:21.043992 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/114cde3d-fb10-4a66-a029-152d6e5b54c7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tp4th\" (UID: \"114cde3d-fb10-4a66-a029-152d6e5b54c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tp4th" Jul 15 21:16:21.044124 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:21.044067 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/114cde3d-fb10-4a66-a029-152d6e5b54c7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tp4th\" (UID: \"114cde3d-fb10-4a66-a029-152d6e5b54c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tp4th" Jul 15 21:16:21.044124 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:21.044104 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/114cde3d-fb10-4a66-a029-152d6e5b54c7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tp4th\" (UID: \"114cde3d-fb10-4a66-a029-152d6e5b54c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tp4th" Jul 15 21:16:21.044343 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:21.044126 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/114cde3d-fb10-4a66-a029-152d6e5b54c7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tp4th\" (UID: \"114cde3d-fb10-4a66-a029-152d6e5b54c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tp4th" Jul 15 21:16:21.044934 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:21.044889 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/114cde3d-fb10-4a66-a029-152d6e5b54c7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tp4th\" (UID: \"114cde3d-fb10-4a66-a029-152d6e5b54c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tp4th" Jul 15 21:16:21.046483 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:21.046456 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/114cde3d-fb10-4a66-a029-152d6e5b54c7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tp4th\" (UID: \"114cde3d-fb10-4a66-a029-152d6e5b54c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tp4th" Jul 15 21:16:21.046650 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:21.046631 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/114cde3d-fb10-4a66-a029-152d6e5b54c7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tp4th\" (UID: \"114cde3d-fb10-4a66-a029-152d6e5b54c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tp4th" Jul 15 21:16:21.055233 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:21.055209 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/114cde3d-fb10-4a66-a029-152d6e5b54c7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tp4th\" (UID: \"114cde3d-fb10-4a66-a029-152d6e5b54c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tp4th" Jul 15 21:16:21.062505 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:21.062480 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpkkl\" (UniqueName: \"kubernetes.io/projected/114cde3d-fb10-4a66-a029-152d6e5b54c7-kube-api-access-xpkkl\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tp4th\" (UID: \"114cde3d-fb10-4a66-a029-152d6e5b54c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tp4th" Jul 15 21:16:21.138932 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:21.138893 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tp4th" Jul 15 21:16:21.294774 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:21.294707 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tp4th"] Jul 15 21:16:21.297394 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:16:21.297367 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod114cde3d_fb10_4a66_a029_152d6e5b54c7.slice/crio-f2ac112c676650af4ff964e3b0ab093e62c1fafd4042a98e1cf0a8de1c64c564 WatchSource:0}: Error finding container f2ac112c676650af4ff964e3b0ab093e62c1fafd4042a98e1cf0a8de1c64c564: Status 404 returned error can't find the container with id f2ac112c676650af4ff964e3b0ab093e62c1fafd4042a98e1cf0a8de1c64c564 Jul 15 21:16:21.578355 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:21.578323 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tp4th" event={"ID":"114cde3d-fb10-4a66-a029-152d6e5b54c7","Type":"ContainerStarted","Data":"f2ac112c676650af4ff964e3b0ab093e62c1fafd4042a98e1cf0a8de1c64c564"} Jul 15 21:16:21.579517 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:21.579488 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-plf56" event={"ID":"9e5c5696-4755-4ff0-80cd-8353cd79ed37","Type":"ContainerStarted","Data":"0945a6fa0c50039e9dc2a340418524c7f5aea4f9e56751a4cdab3af75268bb5e"} Jul 15 21:16:23.543702 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:23.543588 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-69s79" Jul 15 21:16:23.855826 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:23.855790 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-rw6jw"] Jul 15 21:16:25.547788 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:25.547760 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-x7ftv" Jul 15 21:16:26.787521 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:26.787483 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 21:16:26.787825 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:26.787554 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 21:16:26.787825 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:26.787572 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 21:16:26.787825 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:26.787646 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 21:16:26.787825 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:26.787588 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 21:16:27.619564 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:27.619522 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-76phf" event={"ID":"745fbddc-5ba4-47bc-82ec-5d2459817186","Type":"ContainerStarted","Data":"a8fca72a7c0022a4d6317a4da223b51cc2f78b3acddcf2088e4bcab0af01fd19"} Jul 15 21:16:27.620508 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:27.620477 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-76phf" Jul 15 21:16:27.622635 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:27.622608 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rw6jw" event={"ID":"9352769e-41e5-4d9e-bec8-da6e57d09a2f","Type":"ContainerStarted","Data":"a2d668ec1cd0beba92479c0842734683217a35396a82d31dd34e2266b0131547"} Jul 15 21:16:27.622768 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:27.622652 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rw6jw" podUID="9352769e-41e5-4d9e-bec8-da6e57d09a2f" containerName="discovery" containerID="cri-o://a2d668ec1cd0beba92479c0842734683217a35396a82d31dd34e2266b0131547" gracePeriod=30 Jul 15 21:16:27.622918 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:27.622880 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rw6jw" Jul 15 21:16:27.624959 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:27.624911 2570 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-rw6jw container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 15 21:16:27.625086 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:27.624964 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rw6jw" podUID="9352769e-41e5-4d9e-bec8-da6e57d09a2f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 21:16:27.625152 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:27.625094 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tp4th" event={"ID":"114cde3d-fb10-4a66-a029-152d6e5b54c7","Type":"ContainerStarted","Data":"f3c6d49e172dd136b48049f371c0359869c759f8eedc502b95c78ebd3f8105dc"} Jul 15 21:16:27.626925 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:27.626900 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-plf56" event={"ID":"9e5c5696-4755-4ff0-80cd-8353cd79ed37","Type":"ContainerStarted","Data":"a6ebd3b8a60ebcd5697a939021a6d7021dd1916e29f81e514e0ee6126c911638"} Jul 15 21:16:27.627023 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:27.627010 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-plf56" Jul 15 21:16:27.670088 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:27.670041 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-76phf" podStartSLOduration=5.722361231 podStartE2EDuration="8.670027265s" totalImagesPullingTime="2.947666034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:16:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:16:27.642866863 +0000 UTC m=+409.537270927" watchObservedRunningTime="2026-07-15 21:16:27.670027265 +0000 UTC m=+409.564431330" Jul 15 21:16:27.670208 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:27.670122 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-plf56" podStartSLOduration=2.7666536109999997 podStartE2EDuration="8.670117375s" totalImagesPullingTime="5.903463764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:16:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:16:27.668065022 +0000 UTC m=+409.562469088" watchObservedRunningTime="2026-07-15 21:16:27.670117375 +0000 UTC m=+409.564521439" Jul 15 21:16:27.694106 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:27.694054 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tp4th" podStartSLOduration=2.206362915 podStartE2EDuration="7.694038008s" totalImagesPullingTime="5.487675093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:16:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:16:27.692189434 +0000 UTC m=+409.586593500" watchObservedRunningTime="2026-07-15 21:16:27.694038008 +0000 UTC m=+409.588442135" Jul 15 21:16:27.717402 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:27.717357 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rw6jw" podStartSLOduration=1.9159879229999999 podStartE2EDuration="18.717340748s" totalImagesPullingTime="16.801352825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:16:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:16:27.713459753 +0000 UTC m=+409.607863819" watchObservedRunningTime="2026-07-15 21:16:27.717340748 +0000 UTC m=+409.611744812" Jul 15 21:16:27.892541 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:27.892514 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rw6jw" Jul 15 21:16:28.015134 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:28.015105 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9352769e-41e5-4d9e-bec8-da6e57d09a2f-istio-token\") pod \"9352769e-41e5-4d9e-bec8-da6e57d09a2f\" (UID: \"9352769e-41e5-4d9e-bec8-da6e57d09a2f\") " Jul 15 21:16:28.015343 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:28.015141 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9352769e-41e5-4d9e-bec8-da6e57d09a2f-istio-csr-dns-cert\") pod \"9352769e-41e5-4d9e-bec8-da6e57d09a2f\" (UID: \"9352769e-41e5-4d9e-bec8-da6e57d09a2f\") " Jul 15 21:16:28.015343 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:28.015200 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9352769e-41e5-4d9e-bec8-da6e57d09a2f-local-certs\") pod \"9352769e-41e5-4d9e-bec8-da6e57d09a2f\" (UID: \"9352769e-41e5-4d9e-bec8-da6e57d09a2f\") " Jul 15 21:16:28.015343 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:28.015219 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9352769e-41e5-4d9e-bec8-da6e57d09a2f-istio-kubeconfig\") pod \"9352769e-41e5-4d9e-bec8-da6e57d09a2f\" (UID: \"9352769e-41e5-4d9e-bec8-da6e57d09a2f\") " Jul 15 21:16:28.015343 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:28.015270 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5l5w\" (UniqueName: \"kubernetes.io/projected/9352769e-41e5-4d9e-bec8-da6e57d09a2f-kube-api-access-c5l5w\") pod \"9352769e-41e5-4d9e-bec8-da6e57d09a2f\" (UID: \"9352769e-41e5-4d9e-bec8-da6e57d09a2f\") " Jul 15 21:16:28.015343 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:28.015324 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9352769e-41e5-4d9e-bec8-da6e57d09a2f-istio-csr-ca-configmap\") pod \"9352769e-41e5-4d9e-bec8-da6e57d09a2f\" (UID: \"9352769e-41e5-4d9e-bec8-da6e57d09a2f\") " Jul 15 21:16:28.015682 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:28.015364 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9352769e-41e5-4d9e-bec8-da6e57d09a2f-cacerts\") pod \"9352769e-41e5-4d9e-bec8-da6e57d09a2f\" (UID: \"9352769e-41e5-4d9e-bec8-da6e57d09a2f\") " Jul 15 21:16:28.015897 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:28.015844 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9352769e-41e5-4d9e-bec8-da6e57d09a2f-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "9352769e-41e5-4d9e-bec8-da6e57d09a2f" (UID: "9352769e-41e5-4d9e-bec8-da6e57d09a2f"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:16:28.017682 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:28.017653 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9352769e-41e5-4d9e-bec8-da6e57d09a2f-istio-token" (OuterVolumeSpecName: "istio-token") pod "9352769e-41e5-4d9e-bec8-da6e57d09a2f" (UID: "9352769e-41e5-4d9e-bec8-da6e57d09a2f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:16:28.017860 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:28.017826 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9352769e-41e5-4d9e-bec8-da6e57d09a2f-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "9352769e-41e5-4d9e-bec8-da6e57d09a2f" (UID: "9352769e-41e5-4d9e-bec8-da6e57d09a2f"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:16:28.017959 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:28.017855 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9352769e-41e5-4d9e-bec8-da6e57d09a2f-cacerts" (OuterVolumeSpecName: "cacerts") pod "9352769e-41e5-4d9e-bec8-da6e57d09a2f" (UID: "9352769e-41e5-4d9e-bec8-da6e57d09a2f"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:16:28.018360 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:28.018328 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9352769e-41e5-4d9e-bec8-da6e57d09a2f-local-certs" (OuterVolumeSpecName: "local-certs") pod "9352769e-41e5-4d9e-bec8-da6e57d09a2f" (UID: "9352769e-41e5-4d9e-bec8-da6e57d09a2f"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:16:28.018441 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:28.018395 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9352769e-41e5-4d9e-bec8-da6e57d09a2f-kube-api-access-c5l5w" (OuterVolumeSpecName: "kube-api-access-c5l5w") pod "9352769e-41e5-4d9e-bec8-da6e57d09a2f" (UID: "9352769e-41e5-4d9e-bec8-da6e57d09a2f"). InnerVolumeSpecName "kube-api-access-c5l5w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:16:28.018553 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:28.018536 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9352769e-41e5-4d9e-bec8-da6e57d09a2f-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "9352769e-41e5-4d9e-bec8-da6e57d09a2f" (UID: "9352769e-41e5-4d9e-bec8-da6e57d09a2f"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:16:28.116804 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:28.116764 2570 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9352769e-41e5-4d9e-bec8-da6e57d09a2f-local-certs\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:16:28.116804 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:28.116792 2570 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9352769e-41e5-4d9e-bec8-da6e57d09a2f-istio-kubeconfig\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:16:28.116804 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:28.116803 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5l5w\" (UniqueName: \"kubernetes.io/projected/9352769e-41e5-4d9e-bec8-da6e57d09a2f-kube-api-access-c5l5w\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:16:28.116804 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:28.116813 2570 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9352769e-41e5-4d9e-bec8-da6e57d09a2f-istio-csr-ca-configmap\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:16:28.117058 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:28.116822 2570 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9352769e-41e5-4d9e-bec8-da6e57d09a2f-cacerts\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:16:28.117058 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:28.116831 2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9352769e-41e5-4d9e-bec8-da6e57d09a2f-istio-token\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:16:28.117058 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:28.116841 2570 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9352769e-41e5-4d9e-bec8-da6e57d09a2f-istio-csr-dns-cert\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:16:28.139594 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:28.139516 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tp4th" Jul 15 21:16:28.144251 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:28.144226 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tp4th" Jul 15 21:16:28.635489 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:28.635453 2570 generic.go:356] "Generic (PLEG): container finished" podID="9352769e-41e5-4d9e-bec8-da6e57d09a2f" containerID="a2d668ec1cd0beba92479c0842734683217a35396a82d31dd34e2266b0131547" exitCode=2 Jul 15 21:16:28.635678 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:28.635503 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rw6jw" Jul 15 21:16:28.635678 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:28.635531 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rw6jw" event={"ID":"9352769e-41e5-4d9e-bec8-da6e57d09a2f","Type":"ContainerDied","Data":"a2d668ec1cd0beba92479c0842734683217a35396a82d31dd34e2266b0131547"} Jul 15 21:16:28.635678 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:28.635579 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rw6jw" event={"ID":"9352769e-41e5-4d9e-bec8-da6e57d09a2f","Type":"ContainerDied","Data":"4fb434935c59f4d192d5e5b7a6de216abcdbde7e1d13364eb540212de2a62195"} Jul 15 21:16:28.635678 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:28.635605 2570 scope.go:117] "RemoveContainer" containerID="a2d668ec1cd0beba92479c0842734683217a35396a82d31dd34e2266b0131547" Jul 15 21:16:28.636104 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:28.636082 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tp4th" Jul 15 21:16:28.636926 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:28.636909 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tp4th" Jul 15 21:16:28.645299 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:28.645265 2570 scope.go:117] "RemoveContainer" containerID="a2d668ec1cd0beba92479c0842734683217a35396a82d31dd34e2266b0131547" Jul 15 21:16:28.645544 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:16:28.645527 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2d668ec1cd0beba92479c0842734683217a35396a82d31dd34e2266b0131547\": container with ID starting with a2d668ec1cd0beba92479c0842734683217a35396a82d31dd34e2266b0131547 not found: ID does not exist" containerID="a2d668ec1cd0beba92479c0842734683217a35396a82d31dd34e2266b0131547" Jul 15 21:16:28.645581 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:28.645551 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2d668ec1cd0beba92479c0842734683217a35396a82d31dd34e2266b0131547"} err="failed to get container status \"a2d668ec1cd0beba92479c0842734683217a35396a82d31dd34e2266b0131547\": rpc error: code = NotFound desc = could not find container \"a2d668ec1cd0beba92479c0842734683217a35396a82d31dd34e2266b0131547\": container with ID starting with a2d668ec1cd0beba92479c0842734683217a35396a82d31dd34e2266b0131547 not found: ID does not exist" Jul 15 21:16:28.653991 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:28.653967 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-rw6jw"] Jul 15 21:16:28.662326 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:28.661399 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-rw6jw"] Jul 15 21:16:30.589769 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:30.589729 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9352769e-41e5-4d9e-bec8-da6e57d09a2f" path="/var/lib/kubelet/pods/9352769e-41e5-4d9e-bec8-da6e57d09a2f/volumes" Jul 15 21:16:58.637990 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:58.637958 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-plf56" Jul 15 21:16:59.646859 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:16:59.646824 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-76phf" Jul 15 21:17:08.924362 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:08.924333 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dw62p"] Jul 15 21:17:08.924743 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:08.924706 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9352769e-41e5-4d9e-bec8-da6e57d09a2f" containerName="discovery" Jul 15 21:17:08.924743 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:08.924716 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9352769e-41e5-4d9e-bec8-da6e57d09a2f" containerName="discovery" Jul 15 21:17:08.924829 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:08.924794 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="9352769e-41e5-4d9e-bec8-da6e57d09a2f" containerName="discovery" Jul 15 21:17:08.927340 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:08.927318 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dw62p" Jul 15 21:17:08.930302 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:08.930257 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 15 21:17:08.930429 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:08.930342 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-mjvk9\"" Jul 15 21:17:08.931118 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:08.931099 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 15 21:17:08.940470 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:08.940447 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dw62p"] Jul 15 21:17:08.978457 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:08.978431 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krf78\" (UniqueName: \"kubernetes.io/projected/69fdf558-f1a1-446e-8356-6db0caec19b5-kube-api-access-krf78\") pod \"kuadrant-operator-catalog-dw62p\" (UID: \"69fdf558-f1a1-446e-8356-6db0caec19b5\") " pod="kuadrant-system/kuadrant-operator-catalog-dw62p" Jul 15 21:17:09.079229 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:09.079197 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krf78\" (UniqueName: \"kubernetes.io/projected/69fdf558-f1a1-446e-8356-6db0caec19b5-kube-api-access-krf78\") pod \"kuadrant-operator-catalog-dw62p\" (UID: \"69fdf558-f1a1-446e-8356-6db0caec19b5\") " pod="kuadrant-system/kuadrant-operator-catalog-dw62p" Jul 15 21:17:09.087931 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:09.087910 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krf78\" (UniqueName: \"kubernetes.io/projected/69fdf558-f1a1-446e-8356-6db0caec19b5-kube-api-access-krf78\") pod \"kuadrant-operator-catalog-dw62p\" (UID: \"69fdf558-f1a1-446e-8356-6db0caec19b5\") " pod="kuadrant-system/kuadrant-operator-catalog-dw62p" Jul 15 21:17:09.238541 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:09.238455 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dw62p" Jul 15 21:17:09.275489 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:09.275460 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dw62p"] Jul 15 21:17:09.377479 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:09.377367 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dw62p"] Jul 15 21:17:09.380473 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:17:09.380446 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69fdf558_f1a1_446e_8356_6db0caec19b5.slice/crio-ae7dcd1193650022672af773ad6cae4c083a14bdda28e65b75f905820678cb8b WatchSource:0}: Error finding container ae7dcd1193650022672af773ad6cae4c083a14bdda28e65b75f905820678cb8b: Status 404 returned error can't find the container with id ae7dcd1193650022672af773ad6cae4c083a14bdda28e65b75f905820678cb8b Jul 15 21:17:09.481367 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:09.481333 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ph8sr"] Jul 15 21:17:09.484707 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:09.484691 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ph8sr" Jul 15 21:17:09.492440 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:09.492419 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ph8sr"] Jul 15 21:17:09.583413 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:09.583384 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kcqx\" (UniqueName: \"kubernetes.io/projected/590a0719-fcfa-459c-b855-a3ba5bf6d502-kube-api-access-7kcqx\") pod \"kuadrant-operator-catalog-ph8sr\" (UID: \"590a0719-fcfa-459c-b855-a3ba5bf6d502\") " pod="kuadrant-system/kuadrant-operator-catalog-ph8sr" Jul 15 21:17:09.684630 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:09.684581 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kcqx\" (UniqueName: \"kubernetes.io/projected/590a0719-fcfa-459c-b855-a3ba5bf6d502-kube-api-access-7kcqx\") pod \"kuadrant-operator-catalog-ph8sr\" (UID: \"590a0719-fcfa-459c-b855-a3ba5bf6d502\") " pod="kuadrant-system/kuadrant-operator-catalog-ph8sr" Jul 15 21:17:09.693582 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:09.693544 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kcqx\" (UniqueName: \"kubernetes.io/projected/590a0719-fcfa-459c-b855-a3ba5bf6d502-kube-api-access-7kcqx\") pod \"kuadrant-operator-catalog-ph8sr\" (UID: \"590a0719-fcfa-459c-b855-a3ba5bf6d502\") " pod="kuadrant-system/kuadrant-operator-catalog-ph8sr" Jul 15 21:17:09.795450 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:09.795354 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ph8sr" Jul 15 21:17:09.835143 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:09.834754 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dw62p" event={"ID":"69fdf558-f1a1-446e-8356-6db0caec19b5","Type":"ContainerStarted","Data":"ae7dcd1193650022672af773ad6cae4c083a14bdda28e65b75f905820678cb8b"} Jul 15 21:17:09.948774 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:09.948746 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ph8sr"] Jul 15 21:17:09.950835 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:17:09.950805 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod590a0719_fcfa_459c_b855_a3ba5bf6d502.slice/crio-b9c12d92b0fbd159fa0fd590ce131cd4880ec4e4c2284922d70bc2785712edb3 WatchSource:0}: Error finding container b9c12d92b0fbd159fa0fd590ce131cd4880ec4e4c2284922d70bc2785712edb3: Status 404 returned error can't find the container with id b9c12d92b0fbd159fa0fd590ce131cd4880ec4e4c2284922d70bc2785712edb3 Jul 15 21:17:10.840741 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:10.840704 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ph8sr" event={"ID":"590a0719-fcfa-459c-b855-a3ba5bf6d502","Type":"ContainerStarted","Data":"b9c12d92b0fbd159fa0fd590ce131cd4880ec4e4c2284922d70bc2785712edb3"} Jul 15 21:17:11.846721 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:11.846683 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dw62p" event={"ID":"69fdf558-f1a1-446e-8356-6db0caec19b5","Type":"ContainerStarted","Data":"efa4cdb1cb66dd2644f48c16506218b5f82214b241f03c2e911bab5cd828b990"} Jul 15 21:17:11.847190 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:11.846740 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-dw62p" podUID="69fdf558-f1a1-446e-8356-6db0caec19b5" containerName="registry-server" containerID="cri-o://efa4cdb1cb66dd2644f48c16506218b5f82214b241f03c2e911bab5cd828b990" gracePeriod=2 Jul 15 21:17:11.848239 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:11.848208 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ph8sr" event={"ID":"590a0719-fcfa-459c-b855-a3ba5bf6d502","Type":"ContainerStarted","Data":"730854b34e9a4989b551fd315c9105472817342228003cafb7fc7473f0d2d0bc"} Jul 15 21:17:11.863537 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:11.863481 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-dw62p" podStartSLOduration=1.823684408 podStartE2EDuration="3.86346532s" totalImagesPullingTime="2.039780912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:17:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:17:11.862186579 +0000 UTC m=+453.756590645" watchObservedRunningTime="2026-07-15 21:17:11.86346532 +0000 UTC m=+453.757869386" Jul 15 21:17:11.878961 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:11.878912 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-ph8sr" podStartSLOduration=1.408575427 podStartE2EDuration="2.878895345s" totalImagesPullingTime="1.470319918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:17:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:17:11.877566909 +0000 UTC m=+453.771970973" watchObservedRunningTime="2026-07-15 21:17:11.878895345 +0000 UTC m=+453.773299433" Jul 15 21:17:12.100851 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:12.100785 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dw62p" Jul 15 21:17:12.208313 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:12.208265 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krf78\" (UniqueName: \"kubernetes.io/projected/69fdf558-f1a1-446e-8356-6db0caec19b5-kube-api-access-krf78\") pod \"69fdf558-f1a1-446e-8356-6db0caec19b5\" (UID: \"69fdf558-f1a1-446e-8356-6db0caec19b5\") " Jul 15 21:17:12.210488 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:12.210466 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69fdf558-f1a1-446e-8356-6db0caec19b5-kube-api-access-krf78" (OuterVolumeSpecName: "kube-api-access-krf78") pod "69fdf558-f1a1-446e-8356-6db0caec19b5" (UID: "69fdf558-f1a1-446e-8356-6db0caec19b5"). InnerVolumeSpecName "kube-api-access-krf78". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:17:12.309117 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:12.309065 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krf78\" (UniqueName: \"kubernetes.io/projected/69fdf558-f1a1-446e-8356-6db0caec19b5-kube-api-access-krf78\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:17:12.854385 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:12.854349 2570 generic.go:356] "Generic (PLEG): container finished" podID="69fdf558-f1a1-446e-8356-6db0caec19b5" containerID="efa4cdb1cb66dd2644f48c16506218b5f82214b241f03c2e911bab5cd828b990" exitCode=0 Jul 15 21:17:12.854773 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:12.854395 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dw62p" Jul 15 21:17:12.854773 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:12.854429 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dw62p" event={"ID":"69fdf558-f1a1-446e-8356-6db0caec19b5","Type":"ContainerDied","Data":"efa4cdb1cb66dd2644f48c16506218b5f82214b241f03c2e911bab5cd828b990"} Jul 15 21:17:12.854773 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:12.854477 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dw62p" event={"ID":"69fdf558-f1a1-446e-8356-6db0caec19b5","Type":"ContainerDied","Data":"ae7dcd1193650022672af773ad6cae4c083a14bdda28e65b75f905820678cb8b"} Jul 15 21:17:12.854773 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:12.854500 2570 scope.go:117] "RemoveContainer" containerID="efa4cdb1cb66dd2644f48c16506218b5f82214b241f03c2e911bab5cd828b990" Jul 15 21:17:12.863367 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:12.863349 2570 scope.go:117] "RemoveContainer" containerID="efa4cdb1cb66dd2644f48c16506218b5f82214b241f03c2e911bab5cd828b990" Jul 15 21:17:12.863641 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:17:12.863619 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efa4cdb1cb66dd2644f48c16506218b5f82214b241f03c2e911bab5cd828b990\": container with ID starting with efa4cdb1cb66dd2644f48c16506218b5f82214b241f03c2e911bab5cd828b990 not found: ID does not exist" containerID="efa4cdb1cb66dd2644f48c16506218b5f82214b241f03c2e911bab5cd828b990" Jul 15 21:17:12.863688 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:12.863655 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efa4cdb1cb66dd2644f48c16506218b5f82214b241f03c2e911bab5cd828b990"} err="failed to get container status \"efa4cdb1cb66dd2644f48c16506218b5f82214b241f03c2e911bab5cd828b990\": rpc error: code = NotFound desc = could not find container \"efa4cdb1cb66dd2644f48c16506218b5f82214b241f03c2e911bab5cd828b990\": container with ID starting with efa4cdb1cb66dd2644f48c16506218b5f82214b241f03c2e911bab5cd828b990 not found: ID does not exist" Jul 15 21:17:12.871756 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:12.871733 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dw62p"] Jul 15 21:17:12.876971 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:12.876949 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dw62p"] Jul 15 21:17:14.589495 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:14.589459 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69fdf558-f1a1-446e-8356-6db0caec19b5" path="/var/lib/kubelet/pods/69fdf558-f1a1-446e-8356-6db0caec19b5/volumes" Jul 15 21:17:19.796140 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:19.796094 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-ph8sr" Jul 15 21:17:19.796601 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:19.796163 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-ph8sr" Jul 15 21:17:19.818682 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:19.818650 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-ph8sr" Jul 15 21:17:19.913285 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:19.913260 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-ph8sr" Jul 15 21:17:20.711842 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:20.711806 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zlq4c"] Jul 15 21:17:20.712242 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:20.712229 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69fdf558-f1a1-446e-8356-6db0caec19b5" containerName="registry-server" Jul 15 21:17:20.712286 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:20.712244 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="69fdf558-f1a1-446e-8356-6db0caec19b5" containerName="registry-server" Jul 15 21:17:20.712350 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:20.712326 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="69fdf558-f1a1-446e-8356-6db0caec19b5" containerName="registry-server" Jul 15 21:17:20.717189 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:20.717169 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zlq4c" Jul 15 21:17:20.719358 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:20.719340 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hzbjk\"" Jul 15 21:17:20.724100 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:20.724064 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zlq4c"] Jul 15 21:17:20.787354 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:20.787318 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/667c7c4e-0ab4-4034-9d8a-19dae1b6c79c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zlq4c\" (UID: \"667c7c4e-0ab4-4034-9d8a-19dae1b6c79c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zlq4c" Jul 15 21:17:20.787354 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:20.787358 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s879h\" (UniqueName: \"kubernetes.io/projected/667c7c4e-0ab4-4034-9d8a-19dae1b6c79c-kube-api-access-s879h\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zlq4c\" (UID: \"667c7c4e-0ab4-4034-9d8a-19dae1b6c79c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zlq4c" Jul 15 21:17:20.787560 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:20.787433 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/667c7c4e-0ab4-4034-9d8a-19dae1b6c79c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zlq4c\" (UID: \"667c7c4e-0ab4-4034-9d8a-19dae1b6c79c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zlq4c" Jul 15 21:17:20.888053 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:20.888018 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/667c7c4e-0ab4-4034-9d8a-19dae1b6c79c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zlq4c\" (UID: \"667c7c4e-0ab4-4034-9d8a-19dae1b6c79c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zlq4c" Jul 15 21:17:20.888053 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:20.888057 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s879h\" (UniqueName: \"kubernetes.io/projected/667c7c4e-0ab4-4034-9d8a-19dae1b6c79c-kube-api-access-s879h\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zlq4c\" (UID: \"667c7c4e-0ab4-4034-9d8a-19dae1b6c79c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zlq4c" Jul 15 21:17:20.888477 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:20.888115 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/667c7c4e-0ab4-4034-9d8a-19dae1b6c79c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zlq4c\" (UID: \"667c7c4e-0ab4-4034-9d8a-19dae1b6c79c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zlq4c" Jul 15 21:17:20.888477 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:20.888441 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/667c7c4e-0ab4-4034-9d8a-19dae1b6c79c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zlq4c\" (UID: \"667c7c4e-0ab4-4034-9d8a-19dae1b6c79c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zlq4c" Jul 15 21:17:20.888550 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:20.888475 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/667c7c4e-0ab4-4034-9d8a-19dae1b6c79c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zlq4c\" (UID: \"667c7c4e-0ab4-4034-9d8a-19dae1b6c79c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zlq4c" Jul 15 21:17:20.896787 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:20.896760 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s879h\" (UniqueName: \"kubernetes.io/projected/667c7c4e-0ab4-4034-9d8a-19dae1b6c79c-kube-api-access-s879h\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zlq4c\" (UID: \"667c7c4e-0ab4-4034-9d8a-19dae1b6c79c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zlq4c" Jul 15 21:17:21.028183 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:21.028089 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zlq4c" Jul 15 21:17:21.167919 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:21.167892 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zlq4c"] Jul 15 21:17:21.169873 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:17:21.169840 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod667c7c4e_0ab4_4034_9d8a_19dae1b6c79c.slice/crio-1e714b20859454b739b83f01361a5aff7cb3af0d8ec7a770c3f9d537968621d5 WatchSource:0}: Error finding container 1e714b20859454b739b83f01361a5aff7cb3af0d8ec7a770c3f9d537968621d5: Status 404 returned error can't find the container with id 1e714b20859454b739b83f01361a5aff7cb3af0d8ec7a770c3f9d537968621d5 Jul 15 21:17:21.325941 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:21.325909 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sb6zf"] Jul 15 21:17:21.329767 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:21.329748 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sb6zf" Jul 15 21:17:21.338187 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:21.338163 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sb6zf"] Jul 15 21:17:21.392368 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:21.392335 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7fc4b88-50e3-40b3-83fe-a67d05d56b78-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sb6zf\" (UID: \"c7fc4b88-50e3-40b3-83fe-a67d05d56b78\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sb6zf" Jul 15 21:17:21.392506 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:21.392450 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7fc4b88-50e3-40b3-83fe-a67d05d56b78-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sb6zf\" (UID: \"c7fc4b88-50e3-40b3-83fe-a67d05d56b78\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sb6zf" Jul 15 21:17:21.392549 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:21.392513 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bvhg\" (UniqueName: \"kubernetes.io/projected/c7fc4b88-50e3-40b3-83fe-a67d05d56b78-kube-api-access-7bvhg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sb6zf\" (UID: \"c7fc4b88-50e3-40b3-83fe-a67d05d56b78\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sb6zf" Jul 15 21:17:21.493239 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:21.493200 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7fc4b88-50e3-40b3-83fe-a67d05d56b78-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sb6zf\" (UID: \"c7fc4b88-50e3-40b3-83fe-a67d05d56b78\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sb6zf" Jul 15 21:17:21.493458 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:21.493358 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7fc4b88-50e3-40b3-83fe-a67d05d56b78-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sb6zf\" (UID: \"c7fc4b88-50e3-40b3-83fe-a67d05d56b78\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sb6zf" Jul 15 21:17:21.493458 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:21.493425 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bvhg\" (UniqueName: \"kubernetes.io/projected/c7fc4b88-50e3-40b3-83fe-a67d05d56b78-kube-api-access-7bvhg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sb6zf\" (UID: \"c7fc4b88-50e3-40b3-83fe-a67d05d56b78\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sb6zf" Jul 15 21:17:21.493612 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:21.493590 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7fc4b88-50e3-40b3-83fe-a67d05d56b78-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sb6zf\" (UID: \"c7fc4b88-50e3-40b3-83fe-a67d05d56b78\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sb6zf" Jul 15 21:17:21.493669 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:21.493637 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7fc4b88-50e3-40b3-83fe-a67d05d56b78-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sb6zf\" (UID: \"c7fc4b88-50e3-40b3-83fe-a67d05d56b78\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sb6zf" Jul 15 21:17:21.501522 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:21.501492 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bvhg\" (UniqueName: \"kubernetes.io/projected/c7fc4b88-50e3-40b3-83fe-a67d05d56b78-kube-api-access-7bvhg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sb6zf\" (UID: \"c7fc4b88-50e3-40b3-83fe-a67d05d56b78\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sb6zf" Jul 15 21:17:21.640251 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:21.640215 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sb6zf" Jul 15 21:17:21.772705 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:21.772679 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sb6zf"] Jul 15 21:17:21.774546 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:17:21.774519 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7fc4b88_50e3_40b3_83fe_a67d05d56b78.slice/crio-710fabf11c8894b751e082107e0dbce7b383d391ee24405769b88c548e1cac93 WatchSource:0}: Error finding container 710fabf11c8894b751e082107e0dbce7b383d391ee24405769b88c548e1cac93: Status 404 returned error can't find the container with id 710fabf11c8894b751e082107e0dbce7b383d391ee24405769b88c548e1cac93 Jul 15 21:17:21.902246 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:21.902179 2570 generic.go:356] "Generic (PLEG): container finished" podID="c7fc4b88-50e3-40b3-83fe-a67d05d56b78" containerID="07b6b4f80b6e89431c2dda46fa5f7626831a14ba36a306d1dbdf101a7001ffeb" exitCode=0 Jul 15 21:17:21.902622 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:21.902259 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sb6zf" event={"ID":"c7fc4b88-50e3-40b3-83fe-a67d05d56b78","Type":"ContainerDied","Data":"07b6b4f80b6e89431c2dda46fa5f7626831a14ba36a306d1dbdf101a7001ffeb"} Jul 15 21:17:21.902622 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:21.902347 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sb6zf" event={"ID":"c7fc4b88-50e3-40b3-83fe-a67d05d56b78","Type":"ContainerStarted","Data":"710fabf11c8894b751e082107e0dbce7b383d391ee24405769b88c548e1cac93"} Jul 15 21:17:21.903780 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:21.903756 2570 generic.go:356] "Generic (PLEG): container finished" podID="667c7c4e-0ab4-4034-9d8a-19dae1b6c79c" containerID="8882c9949253cbb6bd10922dcf4e97569d307018977cf00d4a651d7a48f50834" exitCode=0 Jul 15 21:17:21.903887 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:21.903787 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zlq4c" event={"ID":"667c7c4e-0ab4-4034-9d8a-19dae1b6c79c","Type":"ContainerDied","Data":"8882c9949253cbb6bd10922dcf4e97569d307018977cf00d4a651d7a48f50834"} Jul 15 21:17:21.903887 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:21.903836 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zlq4c" event={"ID":"667c7c4e-0ab4-4034-9d8a-19dae1b6c79c","Type":"ContainerStarted","Data":"1e714b20859454b739b83f01361a5aff7cb3af0d8ec7a770c3f9d537968621d5"} Jul 15 21:17:21.918118 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:21.918090 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599qdrm"] Jul 15 21:17:21.922094 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:21.922074 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599qdrm" Jul 15 21:17:21.928982 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:21.928946 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599qdrm"] Jul 15 21:17:21.999032 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:21.998998 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbhbn\" (UniqueName: \"kubernetes.io/projected/3552a72a-0c17-4ca6-851a-dbfa12c23d49-kube-api-access-cbhbn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599qdrm\" (UID: \"3552a72a-0c17-4ca6-851a-dbfa12c23d49\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599qdrm" Jul 15 21:17:21.999202 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:21.999041 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3552a72a-0c17-4ca6-851a-dbfa12c23d49-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599qdrm\" (UID: \"3552a72a-0c17-4ca6-851a-dbfa12c23d49\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599qdrm" Jul 15 21:17:21.999202 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:21.999105 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3552a72a-0c17-4ca6-851a-dbfa12c23d49-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599qdrm\" (UID: \"3552a72a-0c17-4ca6-851a-dbfa12c23d49\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599qdrm" Jul 15 21:17:22.100402 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:22.100368 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbhbn\" (UniqueName: \"kubernetes.io/projected/3552a72a-0c17-4ca6-851a-dbfa12c23d49-kube-api-access-cbhbn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599qdrm\" (UID: \"3552a72a-0c17-4ca6-851a-dbfa12c23d49\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599qdrm" Jul 15 21:17:22.100402 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:22.100407 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3552a72a-0c17-4ca6-851a-dbfa12c23d49-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599qdrm\" (UID: \"3552a72a-0c17-4ca6-851a-dbfa12c23d49\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599qdrm" Jul 15 21:17:22.100615 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:22.100454 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3552a72a-0c17-4ca6-851a-dbfa12c23d49-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599qdrm\" (UID: \"3552a72a-0c17-4ca6-851a-dbfa12c23d49\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599qdrm" Jul 15 21:17:22.100896 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:22.100874 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3552a72a-0c17-4ca6-851a-dbfa12c23d49-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599qdrm\" (UID: \"3552a72a-0c17-4ca6-851a-dbfa12c23d49\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599qdrm" Jul 15 21:17:22.100932 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:22.100903 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3552a72a-0c17-4ca6-851a-dbfa12c23d49-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599qdrm\" (UID: \"3552a72a-0c17-4ca6-851a-dbfa12c23d49\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599qdrm" Jul 15 21:17:22.109200 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:22.109178 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbhbn\" (UniqueName: \"kubernetes.io/projected/3552a72a-0c17-4ca6-851a-dbfa12c23d49-kube-api-access-cbhbn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599qdrm\" (UID: \"3552a72a-0c17-4ca6-851a-dbfa12c23d49\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599qdrm" Jul 15 21:17:22.251426 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:22.251345 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599qdrm" Jul 15 21:17:22.392910 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:22.392882 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599qdrm"] Jul 15 21:17:22.394914 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:17:22.394882 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3552a72a_0c17_4ca6_851a_dbfa12c23d49.slice/crio-2d4dae5b28a7a0e5fd5a55c1ff2119f20887ca7020abf0c15de0877ce3b64749 WatchSource:0}: Error finding container 2d4dae5b28a7a0e5fd5a55c1ff2119f20887ca7020abf0c15de0877ce3b64749: Status 404 returned error can't find the container with id 2d4dae5b28a7a0e5fd5a55c1ff2119f20887ca7020abf0c15de0877ce3b64749 Jul 15 21:17:22.524481 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:22.524453 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pt4lv"] Jul 15 21:17:22.528453 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:22.528433 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pt4lv" Jul 15 21:17:22.536953 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:22.536931 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pt4lv"] Jul 15 21:17:22.605418 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:22.605392 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05082e89-deef-4c9c-b3a4-f158b5831bef-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pt4lv\" (UID: \"05082e89-deef-4c9c-b3a4-f158b5831bef\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pt4lv" Jul 15 21:17:22.605550 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:22.605429 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p68n4\" (UniqueName: \"kubernetes.io/projected/05082e89-deef-4c9c-b3a4-f158b5831bef-kube-api-access-p68n4\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pt4lv\" (UID: \"05082e89-deef-4c9c-b3a4-f158b5831bef\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pt4lv" Jul 15 21:17:22.605550 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:22.605462 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05082e89-deef-4c9c-b3a4-f158b5831bef-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pt4lv\" (UID: \"05082e89-deef-4c9c-b3a4-f158b5831bef\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pt4lv" Jul 15 21:17:22.706768 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:22.706736 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05082e89-deef-4c9c-b3a4-f158b5831bef-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pt4lv\" (UID: \"05082e89-deef-4c9c-b3a4-f158b5831bef\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pt4lv" Jul 15 21:17:22.706886 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:22.706775 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p68n4\" (UniqueName: \"kubernetes.io/projected/05082e89-deef-4c9c-b3a4-f158b5831bef-kube-api-access-p68n4\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pt4lv\" (UID: \"05082e89-deef-4c9c-b3a4-f158b5831bef\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pt4lv" Jul 15 21:17:22.706886 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:22.706810 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05082e89-deef-4c9c-b3a4-f158b5831bef-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pt4lv\" (UID: \"05082e89-deef-4c9c-b3a4-f158b5831bef\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pt4lv" Jul 15 21:17:22.707223 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:22.707207 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05082e89-deef-4c9c-b3a4-f158b5831bef-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pt4lv\" (UID: \"05082e89-deef-4c9c-b3a4-f158b5831bef\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pt4lv" Jul 15 21:17:22.707257 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:22.707232 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05082e89-deef-4c9c-b3a4-f158b5831bef-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pt4lv\" (UID: \"05082e89-deef-4c9c-b3a4-f158b5831bef\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pt4lv" Jul 15 21:17:22.714976 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:22.714958 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p68n4\" (UniqueName: \"kubernetes.io/projected/05082e89-deef-4c9c-b3a4-f158b5831bef-kube-api-access-p68n4\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pt4lv\" (UID: \"05082e89-deef-4c9c-b3a4-f158b5831bef\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pt4lv" Jul 15 21:17:22.896866 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:22.896836 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pt4lv" Jul 15 21:17:22.910758 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:22.910732 2570 generic.go:356] "Generic (PLEG): container finished" podID="c7fc4b88-50e3-40b3-83fe-a67d05d56b78" containerID="262fdb300bcc37baaa1c9ac972e16cdd53e270b6ffcde1883ff7c92282dc2d98" exitCode=0 Jul 15 21:17:22.911106 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:22.910813 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sb6zf" event={"ID":"c7fc4b88-50e3-40b3-83fe-a67d05d56b78","Type":"ContainerDied","Data":"262fdb300bcc37baaa1c9ac972e16cdd53e270b6ffcde1883ff7c92282dc2d98"} Jul 15 21:17:22.913074 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:22.913049 2570 generic.go:356] "Generic (PLEG): container finished" podID="667c7c4e-0ab4-4034-9d8a-19dae1b6c79c" containerID="58517ecd5b59c540ce9ebeb996d2e58ea18ece4873edd5a9992305a9c51f5b3e" exitCode=0 Jul 15 21:17:22.913196 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:22.913129 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zlq4c" event={"ID":"667c7c4e-0ab4-4034-9d8a-19dae1b6c79c","Type":"ContainerDied","Data":"58517ecd5b59c540ce9ebeb996d2e58ea18ece4873edd5a9992305a9c51f5b3e"} Jul 15 21:17:22.914666 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:22.914646 2570 generic.go:356] "Generic (PLEG): container finished" podID="3552a72a-0c17-4ca6-851a-dbfa12c23d49" containerID="f80cff092d583566892c985b7c268a29c0701db6ed61f633b474264e04be77fc" exitCode=0 Jul 15 21:17:22.914779 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:22.914672 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599qdrm" event={"ID":"3552a72a-0c17-4ca6-851a-dbfa12c23d49","Type":"ContainerDied","Data":"f80cff092d583566892c985b7c268a29c0701db6ed61f633b474264e04be77fc"} Jul 15 21:17:22.914779 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:22.914705 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599qdrm" event={"ID":"3552a72a-0c17-4ca6-851a-dbfa12c23d49","Type":"ContainerStarted","Data":"2d4dae5b28a7a0e5fd5a55c1ff2119f20887ca7020abf0c15de0877ce3b64749"} Jul 15 21:17:23.056574 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:23.056538 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pt4lv"] Jul 15 21:17:23.058131 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:17:23.058090 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05082e89_deef_4c9c_b3a4_f158b5831bef.slice/crio-9d125190eff899b1654ddf8243676fdec770c8f090967aaaf33ed2b74f455f52 WatchSource:0}: Error finding container 9d125190eff899b1654ddf8243676fdec770c8f090967aaaf33ed2b74f455f52: Status 404 returned error can't find the container with id 9d125190eff899b1654ddf8243676fdec770c8f090967aaaf33ed2b74f455f52 Jul 15 21:17:23.922408 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:23.922382 2570 generic.go:356] "Generic (PLEG): container finished" podID="667c7c4e-0ab4-4034-9d8a-19dae1b6c79c" containerID="7de8e06be34dbf1edfa10a611b3a2eb4de6b6087a07d65ea87dbdc9fe010e320" exitCode=0 Jul 15 21:17:23.922727 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:23.922470 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zlq4c" event={"ID":"667c7c4e-0ab4-4034-9d8a-19dae1b6c79c","Type":"ContainerDied","Data":"7de8e06be34dbf1edfa10a611b3a2eb4de6b6087a07d65ea87dbdc9fe010e320"} Jul 15 21:17:23.925823 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:23.925800 2570 generic.go:356] "Generic (PLEG): container finished" podID="05082e89-deef-4c9c-b3a4-f158b5831bef" containerID="fab8a7e250d2fa7df695cc8b214092ed6eefff3d0a550afa6f3d6ce630512aae" exitCode=0 Jul 15 21:17:23.925926 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:23.925877 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pt4lv" event={"ID":"05082e89-deef-4c9c-b3a4-f158b5831bef","Type":"ContainerDied","Data":"fab8a7e250d2fa7df695cc8b214092ed6eefff3d0a550afa6f3d6ce630512aae"} Jul 15 21:17:23.925926 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:23.925915 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pt4lv" event={"ID":"05082e89-deef-4c9c-b3a4-f158b5831bef","Type":"ContainerStarted","Data":"9d125190eff899b1654ddf8243676fdec770c8f090967aaaf33ed2b74f455f52"} Jul 15 21:17:23.928016 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:23.927979 2570 generic.go:356] "Generic (PLEG): container finished" podID="c7fc4b88-50e3-40b3-83fe-a67d05d56b78" containerID="947a16393c0fd6cd39aa430979395425a45db5a6ea90a1921369865ae6a3ed04" exitCode=0 Jul 15 21:17:23.928120 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:23.928023 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sb6zf" event={"ID":"c7fc4b88-50e3-40b3-83fe-a67d05d56b78","Type":"ContainerDied","Data":"947a16393c0fd6cd39aa430979395425a45db5a6ea90a1921369865ae6a3ed04"} Jul 15 21:17:24.935858 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:24.935825 2570 generic.go:356] "Generic (PLEG): container finished" podID="05082e89-deef-4c9c-b3a4-f158b5831bef" containerID="4f126214b5db18a50af240336db871628fb70ded7aae1121e8be310a61fb9318" exitCode=0 Jul 15 21:17:24.936275 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:24.935907 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pt4lv" event={"ID":"05082e89-deef-4c9c-b3a4-f158b5831bef","Type":"ContainerDied","Data":"4f126214b5db18a50af240336db871628fb70ded7aae1121e8be310a61fb9318"} Jul 15 21:17:24.937993 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:24.937968 2570 generic.go:356] "Generic (PLEG): container finished" podID="3552a72a-0c17-4ca6-851a-dbfa12c23d49" containerID="e5637d2ce0ddc362a5ea743b05bdf76bef1e26831321e4ed8a634b0aaf681c20" exitCode=0 Jul 15 21:17:24.938078 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:24.938035 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599qdrm" event={"ID":"3552a72a-0c17-4ca6-851a-dbfa12c23d49","Type":"ContainerDied","Data":"e5637d2ce0ddc362a5ea743b05bdf76bef1e26831321e4ed8a634b0aaf681c20"} Jul 15 21:17:25.117149 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:25.102454 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sb6zf" Jul 15 21:17:25.228851 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:25.228826 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bvhg\" (UniqueName: \"kubernetes.io/projected/c7fc4b88-50e3-40b3-83fe-a67d05d56b78-kube-api-access-7bvhg\") pod \"c7fc4b88-50e3-40b3-83fe-a67d05d56b78\" (UID: \"c7fc4b88-50e3-40b3-83fe-a67d05d56b78\") " Jul 15 21:17:25.229015 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:25.228932 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7fc4b88-50e3-40b3-83fe-a67d05d56b78-bundle\") pod \"c7fc4b88-50e3-40b3-83fe-a67d05d56b78\" (UID: \"c7fc4b88-50e3-40b3-83fe-a67d05d56b78\") " Jul 15 21:17:25.229015 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:25.228999 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7fc4b88-50e3-40b3-83fe-a67d05d56b78-util\") pod \"c7fc4b88-50e3-40b3-83fe-a67d05d56b78\" (UID: \"c7fc4b88-50e3-40b3-83fe-a67d05d56b78\") " Jul 15 21:17:25.229427 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:25.229399 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7fc4b88-50e3-40b3-83fe-a67d05d56b78-bundle" (OuterVolumeSpecName: "bundle") pod "c7fc4b88-50e3-40b3-83fe-a67d05d56b78" (UID: "c7fc4b88-50e3-40b3-83fe-a67d05d56b78"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:17:25.230901 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:25.230874 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7fc4b88-50e3-40b3-83fe-a67d05d56b78-kube-api-access-7bvhg" (OuterVolumeSpecName: "kube-api-access-7bvhg") pod "c7fc4b88-50e3-40b3-83fe-a67d05d56b78" (UID: "c7fc4b88-50e3-40b3-83fe-a67d05d56b78"). InnerVolumeSpecName "kube-api-access-7bvhg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:17:25.234704 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:25.234682 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7fc4b88-50e3-40b3-83fe-a67d05d56b78-util" (OuterVolumeSpecName: "util") pod "c7fc4b88-50e3-40b3-83fe-a67d05d56b78" (UID: "c7fc4b88-50e3-40b3-83fe-a67d05d56b78"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:17:25.252856 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:25.252835 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zlq4c" Jul 15 21:17:25.330379 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:25.330348 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s879h\" (UniqueName: \"kubernetes.io/projected/667c7c4e-0ab4-4034-9d8a-19dae1b6c79c-kube-api-access-s879h\") pod \"667c7c4e-0ab4-4034-9d8a-19dae1b6c79c\" (UID: \"667c7c4e-0ab4-4034-9d8a-19dae1b6c79c\") " Jul 15 21:17:25.330568 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:25.330414 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/667c7c4e-0ab4-4034-9d8a-19dae1b6c79c-bundle\") pod \"667c7c4e-0ab4-4034-9d8a-19dae1b6c79c\" (UID: \"667c7c4e-0ab4-4034-9d8a-19dae1b6c79c\") " Jul 15 21:17:25.330568 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:25.330472 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/667c7c4e-0ab4-4034-9d8a-19dae1b6c79c-util\") pod \"667c7c4e-0ab4-4034-9d8a-19dae1b6c79c\" (UID: \"667c7c4e-0ab4-4034-9d8a-19dae1b6c79c\") " Jul 15 21:17:25.330773 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:25.330756 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7fc4b88-50e3-40b3-83fe-a67d05d56b78-bundle\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:17:25.330830 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:25.330777 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7fc4b88-50e3-40b3-83fe-a67d05d56b78-util\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:17:25.330830 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:25.330791 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bvhg\" (UniqueName: \"kubernetes.io/projected/c7fc4b88-50e3-40b3-83fe-a67d05d56b78-kube-api-access-7bvhg\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:17:25.331059 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:25.331030 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/667c7c4e-0ab4-4034-9d8a-19dae1b6c79c-bundle" (OuterVolumeSpecName: "bundle") pod "667c7c4e-0ab4-4034-9d8a-19dae1b6c79c" (UID: "667c7c4e-0ab4-4034-9d8a-19dae1b6c79c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:17:25.332502 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:25.332484 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/667c7c4e-0ab4-4034-9d8a-19dae1b6c79c-kube-api-access-s879h" (OuterVolumeSpecName: "kube-api-access-s879h") pod "667c7c4e-0ab4-4034-9d8a-19dae1b6c79c" (UID: "667c7c4e-0ab4-4034-9d8a-19dae1b6c79c"). InnerVolumeSpecName "kube-api-access-s879h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:17:25.335885 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:25.335860 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/667c7c4e-0ab4-4034-9d8a-19dae1b6c79c-util" (OuterVolumeSpecName: "util") pod "667c7c4e-0ab4-4034-9d8a-19dae1b6c79c" (UID: "667c7c4e-0ab4-4034-9d8a-19dae1b6c79c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:17:25.432266 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:25.432228 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s879h\" (UniqueName: \"kubernetes.io/projected/667c7c4e-0ab4-4034-9d8a-19dae1b6c79c-kube-api-access-s879h\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:17:25.432266 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:25.432258 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/667c7c4e-0ab4-4034-9d8a-19dae1b6c79c-bundle\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:17:25.432266 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:25.432270 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/667c7c4e-0ab4-4034-9d8a-19dae1b6c79c-util\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:17:25.945975 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:25.945946 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sb6zf" Jul 15 21:17:25.946432 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:25.945945 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sb6zf" event={"ID":"c7fc4b88-50e3-40b3-83fe-a67d05d56b78","Type":"ContainerDied","Data":"710fabf11c8894b751e082107e0dbce7b383d391ee24405769b88c548e1cac93"} Jul 15 21:17:25.946432 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:25.946098 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="710fabf11c8894b751e082107e0dbce7b383d391ee24405769b88c548e1cac93" Jul 15 21:17:25.947846 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:25.947819 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zlq4c" event={"ID":"667c7c4e-0ab4-4034-9d8a-19dae1b6c79c","Type":"ContainerDied","Data":"1e714b20859454b739b83f01361a5aff7cb3af0d8ec7a770c3f9d537968621d5"} Jul 15 21:17:25.947981 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:25.947867 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e714b20859454b739b83f01361a5aff7cb3af0d8ec7a770c3f9d537968621d5" Jul 15 21:17:25.947981 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:25.947826 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zlq4c" Jul 15 21:17:25.950157 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:25.950132 2570 generic.go:356] "Generic (PLEG): container finished" podID="3552a72a-0c17-4ca6-851a-dbfa12c23d49" containerID="e1cecda542f96ce712d1967248584d079aec76cdabf46ca602f2c5b8193e497e" exitCode=0 Jul 15 21:17:25.950280 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:25.950198 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599qdrm" event={"ID":"3552a72a-0c17-4ca6-851a-dbfa12c23d49","Type":"ContainerDied","Data":"e1cecda542f96ce712d1967248584d079aec76cdabf46ca602f2c5b8193e497e"} Jul 15 21:17:25.952381 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:25.952362 2570 generic.go:356] "Generic (PLEG): container finished" podID="05082e89-deef-4c9c-b3a4-f158b5831bef" containerID="dba9433e2725c3d78e9dd1572e7431201136c2a2b6a46b245ab9d203fed0aabd" exitCode=0 Jul 15 21:17:25.952476 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:25.952422 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pt4lv" event={"ID":"05082e89-deef-4c9c-b3a4-f158b5831bef","Type":"ContainerDied","Data":"dba9433e2725c3d78e9dd1572e7431201136c2a2b6a46b245ab9d203fed0aabd"} Jul 15 21:17:27.121872 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:27.121846 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pt4lv" Jul 15 21:17:27.123988 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:27.123968 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599qdrm" Jul 15 21:17:27.248038 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:27.247947 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05082e89-deef-4c9c-b3a4-f158b5831bef-bundle\") pod \"05082e89-deef-4c9c-b3a4-f158b5831bef\" (UID: \"05082e89-deef-4c9c-b3a4-f158b5831bef\") " Jul 15 21:17:27.248038 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:27.248007 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05082e89-deef-4c9c-b3a4-f158b5831bef-util\") pod \"05082e89-deef-4c9c-b3a4-f158b5831bef\" (UID: \"05082e89-deef-4c9c-b3a4-f158b5831bef\") " Jul 15 21:17:27.248236 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:27.248044 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p68n4\" (UniqueName: \"kubernetes.io/projected/05082e89-deef-4c9c-b3a4-f158b5831bef-kube-api-access-p68n4\") pod \"05082e89-deef-4c9c-b3a4-f158b5831bef\" (UID: \"05082e89-deef-4c9c-b3a4-f158b5831bef\") " Jul 15 21:17:27.248236 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:27.248097 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbhbn\" (UniqueName: \"kubernetes.io/projected/3552a72a-0c17-4ca6-851a-dbfa12c23d49-kube-api-access-cbhbn\") pod \"3552a72a-0c17-4ca6-851a-dbfa12c23d49\" (UID: \"3552a72a-0c17-4ca6-851a-dbfa12c23d49\") " Jul 15 21:17:27.248236 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:27.248136 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3552a72a-0c17-4ca6-851a-dbfa12c23d49-util\") pod \"3552a72a-0c17-4ca6-851a-dbfa12c23d49\" (UID: \"3552a72a-0c17-4ca6-851a-dbfa12c23d49\") " Jul 15 21:17:27.248236 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:27.248182 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3552a72a-0c17-4ca6-851a-dbfa12c23d49-bundle\") pod \"3552a72a-0c17-4ca6-851a-dbfa12c23d49\" (UID: \"3552a72a-0c17-4ca6-851a-dbfa12c23d49\") " Jul 15 21:17:27.248733 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:27.248703 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05082e89-deef-4c9c-b3a4-f158b5831bef-bundle" (OuterVolumeSpecName: "bundle") pod "05082e89-deef-4c9c-b3a4-f158b5831bef" (UID: "05082e89-deef-4c9c-b3a4-f158b5831bef"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:17:27.248841 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:27.248740 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3552a72a-0c17-4ca6-851a-dbfa12c23d49-bundle" (OuterVolumeSpecName: "bundle") pod "3552a72a-0c17-4ca6-851a-dbfa12c23d49" (UID: "3552a72a-0c17-4ca6-851a-dbfa12c23d49"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:17:27.250281 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:27.250249 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05082e89-deef-4c9c-b3a4-f158b5831bef-kube-api-access-p68n4" (OuterVolumeSpecName: "kube-api-access-p68n4") pod "05082e89-deef-4c9c-b3a4-f158b5831bef" (UID: "05082e89-deef-4c9c-b3a4-f158b5831bef"). InnerVolumeSpecName "kube-api-access-p68n4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:17:27.250409 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:27.250337 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3552a72a-0c17-4ca6-851a-dbfa12c23d49-kube-api-access-cbhbn" (OuterVolumeSpecName: "kube-api-access-cbhbn") pod "3552a72a-0c17-4ca6-851a-dbfa12c23d49" (UID: "3552a72a-0c17-4ca6-851a-dbfa12c23d49"). InnerVolumeSpecName "kube-api-access-cbhbn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:17:27.254119 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:27.254086 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05082e89-deef-4c9c-b3a4-f158b5831bef-util" (OuterVolumeSpecName: "util") pod "05082e89-deef-4c9c-b3a4-f158b5831bef" (UID: "05082e89-deef-4c9c-b3a4-f158b5831bef"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:17:27.256992 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:27.256968 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3552a72a-0c17-4ca6-851a-dbfa12c23d49-util" (OuterVolumeSpecName: "util") pod "3552a72a-0c17-4ca6-851a-dbfa12c23d49" (UID: "3552a72a-0c17-4ca6-851a-dbfa12c23d49"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:17:27.349970 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:27.349933 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05082e89-deef-4c9c-b3a4-f158b5831bef-util\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:17:27.349970 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:27.349964 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p68n4\" (UniqueName: \"kubernetes.io/projected/05082e89-deef-4c9c-b3a4-f158b5831bef-kube-api-access-p68n4\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:17:27.349970 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:27.349974 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbhbn\" (UniqueName: \"kubernetes.io/projected/3552a72a-0c17-4ca6-851a-dbfa12c23d49-kube-api-access-cbhbn\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:17:27.350196 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:27.349984 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3552a72a-0c17-4ca6-851a-dbfa12c23d49-util\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:17:27.350196 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:27.349992 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3552a72a-0c17-4ca6-851a-dbfa12c23d49-bundle\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:17:27.350196 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:27.350000 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05082e89-deef-4c9c-b3a4-f158b5831bef-bundle\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:17:27.966625 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:27.966595 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599qdrm" Jul 15 21:17:27.966788 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:27.966625 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599qdrm" event={"ID":"3552a72a-0c17-4ca6-851a-dbfa12c23d49","Type":"ContainerDied","Data":"2d4dae5b28a7a0e5fd5a55c1ff2119f20887ca7020abf0c15de0877ce3b64749"} Jul 15 21:17:27.966788 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:27.966677 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2d4dae5b28a7a0e5fd5a55c1ff2119f20887ca7020abf0c15de0877ce3b64749" Jul 15 21:17:27.968406 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:27.968377 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pt4lv" event={"ID":"05082e89-deef-4c9c-b3a4-f158b5831bef","Type":"ContainerDied","Data":"9d125190eff899b1654ddf8243676fdec770c8f090967aaaf33ed2b74f455f52"} Jul 15 21:17:27.968542 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:27.968419 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d125190eff899b1654ddf8243676fdec770c8f090967aaaf33ed2b74f455f52" Jul 15 21:17:27.968542 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:27.968393 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pt4lv" Jul 15 21:17:39.038042 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:39.038008 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7glw"] Jul 15 21:17:39.038422 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:39.038404 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7fc4b88-50e3-40b3-83fe-a67d05d56b78" containerName="pull" Jul 15 21:17:39.038422 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:39.038414 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7fc4b88-50e3-40b3-83fe-a67d05d56b78" containerName="pull" Jul 15 21:17:39.038422 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:39.038421 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05082e89-deef-4c9c-b3a4-f158b5831bef" containerName="util" Jul 15 21:17:39.038539 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:39.038428 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="05082e89-deef-4c9c-b3a4-f158b5831bef" containerName="util" Jul 15 21:17:39.038539 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:39.038437 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="667c7c4e-0ab4-4034-9d8a-19dae1b6c79c" containerName="extract" Jul 15 21:17:39.038539 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:39.038442 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="667c7c4e-0ab4-4034-9d8a-19dae1b6c79c" containerName="extract" Jul 15 21:17:39.038539 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:39.038449 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="667c7c4e-0ab4-4034-9d8a-19dae1b6c79c" containerName="util" Jul 15 21:17:39.038539 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:39.038454 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="667c7c4e-0ab4-4034-9d8a-19dae1b6c79c" containerName="util" Jul 15 21:17:39.038539 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:39.038461 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3552a72a-0c17-4ca6-851a-dbfa12c23d49" containerName="extract" Jul 15 21:17:39.038539 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:39.038466 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3552a72a-0c17-4ca6-851a-dbfa12c23d49" containerName="extract" Jul 15 21:17:39.038539 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:39.038473 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7fc4b88-50e3-40b3-83fe-a67d05d56b78" containerName="extract" Jul 15 21:17:39.038539 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:39.038478 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7fc4b88-50e3-40b3-83fe-a67d05d56b78" containerName="extract" Jul 15 21:17:39.038539 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:39.038487 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05082e89-deef-4c9c-b3a4-f158b5831bef" containerName="pull" Jul 15 21:17:39.038539 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:39.038492 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="05082e89-deef-4c9c-b3a4-f158b5831bef" containerName="pull" Jul 15 21:17:39.038539 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:39.038500 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7fc4b88-50e3-40b3-83fe-a67d05d56b78" containerName="util" Jul 15 21:17:39.038539 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:39.038505 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7fc4b88-50e3-40b3-83fe-a67d05d56b78" containerName="util" Jul 15 21:17:39.038539 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:39.038512 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3552a72a-0c17-4ca6-851a-dbfa12c23d49" containerName="util" Jul 15 21:17:39.038539 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:39.038517 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3552a72a-0c17-4ca6-851a-dbfa12c23d49" containerName="util" Jul 15 21:17:39.038539 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:39.038527 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="667c7c4e-0ab4-4034-9d8a-19dae1b6c79c" containerName="pull" Jul 15 21:17:39.038539 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:39.038531 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="667c7c4e-0ab4-4034-9d8a-19dae1b6c79c" containerName="pull" Jul 15 21:17:39.038539 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:39.038543 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3552a72a-0c17-4ca6-851a-dbfa12c23d49" containerName="pull" Jul 15 21:17:39.038539 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:39.038548 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3552a72a-0c17-4ca6-851a-dbfa12c23d49" containerName="pull" Jul 15 21:17:39.039050 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:39.038554 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05082e89-deef-4c9c-b3a4-f158b5831bef" containerName="extract" Jul 15 21:17:39.039050 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:39.038559 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="05082e89-deef-4c9c-b3a4-f158b5831bef" containerName="extract" Jul 15 21:17:39.039050 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:39.038619 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7fc4b88-50e3-40b3-83fe-a67d05d56b78" containerName="extract" Jul 15 21:17:39.039050 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:39.038627 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="667c7c4e-0ab4-4034-9d8a-19dae1b6c79c" containerName="extract" Jul 15 21:17:39.039050 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:39.038633 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3552a72a-0c17-4ca6-851a-dbfa12c23d49" containerName="extract" Jul 15 21:17:39.039050 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:39.038640 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="05082e89-deef-4c9c-b3a4-f158b5831bef" containerName="extract" Jul 15 21:17:39.042840 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:39.042825 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7glw" Jul 15 21:17:39.046820 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:39.046795 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ggchg\"" Jul 15 21:17:39.065525 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:39.065496 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7glw"] Jul 15 21:17:39.162342 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:39.162285 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqzg8\" (UniqueName: \"kubernetes.io/projected/39db76e9-b21f-4cfc-8e87-130c4b395a07-kube-api-access-hqzg8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g7glw\" (UID: \"39db76e9-b21f-4cfc-8e87-130c4b395a07\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7glw" Jul 15 21:17:39.162509 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:39.162402 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/39db76e9-b21f-4cfc-8e87-130c4b395a07-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g7glw\" (UID: \"39db76e9-b21f-4cfc-8e87-130c4b395a07\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7glw" Jul 15 21:17:39.263652 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:39.263616 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/39db76e9-b21f-4cfc-8e87-130c4b395a07-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g7glw\" (UID: \"39db76e9-b21f-4cfc-8e87-130c4b395a07\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7glw" Jul 15 21:17:39.263786 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:39.263688 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqzg8\" (UniqueName: \"kubernetes.io/projected/39db76e9-b21f-4cfc-8e87-130c4b395a07-kube-api-access-hqzg8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g7glw\" (UID: \"39db76e9-b21f-4cfc-8e87-130c4b395a07\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7glw" Jul 15 21:17:39.264020 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:39.264000 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/39db76e9-b21f-4cfc-8e87-130c4b395a07-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g7glw\" (UID: \"39db76e9-b21f-4cfc-8e87-130c4b395a07\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7glw" Jul 15 21:17:39.287875 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:39.287847 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqzg8\" (UniqueName: \"kubernetes.io/projected/39db76e9-b21f-4cfc-8e87-130c4b395a07-kube-api-access-hqzg8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g7glw\" (UID: \"39db76e9-b21f-4cfc-8e87-130c4b395a07\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7glw" Jul 15 21:17:39.352915 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:39.352884 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7glw" Jul 15 21:17:39.491067 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:39.491045 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7glw"] Jul 15 21:17:39.493705 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:17:39.493679 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39db76e9_b21f_4cfc_8e87_130c4b395a07.slice/crio-9d9d8eb369c87021b3fbbf010f18887fb1ac6aea6dfc2b0d227e3a40e47fe0fb WatchSource:0}: Error finding container 9d9d8eb369c87021b3fbbf010f18887fb1ac6aea6dfc2b0d227e3a40e47fe0fb: Status 404 returned error can't find the container with id 9d9d8eb369c87021b3fbbf010f18887fb1ac6aea6dfc2b0d227e3a40e47fe0fb Jul 15 21:17:40.030383 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:40.030349 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7glw" event={"ID":"39db76e9-b21f-4cfc-8e87-130c4b395a07","Type":"ContainerStarted","Data":"9d9d8eb369c87021b3fbbf010f18887fb1ac6aea6dfc2b0d227e3a40e47fe0fb"} Jul 15 21:17:40.352114 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:40.352066 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c67c8865f-bsbp8"] Jul 15 21:17:40.356550 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:40.356526 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c67c8865f-bsbp8" Jul 15 21:17:40.359036 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:40.359012 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 15 21:17:40.359263 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:40.359247 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 15 21:17:40.359860 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:40.359836 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 15 21:17:40.359957 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:40.359841 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-64fj2\"" Jul 15 21:17:40.360023 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:40.359842 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 15 21:17:40.360116 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:40.360097 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 15 21:17:40.360208 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:40.360192 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 15 21:17:40.360324 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:40.360285 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 15 21:17:40.364958 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:40.364939 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 15 21:17:40.368961 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:40.368940 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c67c8865f-bsbp8"] Jul 15 21:17:40.475065 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:40.475024 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e5c603e-252b-4d49-b40a-50fc67c79c01-console-oauth-config\") pod \"console-5c67c8865f-bsbp8\" (UID: \"7e5c603e-252b-4d49-b40a-50fc67c79c01\") " pod="openshift-console/console-5c67c8865f-bsbp8" Jul 15 21:17:40.475246 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:40.475139 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e5c603e-252b-4d49-b40a-50fc67c79c01-trusted-ca-bundle\") pod \"console-5c67c8865f-bsbp8\" (UID: \"7e5c603e-252b-4d49-b40a-50fc67c79c01\") " pod="openshift-console/console-5c67c8865f-bsbp8" Jul 15 21:17:40.475246 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:40.475193 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvqc7\" (UniqueName: \"kubernetes.io/projected/7e5c603e-252b-4d49-b40a-50fc67c79c01-kube-api-access-lvqc7\") pod \"console-5c67c8865f-bsbp8\" (UID: \"7e5c603e-252b-4d49-b40a-50fc67c79c01\") " pod="openshift-console/console-5c67c8865f-bsbp8" Jul 15 21:17:40.475246 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:40.475227 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e5c603e-252b-4d49-b40a-50fc67c79c01-console-serving-cert\") pod \"console-5c67c8865f-bsbp8\" (UID: \"7e5c603e-252b-4d49-b40a-50fc67c79c01\") " pod="openshift-console/console-5c67c8865f-bsbp8" Jul 15 21:17:40.475403 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:40.475255 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e5c603e-252b-4d49-b40a-50fc67c79c01-service-ca\") pod \"console-5c67c8865f-bsbp8\" (UID: \"7e5c603e-252b-4d49-b40a-50fc67c79c01\") " pod="openshift-console/console-5c67c8865f-bsbp8" Jul 15 21:17:40.475403 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:40.475280 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e5c603e-252b-4d49-b40a-50fc67c79c01-oauth-serving-cert\") pod \"console-5c67c8865f-bsbp8\" (UID: \"7e5c603e-252b-4d49-b40a-50fc67c79c01\") " pod="openshift-console/console-5c67c8865f-bsbp8" Jul 15 21:17:40.475403 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:40.475352 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e5c603e-252b-4d49-b40a-50fc67c79c01-console-config\") pod \"console-5c67c8865f-bsbp8\" (UID: \"7e5c603e-252b-4d49-b40a-50fc67c79c01\") " pod="openshift-console/console-5c67c8865f-bsbp8" Jul 15 21:17:40.576022 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:40.575978 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e5c603e-252b-4d49-b40a-50fc67c79c01-trusted-ca-bundle\") pod \"console-5c67c8865f-bsbp8\" (UID: \"7e5c603e-252b-4d49-b40a-50fc67c79c01\") " pod="openshift-console/console-5c67c8865f-bsbp8" Jul 15 21:17:40.576205 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:40.576040 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvqc7\" (UniqueName: \"kubernetes.io/projected/7e5c603e-252b-4d49-b40a-50fc67c79c01-kube-api-access-lvqc7\") pod \"console-5c67c8865f-bsbp8\" (UID: \"7e5c603e-252b-4d49-b40a-50fc67c79c01\") " pod="openshift-console/console-5c67c8865f-bsbp8" Jul 15 21:17:40.576205 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:40.576074 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e5c603e-252b-4d49-b40a-50fc67c79c01-console-serving-cert\") pod \"console-5c67c8865f-bsbp8\" (UID: \"7e5c603e-252b-4d49-b40a-50fc67c79c01\") " pod="openshift-console/console-5c67c8865f-bsbp8" Jul 15 21:17:40.576205 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:40.576099 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e5c603e-252b-4d49-b40a-50fc67c79c01-service-ca\") pod \"console-5c67c8865f-bsbp8\" (UID: \"7e5c603e-252b-4d49-b40a-50fc67c79c01\") " pod="openshift-console/console-5c67c8865f-bsbp8" Jul 15 21:17:40.576205 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:40.576122 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e5c603e-252b-4d49-b40a-50fc67c79c01-oauth-serving-cert\") pod \"console-5c67c8865f-bsbp8\" (UID: \"7e5c603e-252b-4d49-b40a-50fc67c79c01\") " pod="openshift-console/console-5c67c8865f-bsbp8" Jul 15 21:17:40.576457 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:40.576401 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e5c603e-252b-4d49-b40a-50fc67c79c01-console-config\") pod \"console-5c67c8865f-bsbp8\" (UID: \"7e5c603e-252b-4d49-b40a-50fc67c79c01\") " pod="openshift-console/console-5c67c8865f-bsbp8" Jul 15 21:17:40.576510 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:40.576482 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e5c603e-252b-4d49-b40a-50fc67c79c01-console-oauth-config\") pod \"console-5c67c8865f-bsbp8\" (UID: \"7e5c603e-252b-4d49-b40a-50fc67c79c01\") " pod="openshift-console/console-5c67c8865f-bsbp8" Jul 15 21:17:40.577335 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:40.576923 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e5c603e-252b-4d49-b40a-50fc67c79c01-oauth-serving-cert\") pod \"console-5c67c8865f-bsbp8\" (UID: \"7e5c603e-252b-4d49-b40a-50fc67c79c01\") " pod="openshift-console/console-5c67c8865f-bsbp8" Jul 15 21:17:40.577335 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:40.577086 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e5c603e-252b-4d49-b40a-50fc67c79c01-console-config\") pod \"console-5c67c8865f-bsbp8\" (UID: \"7e5c603e-252b-4d49-b40a-50fc67c79c01\") " pod="openshift-console/console-5c67c8865f-bsbp8" Jul 15 21:17:40.577335 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:40.577265 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e5c603e-252b-4d49-b40a-50fc67c79c01-trusted-ca-bundle\") pod \"console-5c67c8865f-bsbp8\" (UID: \"7e5c603e-252b-4d49-b40a-50fc67c79c01\") " pod="openshift-console/console-5c67c8865f-bsbp8" Jul 15 21:17:40.577335 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:40.577325 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e5c603e-252b-4d49-b40a-50fc67c79c01-service-ca\") pod \"console-5c67c8865f-bsbp8\" (UID: \"7e5c603e-252b-4d49-b40a-50fc67c79c01\") " pod="openshift-console/console-5c67c8865f-bsbp8" Jul 15 21:17:40.579109 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:40.579086 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e5c603e-252b-4d49-b40a-50fc67c79c01-console-serving-cert\") pod \"console-5c67c8865f-bsbp8\" (UID: \"7e5c603e-252b-4d49-b40a-50fc67c79c01\") " pod="openshift-console/console-5c67c8865f-bsbp8" Jul 15 21:17:40.579244 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:40.579223 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e5c603e-252b-4d49-b40a-50fc67c79c01-console-oauth-config\") pod \"console-5c67c8865f-bsbp8\" (UID: \"7e5c603e-252b-4d49-b40a-50fc67c79c01\") " pod="openshift-console/console-5c67c8865f-bsbp8" Jul 15 21:17:40.589231 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:40.589205 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvqc7\" (UniqueName: \"kubernetes.io/projected/7e5c603e-252b-4d49-b40a-50fc67c79c01-kube-api-access-lvqc7\") pod \"console-5c67c8865f-bsbp8\" (UID: \"7e5c603e-252b-4d49-b40a-50fc67c79c01\") " pod="openshift-console/console-5c67c8865f-bsbp8" Jul 15 21:17:40.668716 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:40.668612 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c67c8865f-bsbp8" Jul 15 21:17:40.819761 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:40.819728 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c67c8865f-bsbp8"] Jul 15 21:17:40.821557 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:17:40.821520 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e5c603e_252b_4d49_b40a_50fc67c79c01.slice/crio-d6e746cecd83b3d5eda4c935c5e34bb63a98bdd98e1375409cacd9bca7120dba WatchSource:0}: Error finding container d6e746cecd83b3d5eda4c935c5e34bb63a98bdd98e1375409cacd9bca7120dba: Status 404 returned error can't find the container with id d6e746cecd83b3d5eda4c935c5e34bb63a98bdd98e1375409cacd9bca7120dba Jul 15 21:17:41.011649 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:41.011566 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mq6m4"] Jul 15 21:17:41.015119 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:41.015097 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mq6m4" Jul 15 21:17:41.017810 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:41.017792 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 15 21:17:41.017956 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:41.017932 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-zlkqs\"" Jul 15 21:17:41.025432 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:41.025410 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mq6m4"] Jul 15 21:17:41.037829 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:41.037806 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c67c8865f-bsbp8" event={"ID":"7e5c603e-252b-4d49-b40a-50fc67c79c01","Type":"ContainerStarted","Data":"649c8910ec6a73f32f76849bfa9e366d5196e7fa5a34b01d068123b3bc25789c"} Jul 15 21:17:41.037916 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:41.037846 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c67c8865f-bsbp8" event={"ID":"7e5c603e-252b-4d49-b40a-50fc67c79c01","Type":"ContainerStarted","Data":"d6e746cecd83b3d5eda4c935c5e34bb63a98bdd98e1375409cacd9bca7120dba"} Jul 15 21:17:41.061436 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:41.061392 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c67c8865f-bsbp8" podStartSLOduration=1.061379521 podStartE2EDuration="1.061379521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:17:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:17:41.060602307 +0000 UTC m=+482.955006394" watchObservedRunningTime="2026-07-15 21:17:41.061379521 +0000 UTC m=+482.955783596" Jul 15 21:17:41.082167 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:41.082141 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jvmg\" (UniqueName: \"kubernetes.io/projected/1aa5b479-d659-48d8-9213-c56af45414e6-kube-api-access-7jvmg\") pod \"dns-operator-controller-manager-864dd78c4c-mq6m4\" (UID: \"1aa5b479-d659-48d8-9213-c56af45414e6\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mq6m4" Jul 15 21:17:41.183706 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:41.183661 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jvmg\" (UniqueName: \"kubernetes.io/projected/1aa5b479-d659-48d8-9213-c56af45414e6-kube-api-access-7jvmg\") pod \"dns-operator-controller-manager-864dd78c4c-mq6m4\" (UID: \"1aa5b479-d659-48d8-9213-c56af45414e6\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mq6m4" Jul 15 21:17:41.193702 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:41.193672 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jvmg\" (UniqueName: \"kubernetes.io/projected/1aa5b479-d659-48d8-9213-c56af45414e6-kube-api-access-7jvmg\") pod \"dns-operator-controller-manager-864dd78c4c-mq6m4\" (UID: \"1aa5b479-d659-48d8-9213-c56af45414e6\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mq6m4" Jul 15 21:17:41.326274 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:41.326242 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mq6m4" Jul 15 21:17:41.491629 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:41.491604 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mq6m4"] Jul 15 21:17:41.493507 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:17:41.493472 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aa5b479_d659_48d8_9213_c56af45414e6.slice/crio-36733e686c25e82ddab6c1e115f5ab39df595dc36e3f8d8ce30baa9fa16fd8d2 WatchSource:0}: Error finding container 36733e686c25e82ddab6c1e115f5ab39df595dc36e3f8d8ce30baa9fa16fd8d2: Status 404 returned error can't find the container with id 36733e686c25e82ddab6c1e115f5ab39df595dc36e3f8d8ce30baa9fa16fd8d2 Jul 15 21:17:42.043923 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:42.043887 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mq6m4" event={"ID":"1aa5b479-d659-48d8-9213-c56af45414e6","Type":"ContainerStarted","Data":"36733e686c25e82ddab6c1e115f5ab39df595dc36e3f8d8ce30baa9fa16fd8d2"} Jul 15 21:17:43.839616 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:43.839583 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpvxx"] Jul 15 21:17:43.857170 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:43.857136 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpvxx" Jul 15 21:17:43.864595 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:43.864568 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-9c68l\"" Jul 15 21:17:43.867443 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:43.866995 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpvxx"] Jul 15 21:17:43.915384 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:43.915349 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptf56\" (UniqueName: \"kubernetes.io/projected/4897d513-dd2a-48c4-a4b0-f96dabd51afe-kube-api-access-ptf56\") pod \"limitador-operator-controller-manager-859d7b78bd-mpvxx\" (UID: \"4897d513-dd2a-48c4-a4b0-f96dabd51afe\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpvxx" Jul 15 21:17:44.016642 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:44.016595 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptf56\" (UniqueName: \"kubernetes.io/projected/4897d513-dd2a-48c4-a4b0-f96dabd51afe-kube-api-access-ptf56\") pod \"limitador-operator-controller-manager-859d7b78bd-mpvxx\" (UID: \"4897d513-dd2a-48c4-a4b0-f96dabd51afe\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpvxx" Jul 15 21:17:44.027938 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:44.027884 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptf56\" (UniqueName: \"kubernetes.io/projected/4897d513-dd2a-48c4-a4b0-f96dabd51afe-kube-api-access-ptf56\") pod \"limitador-operator-controller-manager-859d7b78bd-mpvxx\" (UID: \"4897d513-dd2a-48c4-a4b0-f96dabd51afe\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpvxx" Jul 15 21:17:44.059036 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:44.058997 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mq6m4" event={"ID":"1aa5b479-d659-48d8-9213-c56af45414e6","Type":"ContainerStarted","Data":"12f43b1ce4ecfd10eacbe19ecc0996624222ca230238d01e56c7b63198fea076"} Jul 15 21:17:44.059225 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:44.059083 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mq6m4" Jul 15 21:17:44.080691 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:44.080627 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mq6m4" podStartSLOduration=2.223012359 podStartE2EDuration="4.080608933s" totalImagesPullingTime="1.857596574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:17:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:17:44.07894943 +0000 UTC m=+485.973353519" watchObservedRunningTime="2026-07-15 21:17:44.080608933 +0000 UTC m=+485.975012978" Jul 15 21:17:44.172777 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:44.172687 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpvxx" Jul 15 21:17:44.751728 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:44.751704 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpvxx"] Jul 15 21:17:44.753606 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:17:44.753580 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4897d513_dd2a_48c4_a4b0_f96dabd51afe.slice/crio-f8b5a740342e7cabb364ad4c5964693938adf453ed5df9008e949837ee0ec3e2 WatchSource:0}: Error finding container f8b5a740342e7cabb364ad4c5964693938adf453ed5df9008e949837ee0ec3e2: Status 404 returned error can't find the container with id f8b5a740342e7cabb364ad4c5964693938adf453ed5df9008e949837ee0ec3e2 Jul 15 21:17:45.067381 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:45.067252 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpvxx" event={"ID":"4897d513-dd2a-48c4-a4b0-f96dabd51afe","Type":"ContainerStarted","Data":"f8b5a740342e7cabb364ad4c5964693938adf453ed5df9008e949837ee0ec3e2"} Jul 15 21:17:45.069062 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:45.069034 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7glw" event={"ID":"39db76e9-b21f-4cfc-8e87-130c4b395a07","Type":"ContainerStarted","Data":"ee980000ea5e83963571168aa7319392a261ed8f415786c18999b0cf308eaf54"} Jul 15 21:17:45.069248 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:45.069234 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7glw" Jul 15 21:17:45.093910 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:45.093859 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7glw" podStartSLOduration=1.942728547 podStartE2EDuration="7.093842986s" totalImagesPullingTime="5.151114439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:17:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:17:45.091703693 +0000 UTC m=+486.986107758" watchObservedRunningTime="2026-07-15 21:17:45.093842986 +0000 UTC m=+486.988247050" Jul 15 21:17:47.082660 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:47.082623 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpvxx" event={"ID":"4897d513-dd2a-48c4-a4b0-f96dabd51afe","Type":"ContainerStarted","Data":"d98c2cf82c137c1490c11ab2cd96dc037ed6c8b3234b001a042fb18bfd43aeb7"} Jul 15 21:17:47.083089 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:47.082746 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpvxx" Jul 15 21:17:47.372108 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:47.372011 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpvxx" podStartSLOduration=2.919450593 podStartE2EDuration="4.371980121s" totalImagesPullingTime="1.452529528s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:17:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:17:47.115877648 +0000 UTC m=+489.010281714" watchObservedRunningTime="2026-07-15 21:17:47.371980121 +0000 UTC m=+489.266384394" Jul 15 21:17:47.374258 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:47.374239 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-whr49"] Jul 15 21:17:47.377998 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:47.377982 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-whr49" Jul 15 21:17:47.385354 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:47.385334 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-sp7lg\"" Jul 15 21:17:47.397110 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:47.397085 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-whr49"] Jul 15 21:17:47.454087 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:47.454047 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9wn6\" (UniqueName: \"kubernetes.io/projected/887411a9-6b6e-4c38-a047-6893b81ae21e-kube-api-access-m9wn6\") pod \"authorino-operator-75cc8d5cb7-whr49\" (UID: \"887411a9-6b6e-4c38-a047-6893b81ae21e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-whr49" Jul 15 21:17:47.555632 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:47.555589 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9wn6\" (UniqueName: \"kubernetes.io/projected/887411a9-6b6e-4c38-a047-6893b81ae21e-kube-api-access-m9wn6\") pod \"authorino-operator-75cc8d5cb7-whr49\" (UID: \"887411a9-6b6e-4c38-a047-6893b81ae21e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-whr49" Jul 15 21:17:47.567145 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:47.567120 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9wn6\" (UniqueName: \"kubernetes.io/projected/887411a9-6b6e-4c38-a047-6893b81ae21e-kube-api-access-m9wn6\") pod \"authorino-operator-75cc8d5cb7-whr49\" (UID: \"887411a9-6b6e-4c38-a047-6893b81ae21e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-whr49" Jul 15 21:17:47.688120 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:47.688036 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-whr49" Jul 15 21:17:47.847116 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:47.847089 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-whr49"] Jul 15 21:17:47.849277 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:17:47.849253 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod887411a9_6b6e_4c38_a047_6893b81ae21e.slice/crio-6868d47cdf23f674671b01eb0b8859fd2bfcd2d0d19d18dbdfc089a95ef4af99 WatchSource:0}: Error finding container 6868d47cdf23f674671b01eb0b8859fd2bfcd2d0d19d18dbdfc089a95ef4af99: Status 404 returned error can't find the container with id 6868d47cdf23f674671b01eb0b8859fd2bfcd2d0d19d18dbdfc089a95ef4af99 Jul 15 21:17:48.090065 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:48.090029 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-whr49" event={"ID":"887411a9-6b6e-4c38-a047-6893b81ae21e","Type":"ContainerStarted","Data":"6868d47cdf23f674671b01eb0b8859fd2bfcd2d0d19d18dbdfc089a95ef4af99"} Jul 15 21:17:50.669323 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:50.669274 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c67c8865f-bsbp8" Jul 15 21:17:50.669763 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:50.669340 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c67c8865f-bsbp8" Jul 15 21:17:50.674211 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:50.674190 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c67c8865f-bsbp8" Jul 15 21:17:51.108820 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:51.108780 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-whr49" event={"ID":"887411a9-6b6e-4c38-a047-6893b81ae21e","Type":"ContainerStarted","Data":"4e6ba469555f458e1419edaccd63bd2626bed3e25f976f2e7e6547589b2ca03a"} Jul 15 21:17:51.109056 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:51.109040 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-whr49" Jul 15 21:17:51.112628 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:51.112608 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c67c8865f-bsbp8" Jul 15 21:17:51.140358 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:51.140284 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-whr49" podStartSLOduration=1.914554385 podStartE2EDuration="4.140266593s" totalImagesPullingTime="2.225712208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:17:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:17:51.13893098 +0000 UTC m=+493.033335044" watchObservedRunningTime="2026-07-15 21:17:51.140266593 +0000 UTC m=+493.034670659" Jul 15 21:17:55.070960 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:55.070927 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mq6m4" Jul 15 21:17:56.078426 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:56.078399 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7glw" Jul 15 21:17:58.092314 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:58.092261 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpvxx" Jul 15 21:17:58.579910 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:58.579868 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zp7bs"] Jul 15 21:17:58.586518 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:58.586495 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zp7bs" Jul 15 21:17:58.603942 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:58.603916 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zp7bs"] Jul 15 21:17:58.609879 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:58.609853 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7glw"] Jul 15 21:17:58.610047 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:58.610028 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7glw" podUID="39db76e9-b21f-4cfc-8e87-130c4b395a07" containerName="manager" containerID="cri-o://ee980000ea5e83963571168aa7319392a261ed8f415786c18999b0cf308eaf54" gracePeriod=2 Jul 15 21:17:58.621793 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:58.621764 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7glw"] Jul 15 21:17:58.647469 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:17:58.647429 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g7glw\" is forbidden: User \"system:node:ip-10-0-131-113.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-113.ec2.internal' and this object" podUID="39db76e9-b21f-4cfc-8e87-130c4b395a07" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7glw" Jul 15 21:17:58.651325 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:58.651283 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpvxx"] Jul 15 21:17:58.651724 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:58.651586 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpvxx" podUID="4897d513-dd2a-48c4-a4b0-f96dabd51afe" containerName="manager" containerID="cri-o://d98c2cf82c137c1490c11ab2cd96dc037ed6c8b3234b001a042fb18bfd43aeb7" gracePeriod=2 Jul 15 21:17:58.654899 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:58.654872 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48b8s"] Jul 15 21:17:58.655497 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:58.655474 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39db76e9-b21f-4cfc-8e87-130c4b395a07" containerName="manager" Jul 15 21:17:58.655497 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:58.655497 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="39db76e9-b21f-4cfc-8e87-130c4b395a07" containerName="manager" Jul 15 21:17:58.655760 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:58.655644 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="39db76e9-b21f-4cfc-8e87-130c4b395a07" containerName="manager" Jul 15 21:17:58.658909 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:58.658885 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b42e3d5-8fd3-4dec-ba9d-a84063880622-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-zp7bs\" (UID: \"1b42e3d5-8fd3-4dec-ba9d-a84063880622\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zp7bs" Jul 15 21:17:58.659128 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:58.659107 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cgkf\" (UniqueName: \"kubernetes.io/projected/1b42e3d5-8fd3-4dec-ba9d-a84063880622-kube-api-access-2cgkf\") pod \"kuadrant-operator-controller-manager-55467d9f7-zp7bs\" (UID: \"1b42e3d5-8fd3-4dec-ba9d-a84063880622\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zp7bs" Jul 15 21:17:58.659206 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:58.659179 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48b8s" Jul 15 21:17:58.661393 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:17:58.661358 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g7glw\" is forbidden: User \"system:node:ip-10-0-131-113.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-113.ec2.internal' and this object" podUID="39db76e9-b21f-4cfc-8e87-130c4b395a07" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7glw" Jul 15 21:17:58.663777 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:17:58.663749 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mpvxx\" is forbidden: User \"system:node:ip-10-0-131-113.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-113.ec2.internal' and this object" podUID="4897d513-dd2a-48c4-a4b0-f96dabd51afe" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpvxx" Jul 15 21:17:58.664025 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:58.663813 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpvxx"] Jul 15 21:17:58.667573 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:17:58.666765 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g7glw\" is forbidden: User \"system:node:ip-10-0-131-113.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-113.ec2.internal' and this object" podUID="39db76e9-b21f-4cfc-8e87-130c4b395a07" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7glw" Jul 15 21:17:58.674843 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:17:58.674742 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mpvxx\" is forbidden: User \"system:node:ip-10-0-131-113.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-113.ec2.internal' and this object" podUID="4897d513-dd2a-48c4-a4b0-f96dabd51afe" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpvxx" Jul 15 21:17:58.677808 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:58.677789 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48b8s"] Jul 15 21:17:58.688460 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:58.688430 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ls7jm"] Jul 15 21:17:58.688894 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:58.688879 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4897d513-dd2a-48c4-a4b0-f96dabd51afe" containerName="manager" Jul 15 21:17:58.688894 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:58.688895 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="4897d513-dd2a-48c4-a4b0-f96dabd51afe" containerName="manager" Jul 15 21:17:58.689082 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:58.688978 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="4897d513-dd2a-48c4-a4b0-f96dabd51afe" containerName="manager" Jul 15 21:17:58.692119 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:58.692105 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ls7jm" Jul 15 21:17:58.711389 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:58.711352 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ls7jm"] Jul 15 21:17:58.718014 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:17:58.717973 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g7glw\" is forbidden: User \"system:node:ip-10-0-131-113.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-113.ec2.internal' and this object" podUID="39db76e9-b21f-4cfc-8e87-130c4b395a07" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7glw" Jul 15 21:17:58.720285 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:17:58.720250 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mpvxx\" is forbidden: User \"system:node:ip-10-0-131-113.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-113.ec2.internal' and this object" podUID="4897d513-dd2a-48c4-a4b0-f96dabd51afe" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpvxx" Jul 15 21:17:58.760668 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:58.760644 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cgkf\" (UniqueName: \"kubernetes.io/projected/1b42e3d5-8fd3-4dec-ba9d-a84063880622-kube-api-access-2cgkf\") pod \"kuadrant-operator-controller-manager-55467d9f7-zp7bs\" (UID: \"1b42e3d5-8fd3-4dec-ba9d-a84063880622\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zp7bs" Jul 15 21:17:58.760760 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:58.760681 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk4hr\" (UniqueName: \"kubernetes.io/projected/67b9dbc8-107f-407a-b78e-815d79973cf9-kube-api-access-hk4hr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-48b8s\" (UID: \"67b9dbc8-107f-407a-b78e-815d79973cf9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48b8s" Jul 15 21:17:58.760760 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:58.760716 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/67b9dbc8-107f-407a-b78e-815d79973cf9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-48b8s\" (UID: \"67b9dbc8-107f-407a-b78e-815d79973cf9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48b8s" Jul 15 21:17:58.760760 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:58.760732 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlnxh\" (UniqueName: \"kubernetes.io/projected/c8a76546-f5ec-4b7c-809c-9ea015561752-kube-api-access-dlnxh\") pod \"limitador-operator-controller-manager-859d7b78bd-ls7jm\" (UID: \"c8a76546-f5ec-4b7c-809c-9ea015561752\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ls7jm" Jul 15 21:17:58.760912 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:58.760780 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b42e3d5-8fd3-4dec-ba9d-a84063880622-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-zp7bs\" (UID: \"1b42e3d5-8fd3-4dec-ba9d-a84063880622\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zp7bs" Jul 15 21:17:58.761106 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:58.761087 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b42e3d5-8fd3-4dec-ba9d-a84063880622-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-zp7bs\" (UID: \"1b42e3d5-8fd3-4dec-ba9d-a84063880622\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zp7bs" Jul 15 21:17:58.781870 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:58.781815 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cgkf\" (UniqueName: \"kubernetes.io/projected/1b42e3d5-8fd3-4dec-ba9d-a84063880622-kube-api-access-2cgkf\") pod \"kuadrant-operator-controller-manager-55467d9f7-zp7bs\" (UID: \"1b42e3d5-8fd3-4dec-ba9d-a84063880622\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zp7bs" Jul 15 21:17:58.861973 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:58.861937 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk4hr\" (UniqueName: \"kubernetes.io/projected/67b9dbc8-107f-407a-b78e-815d79973cf9-kube-api-access-hk4hr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-48b8s\" (UID: \"67b9dbc8-107f-407a-b78e-815d79973cf9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48b8s" Jul 15 21:17:58.862453 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:58.861997 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/67b9dbc8-107f-407a-b78e-815d79973cf9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-48b8s\" (UID: \"67b9dbc8-107f-407a-b78e-815d79973cf9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48b8s" Jul 15 21:17:58.862453 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:58.862023 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlnxh\" (UniqueName: \"kubernetes.io/projected/c8a76546-f5ec-4b7c-809c-9ea015561752-kube-api-access-dlnxh\") pod \"limitador-operator-controller-manager-859d7b78bd-ls7jm\" (UID: \"c8a76546-f5ec-4b7c-809c-9ea015561752\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ls7jm" Jul 15 21:17:58.862653 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:58.862478 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/67b9dbc8-107f-407a-b78e-815d79973cf9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-48b8s\" (UID: \"67b9dbc8-107f-407a-b78e-815d79973cf9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48b8s" Jul 15 21:17:58.878930 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:58.878904 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlnxh\" (UniqueName: \"kubernetes.io/projected/c8a76546-f5ec-4b7c-809c-9ea015561752-kube-api-access-dlnxh\") pod \"limitador-operator-controller-manager-859d7b78bd-ls7jm\" (UID: \"c8a76546-f5ec-4b7c-809c-9ea015561752\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ls7jm" Jul 15 21:17:58.880392 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:58.880370 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk4hr\" (UniqueName: \"kubernetes.io/projected/67b9dbc8-107f-407a-b78e-815d79973cf9-kube-api-access-hk4hr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-48b8s\" (UID: \"67b9dbc8-107f-407a-b78e-815d79973cf9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48b8s" Jul 15 21:17:58.897630 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:58.897602 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zp7bs" Jul 15 21:17:58.911393 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:58.911367 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpvxx" Jul 15 21:17:58.913825 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:17:58.913784 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g7glw\" is forbidden: User \"system:node:ip-10-0-131-113.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-113.ec2.internal' and this object" podUID="39db76e9-b21f-4cfc-8e87-130c4b395a07" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7glw" Jul 15 21:17:58.914199 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:58.914179 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7glw" Jul 15 21:17:58.915988 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:17:58.915944 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mpvxx\" is forbidden: User \"system:node:ip-10-0-131-113.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-113.ec2.internal' and this object" podUID="4897d513-dd2a-48c4-a4b0-f96dabd51afe" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpvxx" Jul 15 21:17:58.918856 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:17:58.918831 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g7glw\" is forbidden: User \"system:node:ip-10-0-131-113.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-113.ec2.internal' and this object" podUID="39db76e9-b21f-4cfc-8e87-130c4b395a07" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7glw" Jul 15 21:17:58.922241 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:17:58.922211 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mpvxx\" is forbidden: User \"system:node:ip-10-0-131-113.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-113.ec2.internal' and this object" podUID="4897d513-dd2a-48c4-a4b0-f96dabd51afe" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpvxx" Jul 15 21:17:59.040792 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:59.040759 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48b8s" Jul 15 21:17:59.046689 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:59.046132 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ls7jm" Jul 15 21:17:59.049353 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:59.049333 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zp7bs"] Jul 15 21:17:59.051969 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:17:59.051941 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b42e3d5_8fd3_4dec_ba9d_a84063880622.slice/crio-38a679c359f37ffffc336857278615aa3c6a51744330d99939a4e4ab76432a8e WatchSource:0}: Error finding container 38a679c359f37ffffc336857278615aa3c6a51744330d99939a4e4ab76432a8e: Status 404 returned error can't find the container with id 38a679c359f37ffffc336857278615aa3c6a51744330d99939a4e4ab76432a8e Jul 15 21:17:59.063714 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:59.063692 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/39db76e9-b21f-4cfc-8e87-130c4b395a07-extensions-socket-volume\") pod \"39db76e9-b21f-4cfc-8e87-130c4b395a07\" (UID: \"39db76e9-b21f-4cfc-8e87-130c4b395a07\") " Jul 15 21:17:59.063837 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:59.063822 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptf56\" (UniqueName: \"kubernetes.io/projected/4897d513-dd2a-48c4-a4b0-f96dabd51afe-kube-api-access-ptf56\") pod \"4897d513-dd2a-48c4-a4b0-f96dabd51afe\" (UID: \"4897d513-dd2a-48c4-a4b0-f96dabd51afe\") " Jul 15 21:17:59.063901 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:59.063858 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqzg8\" (UniqueName: \"kubernetes.io/projected/39db76e9-b21f-4cfc-8e87-130c4b395a07-kube-api-access-hqzg8\") pod \"39db76e9-b21f-4cfc-8e87-130c4b395a07\" (UID: \"39db76e9-b21f-4cfc-8e87-130c4b395a07\") " Jul 15 21:17:59.064258 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:59.064231 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39db76e9-b21f-4cfc-8e87-130c4b395a07-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "39db76e9-b21f-4cfc-8e87-130c4b395a07" (UID: "39db76e9-b21f-4cfc-8e87-130c4b395a07"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:17:59.066150 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:59.066120 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39db76e9-b21f-4cfc-8e87-130c4b395a07-kube-api-access-hqzg8" (OuterVolumeSpecName: "kube-api-access-hqzg8") pod "39db76e9-b21f-4cfc-8e87-130c4b395a07" (UID: "39db76e9-b21f-4cfc-8e87-130c4b395a07"). InnerVolumeSpecName "kube-api-access-hqzg8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:17:59.066259 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:59.066158 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4897d513-dd2a-48c4-a4b0-f96dabd51afe-kube-api-access-ptf56" (OuterVolumeSpecName: "kube-api-access-ptf56") pod "4897d513-dd2a-48c4-a4b0-f96dabd51afe" (UID: "4897d513-dd2a-48c4-a4b0-f96dabd51afe"). InnerVolumeSpecName "kube-api-access-ptf56". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:17:59.162495 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:59.162456 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zp7bs" event={"ID":"1b42e3d5-8fd3-4dec-ba9d-a84063880622","Type":"ContainerStarted","Data":"8608f6bd1bba04e08fdc7a8366fb1820364084b1aa031b54014d99da9e7a1749"} Jul 15 21:17:59.162927 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:59.162531 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zp7bs" event={"ID":"1b42e3d5-8fd3-4dec-ba9d-a84063880622","Type":"ContainerStarted","Data":"38a679c359f37ffffc336857278615aa3c6a51744330d99939a4e4ab76432a8e"} Jul 15 21:17:59.162927 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:59.162575 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zp7bs" Jul 15 21:17:59.164124 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:59.164096 2570 generic.go:356] "Generic (PLEG): container finished" podID="4897d513-dd2a-48c4-a4b0-f96dabd51afe" containerID="d98c2cf82c137c1490c11ab2cd96dc037ed6c8b3234b001a042fb18bfd43aeb7" exitCode=0 Jul 15 21:17:59.164273 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:59.164154 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpvxx" Jul 15 21:17:59.164273 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:59.164203 2570 scope.go:117] "RemoveContainer" containerID="d98c2cf82c137c1490c11ab2cd96dc037ed6c8b3234b001a042fb18bfd43aeb7" Jul 15 21:17:59.164655 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:59.164604 2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/39db76e9-b21f-4cfc-8e87-130c4b395a07-extensions-socket-volume\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:17:59.164655 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:59.164629 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptf56\" (UniqueName: \"kubernetes.io/projected/4897d513-dd2a-48c4-a4b0-f96dabd51afe-kube-api-access-ptf56\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:17:59.164655 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:59.164644 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqzg8\" (UniqueName: \"kubernetes.io/projected/39db76e9-b21f-4cfc-8e87-130c4b395a07-kube-api-access-hqzg8\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:17:59.165696 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:17:59.165442 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g7glw\" is forbidden: User \"system:node:ip-10-0-131-113.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-113.ec2.internal' and this object" podUID="39db76e9-b21f-4cfc-8e87-130c4b395a07" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7glw" Jul 15 21:17:59.169150 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:59.168014 2570 generic.go:356] "Generic (PLEG): container finished" podID="39db76e9-b21f-4cfc-8e87-130c4b395a07" containerID="ee980000ea5e83963571168aa7319392a261ed8f415786c18999b0cf308eaf54" exitCode=0 Jul 15 21:17:59.169150 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:59.168153 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7glw" Jul 15 21:17:59.169150 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:17:59.168837 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mpvxx\" is forbidden: User \"system:node:ip-10-0-131-113.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-113.ec2.internal' and this object" podUID="4897d513-dd2a-48c4-a4b0-f96dabd51afe" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpvxx" Jul 15 21:17:59.179482 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:59.179460 2570 scope.go:117] "RemoveContainer" containerID="d98c2cf82c137c1490c11ab2cd96dc037ed6c8b3234b001a042fb18bfd43aeb7" Jul 15 21:17:59.179881 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:17:59.179795 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d98c2cf82c137c1490c11ab2cd96dc037ed6c8b3234b001a042fb18bfd43aeb7\": container with ID starting with d98c2cf82c137c1490c11ab2cd96dc037ed6c8b3234b001a042fb18bfd43aeb7 not found: ID does not exist" containerID="d98c2cf82c137c1490c11ab2cd96dc037ed6c8b3234b001a042fb18bfd43aeb7" Jul 15 21:17:59.179881 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:59.179834 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d98c2cf82c137c1490c11ab2cd96dc037ed6c8b3234b001a042fb18bfd43aeb7"} err="failed to get container status \"d98c2cf82c137c1490c11ab2cd96dc037ed6c8b3234b001a042fb18bfd43aeb7\": rpc error: code = NotFound desc = could not find container \"d98c2cf82c137c1490c11ab2cd96dc037ed6c8b3234b001a042fb18bfd43aeb7\": container with ID starting with d98c2cf82c137c1490c11ab2cd96dc037ed6c8b3234b001a042fb18bfd43aeb7 not found: ID does not exist" Jul 15 21:17:59.179881 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:59.179858 2570 scope.go:117] "RemoveContainer" containerID="ee980000ea5e83963571168aa7319392a261ed8f415786c18999b0cf308eaf54" Jul 15 21:17:59.191590 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:59.191405 2570 scope.go:117] "RemoveContainer" containerID="ee980000ea5e83963571168aa7319392a261ed8f415786c18999b0cf308eaf54" Jul 15 21:17:59.191767 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:17:59.191740 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee980000ea5e83963571168aa7319392a261ed8f415786c18999b0cf308eaf54\": container with ID starting with ee980000ea5e83963571168aa7319392a261ed8f415786c18999b0cf308eaf54 not found: ID does not exist" containerID="ee980000ea5e83963571168aa7319392a261ed8f415786c18999b0cf308eaf54" Jul 15 21:17:59.191847 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:59.191774 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee980000ea5e83963571168aa7319392a261ed8f415786c18999b0cf308eaf54"} err="failed to get container status \"ee980000ea5e83963571168aa7319392a261ed8f415786c18999b0cf308eaf54\": rpc error: code = NotFound desc = could not find container \"ee980000ea5e83963571168aa7319392a261ed8f415786c18999b0cf308eaf54\": container with ID starting with ee980000ea5e83963571168aa7319392a261ed8f415786c18999b0cf308eaf54 not found: ID does not exist" Jul 15 21:17:59.192065 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:59.192015 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zp7bs" podStartSLOduration=1.191987976 podStartE2EDuration="1.191987976s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:17:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:17:59.191392685 +0000 UTC m=+501.085796775" watchObservedRunningTime="2026-07-15 21:17:59.191987976 +0000 UTC m=+501.086392042" Jul 15 21:17:59.193315 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:17:59.193257 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g7glw\" is forbidden: User \"system:node:ip-10-0-131-113.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-113.ec2.internal' and this object" podUID="39db76e9-b21f-4cfc-8e87-130c4b395a07" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7glw" Jul 15 21:17:59.195075 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:17:59.195047 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mpvxx\" is forbidden: User \"system:node:ip-10-0-131-113.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-113.ec2.internal' and this object" podUID="4897d513-dd2a-48c4-a4b0-f96dabd51afe" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpvxx" Jul 15 21:17:59.212961 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:59.212928 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48b8s"] Jul 15 21:17:59.213800 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:17:59.213774 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67b9dbc8_107f_407a_b78e_815d79973cf9.slice/crio-31b2bcce409f487a8d313cd09d8239d67b20e0b240f22dcc084660b118526e97 WatchSource:0}: Error finding container 31b2bcce409f487a8d313cd09d8239d67b20e0b240f22dcc084660b118526e97: Status 404 returned error can't find the container with id 31b2bcce409f487a8d313cd09d8239d67b20e0b240f22dcc084660b118526e97 Jul 15 21:17:59.235920 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:17:59.235891 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ls7jm"] Jul 15 21:17:59.238348 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:17:59.238323 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8a76546_f5ec_4b7c_809c_9ea015561752.slice/crio-4f0383b9f1647b457e9a7c48d19f86cd7ba9bbd88f1a4065d643e3c2180ffc87 WatchSource:0}: Error finding container 4f0383b9f1647b457e9a7c48d19f86cd7ba9bbd88f1a4065d643e3c2180ffc87: Status 404 returned error can't find the container with id 4f0383b9f1647b457e9a7c48d19f86cd7ba9bbd88f1a4065d643e3c2180ffc87 Jul 15 21:18:00.179183 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:00.179149 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ls7jm" event={"ID":"c8a76546-f5ec-4b7c-809c-9ea015561752","Type":"ContainerStarted","Data":"4ec898c262be25b434dfd94b1513ee6266561f4988fb8bdd1cd90fcbda4ccd9a"} Jul 15 21:18:00.179615 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:00.179223 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ls7jm" event={"ID":"c8a76546-f5ec-4b7c-809c-9ea015561752","Type":"ContainerStarted","Data":"4f0383b9f1647b457e9a7c48d19f86cd7ba9bbd88f1a4065d643e3c2180ffc87"} Jul 15 21:18:00.179615 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:00.179248 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ls7jm" Jul 15 21:18:00.180999 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:00.180972 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48b8s" event={"ID":"67b9dbc8-107f-407a-b78e-815d79973cf9","Type":"ContainerStarted","Data":"e64accd0fefffac89e6fd10c3b06a41f172bba51ca45a9a68855c6c04251a20f"} Jul 15 21:18:00.181117 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:00.181018 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48b8s" Jul 15 21:18:00.181117 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:00.181037 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48b8s" event={"ID":"67b9dbc8-107f-407a-b78e-815d79973cf9","Type":"ContainerStarted","Data":"31b2bcce409f487a8d313cd09d8239d67b20e0b240f22dcc084660b118526e97"} Jul 15 21:18:00.198599 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:00.198558 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ls7jm" podStartSLOduration=2.198544691 podStartE2EDuration="2.198544691s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:17:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:18:00.19665833 +0000 UTC m=+502.091062407" watchObservedRunningTime="2026-07-15 21:18:00.198544691 +0000 UTC m=+502.092948755" Jul 15 21:18:00.198844 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:18:00.198816 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g7glw\" is forbidden: User \"system:node:ip-10-0-131-113.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-113.ec2.internal' and this object" podUID="39db76e9-b21f-4cfc-8e87-130c4b395a07" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7glw" Jul 15 21:18:00.200500 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:18:00.200472 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mpvxx\" is forbidden: User \"system:node:ip-10-0-131-113.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-113.ec2.internal' and this object" podUID="4897d513-dd2a-48c4-a4b0-f96dabd51afe" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpvxx" Jul 15 21:18:00.224152 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:00.224102 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48b8s" podStartSLOduration=2.22408558 podStartE2EDuration="2.22408558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:17:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:18:00.222952301 +0000 UTC m=+502.117356392" watchObservedRunningTime="2026-07-15 21:18:00.22408558 +0000 UTC m=+502.118489645" Jul 15 21:18:00.224912 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:18:00.224883 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g7glw\" is forbidden: User \"system:node:ip-10-0-131-113.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-113.ec2.internal' and this object" podUID="39db76e9-b21f-4cfc-8e87-130c4b395a07" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7glw" Jul 15 21:18:00.227264 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:18:00.227240 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mpvxx\" is forbidden: User \"system:node:ip-10-0-131-113.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-113.ec2.internal' and this object" podUID="4897d513-dd2a-48c4-a4b0-f96dabd51afe" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mpvxx" Jul 15 21:18:00.591094 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:00.591061 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39db76e9-b21f-4cfc-8e87-130c4b395a07" path="/var/lib/kubelet/pods/39db76e9-b21f-4cfc-8e87-130c4b395a07/volumes" Jul 15 21:18:00.591440 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:00.591426 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4897d513-dd2a-48c4-a4b0-f96dabd51afe" path="/var/lib/kubelet/pods/4897d513-dd2a-48c4-a4b0-f96dabd51afe/volumes" Jul 15 21:18:02.116830 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:02.116802 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-whr49" Jul 15 21:18:10.183561 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:10.183536 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zp7bs" Jul 15 21:18:10.244117 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:10.244088 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48b8s"] Jul 15 21:18:10.244364 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:10.244332 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48b8s" podUID="67b9dbc8-107f-407a-b78e-815d79973cf9" containerName="manager" containerID="cri-o://e64accd0fefffac89e6fd10c3b06a41f172bba51ca45a9a68855c6c04251a20f" gracePeriod=10 Jul 15 21:18:10.246512 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:10.246483 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48b8s" Jul 15 21:18:10.506233 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:10.506210 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48b8s" Jul 15 21:18:10.669712 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:10.669683 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/67b9dbc8-107f-407a-b78e-815d79973cf9-extensions-socket-volume\") pod \"67b9dbc8-107f-407a-b78e-815d79973cf9\" (UID: \"67b9dbc8-107f-407a-b78e-815d79973cf9\") " Jul 15 21:18:10.669907 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:10.669777 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hk4hr\" (UniqueName: \"kubernetes.io/projected/67b9dbc8-107f-407a-b78e-815d79973cf9-kube-api-access-hk4hr\") pod \"67b9dbc8-107f-407a-b78e-815d79973cf9\" (UID: \"67b9dbc8-107f-407a-b78e-815d79973cf9\") " Jul 15 21:18:10.670104 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:10.670079 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67b9dbc8-107f-407a-b78e-815d79973cf9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "67b9dbc8-107f-407a-b78e-815d79973cf9" (UID: "67b9dbc8-107f-407a-b78e-815d79973cf9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:18:10.671762 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:10.671736 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67b9dbc8-107f-407a-b78e-815d79973cf9-kube-api-access-hk4hr" (OuterVolumeSpecName: "kube-api-access-hk4hr") pod "67b9dbc8-107f-407a-b78e-815d79973cf9" (UID: "67b9dbc8-107f-407a-b78e-815d79973cf9"). InnerVolumeSpecName "kube-api-access-hk4hr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:18:10.771279 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:10.771198 2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/67b9dbc8-107f-407a-b78e-815d79973cf9-extensions-socket-volume\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:18:10.771279 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:10.771230 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hk4hr\" (UniqueName: \"kubernetes.io/projected/67b9dbc8-107f-407a-b78e-815d79973cf9-kube-api-access-hk4hr\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:18:11.190066 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:11.190039 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ls7jm" Jul 15 21:18:11.252882 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:11.252846 2570 generic.go:356] "Generic (PLEG): container finished" podID="67b9dbc8-107f-407a-b78e-815d79973cf9" containerID="e64accd0fefffac89e6fd10c3b06a41f172bba51ca45a9a68855c6c04251a20f" exitCode=0 Jul 15 21:18:11.253058 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:11.252903 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48b8s" Jul 15 21:18:11.253058 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:11.252925 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48b8s" event={"ID":"67b9dbc8-107f-407a-b78e-815d79973cf9","Type":"ContainerDied","Data":"e64accd0fefffac89e6fd10c3b06a41f172bba51ca45a9a68855c6c04251a20f"} Jul 15 21:18:11.253058 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:11.252986 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48b8s" event={"ID":"67b9dbc8-107f-407a-b78e-815d79973cf9","Type":"ContainerDied","Data":"31b2bcce409f487a8d313cd09d8239d67b20e0b240f22dcc084660b118526e97"} Jul 15 21:18:11.253058 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:11.253009 2570 scope.go:117] "RemoveContainer" containerID="e64accd0fefffac89e6fd10c3b06a41f172bba51ca45a9a68855c6c04251a20f" Jul 15 21:18:11.263001 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:11.262987 2570 scope.go:117] "RemoveContainer" containerID="e64accd0fefffac89e6fd10c3b06a41f172bba51ca45a9a68855c6c04251a20f" Jul 15 21:18:11.263259 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:18:11.263240 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e64accd0fefffac89e6fd10c3b06a41f172bba51ca45a9a68855c6c04251a20f\": container with ID starting with e64accd0fefffac89e6fd10c3b06a41f172bba51ca45a9a68855c6c04251a20f not found: ID does not exist" containerID="e64accd0fefffac89e6fd10c3b06a41f172bba51ca45a9a68855c6c04251a20f" Jul 15 21:18:11.263322 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:11.263267 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e64accd0fefffac89e6fd10c3b06a41f172bba51ca45a9a68855c6c04251a20f"} err="failed to get container status \"e64accd0fefffac89e6fd10c3b06a41f172bba51ca45a9a68855c6c04251a20f\": rpc error: code = NotFound desc = could not find container \"e64accd0fefffac89e6fd10c3b06a41f172bba51ca45a9a68855c6c04251a20f\": container with ID starting with e64accd0fefffac89e6fd10c3b06a41f172bba51ca45a9a68855c6c04251a20f not found: ID does not exist" Jul 15 21:18:11.276842 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:11.276821 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48b8s"] Jul 15 21:18:11.288156 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:11.288134 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48b8s"] Jul 15 21:18:12.589810 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:12.589779 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67b9dbc8-107f-407a-b78e-815d79973cf9" path="/var/lib/kubelet/pods/67b9dbc8-107f-407a-b78e-815d79973cf9/volumes" Jul 15 21:18:26.735706 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:26.735671 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp"] Jul 15 21:18:26.736521 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:26.736497 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67b9dbc8-107f-407a-b78e-815d79973cf9" containerName="manager" Jul 15 21:18:26.736521 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:26.736520 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="67b9dbc8-107f-407a-b78e-815d79973cf9" containerName="manager" Jul 15 21:18:26.736708 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:26.736638 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="67b9dbc8-107f-407a-b78e-815d79973cf9" containerName="manager" Jul 15 21:18:26.746243 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:26.746220 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" Jul 15 21:18:26.749131 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:26.749110 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-xc4bf\"" Jul 15 21:18:26.762241 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:26.762217 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp"] Jul 15 21:18:26.808643 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:26.808610 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b11aee3-8b5c-4517-925c-b5c6c0932fdb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-hnfjp\" (UID: \"4b11aee3-8b5c-4517-925c-b5c6c0932fdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" Jul 15 21:18:26.808643 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:26.808648 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw7xj\" (UniqueName: \"kubernetes.io/projected/4b11aee3-8b5c-4517-925c-b5c6c0932fdb-kube-api-access-zw7xj\") pod \"maas-default-gateway-openshift-default-56654dcf7-hnfjp\" (UID: \"4b11aee3-8b5c-4517-925c-b5c6c0932fdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" Jul 15 21:18:26.808911 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:26.808681 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b11aee3-8b5c-4517-925c-b5c6c0932fdb-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-hnfjp\" (UID: \"4b11aee3-8b5c-4517-925c-b5c6c0932fdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" Jul 15 21:18:26.808911 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:26.808766 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b11aee3-8b5c-4517-925c-b5c6c0932fdb-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-hnfjp\" (UID: \"4b11aee3-8b5c-4517-925c-b5c6c0932fdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" Jul 15 21:18:26.808911 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:26.808806 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b11aee3-8b5c-4517-925c-b5c6c0932fdb-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-hnfjp\" (UID: \"4b11aee3-8b5c-4517-925c-b5c6c0932fdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" Jul 15 21:18:26.808911 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:26.808859 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b11aee3-8b5c-4517-925c-b5c6c0932fdb-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-hnfjp\" (UID: \"4b11aee3-8b5c-4517-925c-b5c6c0932fdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" Jul 15 21:18:26.808911 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:26.808909 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b11aee3-8b5c-4517-925c-b5c6c0932fdb-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-hnfjp\" (UID: \"4b11aee3-8b5c-4517-925c-b5c6c0932fdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" Jul 15 21:18:26.809152 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:26.808978 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b11aee3-8b5c-4517-925c-b5c6c0932fdb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-hnfjp\" (UID: \"4b11aee3-8b5c-4517-925c-b5c6c0932fdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" Jul 15 21:18:26.809152 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:26.809024 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b11aee3-8b5c-4517-925c-b5c6c0932fdb-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-hnfjp\" (UID: \"4b11aee3-8b5c-4517-925c-b5c6c0932fdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" Jul 15 21:18:26.910364 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:26.910334 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b11aee3-8b5c-4517-925c-b5c6c0932fdb-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-hnfjp\" (UID: \"4b11aee3-8b5c-4517-925c-b5c6c0932fdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" Jul 15 21:18:26.910566 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:26.910372 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b11aee3-8b5c-4517-925c-b5c6c0932fdb-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-hnfjp\" (UID: \"4b11aee3-8b5c-4517-925c-b5c6c0932fdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" Jul 15 21:18:26.910566 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:26.910394 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b11aee3-8b5c-4517-925c-b5c6c0932fdb-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-hnfjp\" (UID: \"4b11aee3-8b5c-4517-925c-b5c6c0932fdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" Jul 15 21:18:26.910566 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:26.910428 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b11aee3-8b5c-4517-925c-b5c6c0932fdb-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-hnfjp\" (UID: \"4b11aee3-8b5c-4517-925c-b5c6c0932fdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" Jul 15 21:18:26.910566 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:26.910464 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b11aee3-8b5c-4517-925c-b5c6c0932fdb-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-hnfjp\" (UID: \"4b11aee3-8b5c-4517-925c-b5c6c0932fdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" Jul 15 21:18:26.910566 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:26.910532 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b11aee3-8b5c-4517-925c-b5c6c0932fdb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-hnfjp\" (UID: \"4b11aee3-8b5c-4517-925c-b5c6c0932fdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" Jul 15 21:18:26.910844 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:26.910571 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b11aee3-8b5c-4517-925c-b5c6c0932fdb-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-hnfjp\" (UID: \"4b11aee3-8b5c-4517-925c-b5c6c0932fdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" Jul 15 21:18:26.910844 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:26.910715 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b11aee3-8b5c-4517-925c-b5c6c0932fdb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-hnfjp\" (UID: \"4b11aee3-8b5c-4517-925c-b5c6c0932fdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" Jul 15 21:18:26.910844 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:26.910760 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw7xj\" (UniqueName: \"kubernetes.io/projected/4b11aee3-8b5c-4517-925c-b5c6c0932fdb-kube-api-access-zw7xj\") pod \"maas-default-gateway-openshift-default-56654dcf7-hnfjp\" (UID: \"4b11aee3-8b5c-4517-925c-b5c6c0932fdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" Jul 15 21:18:26.910844 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:26.910805 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b11aee3-8b5c-4517-925c-b5c6c0932fdb-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-hnfjp\" (UID: \"4b11aee3-8b5c-4517-925c-b5c6c0932fdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" Jul 15 21:18:26.911018 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:26.910841 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b11aee3-8b5c-4517-925c-b5c6c0932fdb-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-hnfjp\" (UID: \"4b11aee3-8b5c-4517-925c-b5c6c0932fdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" Jul 15 21:18:26.911018 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:26.910952 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b11aee3-8b5c-4517-925c-b5c6c0932fdb-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-hnfjp\" (UID: \"4b11aee3-8b5c-4517-925c-b5c6c0932fdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" Jul 15 21:18:26.911333 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:26.911278 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b11aee3-8b5c-4517-925c-b5c6c0932fdb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-hnfjp\" (UID: \"4b11aee3-8b5c-4517-925c-b5c6c0932fdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" Jul 15 21:18:26.911456 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:26.911377 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b11aee3-8b5c-4517-925c-b5c6c0932fdb-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-hnfjp\" (UID: \"4b11aee3-8b5c-4517-925c-b5c6c0932fdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" Jul 15 21:18:26.912773 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:26.912748 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b11aee3-8b5c-4517-925c-b5c6c0932fdb-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-hnfjp\" (UID: \"4b11aee3-8b5c-4517-925c-b5c6c0932fdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" Jul 15 21:18:26.913118 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:26.913098 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b11aee3-8b5c-4517-925c-b5c6c0932fdb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-hnfjp\" (UID: \"4b11aee3-8b5c-4517-925c-b5c6c0932fdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" Jul 15 21:18:26.923455 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:26.923429 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b11aee3-8b5c-4517-925c-b5c6c0932fdb-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-hnfjp\" (UID: \"4b11aee3-8b5c-4517-925c-b5c6c0932fdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" Jul 15 21:18:26.926628 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:26.926600 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw7xj\" (UniqueName: \"kubernetes.io/projected/4b11aee3-8b5c-4517-925c-b5c6c0932fdb-kube-api-access-zw7xj\") pod \"maas-default-gateway-openshift-default-56654dcf7-hnfjp\" (UID: \"4b11aee3-8b5c-4517-925c-b5c6c0932fdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" Jul 15 21:18:27.057094 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:27.057013 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" Jul 15 21:18:27.202707 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:27.202683 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp"] Jul 15 21:18:27.204461 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:18:27.204430 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b11aee3_8b5c_4517_925c_b5c6c0932fdb.slice/crio-ced7c642064638928d82cdeaaa85f1cbf383db7c84cd6401e3e9c1f67de89d8c WatchSource:0}: Error finding container ced7c642064638928d82cdeaaa85f1cbf383db7c84cd6401e3e9c1f67de89d8c: Status 404 returned error can't find the container with id ced7c642064638928d82cdeaaa85f1cbf383db7c84cd6401e3e9c1f67de89d8c Jul 15 21:18:27.206544 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:27.206510 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 21:18:27.206639 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:27.206583 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 21:18:27.206639 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:27.206615 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 21:18:27.347012 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:27.346973 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" event={"ID":"4b11aee3-8b5c-4517-925c-b5c6c0932fdb","Type":"ContainerStarted","Data":"b3798b0f9c99d4bc60ec81024bdf996bb2015b1fcbad75fa003f59db124275b2"} Jul 15 21:18:27.347214 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:27.347035 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" event={"ID":"4b11aee3-8b5c-4517-925c-b5c6c0932fdb","Type":"ContainerStarted","Data":"ced7c642064638928d82cdeaaa85f1cbf383db7c84cd6401e3e9c1f67de89d8c"} Jul 15 21:18:27.371766 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:27.371733 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zp7bs"] Jul 15 21:18:27.371962 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:27.371909 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" podStartSLOduration=1.371894273 podStartE2EDuration="1.371894273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:18:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:18:27.370723342 +0000 UTC m=+529.265127407" watchObservedRunningTime="2026-07-15 21:18:27.371894273 +0000 UTC m=+529.266298340" Jul 15 21:18:27.372055 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:27.371961 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zp7bs" podUID="1b42e3d5-8fd3-4dec-ba9d-a84063880622" containerName="manager" containerID="cri-o://8608f6bd1bba04e08fdc7a8366fb1820364084b1aa031b54014d99da9e7a1749" gracePeriod=10 Jul 15 21:18:27.621599 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:27.621575 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zp7bs" Jul 15 21:18:27.719160 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:27.719126 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b42e3d5-8fd3-4dec-ba9d-a84063880622-extensions-socket-volume\") pod \"1b42e3d5-8fd3-4dec-ba9d-a84063880622\" (UID: \"1b42e3d5-8fd3-4dec-ba9d-a84063880622\") " Jul 15 21:18:27.719384 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:27.719229 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cgkf\" (UniqueName: \"kubernetes.io/projected/1b42e3d5-8fd3-4dec-ba9d-a84063880622-kube-api-access-2cgkf\") pod \"1b42e3d5-8fd3-4dec-ba9d-a84063880622\" (UID: \"1b42e3d5-8fd3-4dec-ba9d-a84063880622\") " Jul 15 21:18:27.719551 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:27.719524 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b42e3d5-8fd3-4dec-ba9d-a84063880622-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1b42e3d5-8fd3-4dec-ba9d-a84063880622" (UID: "1b42e3d5-8fd3-4dec-ba9d-a84063880622"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:18:27.721305 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:27.721269 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b42e3d5-8fd3-4dec-ba9d-a84063880622-kube-api-access-2cgkf" (OuterVolumeSpecName: "kube-api-access-2cgkf") pod "1b42e3d5-8fd3-4dec-ba9d-a84063880622" (UID: "1b42e3d5-8fd3-4dec-ba9d-a84063880622"). InnerVolumeSpecName "kube-api-access-2cgkf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:18:27.820584 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:27.820549 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cgkf\" (UniqueName: \"kubernetes.io/projected/1b42e3d5-8fd3-4dec-ba9d-a84063880622-kube-api-access-2cgkf\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:18:27.820584 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:27.820583 2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b42e3d5-8fd3-4dec-ba9d-a84063880622-extensions-socket-volume\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:18:28.057782 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:28.057747 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" Jul 15 21:18:28.063014 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:28.062992 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" Jul 15 21:18:28.354063 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:28.354033 2570 generic.go:356] "Generic (PLEG): container finished" podID="1b42e3d5-8fd3-4dec-ba9d-a84063880622" containerID="8608f6bd1bba04e08fdc7a8366fb1820364084b1aa031b54014d99da9e7a1749" exitCode=0 Jul 15 21:18:28.354241 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:28.354082 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zp7bs" Jul 15 21:18:28.354241 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:28.354123 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zp7bs" event={"ID":"1b42e3d5-8fd3-4dec-ba9d-a84063880622","Type":"ContainerDied","Data":"8608f6bd1bba04e08fdc7a8366fb1820364084b1aa031b54014d99da9e7a1749"} Jul 15 21:18:28.354241 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:28.354181 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zp7bs" event={"ID":"1b42e3d5-8fd3-4dec-ba9d-a84063880622","Type":"ContainerDied","Data":"38a679c359f37ffffc336857278615aa3c6a51744330d99939a4e4ab76432a8e"} Jul 15 21:18:28.354241 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:28.354218 2570 scope.go:117] "RemoveContainer" containerID="8608f6bd1bba04e08fdc7a8366fb1820364084b1aa031b54014d99da9e7a1749" Jul 15 21:18:28.354547 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:28.354521 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" Jul 15 21:18:28.355730 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:28.355711 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" Jul 15 21:18:28.367002 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:28.366980 2570 scope.go:117] "RemoveContainer" containerID="8608f6bd1bba04e08fdc7a8366fb1820364084b1aa031b54014d99da9e7a1749" Jul 15 21:18:28.367341 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:18:28.367320 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8608f6bd1bba04e08fdc7a8366fb1820364084b1aa031b54014d99da9e7a1749\": container with ID starting with 8608f6bd1bba04e08fdc7a8366fb1820364084b1aa031b54014d99da9e7a1749 not found: ID does not exist" containerID="8608f6bd1bba04e08fdc7a8366fb1820364084b1aa031b54014d99da9e7a1749" Jul 15 21:18:28.367405 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:28.367349 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8608f6bd1bba04e08fdc7a8366fb1820364084b1aa031b54014d99da9e7a1749"} err="failed to get container status \"8608f6bd1bba04e08fdc7a8366fb1820364084b1aa031b54014d99da9e7a1749\": rpc error: code = NotFound desc = could not find container \"8608f6bd1bba04e08fdc7a8366fb1820364084b1aa031b54014d99da9e7a1749\": container with ID starting with 8608f6bd1bba04e08fdc7a8366fb1820364084b1aa031b54014d99da9e7a1749 not found: ID does not exist" Jul 15 21:18:28.399800 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:28.399764 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zp7bs"] Jul 15 21:18:28.403785 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:28.403761 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zp7bs"] Jul 15 21:18:28.597307 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:28.597270 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b42e3d5-8fd3-4dec-ba9d-a84063880622" path="/var/lib/kubelet/pods/1b42e3d5-8fd3-4dec-ba9d-a84063880622/volumes" Jul 15 21:18:49.306602 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:49.306567 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-spdsc"] Jul 15 21:18:49.307161 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:49.307143 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b42e3d5-8fd3-4dec-ba9d-a84063880622" containerName="manager" Jul 15 21:18:49.307161 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:49.307162 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b42e3d5-8fd3-4dec-ba9d-a84063880622" containerName="manager" Jul 15 21:18:49.307281 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:49.307269 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b42e3d5-8fd3-4dec-ba9d-a84063880622" containerName="manager" Jul 15 21:18:49.311672 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:49.311655 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-spdsc" Jul 15 21:18:49.314163 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:49.314140 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 15 21:18:49.314311 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:49.314179 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hzbjk\"" Jul 15 21:18:49.320150 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:49.320126 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-spdsc"] Jul 15 21:18:49.409364 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:49.409327 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-spdsc"] Jul 15 21:18:49.418727 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:49.418695 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/142d4684-8a54-4c6f-b522-00b3f99054f2-config-file\") pod \"limitador-limitador-64c94fd64f-spdsc\" (UID: \"142d4684-8a54-4c6f-b522-00b3f99054f2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-spdsc" Jul 15 21:18:49.418856 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:49.418752 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9794j\" (UniqueName: \"kubernetes.io/projected/142d4684-8a54-4c6f-b522-00b3f99054f2-kube-api-access-9794j\") pod \"limitador-limitador-64c94fd64f-spdsc\" (UID: \"142d4684-8a54-4c6f-b522-00b3f99054f2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-spdsc" Jul 15 21:18:49.520318 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:49.520264 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/142d4684-8a54-4c6f-b522-00b3f99054f2-config-file\") pod \"limitador-limitador-64c94fd64f-spdsc\" (UID: \"142d4684-8a54-4c6f-b522-00b3f99054f2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-spdsc" Jul 15 21:18:49.520515 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:49.520333 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9794j\" (UniqueName: \"kubernetes.io/projected/142d4684-8a54-4c6f-b522-00b3f99054f2-kube-api-access-9794j\") pod \"limitador-limitador-64c94fd64f-spdsc\" (UID: \"142d4684-8a54-4c6f-b522-00b3f99054f2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-spdsc" Jul 15 21:18:49.520896 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:49.520877 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/142d4684-8a54-4c6f-b522-00b3f99054f2-config-file\") pod \"limitador-limitador-64c94fd64f-spdsc\" (UID: \"142d4684-8a54-4c6f-b522-00b3f99054f2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-spdsc" Jul 15 21:18:49.528169 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:49.528142 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9794j\" (UniqueName: \"kubernetes.io/projected/142d4684-8a54-4c6f-b522-00b3f99054f2-kube-api-access-9794j\") pod \"limitador-limitador-64c94fd64f-spdsc\" (UID: \"142d4684-8a54-4c6f-b522-00b3f99054f2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-spdsc" Jul 15 21:18:49.624270 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:49.624230 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-spdsc" Jul 15 21:18:49.768211 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:49.768187 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-spdsc"] Jul 15 21:18:49.770194 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:18:49.770167 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod142d4684_8a54_4c6f_b522_00b3f99054f2.slice/crio-b84b0125f8fbf97b03d828df3f3d5cb6c1f34129dc5b798fb7bb2b466605a856 WatchSource:0}: Error finding container b84b0125f8fbf97b03d828df3f3d5cb6c1f34129dc5b798fb7bb2b466605a856: Status 404 returned error can't find the container with id b84b0125f8fbf97b03d828df3f3d5cb6c1f34129dc5b798fb7bb2b466605a856 Jul 15 21:18:50.120582 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:50.120551 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-4ngnx"] Jul 15 21:18:50.125458 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:50.125436 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4ngnx" Jul 15 21:18:50.127671 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:50.127646 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-4sgnq\"" Jul 15 21:18:50.130545 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:50.130524 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-4ngnx"] Jul 15 21:18:50.226560 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:50.226522 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8j76z\" (UniqueName: \"kubernetes.io/projected/02763513-f6ba-4a99-a0e5-009145061ad6-kube-api-access-8j76z\") pod \"authorino-58cd955675-4ngnx\" (UID: \"02763513-f6ba-4a99-a0e5-009145061ad6\") " pod="kuadrant-system/authorino-58cd955675-4ngnx" Jul 15 21:18:50.327934 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:50.327900 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8j76z\" (UniqueName: \"kubernetes.io/projected/02763513-f6ba-4a99-a0e5-009145061ad6-kube-api-access-8j76z\") pod \"authorino-58cd955675-4ngnx\" (UID: \"02763513-f6ba-4a99-a0e5-009145061ad6\") " pod="kuadrant-system/authorino-58cd955675-4ngnx" Jul 15 21:18:50.336948 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:50.336918 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8j76z\" (UniqueName: \"kubernetes.io/projected/02763513-f6ba-4a99-a0e5-009145061ad6-kube-api-access-8j76z\") pod \"authorino-58cd955675-4ngnx\" (UID: \"02763513-f6ba-4a99-a0e5-009145061ad6\") " pod="kuadrant-system/authorino-58cd955675-4ngnx" Jul 15 21:18:50.436422 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:50.436352 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4ngnx" Jul 15 21:18:50.487182 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:50.487148 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-h7kk8"] Jul 15 21:18:50.490709 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:50.490679 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-spdsc" event={"ID":"142d4684-8a54-4c6f-b522-00b3f99054f2","Type":"ContainerStarted","Data":"b84b0125f8fbf97b03d828df3f3d5cb6c1f34129dc5b798fb7bb2b466605a856"} Jul 15 21:18:50.490863 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:50.490770 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-h7kk8" Jul 15 21:18:50.500094 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:50.500065 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-h7kk8"] Jul 15 21:18:50.593038 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:50.593009 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-4ngnx"] Jul 15 21:18:50.594854 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:18:50.594826 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod02763513_f6ba_4a99_a0e5_009145061ad6.slice/crio-86be4cf2b0e1f1f498d0b236ec5f8ff42d35829b74817228b041c8d338ca10e5 WatchSource:0}: Error finding container 86be4cf2b0e1f1f498d0b236ec5f8ff42d35829b74817228b041c8d338ca10e5: Status 404 returned error can't find the container with id 86be4cf2b0e1f1f498d0b236ec5f8ff42d35829b74817228b041c8d338ca10e5 Jul 15 21:18:50.631702 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:50.631668 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjp6s\" (UniqueName: \"kubernetes.io/projected/db3c7918-45b5-4e3b-82d3-7d578514be6c-kube-api-access-vjp6s\") pod \"authorino-75d556bd77-h7kk8\" (UID: \"db3c7918-45b5-4e3b-82d3-7d578514be6c\") " pod="kuadrant-system/authorino-75d556bd77-h7kk8" Jul 15 21:18:50.733125 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:50.733040 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjp6s\" (UniqueName: \"kubernetes.io/projected/db3c7918-45b5-4e3b-82d3-7d578514be6c-kube-api-access-vjp6s\") pod \"authorino-75d556bd77-h7kk8\" (UID: \"db3c7918-45b5-4e3b-82d3-7d578514be6c\") " pod="kuadrant-system/authorino-75d556bd77-h7kk8" Jul 15 21:18:50.752770 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:50.752713 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjp6s\" (UniqueName: \"kubernetes.io/projected/db3c7918-45b5-4e3b-82d3-7d578514be6c-kube-api-access-vjp6s\") pod \"authorino-75d556bd77-h7kk8\" (UID: \"db3c7918-45b5-4e3b-82d3-7d578514be6c\") " pod="kuadrant-system/authorino-75d556bd77-h7kk8" Jul 15 21:18:50.805243 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:50.805198 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-h7kk8" Jul 15 21:18:50.974736 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:50.974706 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-h7kk8"] Jul 15 21:18:50.976375 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:18:50.976348 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb3c7918_45b5_4e3b_82d3_7d578514be6c.slice/crio-7471434834e879b1771c7214c37a5877eca256bd6ba5f9c12fa7dc9e73ccbf2e WatchSource:0}: Error finding container 7471434834e879b1771c7214c37a5877eca256bd6ba5f9c12fa7dc9e73ccbf2e: Status 404 returned error can't find the container with id 7471434834e879b1771c7214c37a5877eca256bd6ba5f9c12fa7dc9e73ccbf2e Jul 15 21:18:51.501653 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:51.501608 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-h7kk8" event={"ID":"db3c7918-45b5-4e3b-82d3-7d578514be6c","Type":"ContainerStarted","Data":"7471434834e879b1771c7214c37a5877eca256bd6ba5f9c12fa7dc9e73ccbf2e"} Jul 15 21:18:51.503533 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:51.503501 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4ngnx" event={"ID":"02763513-f6ba-4a99-a0e5-009145061ad6","Type":"ContainerStarted","Data":"86be4cf2b0e1f1f498d0b236ec5f8ff42d35829b74817228b041c8d338ca10e5"} Jul 15 21:18:55.531709 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:55.531674 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-spdsc" event={"ID":"142d4684-8a54-4c6f-b522-00b3f99054f2","Type":"ContainerStarted","Data":"1eefda43edcfd11061e99a01fbef82e2e0e709f5364342c113e242b64154ca02"} Jul 15 21:18:55.532181 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:55.531773 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-spdsc" Jul 15 21:18:55.533206 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:55.533184 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-h7kk8" event={"ID":"db3c7918-45b5-4e3b-82d3-7d578514be6c","Type":"ContainerStarted","Data":"97e5ea56ad3c336874083bd9a29f9258d5af4b9f204d8af5fe589ada17323145"} Jul 15 21:18:55.534572 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:55.534552 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4ngnx" event={"ID":"02763513-f6ba-4a99-a0e5-009145061ad6","Type":"ContainerStarted","Data":"53d9a443b89af38f60c0c2cbe3cde66f3349020eafdc02c49b6218388e9b23b8"} Jul 15 21:18:55.548437 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:55.548397 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-spdsc" podStartSLOduration=1.697456498 podStartE2EDuration="6.548384315s" totalImagesPullingTime="4.850927817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:18:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:18:55.546888798 +0000 UTC m=+557.441292873" watchObservedRunningTime="2026-07-15 21:18:55.548384315 +0000 UTC m=+557.442788379" Jul 15 21:18:55.560694 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:55.560655 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-h7kk8" podStartSLOduration=1.9110439590000001 podStartE2EDuration="5.560641199s" totalImagesPullingTime="3.64959724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:18:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:18:55.559680732 +0000 UTC m=+557.454084799" watchObservedRunningTime="2026-07-15 21:18:55.560641199 +0000 UTC m=+557.455045265" Jul 15 21:18:55.573728 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:55.573675 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-4ngnx" podStartSLOduration=1.547184034 podStartE2EDuration="5.573653763s" totalImagesPullingTime="4.026469729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:18:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:18:55.572651532 +0000 UTC m=+557.467055598" watchObservedRunningTime="2026-07-15 21:18:55.573653763 +0000 UTC m=+557.468057834" Jul 15 21:18:55.600603 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:55.600573 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-4ngnx"] Jul 15 21:18:57.546927 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:57.546872 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-4ngnx" podUID="02763513-f6ba-4a99-a0e5-009145061ad6" containerName="authorino" containerID="cri-o://53d9a443b89af38f60c0c2cbe3cde66f3349020eafdc02c49b6218388e9b23b8" gracePeriod=30 Jul 15 21:18:57.803500 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:57.803424 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4ngnx" Jul 15 21:18:57.911456 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:57.911423 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8j76z\" (UniqueName: \"kubernetes.io/projected/02763513-f6ba-4a99-a0e5-009145061ad6-kube-api-access-8j76z\") pod \"02763513-f6ba-4a99-a0e5-009145061ad6\" (UID: \"02763513-f6ba-4a99-a0e5-009145061ad6\") " Jul 15 21:18:57.913534 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:57.913504 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02763513-f6ba-4a99-a0e5-009145061ad6-kube-api-access-8j76z" (OuterVolumeSpecName: "kube-api-access-8j76z") pod "02763513-f6ba-4a99-a0e5-009145061ad6" (UID: "02763513-f6ba-4a99-a0e5-009145061ad6"). InnerVolumeSpecName "kube-api-access-8j76z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:18:58.012415 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:58.012375 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8j76z\" (UniqueName: \"kubernetes.io/projected/02763513-f6ba-4a99-a0e5-009145061ad6-kube-api-access-8j76z\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:18:58.553961 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:58.553923 2570 generic.go:356] "Generic (PLEG): container finished" podID="02763513-f6ba-4a99-a0e5-009145061ad6" containerID="53d9a443b89af38f60c0c2cbe3cde66f3349020eafdc02c49b6218388e9b23b8" exitCode=0 Jul 15 21:18:58.554431 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:58.553971 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4ngnx" Jul 15 21:18:58.554431 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:58.554007 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4ngnx" event={"ID":"02763513-f6ba-4a99-a0e5-009145061ad6","Type":"ContainerDied","Data":"53d9a443b89af38f60c0c2cbe3cde66f3349020eafdc02c49b6218388e9b23b8"} Jul 15 21:18:58.554431 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:58.554047 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4ngnx" event={"ID":"02763513-f6ba-4a99-a0e5-009145061ad6","Type":"ContainerDied","Data":"86be4cf2b0e1f1f498d0b236ec5f8ff42d35829b74817228b041c8d338ca10e5"} Jul 15 21:18:58.554431 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:58.554064 2570 scope.go:117] "RemoveContainer" containerID="53d9a443b89af38f60c0c2cbe3cde66f3349020eafdc02c49b6218388e9b23b8" Jul 15 21:18:58.564069 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:58.564051 2570 scope.go:117] "RemoveContainer" containerID="53d9a443b89af38f60c0c2cbe3cde66f3349020eafdc02c49b6218388e9b23b8" Jul 15 21:18:58.564390 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:18:58.564366 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53d9a443b89af38f60c0c2cbe3cde66f3349020eafdc02c49b6218388e9b23b8\": container with ID starting with 53d9a443b89af38f60c0c2cbe3cde66f3349020eafdc02c49b6218388e9b23b8 not found: ID does not exist" containerID="53d9a443b89af38f60c0c2cbe3cde66f3349020eafdc02c49b6218388e9b23b8" Jul 15 21:18:58.564442 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:58.564401 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53d9a443b89af38f60c0c2cbe3cde66f3349020eafdc02c49b6218388e9b23b8"} err="failed to get container status \"53d9a443b89af38f60c0c2cbe3cde66f3349020eafdc02c49b6218388e9b23b8\": rpc error: code = NotFound desc = could not find container \"53d9a443b89af38f60c0c2cbe3cde66f3349020eafdc02c49b6218388e9b23b8\": container with ID starting with 53d9a443b89af38f60c0c2cbe3cde66f3349020eafdc02c49b6218388e9b23b8 not found: ID does not exist" Jul 15 21:18:58.574185 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:58.574162 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-4ngnx"] Jul 15 21:18:58.580707 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:58.580686 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-4ngnx"] Jul 15 21:18:58.590862 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:18:58.590836 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02763513-f6ba-4a99-a0e5-009145061ad6" path="/var/lib/kubelet/pods/02763513-f6ba-4a99-a0e5-009145061ad6/volumes" Jul 15 21:19:04.256980 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:04.256935 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-spdsc"] Jul 15 21:19:04.257618 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:04.257253 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-spdsc" podUID="142d4684-8a54-4c6f-b522-00b3f99054f2" containerName="limitador" containerID="cri-o://1eefda43edcfd11061e99a01fbef82e2e0e709f5364342c113e242b64154ca02" gracePeriod=30 Jul 15 21:19:04.258232 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:04.258207 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-spdsc" Jul 15 21:19:04.805453 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:04.805429 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-spdsc" Jul 15 21:19:04.875907 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:04.875873 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/142d4684-8a54-4c6f-b522-00b3f99054f2-config-file\") pod \"142d4684-8a54-4c6f-b522-00b3f99054f2\" (UID: \"142d4684-8a54-4c6f-b522-00b3f99054f2\") " Jul 15 21:19:04.876120 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:04.875918 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9794j\" (UniqueName: \"kubernetes.io/projected/142d4684-8a54-4c6f-b522-00b3f99054f2-kube-api-access-9794j\") pod \"142d4684-8a54-4c6f-b522-00b3f99054f2\" (UID: \"142d4684-8a54-4c6f-b522-00b3f99054f2\") " Jul 15 21:19:04.876263 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:04.876235 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/142d4684-8a54-4c6f-b522-00b3f99054f2-config-file" (OuterVolumeSpecName: "config-file") pod "142d4684-8a54-4c6f-b522-00b3f99054f2" (UID: "142d4684-8a54-4c6f-b522-00b3f99054f2"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:19:04.877990 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:04.877969 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/142d4684-8a54-4c6f-b522-00b3f99054f2-kube-api-access-9794j" (OuterVolumeSpecName: "kube-api-access-9794j") pod "142d4684-8a54-4c6f-b522-00b3f99054f2" (UID: "142d4684-8a54-4c6f-b522-00b3f99054f2"). InnerVolumeSpecName "kube-api-access-9794j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:19:04.976730 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:04.976693 2570 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/142d4684-8a54-4c6f-b522-00b3f99054f2-config-file\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:19:04.976730 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:04.976721 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9794j\" (UniqueName: \"kubernetes.io/projected/142d4684-8a54-4c6f-b522-00b3f99054f2-kube-api-access-9794j\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:19:05.598395 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:05.598360 2570 generic.go:356] "Generic (PLEG): container finished" podID="142d4684-8a54-4c6f-b522-00b3f99054f2" containerID="1eefda43edcfd11061e99a01fbef82e2e0e709f5364342c113e242b64154ca02" exitCode=0 Jul 15 21:19:05.598845 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:05.598408 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-spdsc" event={"ID":"142d4684-8a54-4c6f-b522-00b3f99054f2","Type":"ContainerDied","Data":"1eefda43edcfd11061e99a01fbef82e2e0e709f5364342c113e242b64154ca02"} Jul 15 21:19:05.598845 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:05.598412 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-spdsc" Jul 15 21:19:05.598845 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:05.598450 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-spdsc" event={"ID":"142d4684-8a54-4c6f-b522-00b3f99054f2","Type":"ContainerDied","Data":"b84b0125f8fbf97b03d828df3f3d5cb6c1f34129dc5b798fb7bb2b466605a856"} Jul 15 21:19:05.598845 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:05.598472 2570 scope.go:117] "RemoveContainer" containerID="1eefda43edcfd11061e99a01fbef82e2e0e709f5364342c113e242b64154ca02" Jul 15 21:19:05.607635 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:05.607617 2570 scope.go:117] "RemoveContainer" containerID="1eefda43edcfd11061e99a01fbef82e2e0e709f5364342c113e242b64154ca02" Jul 15 21:19:05.607898 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:19:05.607879 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1eefda43edcfd11061e99a01fbef82e2e0e709f5364342c113e242b64154ca02\": container with ID starting with 1eefda43edcfd11061e99a01fbef82e2e0e709f5364342c113e242b64154ca02 not found: ID does not exist" containerID="1eefda43edcfd11061e99a01fbef82e2e0e709f5364342c113e242b64154ca02" Jul 15 21:19:05.607940 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:05.607906 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1eefda43edcfd11061e99a01fbef82e2e0e709f5364342c113e242b64154ca02"} err="failed to get container status \"1eefda43edcfd11061e99a01fbef82e2e0e709f5364342c113e242b64154ca02\": rpc error: code = NotFound desc = could not find container \"1eefda43edcfd11061e99a01fbef82e2e0e709f5364342c113e242b64154ca02\": container with ID starting with 1eefda43edcfd11061e99a01fbef82e2e0e709f5364342c113e242b64154ca02 not found: ID does not exist" Jul 15 21:19:05.619436 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:05.619406 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-spdsc"] Jul 15 21:19:05.621686 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:05.621666 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-spdsc"] Jul 15 21:19:06.593455 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:06.591832 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="142d4684-8a54-4c6f-b522-00b3f99054f2" path="/var/lib/kubelet/pods/142d4684-8a54-4c6f-b522-00b3f99054f2/volumes" Jul 15 21:19:10.808113 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:10.808083 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-f2x8l"] Jul 15 21:19:10.808763 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:10.808744 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02763513-f6ba-4a99-a0e5-009145061ad6" containerName="authorino" Jul 15 21:19:10.808855 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:10.808766 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="02763513-f6ba-4a99-a0e5-009145061ad6" containerName="authorino" Jul 15 21:19:10.808855 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:10.808799 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="142d4684-8a54-4c6f-b522-00b3f99054f2" containerName="limitador" Jul 15 21:19:10.808855 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:10.808808 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="142d4684-8a54-4c6f-b522-00b3f99054f2" containerName="limitador" Jul 15 21:19:10.809447 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:10.808932 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="142d4684-8a54-4c6f-b522-00b3f99054f2" containerName="limitador" Jul 15 21:19:10.809447 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:10.808949 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="02763513-f6ba-4a99-a0e5-009145061ad6" containerName="authorino" Jul 15 21:19:10.813783 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:10.813762 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-f2x8l" Jul 15 21:19:10.816733 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:10.816707 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 21:19:10.816853 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:10.816826 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 15 21:19:10.816986 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:10.816972 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 15 21:19:10.817546 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:10.817524 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-bhztr\"" Jul 15 21:19:10.827403 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:10.827383 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-f2x8l"] Jul 15 21:19:10.833391 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:10.833370 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jznfl\" (UniqueName: \"kubernetes.io/projected/a018028b-8a6d-40e9-897e-3f58baba9edb-kube-api-access-jznfl\") pod \"postgres-69fb4594cf-f2x8l\" (UID: \"a018028b-8a6d-40e9-897e-3f58baba9edb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-f2x8l" Jul 15 21:19:10.833502 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:10.833487 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a018028b-8a6d-40e9-897e-3f58baba9edb-data\") pod \"postgres-69fb4594cf-f2x8l\" (UID: \"a018028b-8a6d-40e9-897e-3f58baba9edb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-f2x8l" Jul 15 21:19:10.934699 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:10.934663 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a018028b-8a6d-40e9-897e-3f58baba9edb-data\") pod \"postgres-69fb4594cf-f2x8l\" (UID: \"a018028b-8a6d-40e9-897e-3f58baba9edb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-f2x8l" Jul 15 21:19:10.934699 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:10.934703 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jznfl\" (UniqueName: \"kubernetes.io/projected/a018028b-8a6d-40e9-897e-3f58baba9edb-kube-api-access-jznfl\") pod \"postgres-69fb4594cf-f2x8l\" (UID: \"a018028b-8a6d-40e9-897e-3f58baba9edb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-f2x8l" Jul 15 21:19:10.935050 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:10.935032 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a018028b-8a6d-40e9-897e-3f58baba9edb-data\") pod \"postgres-69fb4594cf-f2x8l\" (UID: \"a018028b-8a6d-40e9-897e-3f58baba9edb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-f2x8l" Jul 15 21:19:10.942950 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:10.942927 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jznfl\" (UniqueName: \"kubernetes.io/projected/a018028b-8a6d-40e9-897e-3f58baba9edb-kube-api-access-jznfl\") pod \"postgres-69fb4594cf-f2x8l\" (UID: \"a018028b-8a6d-40e9-897e-3f58baba9edb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-f2x8l" Jul 15 21:19:11.124934 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:11.124904 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-f2x8l" Jul 15 21:19:11.262772 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:11.262742 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-f2x8l"] Jul 15 21:19:11.264323 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:19:11.264279 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda018028b_8a6d_40e9_897e_3f58baba9edb.slice/crio-2e4958b1d64328e5812a48a59d4fc77a689fe01f6d64cb11fb729f1813dd860d WatchSource:0}: Error finding container 2e4958b1d64328e5812a48a59d4fc77a689fe01f6d64cb11fb729f1813dd860d: Status 404 returned error can't find the container with id 2e4958b1d64328e5812a48a59d4fc77a689fe01f6d64cb11fb729f1813dd860d Jul 15 21:19:11.633077 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:11.633041 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-f2x8l" event={"ID":"a018028b-8a6d-40e9-897e-3f58baba9edb","Type":"ContainerStarted","Data":"2e4958b1d64328e5812a48a59d4fc77a689fe01f6d64cb11fb729f1813dd860d"} Jul 15 21:19:16.669550 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:16.669510 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-f2x8l" event={"ID":"a018028b-8a6d-40e9-897e-3f58baba9edb","Type":"ContainerStarted","Data":"ead2f22cb9f76ed89ad9bd98bfd4dd032003e7e96264106412221efe6b1481c6"} Jul 15 21:19:16.669938 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:16.669573 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-f2x8l" Jul 15 21:19:16.685403 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:16.685342 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-f2x8l" podStartSLOduration=1.9615734150000002 podStartE2EDuration="6.685318219s" totalImagesPullingTime="4.723744804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:19:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:19:16.684383693 +0000 UTC m=+578.578787785" watchObservedRunningTime="2026-07-15 21:19:16.685318219 +0000 UTC m=+578.579722288" Jul 15 21:19:22.705658 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:22.705628 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-f2x8l" Jul 15 21:19:23.263898 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:23.263867 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rd7ng"] Jul 15 21:19:23.440336 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:23.440276 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rd7ng"] Jul 15 21:19:23.440498 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:23.440398 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rd7ng" Jul 15 21:19:23.507078 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:23.507044 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rd7ng"] Jul 15 21:19:23.507433 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:19:23.507413 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-246rq], unattached volumes=[], failed to process volumes=[kube-api-access-246rq]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-rd7ng" podUID="bf55ec32-81ab-42ea-a550-9c538de9e9d6" Jul 15 21:19:23.533776 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:23.533704 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-d54794f74-kdjc9"] Jul 15 21:19:23.536556 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:23.536532 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d54794f74-kdjc9" Jul 15 21:19:23.543872 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:23.543842 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d54794f74-kdjc9"] Jul 15 21:19:23.559562 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:23.559528 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-246rq\" (UniqueName: \"kubernetes.io/projected/bf55ec32-81ab-42ea-a550-9c538de9e9d6-kube-api-access-246rq\") pod \"authorino-5d4b67c446-rd7ng\" (UID: \"bf55ec32-81ab-42ea-a550-9c538de9e9d6\") " pod="kuadrant-system/authorino-5d4b67c446-rd7ng" Jul 15 21:19:23.603458 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:23.603424 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d54794f74-kdjc9"] Jul 15 21:19:23.603809 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:19:23.603784 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-482js], unattached volumes=[], failed to process volumes=[kube-api-access-482js]: context canceled" pod="kuadrant-system/authorino-d54794f74-kdjc9" podUID="fed4da69-e3bf-4f72-a36d-16f7aefd2de7" Jul 15 21:19:23.631766 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:23.631728 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-569dcfc4b6-zv95k"] Jul 15 21:19:23.634748 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:23.634724 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-569dcfc4b6-zv95k" Jul 15 21:19:23.637254 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:23.637232 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 15 21:19:23.642474 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:23.642399 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-569dcfc4b6-zv95k"] Jul 15 21:19:23.661061 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:23.661031 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-482js\" (UniqueName: \"kubernetes.io/projected/fed4da69-e3bf-4f72-a36d-16f7aefd2de7-kube-api-access-482js\") pod \"authorino-d54794f74-kdjc9\" (UID: \"fed4da69-e3bf-4f72-a36d-16f7aefd2de7\") " pod="kuadrant-system/authorino-d54794f74-kdjc9" Jul 15 21:19:23.661197 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:23.661152 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-246rq\" (UniqueName: \"kubernetes.io/projected/bf55ec32-81ab-42ea-a550-9c538de9e9d6-kube-api-access-246rq\") pod \"authorino-5d4b67c446-rd7ng\" (UID: \"bf55ec32-81ab-42ea-a550-9c538de9e9d6\") " pod="kuadrant-system/authorino-5d4b67c446-rd7ng" Jul 15 21:19:23.669685 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:23.669663 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-246rq\" (UniqueName: \"kubernetes.io/projected/bf55ec32-81ab-42ea-a550-9c538de9e9d6-kube-api-access-246rq\") pod \"authorino-5d4b67c446-rd7ng\" (UID: \"bf55ec32-81ab-42ea-a550-9c538de9e9d6\") " pod="kuadrant-system/authorino-5d4b67c446-rd7ng" Jul 15 21:19:23.711146 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:23.711118 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rd7ng" Jul 15 21:19:23.711551 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:23.711118 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d54794f74-kdjc9" Jul 15 21:19:23.718074 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:23.718050 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rd7ng" Jul 15 21:19:23.721337 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:23.721317 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d54794f74-kdjc9" Jul 15 21:19:23.762390 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:23.762355 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf5d08c9-5591-438f-938a-5d718e0fc529-tls-cert\") pod \"authorino-569dcfc4b6-zv95k\" (UID: \"bf5d08c9-5591-438f-938a-5d718e0fc529\") " pod="kuadrant-system/authorino-569dcfc4b6-zv95k" Jul 15 21:19:23.762555 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:23.762424 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48spr\" (UniqueName: \"kubernetes.io/projected/bf5d08c9-5591-438f-938a-5d718e0fc529-kube-api-access-48spr\") pod \"authorino-569dcfc4b6-zv95k\" (UID: \"bf5d08c9-5591-438f-938a-5d718e0fc529\") " pod="kuadrant-system/authorino-569dcfc4b6-zv95k" Jul 15 21:19:23.762555 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:23.762526 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-482js\" (UniqueName: \"kubernetes.io/projected/fed4da69-e3bf-4f72-a36d-16f7aefd2de7-kube-api-access-482js\") pod \"authorino-d54794f74-kdjc9\" (UID: \"fed4da69-e3bf-4f72-a36d-16f7aefd2de7\") " pod="kuadrant-system/authorino-d54794f74-kdjc9" Jul 15 21:19:23.770864 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:23.770839 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-482js\" (UniqueName: \"kubernetes.io/projected/fed4da69-e3bf-4f72-a36d-16f7aefd2de7-kube-api-access-482js\") pod \"authorino-d54794f74-kdjc9\" (UID: \"fed4da69-e3bf-4f72-a36d-16f7aefd2de7\") " pod="kuadrant-system/authorino-d54794f74-kdjc9" Jul 15 21:19:23.863132 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:23.863100 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-246rq\" (UniqueName: \"kubernetes.io/projected/bf55ec32-81ab-42ea-a550-9c538de9e9d6-kube-api-access-246rq\") pod \"bf55ec32-81ab-42ea-a550-9c538de9e9d6\" (UID: \"bf55ec32-81ab-42ea-a550-9c538de9e9d6\") " Jul 15 21:19:23.863356 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:23.863147 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-482js\" (UniqueName: \"kubernetes.io/projected/fed4da69-e3bf-4f72-a36d-16f7aefd2de7-kube-api-access-482js\") pod \"fed4da69-e3bf-4f72-a36d-16f7aefd2de7\" (UID: \"fed4da69-e3bf-4f72-a36d-16f7aefd2de7\") " Jul 15 21:19:23.863438 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:23.863371 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf5d08c9-5591-438f-938a-5d718e0fc529-tls-cert\") pod \"authorino-569dcfc4b6-zv95k\" (UID: \"bf5d08c9-5591-438f-938a-5d718e0fc529\") " pod="kuadrant-system/authorino-569dcfc4b6-zv95k" Jul 15 21:19:23.863496 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:23.863464 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48spr\" (UniqueName: \"kubernetes.io/projected/bf5d08c9-5591-438f-938a-5d718e0fc529-kube-api-access-48spr\") pod \"authorino-569dcfc4b6-zv95k\" (UID: \"bf5d08c9-5591-438f-938a-5d718e0fc529\") " pod="kuadrant-system/authorino-569dcfc4b6-zv95k" Jul 15 21:19:23.865488 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:23.865456 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf55ec32-81ab-42ea-a550-9c538de9e9d6-kube-api-access-246rq" (OuterVolumeSpecName: "kube-api-access-246rq") pod "bf55ec32-81ab-42ea-a550-9c538de9e9d6" (UID: "bf55ec32-81ab-42ea-a550-9c538de9e9d6"). InnerVolumeSpecName "kube-api-access-246rq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:19:23.865595 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:23.865493 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fed4da69-e3bf-4f72-a36d-16f7aefd2de7-kube-api-access-482js" (OuterVolumeSpecName: "kube-api-access-482js") pod "fed4da69-e3bf-4f72-a36d-16f7aefd2de7" (UID: "fed4da69-e3bf-4f72-a36d-16f7aefd2de7"). InnerVolumeSpecName "kube-api-access-482js". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:19:23.865861 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:23.865840 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf5d08c9-5591-438f-938a-5d718e0fc529-tls-cert\") pod \"authorino-569dcfc4b6-zv95k\" (UID: \"bf5d08c9-5591-438f-938a-5d718e0fc529\") " pod="kuadrant-system/authorino-569dcfc4b6-zv95k" Jul 15 21:19:23.871165 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:23.871141 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48spr\" (UniqueName: \"kubernetes.io/projected/bf5d08c9-5591-438f-938a-5d718e0fc529-kube-api-access-48spr\") pod \"authorino-569dcfc4b6-zv95k\" (UID: \"bf5d08c9-5591-438f-938a-5d718e0fc529\") " pod="kuadrant-system/authorino-569dcfc4b6-zv95k" Jul 15 21:19:23.945629 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:23.945595 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-569dcfc4b6-zv95k" Jul 15 21:19:23.964320 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:23.964268 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-246rq\" (UniqueName: \"kubernetes.io/projected/bf55ec32-81ab-42ea-a550-9c538de9e9d6-kube-api-access-246rq\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:19:23.964320 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:23.964309 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-482js\" (UniqueName: \"kubernetes.io/projected/fed4da69-e3bf-4f72-a36d-16f7aefd2de7-kube-api-access-482js\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:19:24.083930 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:24.083839 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-569dcfc4b6-zv95k"] Jul 15 21:19:24.086437 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:19:24.086408 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf5d08c9_5591_438f_938a_5d718e0fc529.slice/crio-87c2c4b0d7bac843e6586dbd34835c3ca2241f120ca2ffba47e349fafe4b064c WatchSource:0}: Error finding container 87c2c4b0d7bac843e6586dbd34835c3ca2241f120ca2ffba47e349fafe4b064c: Status 404 returned error can't find the container with id 87c2c4b0d7bac843e6586dbd34835c3ca2241f120ca2ffba47e349fafe4b064c Jul 15 21:19:24.718040 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:24.717936 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-569dcfc4b6-zv95k" event={"ID":"bf5d08c9-5591-438f-938a-5d718e0fc529","Type":"ContainerStarted","Data":"b4693d2ef237336c4578db7d2f2feee588dab23a6a8e34c42b3e839211bfb749"} Jul 15 21:19:24.718040 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:24.717977 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rd7ng" Jul 15 21:19:24.718040 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:24.717993 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-569dcfc4b6-zv95k" event={"ID":"bf5d08c9-5591-438f-938a-5d718e0fc529","Type":"ContainerStarted","Data":"87c2c4b0d7bac843e6586dbd34835c3ca2241f120ca2ffba47e349fafe4b064c"} Jul 15 21:19:24.718040 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:24.717955 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d54794f74-kdjc9" Jul 15 21:19:24.734923 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:24.734874 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-569dcfc4b6-zv95k" podStartSLOduration=1.375902327 podStartE2EDuration="1.734860173s" totalImagesPullingTime="358.957846ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:19:24.732252448 +0000 UTC m=+586.626656514" watchObservedRunningTime="2026-07-15 21:19:24.734860173 +0000 UTC m=+586.629264238" Jul 15 21:19:24.755809 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:24.755774 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d54794f74-kdjc9"] Jul 15 21:19:24.761253 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:24.761226 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-d54794f74-kdjc9"] Jul 15 21:19:24.763435 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:24.763418 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-h7kk8"] Jul 15 21:19:24.763586 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:24.763567 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-h7kk8" podUID="db3c7918-45b5-4e3b-82d3-7d578514be6c" containerName="authorino" containerID="cri-o://97e5ea56ad3c336874083bd9a29f9258d5af4b9f204d8af5fe589ada17323145" gracePeriod=30 Jul 15 21:19:24.782075 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:24.781983 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rd7ng"] Jul 15 21:19:24.788221 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:24.788200 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rd7ng"] Jul 15 21:19:25.016777 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:25.016749 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-h7kk8" Jul 15 21:19:25.075868 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:25.075834 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjp6s\" (UniqueName: \"kubernetes.io/projected/db3c7918-45b5-4e3b-82d3-7d578514be6c-kube-api-access-vjp6s\") pod \"db3c7918-45b5-4e3b-82d3-7d578514be6c\" (UID: \"db3c7918-45b5-4e3b-82d3-7d578514be6c\") " Jul 15 21:19:25.077941 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:25.077909 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db3c7918-45b5-4e3b-82d3-7d578514be6c-kube-api-access-vjp6s" (OuterVolumeSpecName: "kube-api-access-vjp6s") pod "db3c7918-45b5-4e3b-82d3-7d578514be6c" (UID: "db3c7918-45b5-4e3b-82d3-7d578514be6c"). InnerVolumeSpecName "kube-api-access-vjp6s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:19:25.176935 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:25.176898 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjp6s\" (UniqueName: \"kubernetes.io/projected/db3c7918-45b5-4e3b-82d3-7d578514be6c-kube-api-access-vjp6s\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:19:25.725352 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:25.725316 2570 generic.go:356] "Generic (PLEG): container finished" podID="db3c7918-45b5-4e3b-82d3-7d578514be6c" containerID="97e5ea56ad3c336874083bd9a29f9258d5af4b9f204d8af5fe589ada17323145" exitCode=0 Jul 15 21:19:25.725352 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:25.725344 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-h7kk8" Jul 15 21:19:25.725865 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:25.725382 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-h7kk8" event={"ID":"db3c7918-45b5-4e3b-82d3-7d578514be6c","Type":"ContainerDied","Data":"97e5ea56ad3c336874083bd9a29f9258d5af4b9f204d8af5fe589ada17323145"} Jul 15 21:19:25.725865 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:25.725431 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-h7kk8" event={"ID":"db3c7918-45b5-4e3b-82d3-7d578514be6c","Type":"ContainerDied","Data":"7471434834e879b1771c7214c37a5877eca256bd6ba5f9c12fa7dc9e73ccbf2e"} Jul 15 21:19:25.725865 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:25.725459 2570 scope.go:117] "RemoveContainer" containerID="97e5ea56ad3c336874083bd9a29f9258d5af4b9f204d8af5fe589ada17323145" Jul 15 21:19:25.735660 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:25.735642 2570 scope.go:117] "RemoveContainer" containerID="97e5ea56ad3c336874083bd9a29f9258d5af4b9f204d8af5fe589ada17323145" Jul 15 21:19:25.736000 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:19:25.735972 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97e5ea56ad3c336874083bd9a29f9258d5af4b9f204d8af5fe589ada17323145\": container with ID starting with 97e5ea56ad3c336874083bd9a29f9258d5af4b9f204d8af5fe589ada17323145 not found: ID does not exist" containerID="97e5ea56ad3c336874083bd9a29f9258d5af4b9f204d8af5fe589ada17323145" Jul 15 21:19:25.736088 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:25.736019 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97e5ea56ad3c336874083bd9a29f9258d5af4b9f204d8af5fe589ada17323145"} err="failed to get container status \"97e5ea56ad3c336874083bd9a29f9258d5af4b9f204d8af5fe589ada17323145\": rpc error: code = NotFound desc = could not find container \"97e5ea56ad3c336874083bd9a29f9258d5af4b9f204d8af5fe589ada17323145\": container with ID starting with 97e5ea56ad3c336874083bd9a29f9258d5af4b9f204d8af5fe589ada17323145 not found: ID does not exist" Jul 15 21:19:25.747233 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:25.747204 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-h7kk8"] Jul 15 21:19:25.749667 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:25.749639 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-h7kk8"] Jul 15 21:19:26.590373 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:26.590339 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf55ec32-81ab-42ea-a550-9c538de9e9d6" path="/var/lib/kubelet/pods/bf55ec32-81ab-42ea-a550-9c538de9e9d6/volumes" Jul 15 21:19:26.590666 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:26.590649 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db3c7918-45b5-4e3b-82d3-7d578514be6c" path="/var/lib/kubelet/pods/db3c7918-45b5-4e3b-82d3-7d578514be6c/volumes" Jul 15 21:19:26.590966 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:26.590953 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fed4da69-e3bf-4f72-a36d-16f7aefd2de7" path="/var/lib/kubelet/pods/fed4da69-e3bf-4f72-a36d-16f7aefd2de7/volumes" Jul 15 21:19:29.850261 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:29.850227 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-bdd575fbb-vcgz2"] Jul 15 21:19:29.850734 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:29.850718 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db3c7918-45b5-4e3b-82d3-7d578514be6c" containerName="authorino" Jul 15 21:19:29.850778 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:29.850735 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="db3c7918-45b5-4e3b-82d3-7d578514be6c" containerName="authorino" Jul 15 21:19:29.850821 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:29.850807 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="db3c7918-45b5-4e3b-82d3-7d578514be6c" containerName="authorino" Jul 15 21:19:29.853960 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:29.853943 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bdd575fbb-vcgz2" Jul 15 21:19:29.857474 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:29.857448 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 15 21:19:29.857474 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:29.857461 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-x9gdt\"" Jul 15 21:19:29.858177 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:29.858097 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 15 21:19:29.872970 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:29.872943 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bdd575fbb-vcgz2"] Jul 15 21:19:29.927130 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:29.927096 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4de25a0b-4b9a-4d6d-86fc-c8b029e06234-webhook-cert\") pod \"maas-controller-bdd575fbb-vcgz2\" (UID: \"4de25a0b-4b9a-4d6d-86fc-c8b029e06234\") " pod="opendatahub/maas-controller-bdd575fbb-vcgz2" Jul 15 21:19:29.927130 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:29.927143 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bbhp\" (UniqueName: \"kubernetes.io/projected/4de25a0b-4b9a-4d6d-86fc-c8b029e06234-kube-api-access-9bbhp\") pod \"maas-controller-bdd575fbb-vcgz2\" (UID: \"4de25a0b-4b9a-4d6d-86fc-c8b029e06234\") " pod="opendatahub/maas-controller-bdd575fbb-vcgz2" Jul 15 21:19:30.028086 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:30.028051 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4de25a0b-4b9a-4d6d-86fc-c8b029e06234-webhook-cert\") pod \"maas-controller-bdd575fbb-vcgz2\" (UID: \"4de25a0b-4b9a-4d6d-86fc-c8b029e06234\") " pod="opendatahub/maas-controller-bdd575fbb-vcgz2" Jul 15 21:19:30.028261 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:30.028095 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bbhp\" (UniqueName: \"kubernetes.io/projected/4de25a0b-4b9a-4d6d-86fc-c8b029e06234-kube-api-access-9bbhp\") pod \"maas-controller-bdd575fbb-vcgz2\" (UID: \"4de25a0b-4b9a-4d6d-86fc-c8b029e06234\") " pod="opendatahub/maas-controller-bdd575fbb-vcgz2" Jul 15 21:19:30.030620 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:30.030594 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4de25a0b-4b9a-4d6d-86fc-c8b029e06234-webhook-cert\") pod \"maas-controller-bdd575fbb-vcgz2\" (UID: \"4de25a0b-4b9a-4d6d-86fc-c8b029e06234\") " pod="opendatahub/maas-controller-bdd575fbb-vcgz2" Jul 15 21:19:30.039958 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:30.039901 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bbhp\" (UniqueName: \"kubernetes.io/projected/4de25a0b-4b9a-4d6d-86fc-c8b029e06234-kube-api-access-9bbhp\") pod \"maas-controller-bdd575fbb-vcgz2\" (UID: \"4de25a0b-4b9a-4d6d-86fc-c8b029e06234\") " pod="opendatahub/maas-controller-bdd575fbb-vcgz2" Jul 15 21:19:30.062257 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:30.062229 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-d79b5d84b-5tr2b"] Jul 15 21:19:30.065309 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:30.065278 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d79b5d84b-5tr2b" Jul 15 21:19:30.080217 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:30.080193 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d79b5d84b-5tr2b"] Jul 15 21:19:30.165613 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:30.165522 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bdd575fbb-vcgz2" Jul 15 21:19:30.229843 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:30.229813 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-624hs\" (UniqueName: \"kubernetes.io/projected/115cbe88-939c-4693-bbc6-7e3f408da542-kube-api-access-624hs\") pod \"maas-controller-d79b5d84b-5tr2b\" (UID: \"115cbe88-939c-4693-bbc6-7e3f408da542\") " pod="opendatahub/maas-controller-d79b5d84b-5tr2b" Jul 15 21:19:30.230023 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:30.229912 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/115cbe88-939c-4693-bbc6-7e3f408da542-webhook-cert\") pod \"maas-controller-d79b5d84b-5tr2b\" (UID: \"115cbe88-939c-4693-bbc6-7e3f408da542\") " pod="opendatahub/maas-controller-d79b5d84b-5tr2b" Jul 15 21:19:30.301791 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:30.301764 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bdd575fbb-vcgz2"] Jul 15 21:19:30.303017 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:19:30.302990 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4de25a0b_4b9a_4d6d_86fc_c8b029e06234.slice/crio-2649e8dd6ec2e053940e547b053da8648be1bd61ab2a5cf03c2dd07f239a5087 WatchSource:0}: Error finding container 2649e8dd6ec2e053940e547b053da8648be1bd61ab2a5cf03c2dd07f239a5087: Status 404 returned error can't find the container with id 2649e8dd6ec2e053940e547b053da8648be1bd61ab2a5cf03c2dd07f239a5087 Jul 15 21:19:30.331118 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:30.331083 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-624hs\" (UniqueName: \"kubernetes.io/projected/115cbe88-939c-4693-bbc6-7e3f408da542-kube-api-access-624hs\") pod \"maas-controller-d79b5d84b-5tr2b\" (UID: \"115cbe88-939c-4693-bbc6-7e3f408da542\") " pod="opendatahub/maas-controller-d79b5d84b-5tr2b" Jul 15 21:19:30.331332 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:30.331201 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/115cbe88-939c-4693-bbc6-7e3f408da542-webhook-cert\") pod \"maas-controller-d79b5d84b-5tr2b\" (UID: \"115cbe88-939c-4693-bbc6-7e3f408da542\") " pod="opendatahub/maas-controller-d79b5d84b-5tr2b" Jul 15 21:19:30.333644 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:30.333621 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/115cbe88-939c-4693-bbc6-7e3f408da542-webhook-cert\") pod \"maas-controller-d79b5d84b-5tr2b\" (UID: \"115cbe88-939c-4693-bbc6-7e3f408da542\") " pod="opendatahub/maas-controller-d79b5d84b-5tr2b" Jul 15 21:19:30.339202 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:30.339181 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-624hs\" (UniqueName: \"kubernetes.io/projected/115cbe88-939c-4693-bbc6-7e3f408da542-kube-api-access-624hs\") pod \"maas-controller-d79b5d84b-5tr2b\" (UID: \"115cbe88-939c-4693-bbc6-7e3f408da542\") " pod="opendatahub/maas-controller-d79b5d84b-5tr2b" Jul 15 21:19:30.377026 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:30.376994 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d79b5d84b-5tr2b" Jul 15 21:19:30.518345 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:30.518316 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d79b5d84b-5tr2b"] Jul 15 21:19:30.520165 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:19:30.520142 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod115cbe88_939c_4693_bbc6_7e3f408da542.slice/crio-c6aa2b4dec62ca65517422dc4b143cf833e7c95478f0c2d7e46ce7dc03da18a9 WatchSource:0}: Error finding container c6aa2b4dec62ca65517422dc4b143cf833e7c95478f0c2d7e46ce7dc03da18a9: Status 404 returned error can't find the container with id c6aa2b4dec62ca65517422dc4b143cf833e7c95478f0c2d7e46ce7dc03da18a9 Jul 15 21:19:30.755199 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:30.755109 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d79b5d84b-5tr2b" event={"ID":"115cbe88-939c-4693-bbc6-7e3f408da542","Type":"ContainerStarted","Data":"c6aa2b4dec62ca65517422dc4b143cf833e7c95478f0c2d7e46ce7dc03da18a9"} Jul 15 21:19:30.756335 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:30.756308 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bdd575fbb-vcgz2" event={"ID":"4de25a0b-4b9a-4d6d-86fc-c8b029e06234","Type":"ContainerStarted","Data":"2649e8dd6ec2e053940e547b053da8648be1bd61ab2a5cf03c2dd07f239a5087"} Jul 15 21:19:33.781790 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:33.781753 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d79b5d84b-5tr2b" event={"ID":"115cbe88-939c-4693-bbc6-7e3f408da542","Type":"ContainerStarted","Data":"ceb2ce7dc03d832896a527c2a8443f05168a0a05d0ee3f12ac1134310e75fd34"} Jul 15 21:19:33.782264 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:33.781920 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-d79b5d84b-5tr2b" Jul 15 21:19:33.783370 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:33.783347 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bdd575fbb-vcgz2" event={"ID":"4de25a0b-4b9a-4d6d-86fc-c8b029e06234","Type":"ContainerStarted","Data":"78c460db45776933a52ca93742e3069e14c685280cb6d4446ab8e9356c18d228"} Jul 15 21:19:33.783477 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:33.783427 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-bdd575fbb-vcgz2" Jul 15 21:19:33.801602 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:33.801554 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-d79b5d84b-5tr2b" podStartSLOduration=1.279194717 podStartE2EDuration="3.801538824s" totalImagesPullingTime="2.522344107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:19:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:19:33.799651424 +0000 UTC m=+595.694055503" watchObservedRunningTime="2026-07-15 21:19:33.801538824 +0000 UTC m=+595.695942866" Jul 15 21:19:33.822667 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:33.822617 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-bdd575fbb-vcgz2" podStartSLOduration=2.096600942 podStartE2EDuration="4.822602541s" totalImagesPullingTime="2.726001599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:19:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:19:33.821388352 +0000 UTC m=+595.715792435" watchObservedRunningTime="2026-07-15 21:19:33.822602541 +0000 UTC m=+595.717006640" Jul 15 21:19:38.501807 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:38.501783 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c5zg9_50d11f79-1eac-4ad4-8151-9b5dd54cd284/console-operator/1.log" Jul 15 21:19:38.501807 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:38.501796 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c5zg9_50d11f79-1eac-4ad4-8151-9b5dd54cd284/console-operator/1.log" Jul 15 21:19:38.509462 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:38.509432 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nhzkw_beb5b136-86fb-4e57-9b27-3fc1079a9af3/ovn-acl-logging/0.log" Jul 15 21:19:38.509625 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:38.509598 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nhzkw_beb5b136-86fb-4e57-9b27-3fc1079a9af3/ovn-acl-logging/0.log" Jul 15 21:19:44.792132 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:44.792101 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-bdd575fbb-vcgz2" Jul 15 21:19:44.792532 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:44.792174 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-d79b5d84b-5tr2b" Jul 15 21:19:44.853059 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:44.853030 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bdd575fbb-vcgz2"] Jul 15 21:19:44.853427 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:44.853391 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-bdd575fbb-vcgz2" podUID="4de25a0b-4b9a-4d6d-86fc-c8b029e06234" containerName="manager" containerID="cri-o://78c460db45776933a52ca93742e3069e14c685280cb6d4446ab8e9356c18d228" gracePeriod=30 Jul 15 21:19:45.102933 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:45.102910 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bdd575fbb-vcgz2" Jul 15 21:19:45.177867 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:45.177842 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9bbhp\" (UniqueName: \"kubernetes.io/projected/4de25a0b-4b9a-4d6d-86fc-c8b029e06234-kube-api-access-9bbhp\") pod \"4de25a0b-4b9a-4d6d-86fc-c8b029e06234\" (UID: \"4de25a0b-4b9a-4d6d-86fc-c8b029e06234\") " Jul 15 21:19:45.178053 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:45.177916 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4de25a0b-4b9a-4d6d-86fc-c8b029e06234-webhook-cert\") pod \"4de25a0b-4b9a-4d6d-86fc-c8b029e06234\" (UID: \"4de25a0b-4b9a-4d6d-86fc-c8b029e06234\") " Jul 15 21:19:45.180031 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:45.179997 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4de25a0b-4b9a-4d6d-86fc-c8b029e06234-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4de25a0b-4b9a-4d6d-86fc-c8b029e06234" (UID: "4de25a0b-4b9a-4d6d-86fc-c8b029e06234"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:19:45.180132 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:45.180065 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4de25a0b-4b9a-4d6d-86fc-c8b029e06234-kube-api-access-9bbhp" (OuterVolumeSpecName: "kube-api-access-9bbhp") pod "4de25a0b-4b9a-4d6d-86fc-c8b029e06234" (UID: "4de25a0b-4b9a-4d6d-86fc-c8b029e06234"). InnerVolumeSpecName "kube-api-access-9bbhp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:19:45.279276 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:45.279239 2570 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4de25a0b-4b9a-4d6d-86fc-c8b029e06234-webhook-cert\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:19:45.279276 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:45.279268 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bbhp\" (UniqueName: \"kubernetes.io/projected/4de25a0b-4b9a-4d6d-86fc-c8b029e06234-kube-api-access-9bbhp\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:19:45.859730 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:45.859695 2570 generic.go:356] "Generic (PLEG): container finished" podID="4de25a0b-4b9a-4d6d-86fc-c8b029e06234" containerID="78c460db45776933a52ca93742e3069e14c685280cb6d4446ab8e9356c18d228" exitCode=0 Jul 15 21:19:45.860182 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:45.859741 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bdd575fbb-vcgz2" Jul 15 21:19:45.860182 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:45.859773 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bdd575fbb-vcgz2" event={"ID":"4de25a0b-4b9a-4d6d-86fc-c8b029e06234","Type":"ContainerDied","Data":"78c460db45776933a52ca93742e3069e14c685280cb6d4446ab8e9356c18d228"} Jul 15 21:19:45.860182 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:45.859833 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bdd575fbb-vcgz2" event={"ID":"4de25a0b-4b9a-4d6d-86fc-c8b029e06234","Type":"ContainerDied","Data":"2649e8dd6ec2e053940e547b053da8648be1bd61ab2a5cf03c2dd07f239a5087"} Jul 15 21:19:45.860182 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:45.859864 2570 scope.go:117] "RemoveContainer" containerID="78c460db45776933a52ca93742e3069e14c685280cb6d4446ab8e9356c18d228" Jul 15 21:19:45.869574 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:45.869556 2570 scope.go:117] "RemoveContainer" containerID="78c460db45776933a52ca93742e3069e14c685280cb6d4446ab8e9356c18d228" Jul 15 21:19:45.869830 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:19:45.869810 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78c460db45776933a52ca93742e3069e14c685280cb6d4446ab8e9356c18d228\": container with ID starting with 78c460db45776933a52ca93742e3069e14c685280cb6d4446ab8e9356c18d228 not found: ID does not exist" containerID="78c460db45776933a52ca93742e3069e14c685280cb6d4446ab8e9356c18d228" Jul 15 21:19:45.869878 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:45.869841 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78c460db45776933a52ca93742e3069e14c685280cb6d4446ab8e9356c18d228"} err="failed to get container status \"78c460db45776933a52ca93742e3069e14c685280cb6d4446ab8e9356c18d228\": rpc error: code = NotFound desc = could not find container \"78c460db45776933a52ca93742e3069e14c685280cb6d4446ab8e9356c18d228\": container with ID starting with 78c460db45776933a52ca93742e3069e14c685280cb6d4446ab8e9356c18d228 not found: ID does not exist" Jul 15 21:19:45.881515 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:45.881494 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bdd575fbb-vcgz2"] Jul 15 21:19:45.884912 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:45.884893 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-bdd575fbb-vcgz2"] Jul 15 21:19:46.593112 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:19:46.593078 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4de25a0b-4b9a-4d6d-86fc-c8b029e06234" path="/var/lib/kubelet/pods/4de25a0b-4b9a-4d6d-86fc-c8b029e06234/volumes" Jul 15 21:20:06.292362 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:06.292326 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6fd778c595-klfg6"] Jul 15 21:20:06.309615 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:06.292864 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4de25a0b-4b9a-4d6d-86fc-c8b029e06234" containerName="manager" Jul 15 21:20:06.309615 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:06.292879 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="4de25a0b-4b9a-4d6d-86fc-c8b029e06234" containerName="manager" Jul 15 21:20:06.309615 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:06.292969 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="4de25a0b-4b9a-4d6d-86fc-c8b029e06234" containerName="manager" Jul 15 21:20:06.311433 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:06.311406 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6fd778c595-klfg6"] Jul 15 21:20:06.311576 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:06.311504 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6fd778c595-klfg6" Jul 15 21:20:06.313926 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:06.313903 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 15 21:20:06.383706 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:06.383677 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b353c4b-7d91-401d-b34d-f80399b2a8ea-maas-api-tls\") pod \"maas-api-6fd778c595-klfg6\" (UID: \"1b353c4b-7d91-401d-b34d-f80399b2a8ea\") " pod="odh-ai-gateway-infra/maas-api-6fd778c595-klfg6" Jul 15 21:20:06.383874 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:06.383769 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qf2p\" (UniqueName: \"kubernetes.io/projected/1b353c4b-7d91-401d-b34d-f80399b2a8ea-kube-api-access-4qf2p\") pod \"maas-api-6fd778c595-klfg6\" (UID: \"1b353c4b-7d91-401d-b34d-f80399b2a8ea\") " pod="odh-ai-gateway-infra/maas-api-6fd778c595-klfg6" Jul 15 21:20:06.383874 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:06.383802 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b353c4b-7d91-401d-b34d-f80399b2a8ea-openshift-service-ca\") pod \"maas-api-6fd778c595-klfg6\" (UID: \"1b353c4b-7d91-401d-b34d-f80399b2a8ea\") " pod="odh-ai-gateway-infra/maas-api-6fd778c595-klfg6" Jul 15 21:20:06.485031 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:06.485000 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b353c4b-7d91-401d-b34d-f80399b2a8ea-maas-api-tls\") pod \"maas-api-6fd778c595-klfg6\" (UID: \"1b353c4b-7d91-401d-b34d-f80399b2a8ea\") " pod="odh-ai-gateway-infra/maas-api-6fd778c595-klfg6" Jul 15 21:20:06.485202 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:06.485103 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qf2p\" (UniqueName: \"kubernetes.io/projected/1b353c4b-7d91-401d-b34d-f80399b2a8ea-kube-api-access-4qf2p\") pod \"maas-api-6fd778c595-klfg6\" (UID: \"1b353c4b-7d91-401d-b34d-f80399b2a8ea\") " pod="odh-ai-gateway-infra/maas-api-6fd778c595-klfg6" Jul 15 21:20:06.485202 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:06.485142 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b353c4b-7d91-401d-b34d-f80399b2a8ea-openshift-service-ca\") pod \"maas-api-6fd778c595-klfg6\" (UID: \"1b353c4b-7d91-401d-b34d-f80399b2a8ea\") " pod="odh-ai-gateway-infra/maas-api-6fd778c595-klfg6" Jul 15 21:20:06.485888 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:06.485854 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b353c4b-7d91-401d-b34d-f80399b2a8ea-openshift-service-ca\") pod \"maas-api-6fd778c595-klfg6\" (UID: \"1b353c4b-7d91-401d-b34d-f80399b2a8ea\") " pod="odh-ai-gateway-infra/maas-api-6fd778c595-klfg6" Jul 15 21:20:06.487491 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:06.487470 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b353c4b-7d91-401d-b34d-f80399b2a8ea-maas-api-tls\") pod \"maas-api-6fd778c595-klfg6\" (UID: \"1b353c4b-7d91-401d-b34d-f80399b2a8ea\") " pod="odh-ai-gateway-infra/maas-api-6fd778c595-klfg6" Jul 15 21:20:06.493455 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:06.493434 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qf2p\" (UniqueName: \"kubernetes.io/projected/1b353c4b-7d91-401d-b34d-f80399b2a8ea-kube-api-access-4qf2p\") pod \"maas-api-6fd778c595-klfg6\" (UID: \"1b353c4b-7d91-401d-b34d-f80399b2a8ea\") " pod="odh-ai-gateway-infra/maas-api-6fd778c595-klfg6" Jul 15 21:20:06.622979 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:06.622943 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6fd778c595-klfg6" Jul 15 21:20:06.864851 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:06.864819 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-ftvt9"] Jul 15 21:20:06.868107 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:06.868088 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-ftvt9" Jul 15 21:20:06.871628 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:06.871609 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-gktkr\"" Jul 15 21:20:06.871978 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:06.871958 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 15 21:20:06.884732 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:06.884710 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-ftvt9"] Jul 15 21:20:06.913380 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:06.913350 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-54x66"] Jul 15 21:20:06.915926 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:06.915902 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-54x66" Jul 15 21:20:06.926553 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:06.926531 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-54x66"] Jul 15 21:20:06.975267 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:06.975243 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6fd778c595-klfg6"] Jul 15 21:20:06.978057 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:20:06.978027 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b353c4b_7d91_401d_b34d_f80399b2a8ea.slice/crio-6a6a2971b4e554d19f171d1ad7098961fe7fe212179978f6a3ce8ef2d5254321 WatchSource:0}: Error finding container 6a6a2971b4e554d19f171d1ad7098961fe7fe212179978f6a3ce8ef2d5254321: Status 404 returned error can't find the container with id 6a6a2971b4e554d19f171d1ad7098961fe7fe212179978f6a3ce8ef2d5254321 Jul 15 21:20:06.979631 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:06.979614 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 21:20:06.991429 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:06.991397 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkkfk\" (UniqueName: \"kubernetes.io/projected/af428720-6e24-4733-9a1a-0133212d6969-kube-api-access-zkkfk\") pod \"payload-pre-processing-74584bb9f8-54x66\" (UID: \"af428720-6e24-4733-9a1a-0133212d6969\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-54x66" Jul 15 21:20:06.991541 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:06.991430 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sttn\" (UniqueName: \"kubernetes.io/projected/30b77070-2603-4f74-ad7e-9308ac085dd8-kube-api-access-2sttn\") pod \"payload-processing-f9b8d9b9b-ftvt9\" (UID: \"30b77070-2603-4f74-ad7e-9308ac085dd8\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-ftvt9" Jul 15 21:20:06.991541 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:06.991507 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30b77070-2603-4f74-ad7e-9308ac085dd8-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-ftvt9\" (UID: \"30b77070-2603-4f74-ad7e-9308ac085dd8\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-ftvt9" Jul 15 21:20:06.991541 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:06.991524 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af428720-6e24-4733-9a1a-0133212d6969-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-54x66\" (UID: \"af428720-6e24-4733-9a1a-0133212d6969\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-54x66" Jul 15 21:20:07.092784 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:07.092754 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkkfk\" (UniqueName: \"kubernetes.io/projected/af428720-6e24-4733-9a1a-0133212d6969-kube-api-access-zkkfk\") pod \"payload-pre-processing-74584bb9f8-54x66\" (UID: \"af428720-6e24-4733-9a1a-0133212d6969\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-54x66" Jul 15 21:20:07.092784 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:07.092789 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sttn\" (UniqueName: \"kubernetes.io/projected/30b77070-2603-4f74-ad7e-9308ac085dd8-kube-api-access-2sttn\") pod \"payload-processing-f9b8d9b9b-ftvt9\" (UID: \"30b77070-2603-4f74-ad7e-9308ac085dd8\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-ftvt9" Jul 15 21:20:07.093057 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:07.092848 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30b77070-2603-4f74-ad7e-9308ac085dd8-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-ftvt9\" (UID: \"30b77070-2603-4f74-ad7e-9308ac085dd8\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-ftvt9" Jul 15 21:20:07.093057 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:07.092868 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af428720-6e24-4733-9a1a-0133212d6969-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-54x66\" (UID: \"af428720-6e24-4733-9a1a-0133212d6969\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-54x66" Jul 15 21:20:07.093798 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:07.093774 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30b77070-2603-4f74-ad7e-9308ac085dd8-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-ftvt9\" (UID: \"30b77070-2603-4f74-ad7e-9308ac085dd8\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-ftvt9" Jul 15 21:20:07.093849 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:07.093822 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af428720-6e24-4733-9a1a-0133212d6969-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-54x66\" (UID: \"af428720-6e24-4733-9a1a-0133212d6969\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-54x66" Jul 15 21:20:07.101855 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:07.101825 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkkfk\" (UniqueName: \"kubernetes.io/projected/af428720-6e24-4733-9a1a-0133212d6969-kube-api-access-zkkfk\") pod \"payload-pre-processing-74584bb9f8-54x66\" (UID: \"af428720-6e24-4733-9a1a-0133212d6969\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-54x66" Jul 15 21:20:07.101855 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:07.101837 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sttn\" (UniqueName: \"kubernetes.io/projected/30b77070-2603-4f74-ad7e-9308ac085dd8-kube-api-access-2sttn\") pod \"payload-processing-f9b8d9b9b-ftvt9\" (UID: \"30b77070-2603-4f74-ad7e-9308ac085dd8\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-ftvt9" Jul 15 21:20:07.178899 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:07.178813 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-ftvt9" Jul 15 21:20:07.227284 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:07.227257 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-54x66" Jul 15 21:20:07.355454 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:07.355124 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-ftvt9"] Jul 15 21:20:07.435470 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:07.435447 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-54x66"] Jul 15 21:20:07.437320 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:20:07.437279 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf428720_6e24_4733_9a1a_0133212d6969.slice/crio-d5b42b87277f0fecfd250b39264c42bee2d6c4d1c6433e082defd46485d1b4c4 WatchSource:0}: Error finding container d5b42b87277f0fecfd250b39264c42bee2d6c4d1c6433e082defd46485d1b4c4: Status 404 returned error can't find the container with id d5b42b87277f0fecfd250b39264c42bee2d6c4d1c6433e082defd46485d1b4c4 Jul 15 21:20:07.994725 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:07.994694 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-54x66" event={"ID":"af428720-6e24-4733-9a1a-0133212d6969","Type":"ContainerStarted","Data":"d5b42b87277f0fecfd250b39264c42bee2d6c4d1c6433e082defd46485d1b4c4"} Jul 15 21:20:07.996068 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:07.996041 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-ftvt9" event={"ID":"30b77070-2603-4f74-ad7e-9308ac085dd8","Type":"ContainerStarted","Data":"147f1a1154cee3da577c8f8413063b51a01256c25da89cef1c7861a967dad6a0"} Jul 15 21:20:07.997456 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:07.997428 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6fd778c595-klfg6" event={"ID":"1b353c4b-7d91-401d-b34d-f80399b2a8ea","Type":"ContainerStarted","Data":"6a6a2971b4e554d19f171d1ad7098961fe7fe212179978f6a3ce8ef2d5254321"} Jul 15 21:20:10.011613 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:10.011572 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6fd778c595-klfg6" event={"ID":"1b353c4b-7d91-401d-b34d-f80399b2a8ea","Type":"ContainerStarted","Data":"ae864efe983a35a6c2034d8e7bd5fdf54d8ac76044a5809b857e704e5ac41b56"} Jul 15 21:20:10.012087 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:10.011665 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6fd778c595-klfg6" Jul 15 21:20:10.013219 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:10.013184 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-54x66" event={"ID":"af428720-6e24-4733-9a1a-0133212d6969","Type":"ContainerStarted","Data":"802f322dec555543b1ee1909b906c11d5302694b5ba083e36f09f79676c6df45"} Jul 15 21:20:10.013376 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:10.013235 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-54x66" Jul 15 21:20:10.014666 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:10.014639 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-ftvt9" event={"ID":"30b77070-2603-4f74-ad7e-9308ac085dd8","Type":"ContainerStarted","Data":"76203dc58911ca8493acce03486138060edc438286f8d43384e2f69aa1d8e3ce"} Jul 15 21:20:10.014782 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:10.014767 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-ftvt9" Jul 15 21:20:10.030460 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:10.030416 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6fd778c595-klfg6" podStartSLOduration=1.7129546740000001 podStartE2EDuration="4.030400099s" totalImagesPullingTime="2.317445425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:20:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:20:10.028585709 +0000 UTC m=+631.922989773" watchObservedRunningTime="2026-07-15 21:20:10.030400099 +0000 UTC m=+631.924804164" Jul 15 21:20:10.043785 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:10.043739 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-54x66" podStartSLOduration=2.18581488 podStartE2EDuration="4.043725038s" totalImagesPullingTime="1.857910158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:20:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:20:10.043185895 +0000 UTC m=+631.937589962" watchObservedRunningTime="2026-07-15 21:20:10.043725038 +0000 UTC m=+631.938129104" Jul 15 21:20:14.397452 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:14.397418 2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-hnfjp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 15 21:20:14.399308 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:14.397489 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" podUID="4b11aee3-8b5c-4517-925c-b5c6c0932fdb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 15 21:20:15.044279 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:15.044247 2570 generic.go:356] "Generic (PLEG): container finished" podID="4b11aee3-8b5c-4517-925c-b5c6c0932fdb" containerID="b3798b0f9c99d4bc60ec81024bdf996bb2015b1fcbad75fa003f59db124275b2" exitCode=0 Jul 15 21:20:15.044462 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:15.044321 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" event={"ID":"4b11aee3-8b5c-4517-925c-b5c6c0932fdb","Type":"ContainerDied","Data":"b3798b0f9c99d4bc60ec81024bdf996bb2015b1fcbad75fa003f59db124275b2"} Jul 15 21:20:15.044727 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:15.044708 2570 scope.go:117] "RemoveContainer" containerID="b3798b0f9c99d4bc60ec81024bdf996bb2015b1fcbad75fa003f59db124275b2" Jul 15 21:20:15.045721 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:15.045696 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 21:20:15.045786 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:15.045762 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 21:20:15.045835 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:15.045791 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 21:20:15.067199 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:15.067145 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-ftvt9" podStartSLOduration=7.135103917 podStartE2EDuration="9.067127512s" totalImagesPullingTime="1.932023595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:20:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:20:10.061190678 +0000 UTC m=+631.955594748" watchObservedRunningTime="2026-07-15 21:20:15.067127512 +0000 UTC m=+636.961531578" Jul 15 21:20:16.026052 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:16.026026 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6fd778c595-klfg6" Jul 15 21:20:16.052384 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:16.052338 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" event={"ID":"4b11aee3-8b5c-4517-925c-b5c6c0932fdb","Type":"ContainerStarted","Data":"2348e4ce7e4a4f2f2e43fc7a6ec8b6f990c0bb6f894b87874d55e44b24a260b7"} Jul 15 21:20:16.057511 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:16.057438 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" Jul 15 21:20:16.057511 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:16.057485 2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-hnfjp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 15 21:20:16.057746 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:16.057534 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" podUID="4b11aee3-8b5c-4517-925c-b5c6c0932fdb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 15 21:20:17.058208 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:17.058116 2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-hnfjp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 15 21:20:17.058872 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:17.058840 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" podUID="4b11aee3-8b5c-4517-925c-b5c6c0932fdb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 15 21:20:18.058077 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:18.058043 2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-hnfjp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 15 21:20:18.058438 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:18.058410 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" podUID="4b11aee3-8b5c-4517-925c-b5c6c0932fdb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 15 21:20:19.057958 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:19.057914 2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-hnfjp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 15 21:20:19.058162 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:19.058001 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" podUID="4b11aee3-8b5c-4517-925c-b5c6c0932fdb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 15 21:20:20.061450 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:20.061418 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" Jul 15 21:20:20.061916 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:20.061697 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" Jul 15 21:20:20.062407 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:20.062389 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hnfjp" Jul 15 21:20:21.022232 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:21.022205 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-ftvt9" Jul 15 21:20:21.022588 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:21.022562 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-54x66" Jul 15 21:20:25.526558 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:25.526522 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m"] Jul 15 21:20:25.530874 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:25.530851 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m" Jul 15 21:20:25.534270 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:25.534244 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 15 21:20:25.534594 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:25.534250 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 15 21:20:25.534594 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:25.534282 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2cvfv\"" Jul 15 21:20:25.534594 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:25.534324 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 15 21:20:25.537926 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:25.537904 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m"] Jul 15 21:20:25.590483 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:25.590437 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b666c954-b4a7-46f1-ac05-eb1bfdb29ea6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m\" (UID: \"b666c954-b4a7-46f1-ac05-eb1bfdb29ea6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m" Jul 15 21:20:25.590483 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:25.590473 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z42xg\" (UniqueName: \"kubernetes.io/projected/b666c954-b4a7-46f1-ac05-eb1bfdb29ea6-kube-api-access-z42xg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m\" (UID: \"b666c954-b4a7-46f1-ac05-eb1bfdb29ea6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m" Jul 15 21:20:25.590734 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:25.590512 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b666c954-b4a7-46f1-ac05-eb1bfdb29ea6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m\" (UID: \"b666c954-b4a7-46f1-ac05-eb1bfdb29ea6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m" Jul 15 21:20:25.590734 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:25.590532 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b666c954-b4a7-46f1-ac05-eb1bfdb29ea6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m\" (UID: \"b666c954-b4a7-46f1-ac05-eb1bfdb29ea6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m" Jul 15 21:20:25.590734 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:25.590643 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b666c954-b4a7-46f1-ac05-eb1bfdb29ea6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m\" (UID: \"b666c954-b4a7-46f1-ac05-eb1bfdb29ea6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m" Jul 15 21:20:25.590734 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:25.590690 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b666c954-b4a7-46f1-ac05-eb1bfdb29ea6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m\" (UID: \"b666c954-b4a7-46f1-ac05-eb1bfdb29ea6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m" Jul 15 21:20:25.691661 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:25.691625 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b666c954-b4a7-46f1-ac05-eb1bfdb29ea6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m\" (UID: \"b666c954-b4a7-46f1-ac05-eb1bfdb29ea6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m" Jul 15 21:20:25.691661 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:25.691665 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z42xg\" (UniqueName: \"kubernetes.io/projected/b666c954-b4a7-46f1-ac05-eb1bfdb29ea6-kube-api-access-z42xg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m\" (UID: \"b666c954-b4a7-46f1-ac05-eb1bfdb29ea6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m" Jul 15 21:20:25.691861 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:25.691803 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b666c954-b4a7-46f1-ac05-eb1bfdb29ea6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m\" (UID: \"b666c954-b4a7-46f1-ac05-eb1bfdb29ea6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m" Jul 15 21:20:25.691861 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:25.691854 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b666c954-b4a7-46f1-ac05-eb1bfdb29ea6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m\" (UID: \"b666c954-b4a7-46f1-ac05-eb1bfdb29ea6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m" Jul 15 21:20:25.691945 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:25.691930 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b666c954-b4a7-46f1-ac05-eb1bfdb29ea6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m\" (UID: \"b666c954-b4a7-46f1-ac05-eb1bfdb29ea6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m" Jul 15 21:20:25.692017 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:25.691993 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b666c954-b4a7-46f1-ac05-eb1bfdb29ea6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m\" (UID: \"b666c954-b4a7-46f1-ac05-eb1bfdb29ea6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m" Jul 15 21:20:25.692214 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:25.692189 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b666c954-b4a7-46f1-ac05-eb1bfdb29ea6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m\" (UID: \"b666c954-b4a7-46f1-ac05-eb1bfdb29ea6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m" Jul 15 21:20:25.692325 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:25.692230 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b666c954-b4a7-46f1-ac05-eb1bfdb29ea6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m\" (UID: \"b666c954-b4a7-46f1-ac05-eb1bfdb29ea6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m" Jul 15 21:20:25.692477 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:25.692455 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b666c954-b4a7-46f1-ac05-eb1bfdb29ea6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m\" (UID: \"b666c954-b4a7-46f1-ac05-eb1bfdb29ea6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m" Jul 15 21:20:25.693999 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:25.693980 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b666c954-b4a7-46f1-ac05-eb1bfdb29ea6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m\" (UID: \"b666c954-b4a7-46f1-ac05-eb1bfdb29ea6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m" Jul 15 21:20:25.694449 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:25.694430 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b666c954-b4a7-46f1-ac05-eb1bfdb29ea6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m\" (UID: \"b666c954-b4a7-46f1-ac05-eb1bfdb29ea6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m" Jul 15 21:20:25.699537 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:25.699518 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z42xg\" (UniqueName: \"kubernetes.io/projected/b666c954-b4a7-46f1-ac05-eb1bfdb29ea6-kube-api-access-z42xg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m\" (UID: \"b666c954-b4a7-46f1-ac05-eb1bfdb29ea6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m" Jul 15 21:20:25.843661 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:25.843624 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m" Jul 15 21:20:25.995100 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:25.995072 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m"] Jul 15 21:20:25.997623 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:20:25.997589 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb666c954_b4a7_46f1_ac05_eb1bfdb29ea6.slice/crio-3c68ad5e60d83a7c282903e8c369d03b9e09ec41ef97d0837f5ca452a705a54d WatchSource:0}: Error finding container 3c68ad5e60d83a7c282903e8c369d03b9e09ec41ef97d0837f5ca452a705a54d: Status 404 returned error can't find the container with id 3c68ad5e60d83a7c282903e8c369d03b9e09ec41ef97d0837f5ca452a705a54d Jul 15 21:20:26.123212 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:26.123122 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m" event={"ID":"b666c954-b4a7-46f1-ac05-eb1bfdb29ea6","Type":"ContainerStarted","Data":"3c68ad5e60d83a7c282903e8c369d03b9e09ec41ef97d0837f5ca452a705a54d"} Jul 15 21:20:28.138396 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:28.138357 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m" event={"ID":"b666c954-b4a7-46f1-ac05-eb1bfdb29ea6","Type":"ContainerStarted","Data":"fb858ff8fcd2184f27e944e372017a11abdd0ba38ac04006b26b0042483da605"} Jul 15 21:20:28.158520 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:28.158473 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m" podStartSLOduration=1.979913424 podStartE2EDuration="3.158456338s" totalImagesPullingTime="1.178542914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:20:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:20:28.156824843 +0000 UTC m=+650.051228919" watchObservedRunningTime="2026-07-15 21:20:28.158456338 +0000 UTC m=+650.052860403" Jul 15 21:20:35.844026 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:35.843979 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m" Jul 15 21:20:35.844657 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:35.844067 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m" Jul 15 21:20:35.856511 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:35.856484 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m" Jul 15 21:20:36.199063 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:20:36.198984 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m" Jul 15 21:21:04.708686 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:21:04.708648 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-bb8w5"] Jul 15 21:21:04.712308 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:21:04.712276 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb8w5" Jul 15 21:21:04.714663 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:21:04.714643 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 15 21:21:04.723139 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:21:04.723109 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-bb8w5"] Jul 15 21:21:04.877432 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:21:04.877388 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3b097db-ec9e-4d58-84c3-168bdbb96524-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bb8w5\" (UID: \"d3b097db-ec9e-4d58-84c3-168bdbb96524\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb8w5" Jul 15 21:21:04.877634 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:21:04.877444 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwk7m\" (UniqueName: \"kubernetes.io/projected/d3b097db-ec9e-4d58-84c3-168bdbb96524-kube-api-access-cwk7m\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bb8w5\" (UID: \"d3b097db-ec9e-4d58-84c3-168bdbb96524\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb8w5" Jul 15 21:21:04.877634 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:21:04.877510 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3b097db-ec9e-4d58-84c3-168bdbb96524-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bb8w5\" (UID: \"d3b097db-ec9e-4d58-84c3-168bdbb96524\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb8w5" Jul 15 21:21:04.877634 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:21:04.877577 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3b097db-ec9e-4d58-84c3-168bdbb96524-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bb8w5\" (UID: \"d3b097db-ec9e-4d58-84c3-168bdbb96524\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb8w5" Jul 15 21:21:04.877797 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:21:04.877635 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3b097db-ec9e-4d58-84c3-168bdbb96524-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bb8w5\" (UID: \"d3b097db-ec9e-4d58-84c3-168bdbb96524\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb8w5" Jul 15 21:21:04.877797 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:21:04.877664 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3b097db-ec9e-4d58-84c3-168bdbb96524-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bb8w5\" (UID: \"d3b097db-ec9e-4d58-84c3-168bdbb96524\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb8w5" Jul 15 21:21:04.979063 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:21:04.978958 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3b097db-ec9e-4d58-84c3-168bdbb96524-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bb8w5\" (UID: \"d3b097db-ec9e-4d58-84c3-168bdbb96524\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb8w5" Jul 15 21:21:04.979063 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:21:04.979010 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwk7m\" (UniqueName: \"kubernetes.io/projected/d3b097db-ec9e-4d58-84c3-168bdbb96524-kube-api-access-cwk7m\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bb8w5\" (UID: \"d3b097db-ec9e-4d58-84c3-168bdbb96524\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb8w5" Jul 15 21:21:04.979063 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:21:04.979048 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3b097db-ec9e-4d58-84c3-168bdbb96524-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bb8w5\" (UID: \"d3b097db-ec9e-4d58-84c3-168bdbb96524\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb8w5" Jul 15 21:21:04.979413 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:21:04.979091 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3b097db-ec9e-4d58-84c3-168bdbb96524-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bb8w5\" (UID: \"d3b097db-ec9e-4d58-84c3-168bdbb96524\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb8w5" Jul 15 21:21:04.979413 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:21:04.979131 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3b097db-ec9e-4d58-84c3-168bdbb96524-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bb8w5\" (UID: \"d3b097db-ec9e-4d58-84c3-168bdbb96524\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb8w5" Jul 15 21:21:04.979413 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:21:04.979160 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3b097db-ec9e-4d58-84c3-168bdbb96524-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bb8w5\" (UID: \"d3b097db-ec9e-4d58-84c3-168bdbb96524\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb8w5" Jul 15 21:21:04.979564 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:21:04.979489 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3b097db-ec9e-4d58-84c3-168bdbb96524-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bb8w5\" (UID: \"d3b097db-ec9e-4d58-84c3-168bdbb96524\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb8w5" Jul 15 21:21:04.979564 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:21:04.979546 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3b097db-ec9e-4d58-84c3-168bdbb96524-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bb8w5\" (UID: \"d3b097db-ec9e-4d58-84c3-168bdbb96524\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb8w5" Jul 15 21:21:04.979631 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:21:04.979618 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3b097db-ec9e-4d58-84c3-168bdbb96524-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bb8w5\" (UID: \"d3b097db-ec9e-4d58-84c3-168bdbb96524\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb8w5" Jul 15 21:21:04.981426 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:21:04.981404 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3b097db-ec9e-4d58-84c3-168bdbb96524-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bb8w5\" (UID: \"d3b097db-ec9e-4d58-84c3-168bdbb96524\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb8w5" Jul 15 21:21:04.981556 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:21:04.981537 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3b097db-ec9e-4d58-84c3-168bdbb96524-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bb8w5\" (UID: \"d3b097db-ec9e-4d58-84c3-168bdbb96524\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb8w5" Jul 15 21:21:04.988357 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:21:04.988332 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwk7m\" (UniqueName: \"kubernetes.io/projected/d3b097db-ec9e-4d58-84c3-168bdbb96524-kube-api-access-cwk7m\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bb8w5\" (UID: \"d3b097db-ec9e-4d58-84c3-168bdbb96524\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb8w5" Jul 15 21:21:05.026199 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:21:05.026163 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb8w5" Jul 15 21:21:05.171969 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:21:05.171943 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-bb8w5"] Jul 15 21:21:05.174025 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:21:05.173996 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3b097db_ec9e_4d58_84c3_168bdbb96524.slice/crio-b4eada09bcde3fbe423f5da3de51945cefa4517f2c659f0f2bd8eedbd39c4258 WatchSource:0}: Error finding container b4eada09bcde3fbe423f5da3de51945cefa4517f2c659f0f2bd8eedbd39c4258: Status 404 returned error can't find the container with id b4eada09bcde3fbe423f5da3de51945cefa4517f2c659f0f2bd8eedbd39c4258 Jul 15 21:21:05.371918 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:21:05.371889 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb8w5" event={"ID":"d3b097db-ec9e-4d58-84c3-168bdbb96524","Type":"ContainerStarted","Data":"b4eada09bcde3fbe423f5da3de51945cefa4517f2c659f0f2bd8eedbd39c4258"} Jul 15 21:21:06.380718 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:21:06.380672 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb8w5" event={"ID":"d3b097db-ec9e-4d58-84c3-168bdbb96524","Type":"ContainerStarted","Data":"1d6db0fee6c3175a2ba2e35fb68420128eccdbb0f7414897af9bd01c7fa3b04a"} Jul 15 21:21:06.404379 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:21:06.404310 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb8w5" podStartSLOduration=2.227824972 podStartE2EDuration="2.404281827s" totalImagesPullingTime="176.456855ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:21:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:21:06.401506797 +0000 UTC m=+688.295910888" watchObservedRunningTime="2026-07-15 21:21:06.404281827 +0000 UTC m=+688.298685934" Jul 15 21:21:15.027192 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:21:15.027160 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb8w5" Jul 15 21:21:15.027710 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:21:15.027332 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb8w5" Jul 15 21:21:15.040110 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:21:15.040085 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb8w5" Jul 15 21:21:15.454700 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:21:15.454671 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb8w5" Jul 15 21:22:07.850121 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:22:07.850089 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5bfd94b979-5lx6x"] Jul 15 21:22:07.854355 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:22:07.854333 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bfd94b979-5lx6x" Jul 15 21:22:07.861235 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:22:07.861212 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5bfd94b979-5lx6x"] Jul 15 21:22:08.008725 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:22:08.008681 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/40bca165-8520-427d-8da9-1a0bf7776819-tls-cert\") pod \"authorino-5bfd94b979-5lx6x\" (UID: \"40bca165-8520-427d-8da9-1a0bf7776819\") " pod="kuadrant-system/authorino-5bfd94b979-5lx6x" Jul 15 21:22:08.008890 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:22:08.008818 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zhwz\" (UniqueName: \"kubernetes.io/projected/40bca165-8520-427d-8da9-1a0bf7776819-kube-api-access-2zhwz\") pod \"authorino-5bfd94b979-5lx6x\" (UID: \"40bca165-8520-427d-8da9-1a0bf7776819\") " pod="kuadrant-system/authorino-5bfd94b979-5lx6x" Jul 15 21:22:08.109937 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:22:08.109844 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zhwz\" (UniqueName: \"kubernetes.io/projected/40bca165-8520-427d-8da9-1a0bf7776819-kube-api-access-2zhwz\") pod \"authorino-5bfd94b979-5lx6x\" (UID: \"40bca165-8520-427d-8da9-1a0bf7776819\") " pod="kuadrant-system/authorino-5bfd94b979-5lx6x" Jul 15 21:22:08.109937 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:22:08.109933 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/40bca165-8520-427d-8da9-1a0bf7776819-tls-cert\") pod \"authorino-5bfd94b979-5lx6x\" (UID: \"40bca165-8520-427d-8da9-1a0bf7776819\") " pod="kuadrant-system/authorino-5bfd94b979-5lx6x" Jul 15 21:22:08.112532 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:22:08.112502 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/40bca165-8520-427d-8da9-1a0bf7776819-tls-cert\") pod \"authorino-5bfd94b979-5lx6x\" (UID: \"40bca165-8520-427d-8da9-1a0bf7776819\") " pod="kuadrant-system/authorino-5bfd94b979-5lx6x" Jul 15 21:22:08.117539 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:22:08.117519 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zhwz\" (UniqueName: \"kubernetes.io/projected/40bca165-8520-427d-8da9-1a0bf7776819-kube-api-access-2zhwz\") pod \"authorino-5bfd94b979-5lx6x\" (UID: \"40bca165-8520-427d-8da9-1a0bf7776819\") " pod="kuadrant-system/authorino-5bfd94b979-5lx6x" Jul 15 21:22:08.165821 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:22:08.165782 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bfd94b979-5lx6x" Jul 15 21:22:08.304837 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:22:08.304812 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5bfd94b979-5lx6x"] Jul 15 21:22:08.305896 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:22:08.305874 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40bca165_8520_427d_8da9_1a0bf7776819.slice/crio-09b3a6556447640b14e459a52a74ae772896b8e8cefab4af63f4992f8f495e7d WatchSource:0}: Error finding container 09b3a6556447640b14e459a52a74ae772896b8e8cefab4af63f4992f8f495e7d: Status 404 returned error can't find the container with id 09b3a6556447640b14e459a52a74ae772896b8e8cefab4af63f4992f8f495e7d Jul 15 21:22:08.768411 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:22:08.768376 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bfd94b979-5lx6x" event={"ID":"40bca165-8520-427d-8da9-1a0bf7776819","Type":"ContainerStarted","Data":"09b3a6556447640b14e459a52a74ae772896b8e8cefab4af63f4992f8f495e7d"} Jul 15 21:22:09.776270 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:22:09.776229 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bfd94b979-5lx6x" event={"ID":"40bca165-8520-427d-8da9-1a0bf7776819","Type":"ContainerStarted","Data":"87cd162072eaefe1c8b3074d3807d0824e08d7795b2cb0d85f08a6ae8ef6aaeb"} Jul 15 21:22:09.808957 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:22:09.807691 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5bfd94b979-5lx6x" podStartSLOduration=2.416216042 podStartE2EDuration="2.807666938s" totalImagesPullingTime="391.450896ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:22:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:22:09.806812083 +0000 UTC m=+751.701216148" watchObservedRunningTime="2026-07-15 21:22:09.807666938 +0000 UTC m=+751.702071005" Jul 15 21:22:09.847020 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:22:09.845785 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-569dcfc4b6-zv95k"] Jul 15 21:22:09.847020 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:22:09.846650 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-569dcfc4b6-zv95k" podUID="bf5d08c9-5591-438f-938a-5d718e0fc529" containerName="authorino" containerID="cri-o://b4693d2ef237336c4578db7d2f2feee588dab23a6a8e34c42b3e839211bfb749" gracePeriod=30 Jul 15 21:22:10.124653 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:22:10.124626 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-569dcfc4b6-zv95k" Jul 15 21:22:10.235619 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:22:10.235573 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48spr\" (UniqueName: \"kubernetes.io/projected/bf5d08c9-5591-438f-938a-5d718e0fc529-kube-api-access-48spr\") pod \"bf5d08c9-5591-438f-938a-5d718e0fc529\" (UID: \"bf5d08c9-5591-438f-938a-5d718e0fc529\") " Jul 15 21:22:10.235619 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:22:10.235619 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf5d08c9-5591-438f-938a-5d718e0fc529-tls-cert\") pod \"bf5d08c9-5591-438f-938a-5d718e0fc529\" (UID: \"bf5d08c9-5591-438f-938a-5d718e0fc529\") " Jul 15 21:22:10.237749 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:22:10.237707 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf5d08c9-5591-438f-938a-5d718e0fc529-kube-api-access-48spr" (OuterVolumeSpecName: "kube-api-access-48spr") pod "bf5d08c9-5591-438f-938a-5d718e0fc529" (UID: "bf5d08c9-5591-438f-938a-5d718e0fc529"). InnerVolumeSpecName "kube-api-access-48spr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:22:10.247711 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:22:10.247681 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf5d08c9-5591-438f-938a-5d718e0fc529-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "bf5d08c9-5591-438f-938a-5d718e0fc529" (UID: "bf5d08c9-5591-438f-938a-5d718e0fc529"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:22:10.337386 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:22:10.337355 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48spr\" (UniqueName: \"kubernetes.io/projected/bf5d08c9-5591-438f-938a-5d718e0fc529-kube-api-access-48spr\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:22:10.337386 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:22:10.337387 2570 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf5d08c9-5591-438f-938a-5d718e0fc529-tls-cert\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:22:10.784816 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:22:10.784779 2570 generic.go:356] "Generic (PLEG): container finished" podID="bf5d08c9-5591-438f-938a-5d718e0fc529" containerID="b4693d2ef237336c4578db7d2f2feee588dab23a6a8e34c42b3e839211bfb749" exitCode=0 Jul 15 21:22:10.784816 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:22:10.784817 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-569dcfc4b6-zv95k" Jul 15 21:22:10.785311 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:22:10.784853 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-569dcfc4b6-zv95k" event={"ID":"bf5d08c9-5591-438f-938a-5d718e0fc529","Type":"ContainerDied","Data":"b4693d2ef237336c4578db7d2f2feee588dab23a6a8e34c42b3e839211bfb749"} Jul 15 21:22:10.785311 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:22:10.784895 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-569dcfc4b6-zv95k" event={"ID":"bf5d08c9-5591-438f-938a-5d718e0fc529","Type":"ContainerDied","Data":"87c2c4b0d7bac843e6586dbd34835c3ca2241f120ca2ffba47e349fafe4b064c"} Jul 15 21:22:10.785311 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:22:10.784920 2570 scope.go:117] "RemoveContainer" containerID="b4693d2ef237336c4578db7d2f2feee588dab23a6a8e34c42b3e839211bfb749" Jul 15 21:22:10.794701 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:22:10.794679 2570 scope.go:117] "RemoveContainer" containerID="b4693d2ef237336c4578db7d2f2feee588dab23a6a8e34c42b3e839211bfb749" Jul 15 21:22:10.794999 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:22:10.794975 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4693d2ef237336c4578db7d2f2feee588dab23a6a8e34c42b3e839211bfb749\": container with ID starting with b4693d2ef237336c4578db7d2f2feee588dab23a6a8e34c42b3e839211bfb749 not found: ID does not exist" containerID="b4693d2ef237336c4578db7d2f2feee588dab23a6a8e34c42b3e839211bfb749" Jul 15 21:22:10.795107 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:22:10.795005 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4693d2ef237336c4578db7d2f2feee588dab23a6a8e34c42b3e839211bfb749"} err="failed to get container status \"b4693d2ef237336c4578db7d2f2feee588dab23a6a8e34c42b3e839211bfb749\": rpc error: code = NotFound desc = could not find container \"b4693d2ef237336c4578db7d2f2feee588dab23a6a8e34c42b3e839211bfb749\": container with ID starting with b4693d2ef237336c4578db7d2f2feee588dab23a6a8e34c42b3e839211bfb749 not found: ID does not exist" Jul 15 21:22:10.801668 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:22:10.801641 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-569dcfc4b6-zv95k"] Jul 15 21:22:10.804306 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:22:10.804273 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-569dcfc4b6-zv95k"] Jul 15 21:22:12.589947 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:22:12.589916 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf5d08c9-5591-438f-938a-5d718e0fc529" path="/var/lib/kubelet/pods/bf5d08c9-5591-438f-938a-5d718e0fc529/volumes" Jul 15 21:23:25.901346 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:25.901233 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d79b5d84b-5tr2b"] Jul 15 21:23:25.902033 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:25.901495 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-d79b5d84b-5tr2b" podUID="115cbe88-939c-4693-bbc6-7e3f408da542" containerName="manager" containerID="cri-o://ceb2ce7dc03d832896a527c2a8443f05168a0a05d0ee3f12ac1134310e75fd34" gracePeriod=30 Jul 15 21:23:26.157684 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:26.157624 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d79b5d84b-5tr2b" Jul 15 21:23:26.254805 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:26.254771 2570 generic.go:356] "Generic (PLEG): container finished" podID="115cbe88-939c-4693-bbc6-7e3f408da542" containerID="ceb2ce7dc03d832896a527c2a8443f05168a0a05d0ee3f12ac1134310e75fd34" exitCode=0 Jul 15 21:23:26.254990 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:26.254816 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d79b5d84b-5tr2b" Jul 15 21:23:26.254990 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:26.254863 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d79b5d84b-5tr2b" event={"ID":"115cbe88-939c-4693-bbc6-7e3f408da542","Type":"ContainerDied","Data":"ceb2ce7dc03d832896a527c2a8443f05168a0a05d0ee3f12ac1134310e75fd34"} Jul 15 21:23:26.254990 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:26.254922 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d79b5d84b-5tr2b" event={"ID":"115cbe88-939c-4693-bbc6-7e3f408da542","Type":"ContainerDied","Data":"c6aa2b4dec62ca65517422dc4b143cf833e7c95478f0c2d7e46ce7dc03da18a9"} Jul 15 21:23:26.254990 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:26.254951 2570 scope.go:117] "RemoveContainer" containerID="ceb2ce7dc03d832896a527c2a8443f05168a0a05d0ee3f12ac1134310e75fd34" Jul 15 21:23:26.266784 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:26.266766 2570 scope.go:117] "RemoveContainer" containerID="ceb2ce7dc03d832896a527c2a8443f05168a0a05d0ee3f12ac1134310e75fd34" Jul 15 21:23:26.267340 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:23:26.267319 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ceb2ce7dc03d832896a527c2a8443f05168a0a05d0ee3f12ac1134310e75fd34\": container with ID starting with ceb2ce7dc03d832896a527c2a8443f05168a0a05d0ee3f12ac1134310e75fd34 not found: ID does not exist" containerID="ceb2ce7dc03d832896a527c2a8443f05168a0a05d0ee3f12ac1134310e75fd34" Jul 15 21:23:26.267433 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:26.267351 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ceb2ce7dc03d832896a527c2a8443f05168a0a05d0ee3f12ac1134310e75fd34"} err="failed to get container status \"ceb2ce7dc03d832896a527c2a8443f05168a0a05d0ee3f12ac1134310e75fd34\": rpc error: code = NotFound desc = could not find container \"ceb2ce7dc03d832896a527c2a8443f05168a0a05d0ee3f12ac1134310e75fd34\": container with ID starting with ceb2ce7dc03d832896a527c2a8443f05168a0a05d0ee3f12ac1134310e75fd34 not found: ID does not exist" Jul 15 21:23:26.274629 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:26.274613 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-624hs\" (UniqueName: \"kubernetes.io/projected/115cbe88-939c-4693-bbc6-7e3f408da542-kube-api-access-624hs\") pod \"115cbe88-939c-4693-bbc6-7e3f408da542\" (UID: \"115cbe88-939c-4693-bbc6-7e3f408da542\") " Jul 15 21:23:26.274724 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:26.274712 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/115cbe88-939c-4693-bbc6-7e3f408da542-webhook-cert\") pod \"115cbe88-939c-4693-bbc6-7e3f408da542\" (UID: \"115cbe88-939c-4693-bbc6-7e3f408da542\") " Jul 15 21:23:26.276609 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:26.276574 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/115cbe88-939c-4693-bbc6-7e3f408da542-kube-api-access-624hs" (OuterVolumeSpecName: "kube-api-access-624hs") pod "115cbe88-939c-4693-bbc6-7e3f408da542" (UID: "115cbe88-939c-4693-bbc6-7e3f408da542"). InnerVolumeSpecName "kube-api-access-624hs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:23:26.276690 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:26.276609 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/115cbe88-939c-4693-bbc6-7e3f408da542-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "115cbe88-939c-4693-bbc6-7e3f408da542" (UID: "115cbe88-939c-4693-bbc6-7e3f408da542"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:23:26.376368 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:26.376333 2570 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/115cbe88-939c-4693-bbc6-7e3f408da542-webhook-cert\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:23:26.376368 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:26.376366 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-624hs\" (UniqueName: \"kubernetes.io/projected/115cbe88-939c-4693-bbc6-7e3f408da542-kube-api-access-624hs\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:23:26.578213 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:26.578185 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d79b5d84b-5tr2b"] Jul 15 21:23:26.582214 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:26.582190 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-d79b5d84b-5tr2b"] Jul 15 21:23:26.590560 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:26.590533 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="115cbe88-939c-4693-bbc6-7e3f408da542" path="/var/lib/kubelet/pods/115cbe88-939c-4693-bbc6-7e3f408da542/volumes" Jul 15 21:23:27.429949 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:27.429911 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-d79b5d84b-h7tmp"] Jul 15 21:23:27.430671 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:27.430653 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="115cbe88-939c-4693-bbc6-7e3f408da542" containerName="manager" Jul 15 21:23:27.430727 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:27.430673 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="115cbe88-939c-4693-bbc6-7e3f408da542" containerName="manager" Jul 15 21:23:27.430727 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:27.430689 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf5d08c9-5591-438f-938a-5d718e0fc529" containerName="authorino" Jul 15 21:23:27.430727 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:27.430695 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf5d08c9-5591-438f-938a-5d718e0fc529" containerName="authorino" Jul 15 21:23:27.430819 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:27.430770 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf5d08c9-5591-438f-938a-5d718e0fc529" containerName="authorino" Jul 15 21:23:27.430819 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:27.430781 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="115cbe88-939c-4693-bbc6-7e3f408da542" containerName="manager" Jul 15 21:23:27.435541 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:27.435524 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d79b5d84b-h7tmp" Jul 15 21:23:27.438551 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:27.438120 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 15 21:23:27.438551 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:27.438309 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-x9gdt\"" Jul 15 21:23:27.438551 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:27.438371 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 15 21:23:27.441757 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:27.441731 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d79b5d84b-h7tmp"] Jul 15 21:23:27.486511 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:27.486477 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/68aedec3-4453-455c-985a-5ad03f8fca5f-webhook-cert\") pod \"maas-controller-d79b5d84b-h7tmp\" (UID: \"68aedec3-4453-455c-985a-5ad03f8fca5f\") " pod="opendatahub/maas-controller-d79b5d84b-h7tmp" Jul 15 21:23:27.486687 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:27.486531 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbp7n\" (UniqueName: \"kubernetes.io/projected/68aedec3-4453-455c-985a-5ad03f8fca5f-kube-api-access-pbp7n\") pod \"maas-controller-d79b5d84b-h7tmp\" (UID: \"68aedec3-4453-455c-985a-5ad03f8fca5f\") " pod="opendatahub/maas-controller-d79b5d84b-h7tmp" Jul 15 21:23:27.588354 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:27.588320 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/68aedec3-4453-455c-985a-5ad03f8fca5f-webhook-cert\") pod \"maas-controller-d79b5d84b-h7tmp\" (UID: \"68aedec3-4453-455c-985a-5ad03f8fca5f\") " pod="opendatahub/maas-controller-d79b5d84b-h7tmp" Jul 15 21:23:27.588527 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:27.588369 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbp7n\" (UniqueName: \"kubernetes.io/projected/68aedec3-4453-455c-985a-5ad03f8fca5f-kube-api-access-pbp7n\") pod \"maas-controller-d79b5d84b-h7tmp\" (UID: \"68aedec3-4453-455c-985a-5ad03f8fca5f\") " pod="opendatahub/maas-controller-d79b5d84b-h7tmp" Jul 15 21:23:27.590740 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:27.590719 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/68aedec3-4453-455c-985a-5ad03f8fca5f-webhook-cert\") pod \"maas-controller-d79b5d84b-h7tmp\" (UID: \"68aedec3-4453-455c-985a-5ad03f8fca5f\") " pod="opendatahub/maas-controller-d79b5d84b-h7tmp" Jul 15 21:23:27.597979 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:27.597952 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbp7n\" (UniqueName: \"kubernetes.io/projected/68aedec3-4453-455c-985a-5ad03f8fca5f-kube-api-access-pbp7n\") pod \"maas-controller-d79b5d84b-h7tmp\" (UID: \"68aedec3-4453-455c-985a-5ad03f8fca5f\") " pod="opendatahub/maas-controller-d79b5d84b-h7tmp" Jul 15 21:23:27.746920 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:27.746734 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d79b5d84b-h7tmp" Jul 15 21:23:27.901133 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:27.901110 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d79b5d84b-h7tmp"] Jul 15 21:23:27.903490 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:23:27.903465 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68aedec3_4453_455c_985a_5ad03f8fca5f.slice/crio-eec4ec31ca23e49dc4dc7eba338ed40096a7fd4a582d9a91dd0e25932c828679 WatchSource:0}: Error finding container eec4ec31ca23e49dc4dc7eba338ed40096a7fd4a582d9a91dd0e25932c828679: Status 404 returned error can't find the container with id eec4ec31ca23e49dc4dc7eba338ed40096a7fd4a582d9a91dd0e25932c828679 Jul 15 21:23:28.271417 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:28.271386 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d79b5d84b-h7tmp" event={"ID":"68aedec3-4453-455c-985a-5ad03f8fca5f","Type":"ContainerStarted","Data":"eec4ec31ca23e49dc4dc7eba338ed40096a7fd4a582d9a91dd0e25932c828679"} Jul 15 21:23:29.279728 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:29.279693 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d79b5d84b-h7tmp" event={"ID":"68aedec3-4453-455c-985a-5ad03f8fca5f","Type":"ContainerStarted","Data":"60fb6eef9d5d7c01daea679991d7f9632d4ba1c9ea4269d932e200473eb47dfe"} Jul 15 21:23:29.280140 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:29.279823 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-d79b5d84b-h7tmp" Jul 15 21:23:29.298417 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:29.298324 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-d79b5d84b-h7tmp" podStartSLOduration=1.843147911 podStartE2EDuration="2.298307041s" totalImagesPullingTime="455.15913ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:23:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:23:29.297126417 +0000 UTC m=+831.191530493" watchObservedRunningTime="2026-07-15 21:23:29.298307041 +0000 UTC m=+831.192711097" Jul 15 21:23:40.288465 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:23:40.288431 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-d79b5d84b-h7tmp" Jul 15 21:24:38.545091 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:24:38.545059 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c5zg9_50d11f79-1eac-4ad4-8151-9b5dd54cd284/console-operator/1.log" Jul 15 21:24:38.546609 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:24:38.546585 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c5zg9_50d11f79-1eac-4ad4-8151-9b5dd54cd284/console-operator/1.log" Jul 15 21:24:38.553983 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:24:38.553904 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nhzkw_beb5b136-86fb-4e57-9b27-3fc1079a9af3/ovn-acl-logging/0.log" Jul 15 21:24:38.555903 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:24:38.555883 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nhzkw_beb5b136-86fb-4e57-9b27-3fc1079a9af3/ovn-acl-logging/0.log" Jul 15 21:29:38.589171 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:29:38.589144 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c5zg9_50d11f79-1eac-4ad4-8151-9b5dd54cd284/console-operator/1.log" Jul 15 21:29:38.595048 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:29:38.595024 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c5zg9_50d11f79-1eac-4ad4-8151-9b5dd54cd284/console-operator/1.log" Jul 15 21:29:38.596817 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:29:38.596796 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nhzkw_beb5b136-86fb-4e57-9b27-3fc1079a9af3/ovn-acl-logging/0.log" Jul 15 21:29:38.602679 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:29:38.602660 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nhzkw_beb5b136-86fb-4e57-9b27-3fc1079a9af3/ovn-acl-logging/0.log" Jul 15 21:34:38.638823 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:34:38.638799 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c5zg9_50d11f79-1eac-4ad4-8151-9b5dd54cd284/console-operator/1.log" Jul 15 21:34:38.645930 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:34:38.645907 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nhzkw_beb5b136-86fb-4e57-9b27-3fc1079a9af3/ovn-acl-logging/0.log" Jul 15 21:34:38.646577 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:34:38.646558 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c5zg9_50d11f79-1eac-4ad4-8151-9b5dd54cd284/console-operator/1.log" Jul 15 21:34:38.653221 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:34:38.653198 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nhzkw_beb5b136-86fb-4e57-9b27-3fc1079a9af3/ovn-acl-logging/0.log" Jul 15 21:35:36.216272 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:36.216178 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj"] Jul 15 21:35:36.220935 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:36.220909 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj" Jul 15 21:35:36.231019 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:36.230529 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-d8b57005-openshift-default-dockercfg-46rx6\"" Jul 15 21:35:36.266705 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:36.266670 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj"] Jul 15 21:35:36.341186 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:36.341134 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/548c6db6-880d-4655-851d-12557f1b4190-istiod-ca-cert\") pod \"e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj\" (UID: \"548c6db6-880d-4655-851d-12557f1b4190\") " pod="openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj" Jul 15 21:35:36.341447 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:36.341275 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjkdh\" (UniqueName: \"kubernetes.io/projected/548c6db6-880d-4655-851d-12557f1b4190-kube-api-access-pjkdh\") pod \"e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj\" (UID: \"548c6db6-880d-4655-851d-12557f1b4190\") " pod="openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj" Jul 15 21:35:36.341447 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:36.341370 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/548c6db6-880d-4655-851d-12557f1b4190-credential-socket\") pod \"e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj\" (UID: \"548c6db6-880d-4655-851d-12557f1b4190\") " pod="openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj" Jul 15 21:35:36.341447 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:36.341398 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/548c6db6-880d-4655-851d-12557f1b4190-workload-socket\") pod \"e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj\" (UID: \"548c6db6-880d-4655-851d-12557f1b4190\") " pod="openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj" Jul 15 21:35:36.341447 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:36.341444 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/548c6db6-880d-4655-851d-12557f1b4190-istio-envoy\") pod \"e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj\" (UID: \"548c6db6-880d-4655-851d-12557f1b4190\") " pod="openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj" Jul 15 21:35:36.341684 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:36.341465 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/548c6db6-880d-4655-851d-12557f1b4190-istio-data\") pod \"e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj\" (UID: \"548c6db6-880d-4655-851d-12557f1b4190\") " pod="openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj" Jul 15 21:35:36.341684 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:36.341532 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/548c6db6-880d-4655-851d-12557f1b4190-workload-certs\") pod \"e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj\" (UID: \"548c6db6-880d-4655-851d-12557f1b4190\") " pod="openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj" Jul 15 21:35:36.341684 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:36.341557 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/548c6db6-880d-4655-851d-12557f1b4190-istio-podinfo\") pod \"e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj\" (UID: \"548c6db6-880d-4655-851d-12557f1b4190\") " pod="openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj" Jul 15 21:35:36.341684 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:36.341612 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/548c6db6-880d-4655-851d-12557f1b4190-istio-token\") pod \"e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj\" (UID: \"548c6db6-880d-4655-851d-12557f1b4190\") " pod="openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj" Jul 15 21:35:36.442829 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:36.442781 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/548c6db6-880d-4655-851d-12557f1b4190-istio-token\") pod \"e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj\" (UID: \"548c6db6-880d-4655-851d-12557f1b4190\") " pod="openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj" Jul 15 21:35:36.442829 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:36.442861 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/548c6db6-880d-4655-851d-12557f1b4190-istiod-ca-cert\") pod \"e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj\" (UID: \"548c6db6-880d-4655-851d-12557f1b4190\") " pod="openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj" Jul 15 21:35:36.443252 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:36.442937 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjkdh\" (UniqueName: \"kubernetes.io/projected/548c6db6-880d-4655-851d-12557f1b4190-kube-api-access-pjkdh\") pod \"e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj\" (UID: \"548c6db6-880d-4655-851d-12557f1b4190\") " pod="openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj" Jul 15 21:35:36.443252 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:36.443073 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/548c6db6-880d-4655-851d-12557f1b4190-credential-socket\") pod \"e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj\" (UID: \"548c6db6-880d-4655-851d-12557f1b4190\") " pod="openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj" Jul 15 21:35:36.443252 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:36.443118 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/548c6db6-880d-4655-851d-12557f1b4190-workload-socket\") pod \"e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj\" (UID: \"548c6db6-880d-4655-851d-12557f1b4190\") " pod="openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj" Jul 15 21:35:36.443252 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:36.443182 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/548c6db6-880d-4655-851d-12557f1b4190-istio-envoy\") pod \"e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj\" (UID: \"548c6db6-880d-4655-851d-12557f1b4190\") " pod="openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj" Jul 15 21:35:36.443252 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:36.443206 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/548c6db6-880d-4655-851d-12557f1b4190-istio-data\") pod \"e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj\" (UID: \"548c6db6-880d-4655-851d-12557f1b4190\") " pod="openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj" Jul 15 21:35:36.443558 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:36.443353 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/548c6db6-880d-4655-851d-12557f1b4190-workload-certs\") pod \"e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj\" (UID: \"548c6db6-880d-4655-851d-12557f1b4190\") " pod="openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj" Jul 15 21:35:36.443558 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:36.443420 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/548c6db6-880d-4655-851d-12557f1b4190-istio-podinfo\") pod \"e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj\" (UID: \"548c6db6-880d-4655-851d-12557f1b4190\") " pod="openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj" Jul 15 21:35:36.443668 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:36.443572 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/548c6db6-880d-4655-851d-12557f1b4190-workload-socket\") pod \"e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj\" (UID: \"548c6db6-880d-4655-851d-12557f1b4190\") " pod="openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj" Jul 15 21:35:36.443729 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:36.443675 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/548c6db6-880d-4655-851d-12557f1b4190-istio-data\") pod \"e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj\" (UID: \"548c6db6-880d-4655-851d-12557f1b4190\") " pod="openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj" Jul 15 21:35:36.443840 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:36.443817 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/548c6db6-880d-4655-851d-12557f1b4190-credential-socket\") pod \"e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj\" (UID: \"548c6db6-880d-4655-851d-12557f1b4190\") " pod="openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj" Jul 15 21:35:36.443907 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:36.443819 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/548c6db6-880d-4655-851d-12557f1b4190-istiod-ca-cert\") pod \"e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj\" (UID: \"548c6db6-880d-4655-851d-12557f1b4190\") " pod="openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj" Jul 15 21:35:36.443965 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:36.443912 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/548c6db6-880d-4655-851d-12557f1b4190-workload-certs\") pod \"e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj\" (UID: \"548c6db6-880d-4655-851d-12557f1b4190\") " pod="openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj" Jul 15 21:35:36.446059 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:36.446037 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/548c6db6-880d-4655-851d-12557f1b4190-istio-envoy\") pod \"e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj\" (UID: \"548c6db6-880d-4655-851d-12557f1b4190\") " pod="openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj" Jul 15 21:35:36.446278 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:36.446255 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/548c6db6-880d-4655-851d-12557f1b4190-istio-podinfo\") pod \"e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj\" (UID: \"548c6db6-880d-4655-851d-12557f1b4190\") " pod="openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj" Jul 15 21:35:36.454822 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:36.454793 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/548c6db6-880d-4655-851d-12557f1b4190-istio-token\") pod \"e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj\" (UID: \"548c6db6-880d-4655-851d-12557f1b4190\") " pod="openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj" Jul 15 21:35:36.466576 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:36.466498 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjkdh\" (UniqueName: \"kubernetes.io/projected/548c6db6-880d-4655-851d-12557f1b4190-kube-api-access-pjkdh\") pod \"e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj\" (UID: \"548c6db6-880d-4655-851d-12557f1b4190\") " pod="openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj" Jul 15 21:35:36.534465 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:36.534423 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj" Jul 15 21:35:36.728185 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:36.728159 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj"] Jul 15 21:35:36.730787 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:35:36.730756 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod548c6db6_880d_4655_851d_12557f1b4190.slice/crio-5936ac4c40ca3971058ec2f10f07826c37c82d378a5e1fea4cc7ae10e320439d WatchSource:0}: Error finding container 5936ac4c40ca3971058ec2f10f07826c37c82d378a5e1fea4cc7ae10e320439d: Status 404 returned error can't find the container with id 5936ac4c40ca3971058ec2f10f07826c37c82d378a5e1fea4cc7ae10e320439d Jul 15 21:35:36.733035 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:36.733003 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 21:35:36.733094 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:36.733072 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 21:35:36.733170 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:36.733106 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 21:35:36.744745 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:36.744714 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj" event={"ID":"548c6db6-880d-4655-851d-12557f1b4190","Type":"ContainerStarted","Data":"5936ac4c40ca3971058ec2f10f07826c37c82d378a5e1fea4cc7ae10e320439d"} Jul 15 21:35:37.753268 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:37.753226 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj" event={"ID":"548c6db6-880d-4655-851d-12557f1b4190","Type":"ContainerStarted","Data":"bcde6028b35351f1b3d827f12e1c9e42a298b5a69613b2c098f76d910cb11762"} Jul 15 21:35:37.783359 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:37.783271 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj" podStartSLOduration=1.783253872 podStartE2EDuration="1.783253872s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:35:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:35:37.780816565 +0000 UTC m=+1559.675220652" watchObservedRunningTime="2026-07-15 21:35:37.783253872 +0000 UTC m=+1559.677657936" Jul 15 21:35:38.534951 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:38.534916 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj" Jul 15 21:35:38.540550 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:38.540523 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj" Jul 15 21:35:38.769198 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:38.769156 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj" Jul 15 21:35:38.770396 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:38.770377 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj" Jul 15 21:35:42.629131 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:42.629096 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj"] Jul 15 21:35:42.629693 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:42.629307 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj" podUID="548c6db6-880d-4655-851d-12557f1b4190" containerName="istio-proxy" containerID="cri-o://bcde6028b35351f1b3d827f12e1c9e42a298b5a69613b2c098f76d910cb11762" gracePeriod=30 Jul 15 21:35:48.499091 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:48.499061 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj" Jul 15 21:35:48.568349 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:48.568313 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pjkdh\" (UniqueName: \"kubernetes.io/projected/548c6db6-880d-4655-851d-12557f1b4190-kube-api-access-pjkdh\") pod \"548c6db6-880d-4655-851d-12557f1b4190\" (UID: \"548c6db6-880d-4655-851d-12557f1b4190\") " Jul 15 21:35:48.568529 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:48.568380 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/548c6db6-880d-4655-851d-12557f1b4190-workload-socket\") pod \"548c6db6-880d-4655-851d-12557f1b4190\" (UID: \"548c6db6-880d-4655-851d-12557f1b4190\") " Jul 15 21:35:48.568529 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:48.568405 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/548c6db6-880d-4655-851d-12557f1b4190-istio-podinfo\") pod \"548c6db6-880d-4655-851d-12557f1b4190\" (UID: \"548c6db6-880d-4655-851d-12557f1b4190\") " Jul 15 21:35:48.568529 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:48.568440 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/548c6db6-880d-4655-851d-12557f1b4190-istio-data\") pod \"548c6db6-880d-4655-851d-12557f1b4190\" (UID: \"548c6db6-880d-4655-851d-12557f1b4190\") " Jul 15 21:35:48.568529 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:48.568481 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/548c6db6-880d-4655-851d-12557f1b4190-credential-socket\") pod \"548c6db6-880d-4655-851d-12557f1b4190\" (UID: \"548c6db6-880d-4655-851d-12557f1b4190\") " Jul 15 21:35:48.568751 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:48.568542 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/548c6db6-880d-4655-851d-12557f1b4190-istiod-ca-cert\") pod \"548c6db6-880d-4655-851d-12557f1b4190\" (UID: \"548c6db6-880d-4655-851d-12557f1b4190\") " Jul 15 21:35:48.568751 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:48.568616 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/548c6db6-880d-4655-851d-12557f1b4190-workload-certs\") pod \"548c6db6-880d-4655-851d-12557f1b4190\" (UID: \"548c6db6-880d-4655-851d-12557f1b4190\") " Jul 15 21:35:48.568751 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:48.568648 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/548c6db6-880d-4655-851d-12557f1b4190-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "548c6db6-880d-4655-851d-12557f1b4190" (UID: "548c6db6-880d-4655-851d-12557f1b4190"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:35:48.568751 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:48.568669 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/548c6db6-880d-4655-851d-12557f1b4190-istio-token\") pod \"548c6db6-880d-4655-851d-12557f1b4190\" (UID: \"548c6db6-880d-4655-851d-12557f1b4190\") " Jul 15 21:35:48.568751 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:48.568696 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/548c6db6-880d-4655-851d-12557f1b4190-istio-envoy\") pod \"548c6db6-880d-4655-851d-12557f1b4190\" (UID: \"548c6db6-880d-4655-851d-12557f1b4190\") " Jul 15 21:35:48.569003 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:48.568829 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/548c6db6-880d-4655-851d-12557f1b4190-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "548c6db6-880d-4655-851d-12557f1b4190" (UID: "548c6db6-880d-4655-851d-12557f1b4190"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:35:48.569003 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:48.568866 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/548c6db6-880d-4655-851d-12557f1b4190-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "548c6db6-880d-4655-851d-12557f1b4190" (UID: "548c6db6-880d-4655-851d-12557f1b4190"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:35:48.569003 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:48.568977 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/548c6db6-880d-4655-851d-12557f1b4190-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "548c6db6-880d-4655-851d-12557f1b4190" (UID: "548c6db6-880d-4655-851d-12557f1b4190"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:35:48.569158 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:48.569129 2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/548c6db6-880d-4655-851d-12557f1b4190-workload-socket\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:35:48.569212 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:48.569158 2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/548c6db6-880d-4655-851d-12557f1b4190-credential-socket\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:35:48.569212 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:48.569175 2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/548c6db6-880d-4655-851d-12557f1b4190-istiod-ca-cert\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:35:48.569212 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:48.569191 2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/548c6db6-880d-4655-851d-12557f1b4190-workload-certs\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:35:48.569462 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:48.569441 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/548c6db6-880d-4655-851d-12557f1b4190-istio-data" (OuterVolumeSpecName: "istio-data") pod "548c6db6-880d-4655-851d-12557f1b4190" (UID: "548c6db6-880d-4655-851d-12557f1b4190"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:35:48.570803 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:48.570779 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/548c6db6-880d-4655-851d-12557f1b4190-istio-token" (OuterVolumeSpecName: "istio-token") pod "548c6db6-880d-4655-851d-12557f1b4190" (UID: "548c6db6-880d-4655-851d-12557f1b4190"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:35:48.570920 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:48.570859 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/548c6db6-880d-4655-851d-12557f1b4190-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "548c6db6-880d-4655-851d-12557f1b4190" (UID: "548c6db6-880d-4655-851d-12557f1b4190"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 21:35:48.571096 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:48.571073 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/548c6db6-880d-4655-851d-12557f1b4190-kube-api-access-pjkdh" (OuterVolumeSpecName: "kube-api-access-pjkdh") pod "548c6db6-880d-4655-851d-12557f1b4190" (UID: "548c6db6-880d-4655-851d-12557f1b4190"). InnerVolumeSpecName "kube-api-access-pjkdh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:35:48.571096 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:48.571072 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/548c6db6-880d-4655-851d-12557f1b4190-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "548c6db6-880d-4655-851d-12557f1b4190" (UID: "548c6db6-880d-4655-851d-12557f1b4190"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:35:48.670690 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:48.670645 2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/548c6db6-880d-4655-851d-12557f1b4190-istio-token\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:35:48.670690 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:48.670683 2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/548c6db6-880d-4655-851d-12557f1b4190-istio-envoy\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:35:48.670690 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:48.670698 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pjkdh\" (UniqueName: \"kubernetes.io/projected/548c6db6-880d-4655-851d-12557f1b4190-kube-api-access-pjkdh\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:35:48.670983 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:48.670715 2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/548c6db6-880d-4655-851d-12557f1b4190-istio-podinfo\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:35:48.670983 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:48.670728 2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/548c6db6-880d-4655-851d-12557f1b4190-istio-data\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:35:48.839715 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:48.839676 2570 generic.go:356] "Generic (PLEG): container finished" podID="548c6db6-880d-4655-851d-12557f1b4190" containerID="bcde6028b35351f1b3d827f12e1c9e42a298b5a69613b2c098f76d910cb11762" exitCode=0 Jul 15 21:35:48.839882 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:48.839738 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj" Jul 15 21:35:48.839882 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:48.839766 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj" event={"ID":"548c6db6-880d-4655-851d-12557f1b4190","Type":"ContainerDied","Data":"bcde6028b35351f1b3d827f12e1c9e42a298b5a69613b2c098f76d910cb11762"} Jul 15 21:35:48.839882 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:48.839828 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj" event={"ID":"548c6db6-880d-4655-851d-12557f1b4190","Type":"ContainerDied","Data":"5936ac4c40ca3971058ec2f10f07826c37c82d378a5e1fea4cc7ae10e320439d"} Jul 15 21:35:48.839882 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:48.839857 2570 scope.go:117] "RemoveContainer" containerID="bcde6028b35351f1b3d827f12e1c9e42a298b5a69613b2c098f76d910cb11762" Jul 15 21:35:48.849696 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:48.849679 2570 scope.go:117] "RemoveContainer" containerID="bcde6028b35351f1b3d827f12e1c9e42a298b5a69613b2c098f76d910cb11762" Jul 15 21:35:48.849967 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:35:48.849945 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcde6028b35351f1b3d827f12e1c9e42a298b5a69613b2c098f76d910cb11762\": container with ID starting with bcde6028b35351f1b3d827f12e1c9e42a298b5a69613b2c098f76d910cb11762 not found: ID does not exist" containerID="bcde6028b35351f1b3d827f12e1c9e42a298b5a69613b2c098f76d910cb11762" Jul 15 21:35:48.850012 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:48.849976 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcde6028b35351f1b3d827f12e1c9e42a298b5a69613b2c098f76d910cb11762"} err="failed to get container status \"bcde6028b35351f1b3d827f12e1c9e42a298b5a69613b2c098f76d910cb11762\": rpc error: code = NotFound desc = could not find container \"bcde6028b35351f1b3d827f12e1c9e42a298b5a69613b2c098f76d910cb11762\": container with ID starting with bcde6028b35351f1b3d827f12e1c9e42a298b5a69613b2c098f76d910cb11762 not found: ID does not exist" Jul 15 21:35:48.869346 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:48.869313 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj"] Jul 15 21:35:48.878129 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:48.878096 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-d8b57005-openshift-default-c7b476b85-2wtwj"] Jul 15 21:35:49.029888 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:49.029854 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m"] Jul 15 21:35:49.030658 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:49.030633 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="548c6db6-880d-4655-851d-12557f1b4190" containerName="istio-proxy" Jul 15 21:35:49.030658 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:49.030659 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="548c6db6-880d-4655-851d-12557f1b4190" containerName="istio-proxy" Jul 15 21:35:49.030832 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:49.030809 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="548c6db6-880d-4655-851d-12557f1b4190" containerName="istio-proxy" Jul 15 21:35:49.034457 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:49.034431 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m" Jul 15 21:35:49.039044 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:49.039023 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-620eb2f1-gw-openshift-default-dockercfg-997lp\"" Jul 15 21:35:49.063165 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:49.063138 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m"] Jul 15 21:35:49.174256 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:49.174148 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2fb332eb-585d-42d1-affd-a951162695fe-istio-envoy\") pod \"e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m\" (UID: \"2fb332eb-585d-42d1-affd-a951162695fe\") " pod="openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m" Jul 15 21:35:49.174256 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:49.174198 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2fb332eb-585d-42d1-affd-a951162695fe-istio-podinfo\") pod \"e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m\" (UID: \"2fb332eb-585d-42d1-affd-a951162695fe\") " pod="openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m" Jul 15 21:35:49.174256 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:49.174231 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2fb332eb-585d-42d1-affd-a951162695fe-istio-token\") pod \"e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m\" (UID: \"2fb332eb-585d-42d1-affd-a951162695fe\") " pod="openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m" Jul 15 21:35:49.174631 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:49.174336 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2fb332eb-585d-42d1-affd-a951162695fe-istiod-ca-cert\") pod \"e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m\" (UID: \"2fb332eb-585d-42d1-affd-a951162695fe\") " pod="openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m" Jul 15 21:35:49.174631 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:49.174383 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fb332eb-585d-42d1-affd-a951162695fe-workload-socket\") pod \"e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m\" (UID: \"2fb332eb-585d-42d1-affd-a951162695fe\") " pod="openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m" Jul 15 21:35:49.174631 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:49.174527 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2fb332eb-585d-42d1-affd-a951162695fe-istio-data\") pod \"e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m\" (UID: \"2fb332eb-585d-42d1-affd-a951162695fe\") " pod="openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m" Jul 15 21:35:49.174631 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:49.174593 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2fb332eb-585d-42d1-affd-a951162695fe-workload-certs\") pod \"e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m\" (UID: \"2fb332eb-585d-42d1-affd-a951162695fe\") " pod="openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m" Jul 15 21:35:49.174631 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:49.174625 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fb332eb-585d-42d1-affd-a951162695fe-credential-socket\") pod \"e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m\" (UID: \"2fb332eb-585d-42d1-affd-a951162695fe\") " pod="openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m" Jul 15 21:35:49.174832 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:49.174665 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tr9t\" (UniqueName: \"kubernetes.io/projected/2fb332eb-585d-42d1-affd-a951162695fe-kube-api-access-9tr9t\") pod \"e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m\" (UID: \"2fb332eb-585d-42d1-affd-a951162695fe\") " pod="openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m" Jul 15 21:35:49.275446 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:49.275409 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2fb332eb-585d-42d1-affd-a951162695fe-istio-envoy\") pod \"e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m\" (UID: \"2fb332eb-585d-42d1-affd-a951162695fe\") " pod="openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m" Jul 15 21:35:49.275446 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:49.275451 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2fb332eb-585d-42d1-affd-a951162695fe-istio-podinfo\") pod \"e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m\" (UID: \"2fb332eb-585d-42d1-affd-a951162695fe\") " pod="openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m" Jul 15 21:35:49.275693 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:49.275475 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2fb332eb-585d-42d1-affd-a951162695fe-istio-token\") pod \"e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m\" (UID: \"2fb332eb-585d-42d1-affd-a951162695fe\") " pod="openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m" Jul 15 21:35:49.275693 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:49.275508 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2fb332eb-585d-42d1-affd-a951162695fe-istiod-ca-cert\") pod \"e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m\" (UID: \"2fb332eb-585d-42d1-affd-a951162695fe\") " pod="openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m" Jul 15 21:35:49.275693 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:49.275537 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fb332eb-585d-42d1-affd-a951162695fe-workload-socket\") pod \"e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m\" (UID: \"2fb332eb-585d-42d1-affd-a951162695fe\") " pod="openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m" Jul 15 21:35:49.275693 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:49.275606 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2fb332eb-585d-42d1-affd-a951162695fe-istio-data\") pod \"e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m\" (UID: \"2fb332eb-585d-42d1-affd-a951162695fe\") " pod="openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m" Jul 15 21:35:49.275693 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:49.275651 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2fb332eb-585d-42d1-affd-a951162695fe-workload-certs\") pod \"e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m\" (UID: \"2fb332eb-585d-42d1-affd-a951162695fe\") " pod="openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m" Jul 15 21:35:49.275693 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:49.275676 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fb332eb-585d-42d1-affd-a951162695fe-credential-socket\") pod \"e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m\" (UID: \"2fb332eb-585d-42d1-affd-a951162695fe\") " pod="openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m" Jul 15 21:35:49.276016 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:49.275711 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tr9t\" (UniqueName: \"kubernetes.io/projected/2fb332eb-585d-42d1-affd-a951162695fe-kube-api-access-9tr9t\") pod \"e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m\" (UID: \"2fb332eb-585d-42d1-affd-a951162695fe\") " pod="openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m" Jul 15 21:35:49.276095 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:49.276063 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2fb332eb-585d-42d1-affd-a951162695fe-istio-data\") pod \"e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m\" (UID: \"2fb332eb-585d-42d1-affd-a951162695fe\") " pod="openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m" Jul 15 21:35:49.276335 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:49.276283 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fb332eb-585d-42d1-affd-a951162695fe-credential-socket\") pod \"e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m\" (UID: \"2fb332eb-585d-42d1-affd-a951162695fe\") " pod="openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m" Jul 15 21:35:49.276443 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:49.276307 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2fb332eb-585d-42d1-affd-a951162695fe-workload-certs\") pod \"e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m\" (UID: \"2fb332eb-585d-42d1-affd-a951162695fe\") " pod="openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m" Jul 15 21:35:49.276443 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:49.276409 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fb332eb-585d-42d1-affd-a951162695fe-workload-socket\") pod \"e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m\" (UID: \"2fb332eb-585d-42d1-affd-a951162695fe\") " pod="openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m" Jul 15 21:35:49.276581 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:49.276409 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2fb332eb-585d-42d1-affd-a951162695fe-istiod-ca-cert\") pod \"e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m\" (UID: \"2fb332eb-585d-42d1-affd-a951162695fe\") " pod="openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m" Jul 15 21:35:49.277975 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:49.277944 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2fb332eb-585d-42d1-affd-a951162695fe-istio-envoy\") pod \"e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m\" (UID: \"2fb332eb-585d-42d1-affd-a951162695fe\") " pod="openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m" Jul 15 21:35:49.278193 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:49.278175 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2fb332eb-585d-42d1-affd-a951162695fe-istio-podinfo\") pod \"e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m\" (UID: \"2fb332eb-585d-42d1-affd-a951162695fe\") " pod="openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m" Jul 15 21:35:49.285566 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:49.285546 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2fb332eb-585d-42d1-affd-a951162695fe-istio-token\") pod \"e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m\" (UID: \"2fb332eb-585d-42d1-affd-a951162695fe\") " pod="openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m" Jul 15 21:35:49.285726 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:49.285705 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tr9t\" (UniqueName: \"kubernetes.io/projected/2fb332eb-585d-42d1-affd-a951162695fe-kube-api-access-9tr9t\") pod \"e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m\" (UID: \"2fb332eb-585d-42d1-affd-a951162695fe\") " pod="openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m" Jul 15 21:35:49.346788 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:49.346754 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m" Jul 15 21:35:49.502272 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:49.502241 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m"] Jul 15 21:35:49.503681 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:35:49.503656 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fb332eb_585d_42d1_affd_a951162695fe.slice/crio-397b2d2605e80f120b7894a57d2b2a6b1ec58923ed2197c5886b447d0f96d9ff WatchSource:0}: Error finding container 397b2d2605e80f120b7894a57d2b2a6b1ec58923ed2197c5886b447d0f96d9ff: Status 404 returned error can't find the container with id 397b2d2605e80f120b7894a57d2b2a6b1ec58923ed2197c5886b447d0f96d9ff Jul 15 21:35:49.506397 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:49.506360 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 21:35:49.506468 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:49.506434 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 21:35:49.506504 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:49.506471 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 21:35:49.847446 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:49.847408 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m" event={"ID":"2fb332eb-585d-42d1-affd-a951162695fe","Type":"ContainerStarted","Data":"cff8e009f9bc93c5f67cee00e8b09082ab85725bb3b1ac690196b3d39dbc43e7"} Jul 15 21:35:49.847622 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:49.847466 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m" event={"ID":"2fb332eb-585d-42d1-affd-a951162695fe","Type":"ContainerStarted","Data":"397b2d2605e80f120b7894a57d2b2a6b1ec58923ed2197c5886b447d0f96d9ff"} Jul 15 21:35:49.881953 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:49.881884 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m" podStartSLOduration=1.881861767 podStartE2EDuration="1.881861767s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:35:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:35:49.880826823 +0000 UTC m=+1571.775230946" watchObservedRunningTime="2026-07-15 21:35:49.881861767 +0000 UTC m=+1571.776265833" Jul 15 21:35:50.347126 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:50.347094 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m" Jul 15 21:35:50.352827 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:50.352801 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m" Jul 15 21:35:50.590357 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:50.590329 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="548c6db6-880d-4655-851d-12557f1b4190" path="/var/lib/kubelet/pods/548c6db6-880d-4655-851d-12557f1b4190/volumes" Jul 15 21:35:50.854726 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:50.854695 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m" Jul 15 21:35:50.855663 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:50.855643 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m" Jul 15 21:35:54.924625 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:54.924586 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m"] Jul 15 21:35:54.925040 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:35:54.924806 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m" podUID="2fb332eb-585d-42d1-affd-a951162695fe" containerName="istio-proxy" containerID="cri-o://cff8e009f9bc93c5f67cee00e8b09082ab85725bb3b1ac690196b3d39dbc43e7" gracePeriod=30 Jul 15 21:36:01.517396 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:01.517280 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-86b85e98-67f6f6f65d-tlhr2"] Jul 15 21:36:01.521070 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:01.521042 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-86b85e98-67f6f6f65d-tlhr2" Jul 15 21:36:01.526440 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:01.526408 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-86b85e98-serving-cert\"" Jul 15 21:36:01.526440 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:01.526431 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-d28lw\"" Jul 15 21:36:01.541741 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:01.541715 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-86b85e98-67f6f6f65d-tlhr2"] Jul 15 21:36:01.711044 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:01.711008 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb44c334-6dd7-4e30-ad2b-f289bc5486a1-maas-api-tls\") pod \"maas-api-e2e-derive-86b85e98-67f6f6f65d-tlhr2\" (UID: \"cb44c334-6dd7-4e30-ad2b-f289bc5486a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-86b85e98-67f6f6f65d-tlhr2" Jul 15 21:36:01.711044 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:01.711043 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb44c334-6dd7-4e30-ad2b-f289bc5486a1-openshift-service-ca\") pod \"maas-api-e2e-derive-86b85e98-67f6f6f65d-tlhr2\" (UID: \"cb44c334-6dd7-4e30-ad2b-f289bc5486a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-86b85e98-67f6f6f65d-tlhr2" Jul 15 21:36:01.711264 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:01.711105 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ww2jk\" (UniqueName: \"kubernetes.io/projected/cb44c334-6dd7-4e30-ad2b-f289bc5486a1-kube-api-access-ww2jk\") pod \"maas-api-e2e-derive-86b85e98-67f6f6f65d-tlhr2\" (UID: \"cb44c334-6dd7-4e30-ad2b-f289bc5486a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-86b85e98-67f6f6f65d-tlhr2" Jul 15 21:36:01.812431 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:01.812265 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb44c334-6dd7-4e30-ad2b-f289bc5486a1-maas-api-tls\") pod \"maas-api-e2e-derive-86b85e98-67f6f6f65d-tlhr2\" (UID: \"cb44c334-6dd7-4e30-ad2b-f289bc5486a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-86b85e98-67f6f6f65d-tlhr2" Jul 15 21:36:01.812431 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:01.812344 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb44c334-6dd7-4e30-ad2b-f289bc5486a1-openshift-service-ca\") pod \"maas-api-e2e-derive-86b85e98-67f6f6f65d-tlhr2\" (UID: \"cb44c334-6dd7-4e30-ad2b-f289bc5486a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-86b85e98-67f6f6f65d-tlhr2" Jul 15 21:36:01.812431 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:01.812396 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ww2jk\" (UniqueName: \"kubernetes.io/projected/cb44c334-6dd7-4e30-ad2b-f289bc5486a1-kube-api-access-ww2jk\") pod \"maas-api-e2e-derive-86b85e98-67f6f6f65d-tlhr2\" (UID: \"cb44c334-6dd7-4e30-ad2b-f289bc5486a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-86b85e98-67f6f6f65d-tlhr2" Jul 15 21:36:01.812741 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:36:01.812453 2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-86b85e98-serving-cert: secret "maas-api-e2e-derive-86b85e98-serving-cert" not found Jul 15 21:36:01.812741 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:36:01.812536 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb44c334-6dd7-4e30-ad2b-f289bc5486a1-maas-api-tls podName:cb44c334-6dd7-4e30-ad2b-f289bc5486a1 nodeName:}" failed. No retries permitted until 2026-07-15 21:36:02.312513961 +0000 UTC m=+1584.206918005 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cb44c334-6dd7-4e30-ad2b-f289bc5486a1-maas-api-tls") pod "maas-api-e2e-derive-86b85e98-67f6f6f65d-tlhr2" (UID: "cb44c334-6dd7-4e30-ad2b-f289bc5486a1") : secret "maas-api-e2e-derive-86b85e98-serving-cert" not found Jul 15 21:36:01.813185 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:01.813154 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb44c334-6dd7-4e30-ad2b-f289bc5486a1-openshift-service-ca\") pod \"maas-api-e2e-derive-86b85e98-67f6f6f65d-tlhr2\" (UID: \"cb44c334-6dd7-4e30-ad2b-f289bc5486a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-86b85e98-67f6f6f65d-tlhr2" Jul 15 21:36:01.824980 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:01.824943 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww2jk\" (UniqueName: \"kubernetes.io/projected/cb44c334-6dd7-4e30-ad2b-f289bc5486a1-kube-api-access-ww2jk\") pod \"maas-api-e2e-derive-86b85e98-67f6f6f65d-tlhr2\" (UID: \"cb44c334-6dd7-4e30-ad2b-f289bc5486a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-86b85e98-67f6f6f65d-tlhr2" Jul 15 21:36:02.200676 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:02.200648 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m" Jul 15 21:36:02.316619 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:02.316590 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2fb332eb-585d-42d1-affd-a951162695fe-istio-envoy\") pod \"2fb332eb-585d-42d1-affd-a951162695fe\" (UID: \"2fb332eb-585d-42d1-affd-a951162695fe\") " Jul 15 21:36:02.316800 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:02.316645 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2fb332eb-585d-42d1-affd-a951162695fe-workload-certs\") pod \"2fb332eb-585d-42d1-affd-a951162695fe\" (UID: \"2fb332eb-585d-42d1-affd-a951162695fe\") " Jul 15 21:36:02.316800 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:02.316691 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fb332eb-585d-42d1-affd-a951162695fe-workload-socket\") pod \"2fb332eb-585d-42d1-affd-a951162695fe\" (UID: \"2fb332eb-585d-42d1-affd-a951162695fe\") " Jul 15 21:36:02.316800 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:02.316721 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2fb332eb-585d-42d1-affd-a951162695fe-istiod-ca-cert\") pod \"2fb332eb-585d-42d1-affd-a951162695fe\" (UID: \"2fb332eb-585d-42d1-affd-a951162695fe\") " Jul 15 21:36:02.316800 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:02.316741 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2fb332eb-585d-42d1-affd-a951162695fe-istio-data\") pod \"2fb332eb-585d-42d1-affd-a951162695fe\" (UID: \"2fb332eb-585d-42d1-affd-a951162695fe\") " Jul 15 21:36:02.317054 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:02.316850 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tr9t\" (UniqueName: \"kubernetes.io/projected/2fb332eb-585d-42d1-affd-a951162695fe-kube-api-access-9tr9t\") pod \"2fb332eb-585d-42d1-affd-a951162695fe\" (UID: \"2fb332eb-585d-42d1-affd-a951162695fe\") " Jul 15 21:36:02.317054 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:02.316881 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fb332eb-585d-42d1-affd-a951162695fe-credential-socket\") pod \"2fb332eb-585d-42d1-affd-a951162695fe\" (UID: \"2fb332eb-585d-42d1-affd-a951162695fe\") " Jul 15 21:36:02.317054 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:02.316942 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2fb332eb-585d-42d1-affd-a951162695fe-istio-token\") pod \"2fb332eb-585d-42d1-affd-a951162695fe\" (UID: \"2fb332eb-585d-42d1-affd-a951162695fe\") " Jul 15 21:36:02.317054 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:02.316980 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2fb332eb-585d-42d1-affd-a951162695fe-istio-podinfo\") pod \"2fb332eb-585d-42d1-affd-a951162695fe\" (UID: \"2fb332eb-585d-42d1-affd-a951162695fe\") " Jul 15 21:36:02.317054 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:02.317009 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fb332eb-585d-42d1-affd-a951162695fe-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2fb332eb-585d-42d1-affd-a951162695fe" (UID: "2fb332eb-585d-42d1-affd-a951162695fe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:36:02.317373 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:02.317213 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fb332eb-585d-42d1-affd-a951162695fe-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2fb332eb-585d-42d1-affd-a951162695fe" (UID: "2fb332eb-585d-42d1-affd-a951162695fe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:36:02.317373 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:02.317247 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fb332eb-585d-42d1-affd-a951162695fe-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2fb332eb-585d-42d1-affd-a951162695fe" (UID: "2fb332eb-585d-42d1-affd-a951162695fe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:36:02.317498 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:02.317383 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb44c334-6dd7-4e30-ad2b-f289bc5486a1-maas-api-tls\") pod \"maas-api-e2e-derive-86b85e98-67f6f6f65d-tlhr2\" (UID: \"cb44c334-6dd7-4e30-ad2b-f289bc5486a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-86b85e98-67f6f6f65d-tlhr2" Jul 15 21:36:02.317498 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:02.317453 2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2fb332eb-585d-42d1-affd-a951162695fe-workload-certs\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:36:02.317498 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:02.317469 2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2fb332eb-585d-42d1-affd-a951162695fe-istiod-ca-cert\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:36:02.317498 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:02.317485 2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fb332eb-585d-42d1-affd-a951162695fe-credential-socket\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:36:02.317713 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:36:02.317587 2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-86b85e98-serving-cert: secret "maas-api-e2e-derive-86b85e98-serving-cert" not found Jul 15 21:36:02.317713 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:36:02.317647 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb44c334-6dd7-4e30-ad2b-f289bc5486a1-maas-api-tls podName:cb44c334-6dd7-4e30-ad2b-f289bc5486a1 nodeName:}" failed. No retries permitted until 2026-07-15 21:36:03.317628865 +0000 UTC m=+1585.212032944 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cb44c334-6dd7-4e30-ad2b-f289bc5486a1-maas-api-tls") pod "maas-api-e2e-derive-86b85e98-67f6f6f65d-tlhr2" (UID: "cb44c334-6dd7-4e30-ad2b-f289bc5486a1") : secret "maas-api-e2e-derive-86b85e98-serving-cert" not found Jul 15 21:36:02.317832 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:02.317750 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fb332eb-585d-42d1-affd-a951162695fe-istio-data" (OuterVolumeSpecName: "istio-data") pod "2fb332eb-585d-42d1-affd-a951162695fe" (UID: "2fb332eb-585d-42d1-affd-a951162695fe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:36:02.317890 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:02.317831 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fb332eb-585d-42d1-affd-a951162695fe-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2fb332eb-585d-42d1-affd-a951162695fe" (UID: "2fb332eb-585d-42d1-affd-a951162695fe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:36:02.319543 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:02.319505 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fb332eb-585d-42d1-affd-a951162695fe-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2fb332eb-585d-42d1-affd-a951162695fe" (UID: "2fb332eb-585d-42d1-affd-a951162695fe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:36:02.319669 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:02.319564 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fb332eb-585d-42d1-affd-a951162695fe-istio-token" (OuterVolumeSpecName: "istio-token") pod "2fb332eb-585d-42d1-affd-a951162695fe" (UID: "2fb332eb-585d-42d1-affd-a951162695fe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:36:02.319669 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:02.319597 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fb332eb-585d-42d1-affd-a951162695fe-kube-api-access-9tr9t" (OuterVolumeSpecName: "kube-api-access-9tr9t") pod "2fb332eb-585d-42d1-affd-a951162695fe" (UID: "2fb332eb-585d-42d1-affd-a951162695fe"). InnerVolumeSpecName "kube-api-access-9tr9t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:36:02.319669 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:02.319649 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2fb332eb-585d-42d1-affd-a951162695fe-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2fb332eb-585d-42d1-affd-a951162695fe" (UID: "2fb332eb-585d-42d1-affd-a951162695fe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 21:36:02.418965 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:02.418874 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tr9t\" (UniqueName: \"kubernetes.io/projected/2fb332eb-585d-42d1-affd-a951162695fe-kube-api-access-9tr9t\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:36:02.418965 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:02.418908 2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2fb332eb-585d-42d1-affd-a951162695fe-istio-token\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:36:02.418965 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:02.418917 2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2fb332eb-585d-42d1-affd-a951162695fe-istio-podinfo\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:36:02.418965 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:02.418925 2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2fb332eb-585d-42d1-affd-a951162695fe-istio-envoy\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:36:02.418965 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:02.418934 2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fb332eb-585d-42d1-affd-a951162695fe-workload-socket\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:36:02.418965 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:02.418942 2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2fb332eb-585d-42d1-affd-a951162695fe-istio-data\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:36:02.935450 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:02.935416 2570 generic.go:356] "Generic (PLEG): container finished" podID="2fb332eb-585d-42d1-affd-a951162695fe" containerID="cff8e009f9bc93c5f67cee00e8b09082ab85725bb3b1ac690196b3d39dbc43e7" exitCode=0 Jul 15 21:36:02.935956 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:02.935473 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m" Jul 15 21:36:02.935956 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:02.935500 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m" event={"ID":"2fb332eb-585d-42d1-affd-a951162695fe","Type":"ContainerDied","Data":"cff8e009f9bc93c5f67cee00e8b09082ab85725bb3b1ac690196b3d39dbc43e7"} Jul 15 21:36:02.935956 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:02.935567 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m" event={"ID":"2fb332eb-585d-42d1-affd-a951162695fe","Type":"ContainerDied","Data":"397b2d2605e80f120b7894a57d2b2a6b1ec58923ed2197c5886b447d0f96d9ff"} Jul 15 21:36:02.935956 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:02.935605 2570 scope.go:117] "RemoveContainer" containerID="cff8e009f9bc93c5f67cee00e8b09082ab85725bb3b1ac690196b3d39dbc43e7" Jul 15 21:36:02.945756 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:02.945736 2570 scope.go:117] "RemoveContainer" containerID="cff8e009f9bc93c5f67cee00e8b09082ab85725bb3b1ac690196b3d39dbc43e7" Jul 15 21:36:02.946063 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:36:02.946043 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cff8e009f9bc93c5f67cee00e8b09082ab85725bb3b1ac690196b3d39dbc43e7\": container with ID starting with cff8e009f9bc93c5f67cee00e8b09082ab85725bb3b1ac690196b3d39dbc43e7 not found: ID does not exist" containerID="cff8e009f9bc93c5f67cee00e8b09082ab85725bb3b1ac690196b3d39dbc43e7" Jul 15 21:36:02.946130 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:02.946072 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cff8e009f9bc93c5f67cee00e8b09082ab85725bb3b1ac690196b3d39dbc43e7"} err="failed to get container status \"cff8e009f9bc93c5f67cee00e8b09082ab85725bb3b1ac690196b3d39dbc43e7\": rpc error: code = NotFound desc = could not find container \"cff8e009f9bc93c5f67cee00e8b09082ab85725bb3b1ac690196b3d39dbc43e7\": container with ID starting with cff8e009f9bc93c5f67cee00e8b09082ab85725bb3b1ac690196b3d39dbc43e7 not found: ID does not exist" Jul 15 21:36:02.955158 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:02.955129 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m"] Jul 15 21:36:02.959346 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:02.959324 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-620eb2f1-gw-openshift-default-b98cc5b67-8n29m"] Jul 15 21:36:03.330061 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:03.330028 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb44c334-6dd7-4e30-ad2b-f289bc5486a1-maas-api-tls\") pod \"maas-api-e2e-derive-86b85e98-67f6f6f65d-tlhr2\" (UID: \"cb44c334-6dd7-4e30-ad2b-f289bc5486a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-86b85e98-67f6f6f65d-tlhr2" Jul 15 21:36:03.332472 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:03.332450 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb44c334-6dd7-4e30-ad2b-f289bc5486a1-maas-api-tls\") pod \"maas-api-e2e-derive-86b85e98-67f6f6f65d-tlhr2\" (UID: \"cb44c334-6dd7-4e30-ad2b-f289bc5486a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-86b85e98-67f6f6f65d-tlhr2" Jul 15 21:36:03.632223 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:03.632003 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-86b85e98-67f6f6f65d-tlhr2" Jul 15 21:36:03.778008 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:03.777973 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-86b85e98-67f6f6f65d-tlhr2"] Jul 15 21:36:03.779157 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:36:03.779123 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb44c334_6dd7_4e30_ad2b_f289bc5486a1.slice/crio-3cf4b58c0cb7c220900d02f052e3d01105073b06b93420d49767e21bb63552c2 WatchSource:0}: Error finding container 3cf4b58c0cb7c220900d02f052e3d01105073b06b93420d49767e21bb63552c2: Status 404 returned error can't find the container with id 3cf4b58c0cb7c220900d02f052e3d01105073b06b93420d49767e21bb63552c2 Jul 15 21:36:03.780812 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:03.780789 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 21:36:03.943962 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:03.943869 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-86b85e98-67f6f6f65d-tlhr2" event={"ID":"cb44c334-6dd7-4e30-ad2b-f289bc5486a1","Type":"ContainerStarted","Data":"3cf4b58c0cb7c220900d02f052e3d01105073b06b93420d49767e21bb63552c2"} Jul 15 21:36:04.592426 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:04.592218 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fb332eb-585d-42d1-affd-a951162695fe" path="/var/lib/kubelet/pods/2fb332eb-585d-42d1-affd-a951162695fe/volumes" Jul 15 21:36:04.951583 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:04.951488 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-86b85e98-67f6f6f65d-tlhr2" event={"ID":"cb44c334-6dd7-4e30-ad2b-f289bc5486a1","Type":"ContainerStarted","Data":"728bc93b9d75d833c0efdbc261e146c6fc630aa4b0b3c8a0e839f7c07ee8ab58"} Jul 15 21:36:04.951583 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:04.951557 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-86b85e98-67f6f6f65d-tlhr2" Jul 15 21:36:04.969087 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:04.969031 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-86b85e98-67f6f6f65d-tlhr2" podStartSLOduration=3.401472489 podStartE2EDuration="3.969013389s" totalImagesPullingTime="567.5409ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:36:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:36:04.967508181 +0000 UTC m=+1586.861912267" watchObservedRunningTime="2026-07-15 21:36:04.969013389 +0000 UTC m=+1586.863417454" Jul 15 21:36:10.966714 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:36:10.966684 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-86b85e98-67f6f6f65d-tlhr2" Jul 15 21:39:38.683202 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:39:38.683172 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c5zg9_50d11f79-1eac-4ad4-8151-9b5dd54cd284/console-operator/1.log" Jul 15 21:39:38.690737 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:39:38.690717 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nhzkw_beb5b136-86fb-4e57-9b27-3fc1079a9af3/ovn-acl-logging/0.log" Jul 15 21:39:38.690892 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:39:38.690768 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c5zg9_50d11f79-1eac-4ad4-8151-9b5dd54cd284/console-operator/1.log" Jul 15 21:39:38.698229 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:39:38.698208 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nhzkw_beb5b136-86fb-4e57-9b27-3fc1079a9af3/ovn-acl-logging/0.log" Jul 15 21:42:17.480821 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:17.480788 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh"] Jul 15 21:42:17.481323 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:17.481283 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fb332eb-585d-42d1-affd-a951162695fe" containerName="istio-proxy" Jul 15 21:42:17.481323 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:17.481324 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fb332eb-585d-42d1-affd-a951162695fe" containerName="istio-proxy" Jul 15 21:42:17.481452 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:17.481407 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fb332eb-585d-42d1-affd-a951162695fe" containerName="istio-proxy" Jul 15 21:42:17.484761 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:17.484739 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" Jul 15 21:42:17.488099 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:17.488082 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-c664d0-openshift-default-dockercfg-ppwxh\"" Jul 15 21:42:17.497707 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:17.497678 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-istio-token\") pod \"e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh\" (UID: \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\") " pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" Jul 15 21:42:17.497829 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:17.497747 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-istio-data\") pod \"e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh\" (UID: \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\") " pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" Jul 15 21:42:17.497829 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:17.497774 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-istio-podinfo\") pod \"e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh\" (UID: \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\") " pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" Jul 15 21:42:17.497829 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:17.497799 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-istiod-ca-cert\") pod \"e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh\" (UID: \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\") " pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" Jul 15 21:42:17.497994 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:17.497879 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-workload-certs\") pod \"e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh\" (UID: \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\") " pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" Jul 15 21:42:17.497994 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:17.497908 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-workload-socket\") pod \"e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh\" (UID: \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\") " pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" Jul 15 21:42:17.497994 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:17.497953 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9srm\" (UniqueName: \"kubernetes.io/projected/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-kube-api-access-f9srm\") pod \"e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh\" (UID: \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\") " pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" Jul 15 21:42:17.497994 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:17.497974 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-credential-socket\") pod \"e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh\" (UID: \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\") " pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" Jul 15 21:42:17.497994 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:17.497994 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-istio-envoy\") pod \"e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh\" (UID: \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\") " pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" Jul 15 21:42:17.500040 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:17.500019 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh"] Jul 15 21:42:17.598852 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:17.598812 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-workload-certs\") pod \"e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh\" (UID: \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\") " pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" Jul 15 21:42:17.599023 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:17.598863 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-workload-socket\") pod \"e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh\" (UID: \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\") " pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" Jul 15 21:42:17.599023 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:17.598910 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9srm\" (UniqueName: \"kubernetes.io/projected/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-kube-api-access-f9srm\") pod \"e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh\" (UID: \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\") " pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" Jul 15 21:42:17.599023 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:17.598941 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-credential-socket\") pod \"e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh\" (UID: \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\") " pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" Jul 15 21:42:17.599023 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:17.598971 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-istio-envoy\") pod \"e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh\" (UID: \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\") " pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" Jul 15 21:42:17.599226 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:17.599025 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-istio-token\") pod \"e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh\" (UID: \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\") " pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" Jul 15 21:42:17.599226 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:17.599099 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-istio-data\") pod \"e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh\" (UID: \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\") " pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" Jul 15 21:42:17.599226 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:17.599125 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-istio-podinfo\") pod \"e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh\" (UID: \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\") " pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" Jul 15 21:42:17.599226 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:17.599156 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-istiod-ca-cert\") pod \"e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh\" (UID: \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\") " pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" Jul 15 21:42:17.599466 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:17.599326 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-workload-certs\") pod \"e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh\" (UID: \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\") " pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" Jul 15 21:42:17.599466 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:17.599376 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-credential-socket\") pod \"e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh\" (UID: \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\") " pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" Jul 15 21:42:17.599466 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:17.599420 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-workload-socket\") pod \"e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh\" (UID: \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\") " pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" Jul 15 21:42:17.599630 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:17.599523 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-istio-data\") pod \"e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh\" (UID: \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\") " pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" Jul 15 21:42:17.599912 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:17.599891 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-istiod-ca-cert\") pod \"e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh\" (UID: \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\") " pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" Jul 15 21:42:17.601691 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:17.601663 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-istio-envoy\") pod \"e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh\" (UID: \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\") " pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" Jul 15 21:42:17.601846 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:17.601824 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-istio-podinfo\") pod \"e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh\" (UID: \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\") " pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" Jul 15 21:42:17.607686 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:17.607664 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-istio-token\") pod \"e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh\" (UID: \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\") " pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" Jul 15 21:42:17.608612 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:17.608593 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9srm\" (UniqueName: \"kubernetes.io/projected/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-kube-api-access-f9srm\") pod \"e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh\" (UID: \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\") " pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" Jul 15 21:42:17.794869 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:17.794781 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" Jul 15 21:42:17.940806 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:17.940713 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh"] Jul 15 21:42:17.943149 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:42:17.942681 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f49a35b_41c9_4a3c_85e0_6efe0329f3b6.slice/crio-bb576a7ba39ed5f6af23bd6c2c1ce935258fbb388d9dcec49742fc19ea79705d WatchSource:0}: Error finding container bb576a7ba39ed5f6af23bd6c2c1ce935258fbb388d9dcec49742fc19ea79705d: Status 404 returned error can't find the container with id bb576a7ba39ed5f6af23bd6c2c1ce935258fbb388d9dcec49742fc19ea79705d Jul 15 21:42:17.945667 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:17.945632 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 21:42:17.945762 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:17.945699 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 21:42:17.945762 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:17.945729 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 21:42:18.258359 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:18.258321 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" event={"ID":"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6","Type":"ContainerStarted","Data":"1c519c8f13519ca2d1df5f74dc4ca7e4ade6a2b26740fd4d4a2d8081fbd30a2a"} Jul 15 21:42:18.258578 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:18.258397 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" event={"ID":"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6","Type":"ContainerStarted","Data":"bb576a7ba39ed5f6af23bd6c2c1ce935258fbb388d9dcec49742fc19ea79705d"} Jul 15 21:42:18.284146 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:18.284095 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" podStartSLOduration=1.284079114 podStartE2EDuration="1.284079114s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:42:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:42:18.281420929 +0000 UTC m=+1960.175824993" watchObservedRunningTime="2026-07-15 21:42:18.284079114 +0000 UTC m=+1960.178483178" Jul 15 21:42:18.794868 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:18.794839 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" Jul 15 21:42:19.801162 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:19.801131 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" Jul 15 21:42:20.274987 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:20.274956 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" Jul 15 21:42:20.276154 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:20.276130 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" Jul 15 21:42:36.317503 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:36.317459 2570 patch_prober.go:28] interesting pod/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 15 21:42:36.317907 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:36.317544 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" podUID="7f49a35b-41c9-4a3c-85e0-6efe0329f3b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 15 21:42:37.382113 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:37.382079 2570 generic.go:356] "Generic (PLEG): container finished" podID="7f49a35b-41c9-4a3c-85e0-6efe0329f3b6" containerID="1c519c8f13519ca2d1df5f74dc4ca7e4ade6a2b26740fd4d4a2d8081fbd30a2a" exitCode=0 Jul 15 21:42:37.382675 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:37.382161 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" event={"ID":"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6","Type":"ContainerDied","Data":"1c519c8f13519ca2d1df5f74dc4ca7e4ade6a2b26740fd4d4a2d8081fbd30a2a"} Jul 15 21:42:37.382784 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:37.382767 2570 scope.go:117] "RemoveContainer" containerID="1c519c8f13519ca2d1df5f74dc4ca7e4ade6a2b26740fd4d4a2d8081fbd30a2a" Jul 15 21:42:37.383861 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:37.383832 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 21:42:37.383927 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:37.383914 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 21:42:37.383965 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:37.383949 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 21:42:38.390781 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:38.390744 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" event={"ID":"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6","Type":"ContainerStarted","Data":"8ab0413ee1182ec1aa2122e0ae22f3391e2bec3c1242aedd4b52e15bc7faac67"} Jul 15 21:42:38.795836 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:38.795745 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" Jul 15 21:42:38.796083 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:38.796060 2570 patch_prober.go:28] interesting pod/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body= Jul 15 21:42:38.796140 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:38.796111 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" podUID="7f49a35b-41c9-4a3c-85e0-6efe0329f3b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" Jul 15 21:42:39.795661 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:39.795597 2570 patch_prober.go:28] interesting pod/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body= Jul 15 21:42:39.796157 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:39.795677 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" podUID="7f49a35b-41c9-4a3c-85e0-6efe0329f3b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" Jul 15 21:42:40.795173 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:40.795135 2570 patch_prober.go:28] interesting pod/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body= Jul 15 21:42:40.795387 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:40.795193 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" podUID="7f49a35b-41c9-4a3c-85e0-6efe0329f3b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" Jul 15 21:42:41.795640 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:41.795601 2570 patch_prober.go:28] interesting pod/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body= Jul 15 21:42:41.796126 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:41.795665 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" podUID="7f49a35b-41c9-4a3c-85e0-6efe0329f3b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" Jul 15 21:42:42.799010 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:42.798973 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" Jul 15 21:42:42.799523 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:42.799502 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" Jul 15 21:42:42.800351 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:42:42.800324 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" Jul 15 21:44:38.723611 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:44:38.723531 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c5zg9_50d11f79-1eac-4ad4-8151-9b5dd54cd284/console-operator/1.log" Jul 15 21:44:38.730539 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:44:38.730512 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nhzkw_beb5b136-86fb-4e57-9b27-3fc1079a9af3/ovn-acl-logging/0.log" Jul 15 21:44:38.733071 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:44:38.733051 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c5zg9_50d11f79-1eac-4ad4-8151-9b5dd54cd284/console-operator/1.log" Jul 15 21:44:38.739706 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:44:38.739690 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nhzkw_beb5b136-86fb-4e57-9b27-3fc1079a9af3/ovn-acl-logging/0.log" Jul 15 21:45:00.162495 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.162461 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-c664d0-29735865-2nbfn"] Jul 15 21:45:00.166536 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.166512 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-86b85e98-29735865-v872x"] Jul 15 21:45:00.166677 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.166649 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-c664d0-29735865-2nbfn" Jul 15 21:45:00.172651 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.171216 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jwtcw\"" Jul 15 21:45:00.177923 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.177861 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-c2c3a008-29735865-pvdw5"] Jul 15 21:45:00.178450 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.178413 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-86b85e98-29735865-v872x" Jul 15 21:45:00.187895 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.187229 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-620eb2f1-29735865-xtt8n"] Jul 15 21:45:00.189485 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.189465 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-c664d0-29735865-2nbfn" Jul 15 21:45:00.189942 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.189924 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-c2c3a008-29735865-pvdw5" Jul 15 21:45:00.193187 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.191634 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-d8b57005-29735865-xpdbf"] Jul 15 21:45:00.193187 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.192554 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-620eb2f1-29735865-xtt8n" Jul 15 21:45:00.197100 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.196974 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-c664d0-29735865-2nbfn"] Jul 15 21:45:00.197100 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.197065 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-d8b57005-29735865-xpdbf" Jul 15 21:45:00.199264 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.199240 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-86b85e98-29735865-v872x"] Jul 15 21:45:00.202730 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.202584 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-599e95-29735865-q9lbd"] Jul 15 21:45:00.203439 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.203416 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-86b85e98-29735865-v872x" Jul 15 21:45:00.206936 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.206915 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-c2c3a008-29735865-pvdw5"] Jul 15 21:45:00.207107 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.207016 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-599e95-29735865-q9lbd" Jul 15 21:45:00.210542 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.210523 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-620eb2f1-29735865-xtt8n"] Jul 15 21:45:00.217840 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.217815 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-a5309f-29735865-frzz7"] Jul 15 21:45:00.225811 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.225759 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-d8b57005-29735865-xpdbf"] Jul 15 21:45:00.225917 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.225860 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-a5309f-29735865-frzz7" Jul 15 21:45:00.234430 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.232001 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-4ec9ec-29735865-rgnbz"] Jul 15 21:45:00.238479 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.236641 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735865-tc5ds"] Jul 15 21:45:00.238479 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.237697 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-4ec9ec-29735865-rgnbz" Jul 15 21:45:00.247966 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.245018 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-d3a40f-29735865-mgtbr"] Jul 15 21:45:00.247966 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.246373 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735865-tc5ds" Jul 15 21:45:00.254976 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.253565 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-599e95-29735865-q9lbd"] Jul 15 21:45:00.254976 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.253727 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-d3a40f-29735865-mgtbr" Jul 15 21:45:00.260607 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.260543 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-a5309f-29735865-frzz7"] Jul 15 21:45:00.264011 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.263943 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735865-tc5ds"] Jul 15 21:45:00.264967 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.264812 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-c2c3a008-29735865-pvdw5" Jul 15 21:45:00.269930 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.269208 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-4ec9ec-29735865-rgnbz"] Jul 15 21:45:00.279186 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.279164 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-d3a40f-29735865-mgtbr"] Jul 15 21:45:00.280511 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.280251 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-620eb2f1-29735865-xtt8n" Jul 15 21:45:00.328132 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.327922 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-d8b57005-29735865-xpdbf" Jul 15 21:45:00.341040 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.339739 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-599e95-29735865-q9lbd" Jul 15 21:45:00.360408 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.360270 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-a5309f-29735865-frzz7" Jul 15 21:45:00.383442 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.383080 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-4ec9ec-29735865-rgnbz" Jul 15 21:45:00.407931 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.407726 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735865-tc5ds" Jul 15 21:45:00.408903 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.408856 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-d3a40f-29735865-mgtbr" Jul 15 21:45:00.454360 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.454001 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-c664d0-29735865-2nbfn"] Jul 15 21:45:00.507088 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.502310 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 21:45:00.585017 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.584987 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-c2c3a008-29735865-pvdw5"] Jul 15 21:45:00.642076 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.642032 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-620eb2f1-29735865-xtt8n"] Jul 15 21:45:00.710699 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.710667 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-86b85e98-29735865-v872x"] Jul 15 21:45:00.712339 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:45:00.712275 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5808607a_4523_4434_935a_e59857259654.slice/crio-5f6fbda8eb90480c5723e11b9a477b17b90bef18c7ad035d0078dc315da8f470 WatchSource:0}: Error finding container 5f6fbda8eb90480c5723e11b9a477b17b90bef18c7ad035d0078dc315da8f470: Status 404 returned error can't find the container with id 5f6fbda8eb90480c5723e11b9a477b17b90bef18c7ad035d0078dc315da8f470 Jul 15 21:45:00.889032 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.887704 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-d8b57005-29735865-xpdbf"] Jul 15 21:45:00.926609 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.926572 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-a5309f-29735865-frzz7"] Jul 15 21:45:00.927360 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:45:00.927336 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19ec0c66_45ff_4cb1_a6d0_7e849996c5d7.slice/crio-f6876b7bf79b8572ba16bf7caa7fb14117e740a462b45679706532fb0ec0e444 WatchSource:0}: Error finding container f6876b7bf79b8572ba16bf7caa7fb14117e740a462b45679706532fb0ec0e444: Status 404 returned error can't find the container with id f6876b7bf79b8572ba16bf7caa7fb14117e740a462b45679706532fb0ec0e444 Jul 15 21:45:00.928121 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:45:00.928092 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9432dd1c_089d_448d_9252_d3b7bd514b3d.slice/crio-9e97480f1356cb7a1cf9bbdaa9333f250ee53e77d364eab4aa9a7c7c3aa9cc1c WatchSource:0}: Error finding container 9e97480f1356cb7a1cf9bbdaa9333f250ee53e77d364eab4aa9a7c7c3aa9cc1c: Status 404 returned error can't find the container with id 9e97480f1356cb7a1cf9bbdaa9333f250ee53e77d364eab4aa9a7c7c3aa9cc1c Jul 15 21:45:00.929710 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.929618 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-599e95-29735865-q9lbd"] Jul 15 21:45:00.970015 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.969983 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-4ec9ec-29735865-rgnbz"] Jul 15 21:45:00.970518 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:45:00.970485 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc92baa17_cd07_40e5_81f6_60911f3bbf93.slice/crio-f135b92b2c5559e24bf86272ccc9ab87974da2b4c515ef76c12fdb03649ad295 WatchSource:0}: Error finding container f135b92b2c5559e24bf86272ccc9ab87974da2b4c515ef76c12fdb03649ad295: Status 404 returned error can't find the container with id f135b92b2c5559e24bf86272ccc9ab87974da2b4c515ef76c12fdb03649ad295 Jul 15 21:45:00.971330 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:45:00.971280 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54e00cf7_d349_4216_bf96_900cded7eb8c.slice/crio-9d466eed3dcaa2d1a51dfd5916693e3558908ce8566351b925cef57db4d593e9 WatchSource:0}: Error finding container 9d466eed3dcaa2d1a51dfd5916693e3558908ce8566351b925cef57db4d593e9: Status 404 returned error can't find the container with id 9d466eed3dcaa2d1a51dfd5916693e3558908ce8566351b925cef57db4d593e9 Jul 15 21:45:00.973432 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:00.973410 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735865-tc5ds"] Jul 15 21:45:01.012457 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:01.012432 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-d3a40f-29735865-mgtbr"] Jul 15 21:45:01.014448 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:45:01.014423 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94bc3837_1aca_4a00_a796_48463fa0b868.slice/crio-43d3ab894f04a9e08ea305ca9287bb201efd46d21a265bae9bc199f4c32720b0 WatchSource:0}: Error finding container 43d3ab894f04a9e08ea305ca9287bb201efd46d21a265bae9bc199f4c32720b0: Status 404 returned error can't find the container with id 43d3ab894f04a9e08ea305ca9287bb201efd46d21a265bae9bc199f4c32720b0 Jul 15 21:45:01.287658 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:01.287568 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-599e95-29735865-q9lbd" event={"ID":"9432dd1c-089d-448d-9252-d3b7bd514b3d","Type":"ContainerStarted","Data":"9e97480f1356cb7a1cf9bbdaa9333f250ee53e77d364eab4aa9a7c7c3aa9cc1c"} Jul 15 21:45:01.290015 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:01.289889 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-c664d0-29735865-2nbfn" event={"ID":"7f023c97-319c-4d72-b4fa-1990243d3c1e","Type":"ContainerStarted","Data":"b7fe14c2235f7eca31d7bfe553851b1ba86a5de76bb3b38803d62d3e3a085330"} Jul 15 21:45:01.292012 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:01.291982 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-d3a40f-29735865-mgtbr" event={"ID":"94bc3837-1aca-4a00-a796-48463fa0b868","Type":"ContainerStarted","Data":"43d3ab894f04a9e08ea305ca9287bb201efd46d21a265bae9bc199f4c32720b0"} Jul 15 21:45:01.294193 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:01.294162 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-4ec9ec-29735865-rgnbz" event={"ID":"54e00cf7-d349-4216-bf96-900cded7eb8c","Type":"ContainerStarted","Data":"9d466eed3dcaa2d1a51dfd5916693e3558908ce8566351b925cef57db4d593e9"} Jul 15 21:45:01.296317 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:01.296268 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-a5309f-29735865-frzz7" event={"ID":"19ec0c66-45ff-4cb1-a6d0-7e849996c5d7","Type":"ContainerStarted","Data":"f6876b7bf79b8572ba16bf7caa7fb14117e740a462b45679706532fb0ec0e444"} Jul 15 21:45:01.298166 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:01.298097 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735865-tc5ds" event={"ID":"c92baa17-cd07-40e5-81f6-60911f3bbf93","Type":"ContainerStarted","Data":"f135b92b2c5559e24bf86272ccc9ab87974da2b4c515ef76c12fdb03649ad295"} Jul 15 21:45:01.300057 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:01.299940 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-d8b57005-29735865-xpdbf" event={"ID":"79eadbb8-3991-459c-89ef-525b30e1bfce","Type":"ContainerStarted","Data":"9fdf234f5722fb8a32999cf9285a76e9bf34d9585b97cb36e05dbb269d1448ab"} Jul 15 21:45:01.302072 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:01.301948 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-c2c3a008-29735865-pvdw5" event={"ID":"71d31fc0-463a-4808-a369-23852315612e","Type":"ContainerStarted","Data":"bf7dd459833b54f3aea642e601c9f043ec2085003c65e3160d6c1b3e6f64887f"} Jul 15 21:45:01.304586 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:01.304513 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-86b85e98-29735865-v872x" event={"ID":"5808607a-4523-4434-935a-e59857259654","Type":"ContainerStarted","Data":"5f6fbda8eb90480c5723e11b9a477b17b90bef18c7ad035d0078dc315da8f470"} Jul 15 21:45:01.306555 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:01.306478 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-620eb2f1-29735865-xtt8n" event={"ID":"fe664183-a069-4b51-8c9d-9af93ebcca27","Type":"ContainerStarted","Data":"ce170e1ce48146b5ea2017e6afd3221f0588d824f8a2ec95065c97aa50775ba4"} Jul 15 21:45:05.348304 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:05.348252 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-599e95-29735865-q9lbd" event={"ID":"9432dd1c-089d-448d-9252-d3b7bd514b3d","Type":"ContainerStarted","Data":"4c96a9d430b0e40b8d90582ad6fc32c88c702c774211d8f0f95e7a962e8f8a73"} Jul 15 21:45:05.349944 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:05.349916 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-c664d0-29735865-2nbfn" event={"ID":"7f023c97-319c-4d72-b4fa-1990243d3c1e","Type":"ContainerStarted","Data":"e73b7fdeeb48115b49a7a241ef3ec73dd6bc848e7e823ce3f97cfb8d4f168e96"} Jul 15 21:45:05.351586 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:05.351562 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-d3a40f-29735865-mgtbr" event={"ID":"94bc3837-1aca-4a00-a796-48463fa0b868","Type":"ContainerStarted","Data":"7c3046fc715d0af350e915f3a1264b6beaccd3d3de738a74848e6e4ed91db44d"} Jul 15 21:45:05.352970 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:05.352949 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-a5309f-29735865-frzz7" event={"ID":"19ec0c66-45ff-4cb1-a6d0-7e849996c5d7","Type":"ContainerStarted","Data":"f1705c4ffb0279f01acd4dabc0c53b45dcc07f6eedb9bf013312a6454d473fb5"} Jul 15 21:45:05.354575 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:05.354552 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735865-tc5ds" event={"ID":"c92baa17-cd07-40e5-81f6-60911f3bbf93","Type":"ContainerStarted","Data":"4a8c56dfa45d9e0beae625095feccf03be35eae9ec843a293a3042f07865cd61"} Jul 15 21:45:05.355983 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:05.355960 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-d8b57005-29735865-xpdbf" event={"ID":"79eadbb8-3991-459c-89ef-525b30e1bfce","Type":"ContainerStarted","Data":"e2a9deb362c433d66dff8d2f1bdd2c6acf4eff9c5074c47da003b2ae63860364"} Jul 15 21:45:05.358410 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:05.357676 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-86b85e98-29735865-v872x" event={"ID":"5808607a-4523-4434-935a-e59857259654","Type":"ContainerStarted","Data":"2cb38ae61629e992c11c11ef9f2b5a344ff6d1d99324d98e459e8f7b325e8647"} Jul 15 21:45:05.361530 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:05.361504 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-620eb2f1-29735865-xtt8n" event={"ID":"fe664183-a069-4b51-8c9d-9af93ebcca27","Type":"ContainerStarted","Data":"c78eec9fb8ec71c4d6123fe4ab193b926da92a14f703ad35f6a7427156d57da9"} Jul 15 21:45:05.367370 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:05.367317 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-599e95-29735865-q9lbd" podStartSLOduration=2.057895893 podStartE2EDuration="5.367282317s" totalImagesPullingTime="3.309386424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:45:05.364951107 +0000 UTC m=+2127.259355173" watchObservedRunningTime="2026-07-15 21:45:05.367282317 +0000 UTC m=+2127.261686383" Jul 15 21:45:05.382793 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:05.382749 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-d3a40f-29735865-mgtbr" podStartSLOduration=1.809473117 podStartE2EDuration="5.382731218s" totalImagesPullingTime="3.573258101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:45:05.379555152 +0000 UTC m=+2127.273959217" watchObservedRunningTime="2026-07-15 21:45:05.382731218 +0000 UTC m=+2127.277135282" Jul 15 21:45:05.393572 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:05.393532 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-c664d0-29735865-2nbfn" podStartSLOduration=1.73858289 podStartE2EDuration="5.393517094s" totalImagesPullingTime="3.654934204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:45:05.392670135 +0000 UTC m=+2127.287074216" watchObservedRunningTime="2026-07-15 21:45:05.393517094 +0000 UTC m=+2127.287921158" Jul 15 21:45:05.406536 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:05.406498 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-d8b57005-29735865-xpdbf" podStartSLOduration=2.192238975 podStartE2EDuration="5.40648498s" totalImagesPullingTime="3.214246005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:45:05.406093128 +0000 UTC m=+2127.300497213" watchObservedRunningTime="2026-07-15 21:45:05.40648498 +0000 UTC m=+2127.300889045" Jul 15 21:45:05.421236 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:05.421182 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735865-tc5ds" podStartSLOduration=2.287127045 podStartE2EDuration="5.421166845s" totalImagesPullingTime="3.1340398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:45:05.420082427 +0000 UTC m=+2127.314486491" watchObservedRunningTime="2026-07-15 21:45:05.421166845 +0000 UTC m=+2127.315570994" Jul 15 21:45:05.435325 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:05.435247 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-86b85e98-29735865-v872x" podStartSLOduration=1.357814688 podStartE2EDuration="5.435228602s" totalImagesPullingTime="4.077413914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:45:05.434428478 +0000 UTC m=+2127.328832568" watchObservedRunningTime="2026-07-15 21:45:05.435228602 +0000 UTC m=+2127.329632667" Jul 15 21:45:05.450802 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:05.450755 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-620eb2f1-29735865-xtt8n" podStartSLOduration=1.937552454 podStartE2EDuration="5.450739184s" totalImagesPullingTime="3.51318673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:45:05.449152855 +0000 UTC m=+2127.343556921" watchObservedRunningTime="2026-07-15 21:45:05.450739184 +0000 UTC m=+2127.345143248" Jul 15 21:45:05.466834 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:05.466771 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-a5309f-29735865-frzz7" podStartSLOduration=2.006505331 podStartE2EDuration="5.466750517s" totalImagesPullingTime="3.460245186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:45:05.463415173 +0000 UTC m=+2127.357819239" watchObservedRunningTime="2026-07-15 21:45:05.466750517 +0000 UTC m=+2127.361154585" Jul 15 21:45:06.187256 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:45:06.187221 2570 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71d31fc0_463a_4808_a369_23852315612e.slice/crio-431404d3c61e763409b83777687a026122d1e603d2c11ba204bcbc6276175ab8.scope\": RecentStats: unable to find data in memory cache]" Jul 15 21:45:06.369978 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:06.369945 2570 generic.go:356] "Generic (PLEG): container finished" podID="54e00cf7-d349-4216-bf96-900cded7eb8c" containerID="aec08a237e9e4fe71dede8fa656608699e8c61fa44a4977b806501f3a39089c1" exitCode=0 Jul 15 21:45:06.370403 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:06.370028 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-4ec9ec-29735865-rgnbz" event={"ID":"54e00cf7-d349-4216-bf96-900cded7eb8c","Type":"ContainerDied","Data":"aec08a237e9e4fe71dede8fa656608699e8c61fa44a4977b806501f3a39089c1"} Jul 15 21:45:06.371591 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:06.371562 2570 generic.go:356] "Generic (PLEG): container finished" podID="19ec0c66-45ff-4cb1-a6d0-7e849996c5d7" containerID="f1705c4ffb0279f01acd4dabc0c53b45dcc07f6eedb9bf013312a6454d473fb5" exitCode=0 Jul 15 21:45:06.371729 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:06.371643 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-a5309f-29735865-frzz7" event={"ID":"19ec0c66-45ff-4cb1-a6d0-7e849996c5d7","Type":"ContainerDied","Data":"f1705c4ffb0279f01acd4dabc0c53b45dcc07f6eedb9bf013312a6454d473fb5"} Jul 15 21:45:06.373073 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:06.373051 2570 generic.go:356] "Generic (PLEG): container finished" podID="c92baa17-cd07-40e5-81f6-60911f3bbf93" containerID="4a8c56dfa45d9e0beae625095feccf03be35eae9ec843a293a3042f07865cd61" exitCode=0 Jul 15 21:45:06.373177 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:06.373076 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735865-tc5ds" event={"ID":"c92baa17-cd07-40e5-81f6-60911f3bbf93","Type":"ContainerDied","Data":"4a8c56dfa45d9e0beae625095feccf03be35eae9ec843a293a3042f07865cd61"} Jul 15 21:45:06.374695 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:06.374674 2570 generic.go:356] "Generic (PLEG): container finished" podID="79eadbb8-3991-459c-89ef-525b30e1bfce" containerID="e2a9deb362c433d66dff8d2f1bdd2c6acf4eff9c5074c47da003b2ae63860364" exitCode=0 Jul 15 21:45:06.374787 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:06.374703 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-d8b57005-29735865-xpdbf" event={"ID":"79eadbb8-3991-459c-89ef-525b30e1bfce","Type":"ContainerDied","Data":"e2a9deb362c433d66dff8d2f1bdd2c6acf4eff9c5074c47da003b2ae63860364"} Jul 15 21:45:06.376118 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:06.376100 2570 generic.go:356] "Generic (PLEG): container finished" podID="71d31fc0-463a-4808-a369-23852315612e" containerID="431404d3c61e763409b83777687a026122d1e603d2c11ba204bcbc6276175ab8" exitCode=0 Jul 15 21:45:06.376225 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:06.376164 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-c2c3a008-29735865-pvdw5" event={"ID":"71d31fc0-463a-4808-a369-23852315612e","Type":"ContainerDied","Data":"431404d3c61e763409b83777687a026122d1e603d2c11ba204bcbc6276175ab8"} Jul 15 21:45:06.377487 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:06.377467 2570 generic.go:356] "Generic (PLEG): container finished" podID="5808607a-4523-4434-935a-e59857259654" containerID="2cb38ae61629e992c11c11ef9f2b5a344ff6d1d99324d98e459e8f7b325e8647" exitCode=0 Jul 15 21:45:06.377570 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:06.377494 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-86b85e98-29735865-v872x" event={"ID":"5808607a-4523-4434-935a-e59857259654","Type":"ContainerDied","Data":"2cb38ae61629e992c11c11ef9f2b5a344ff6d1d99324d98e459e8f7b325e8647"} Jul 15 21:45:06.378786 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:06.378769 2570 generic.go:356] "Generic (PLEG): container finished" podID="fe664183-a069-4b51-8c9d-9af93ebcca27" containerID="c78eec9fb8ec71c4d6123fe4ab193b926da92a14f703ad35f6a7427156d57da9" exitCode=0 Jul 15 21:45:06.378886 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:06.378790 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-620eb2f1-29735865-xtt8n" event={"ID":"fe664183-a069-4b51-8c9d-9af93ebcca27","Type":"ContainerDied","Data":"c78eec9fb8ec71c4d6123fe4ab193b926da92a14f703ad35f6a7427156d57da9"} Jul 15 21:45:06.380219 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:06.380200 2570 generic.go:356] "Generic (PLEG): container finished" podID="9432dd1c-089d-448d-9252-d3b7bd514b3d" containerID="4c96a9d430b0e40b8d90582ad6fc32c88c702c774211d8f0f95e7a962e8f8a73" exitCode=0 Jul 15 21:45:06.380319 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:06.380262 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-599e95-29735865-q9lbd" event={"ID":"9432dd1c-089d-448d-9252-d3b7bd514b3d","Type":"ContainerDied","Data":"4c96a9d430b0e40b8d90582ad6fc32c88c702c774211d8f0f95e7a962e8f8a73"} Jul 15 21:45:06.381589 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:06.381573 2570 generic.go:356] "Generic (PLEG): container finished" podID="7f023c97-319c-4d72-b4fa-1990243d3c1e" containerID="e73b7fdeeb48115b49a7a241ef3ec73dd6bc848e7e823ce3f97cfb8d4f168e96" exitCode=0 Jul 15 21:45:06.381666 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:06.381599 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-c664d0-29735865-2nbfn" event={"ID":"7f023c97-319c-4d72-b4fa-1990243d3c1e","Type":"ContainerDied","Data":"e73b7fdeeb48115b49a7a241ef3ec73dd6bc848e7e823ce3f97cfb8d4f168e96"} Jul 15 21:45:06.382941 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:06.382928 2570 generic.go:356] "Generic (PLEG): container finished" podID="94bc3837-1aca-4a00-a796-48463fa0b868" containerID="7c3046fc715d0af350e915f3a1264b6beaccd3d3de738a74848e6e4ed91db44d" exitCode=0 Jul 15 21:45:06.382995 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:06.382951 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-d3a40f-29735865-mgtbr" event={"ID":"94bc3837-1aca-4a00-a796-48463fa0b868","Type":"ContainerDied","Data":"7c3046fc715d0af350e915f3a1264b6beaccd3d3de738a74848e6e4ed91db44d"} Jul 15 21:45:07.633881 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:07.633852 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-620eb2f1-29735865-xtt8n" Jul 15 21:45:07.747464 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:07.733752 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-d8b57005-29735865-xpdbf" Jul 15 21:45:07.778224 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:07.778203 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-c664d0-29735865-2nbfn" Jul 15 21:45:07.781445 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:07.781425 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-86b85e98-29735865-v872x" Jul 15 21:45:07.786099 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:07.786080 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-d3a40f-29735865-mgtbr" Jul 15 21:45:07.797165 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:07.796642 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-c2c3a008-29735865-pvdw5" Jul 15 21:45:07.799721 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:07.799696 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735865-tc5ds" Jul 15 21:45:07.801717 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:07.801697 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-a5309f-29735865-frzz7" Jul 15 21:45:07.803865 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:07.803841 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-599e95-29735865-q9lbd" Jul 15 21:45:07.808186 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:07.808161 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-4ec9ec-29735865-rgnbz" Jul 15 21:45:08.398256 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:08.398226 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-d8b57005-29735865-xpdbf" Jul 15 21:45:08.398480 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:08.398219 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-d8b57005-29735865-xpdbf" event={"ID":"79eadbb8-3991-459c-89ef-525b30e1bfce","Type":"ContainerDied","Data":"9fdf234f5722fb8a32999cf9285a76e9bf34d9585b97cb36e05dbb269d1448ab"} Jul 15 21:45:08.398480 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:08.398343 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9fdf234f5722fb8a32999cf9285a76e9bf34d9585b97cb36e05dbb269d1448ab" Jul 15 21:45:08.399532 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:08.399512 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-c2c3a008-29735865-pvdw5" Jul 15 21:45:08.399665 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:08.399514 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-c2c3a008-29735865-pvdw5" event={"ID":"71d31fc0-463a-4808-a369-23852315612e","Type":"ContainerDied","Data":"bf7dd459833b54f3aea642e601c9f043ec2085003c65e3160d6c1b3e6f64887f"} Jul 15 21:45:08.399665 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:08.399619 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bf7dd459833b54f3aea642e601c9f043ec2085003c65e3160d6c1b3e6f64887f" Jul 15 21:45:08.400949 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:08.400901 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-86b85e98-29735865-v872x" Jul 15 21:45:08.401074 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:08.400931 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-86b85e98-29735865-v872x" event={"ID":"5808607a-4523-4434-935a-e59857259654","Type":"ContainerDied","Data":"5f6fbda8eb90480c5723e11b9a477b17b90bef18c7ad035d0078dc315da8f470"} Jul 15 21:45:08.401074 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:08.401036 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5f6fbda8eb90480c5723e11b9a477b17b90bef18c7ad035d0078dc315da8f470" Jul 15 21:45:08.402859 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:08.402817 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-620eb2f1-29735865-xtt8n" Jul 15 21:45:08.402859 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:08.402830 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-620eb2f1-29735865-xtt8n" event={"ID":"fe664183-a069-4b51-8c9d-9af93ebcca27","Type":"ContainerDied","Data":"ce170e1ce48146b5ea2017e6afd3221f0588d824f8a2ec95065c97aa50775ba4"} Jul 15 21:45:08.403085 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:08.402897 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce170e1ce48146b5ea2017e6afd3221f0588d824f8a2ec95065c97aa50775ba4" Jul 15 21:45:08.404434 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:08.404395 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-599e95-29735865-q9lbd" Jul 15 21:45:08.404434 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:08.404404 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-599e95-29735865-q9lbd" event={"ID":"9432dd1c-089d-448d-9252-d3b7bd514b3d","Type":"ContainerDied","Data":"9e97480f1356cb7a1cf9bbdaa9333f250ee53e77d364eab4aa9a7c7c3aa9cc1c"} Jul 15 21:45:08.404601 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:08.404441 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e97480f1356cb7a1cf9bbdaa9333f250ee53e77d364eab4aa9a7c7c3aa9cc1c" Jul 15 21:45:08.407168 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:08.407075 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-c664d0-29735865-2nbfn" event={"ID":"7f023c97-319c-4d72-b4fa-1990243d3c1e","Type":"ContainerDied","Data":"b7fe14c2235f7eca31d7bfe553851b1ba86a5de76bb3b38803d62d3e3a085330"} Jul 15 21:45:08.407168 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:08.407095 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-c664d0-29735865-2nbfn" Jul 15 21:45:08.407168 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:08.407115 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b7fe14c2235f7eca31d7bfe553851b1ba86a5de76bb3b38803d62d3e3a085330" Jul 15 21:45:08.409306 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:08.409267 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-d3a40f-29735865-mgtbr" Jul 15 21:45:08.409410 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:08.409370 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-d3a40f-29735865-mgtbr" event={"ID":"94bc3837-1aca-4a00-a796-48463fa0b868","Type":"ContainerDied","Data":"43d3ab894f04a9e08ea305ca9287bb201efd46d21a265bae9bc199f4c32720b0"} Jul 15 21:45:08.409464 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:08.409412 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="43d3ab894f04a9e08ea305ca9287bb201efd46d21a265bae9bc199f4c32720b0" Jul 15 21:45:08.411011 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:08.410985 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-4ec9ec-29735865-rgnbz" event={"ID":"54e00cf7-d349-4216-bf96-900cded7eb8c","Type":"ContainerDied","Data":"9d466eed3dcaa2d1a51dfd5916693e3558908ce8566351b925cef57db4d593e9"} Jul 15 21:45:08.411138 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:08.411029 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d466eed3dcaa2d1a51dfd5916693e3558908ce8566351b925cef57db4d593e9" Jul 15 21:45:08.411138 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:08.411086 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-4ec9ec-29735865-rgnbz" Jul 15 21:45:08.413864 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:08.413848 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-a5309f-29735865-frzz7" Jul 15 21:45:08.413960 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:08.413908 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-a5309f-29735865-frzz7" event={"ID":"19ec0c66-45ff-4cb1-a6d0-7e849996c5d7","Type":"ContainerDied","Data":"f6876b7bf79b8572ba16bf7caa7fb14117e740a462b45679706532fb0ec0e444"} Jul 15 21:45:08.413960 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:08.413945 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f6876b7bf79b8572ba16bf7caa7fb14117e740a462b45679706532fb0ec0e444" Jul 15 21:45:08.418317 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:08.416966 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735865-tc5ds" event={"ID":"c92baa17-cd07-40e5-81f6-60911f3bbf93","Type":"ContainerDied","Data":"f135b92b2c5559e24bf86272ccc9ab87974da2b4c515ef76c12fdb03649ad295"} Jul 15 21:45:08.418317 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:08.417004 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f135b92b2c5559e24bf86272ccc9ab87974da2b4c515ef76c12fdb03649ad295" Jul 15 21:45:08.418317 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:45:08.417057 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735865-tc5ds" Jul 15 21:48:34.051438 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:34.051361 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7624-140173653060016"] Jul 15 21:48:34.051921 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:34.051906 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c92baa17-cd07-40e5-81f6-60911f3bbf93" containerName="cleanup" Jul 15 21:48:34.051977 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:34.051923 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c92baa17-cd07-40e5-81f6-60911f3bbf93" containerName="cleanup" Jul 15 21:48:34.051977 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:34.051940 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f023c97-319c-4d72-b4fa-1990243d3c1e" containerName="cleanup" Jul 15 21:48:34.051977 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:34.051945 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f023c97-319c-4d72-b4fa-1990243d3c1e" containerName="cleanup" Jul 15 21:48:34.051977 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:34.051956 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe664183-a069-4b51-8c9d-9af93ebcca27" containerName="cleanup" Jul 15 21:48:34.051977 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:34.051968 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe664183-a069-4b51-8c9d-9af93ebcca27" containerName="cleanup" Jul 15 21:48:34.052131 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:34.051977 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9432dd1c-089d-448d-9252-d3b7bd514b3d" containerName="cleanup" Jul 15 21:48:34.052131 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:34.051986 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9432dd1c-089d-448d-9252-d3b7bd514b3d" containerName="cleanup" Jul 15 21:48:34.052131 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:34.051999 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79eadbb8-3991-459c-89ef-525b30e1bfce" containerName="cleanup" Jul 15 21:48:34.052131 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:34.052004 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="79eadbb8-3991-459c-89ef-525b30e1bfce" containerName="cleanup" Jul 15 21:48:34.052131 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:34.052013 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19ec0c66-45ff-4cb1-a6d0-7e849996c5d7" containerName="cleanup" Jul 15 21:48:34.052131 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:34.052018 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="19ec0c66-45ff-4cb1-a6d0-7e849996c5d7" containerName="cleanup" Jul 15 21:48:34.052131 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:34.052026 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5808607a-4523-4434-935a-e59857259654" containerName="cleanup" Jul 15 21:48:34.052131 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:34.052031 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5808607a-4523-4434-935a-e59857259654" containerName="cleanup" Jul 15 21:48:34.052131 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:34.052036 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54e00cf7-d349-4216-bf96-900cded7eb8c" containerName="cleanup" Jul 15 21:48:34.052131 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:34.052042 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="54e00cf7-d349-4216-bf96-900cded7eb8c" containerName="cleanup" Jul 15 21:48:34.052131 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:34.052049 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94bc3837-1aca-4a00-a796-48463fa0b868" containerName="cleanup" Jul 15 21:48:34.052131 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:34.052053 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="94bc3837-1aca-4a00-a796-48463fa0b868" containerName="cleanup" Jul 15 21:48:34.052131 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:34.052060 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71d31fc0-463a-4808-a369-23852315612e" containerName="cleanup" Jul 15 21:48:34.052131 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:34.052064 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="71d31fc0-463a-4808-a369-23852315612e" containerName="cleanup" Jul 15 21:48:34.052131 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:34.052133 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="5808607a-4523-4434-935a-e59857259654" containerName="cleanup" Jul 15 21:48:34.052618 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:34.052139 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c92baa17-cd07-40e5-81f6-60911f3bbf93" containerName="cleanup" Jul 15 21:48:34.052618 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:34.052144 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe664183-a069-4b51-8c9d-9af93ebcca27" containerName="cleanup" Jul 15 21:48:34.052618 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:34.052150 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f023c97-319c-4d72-b4fa-1990243d3c1e" containerName="cleanup" Jul 15 21:48:34.052618 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:34.052155 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="54e00cf7-d349-4216-bf96-900cded7eb8c" containerName="cleanup" Jul 15 21:48:34.052618 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:34.052161 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="9432dd1c-089d-448d-9252-d3b7bd514b3d" containerName="cleanup" Jul 15 21:48:34.052618 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:34.052166 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="71d31fc0-463a-4808-a369-23852315612e" containerName="cleanup" Jul 15 21:48:34.052618 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:34.052172 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="79eadbb8-3991-459c-89ef-525b30e1bfce" containerName="cleanup" Jul 15 21:48:34.052618 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:34.052176 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="19ec0c66-45ff-4cb1-a6d0-7e849996c5d7" containerName="cleanup" Jul 15 21:48:34.052618 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:34.052183 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="94bc3837-1aca-4a00-a796-48463fa0b868" containerName="cleanup" Jul 15 21:48:34.054698 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:34.054683 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7624-140173653060016" Jul 15 21:48:34.056948 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:34.056926 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-qt2bh\"" Jul 15 21:48:34.058817 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:34.058798 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7624-140173653060016"] Jul 15 21:48:34.135990 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:34.135949 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btjgq\" (UniqueName: \"kubernetes.io/projected/17ee81a5-e6e5-4f90-89f2-af7caec18c24-kube-api-access-btjgq\") pod \"test-curl-7624-140173653060016\" (UID: \"17ee81a5-e6e5-4f90-89f2-af7caec18c24\") " pod="opendatahub/test-curl-7624-140173653060016" Jul 15 21:48:34.237094 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:34.237043 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btjgq\" (UniqueName: \"kubernetes.io/projected/17ee81a5-e6e5-4f90-89f2-af7caec18c24-kube-api-access-btjgq\") pod \"test-curl-7624-140173653060016\" (UID: \"17ee81a5-e6e5-4f90-89f2-af7caec18c24\") " pod="opendatahub/test-curl-7624-140173653060016" Jul 15 21:48:34.245303 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:34.245269 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btjgq\" (UniqueName: \"kubernetes.io/projected/17ee81a5-e6e5-4f90-89f2-af7caec18c24-kube-api-access-btjgq\") pod \"test-curl-7624-140173653060016\" (UID: \"17ee81a5-e6e5-4f90-89f2-af7caec18c24\") " pod="opendatahub/test-curl-7624-140173653060016" Jul 15 21:48:34.366068 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:34.366032 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7624-140173653060016" Jul 15 21:48:34.511777 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:34.511752 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7624-140173653060016"] Jul 15 21:48:34.513801 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:48:34.513773 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod17ee81a5_e6e5_4f90_89f2_af7caec18c24.slice/crio-0a5092ce54a909eb474201a0ef178e061f4e031b1f1ffab54cd78061cfc7f98d WatchSource:0}: Error finding container 0a5092ce54a909eb474201a0ef178e061f4e031b1f1ffab54cd78061cfc7f98d: Status 404 returned error can't find the container with id 0a5092ce54a909eb474201a0ef178e061f4e031b1f1ffab54cd78061cfc7f98d Jul 15 21:48:34.800780 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:34.800695 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7624-140173653060016" event={"ID":"17ee81a5-e6e5-4f90-89f2-af7caec18c24","Type":"ContainerStarted","Data":"0a5092ce54a909eb474201a0ef178e061f4e031b1f1ffab54cd78061cfc7f98d"} Jul 15 21:48:35.808939 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:35.808906 2570 generic.go:356] "Generic (PLEG): container finished" podID="17ee81a5-e6e5-4f90-89f2-af7caec18c24" containerID="6420e4ca71b613cac3f7055a89c358c43960532d2d72ebcfdb6685e7e2ef5e07" exitCode=0 Jul 15 21:48:35.809371 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:35.808995 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7624-140173653060016" event={"ID":"17ee81a5-e6e5-4f90-89f2-af7caec18c24","Type":"ContainerDied","Data":"6420e4ca71b613cac3f7055a89c358c43960532d2d72ebcfdb6685e7e2ef5e07"} Jul 15 21:48:36.963218 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:36.963194 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7624-140173653060016" Jul 15 21:48:36.995010 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:36.994989 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7624-140173653060016_17ee81a5-e6e5-4f90-89f2-af7caec18c24/test-curl-7624-140173653060016/0.log" Jul 15 21:48:37.020627 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:37.020587 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7624-140173653060016"] Jul 15 21:48:37.023624 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:37.023599 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7624-140173653060016"] Jul 15 21:48:37.068534 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:37.068458 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-btjgq\" (UniqueName: \"kubernetes.io/projected/17ee81a5-e6e5-4f90-89f2-af7caec18c24-kube-api-access-btjgq\") pod \"17ee81a5-e6e5-4f90-89f2-af7caec18c24\" (UID: \"17ee81a5-e6e5-4f90-89f2-af7caec18c24\") " Jul 15 21:48:37.070562 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:37.070534 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17ee81a5-e6e5-4f90-89f2-af7caec18c24-kube-api-access-btjgq" (OuterVolumeSpecName: "kube-api-access-btjgq") pod "17ee81a5-e6e5-4f90-89f2-af7caec18c24" (UID: "17ee81a5-e6e5-4f90-89f2-af7caec18c24"). InnerVolumeSpecName "kube-api-access-btjgq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:48:37.156521 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:37.156490 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7624-140173654587312"] Jul 15 21:48:37.156998 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:37.156985 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17ee81a5-e6e5-4f90-89f2-af7caec18c24" containerName="test-curl-7624-140173653060016" Jul 15 21:48:37.157052 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:37.157000 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="17ee81a5-e6e5-4f90-89f2-af7caec18c24" containerName="test-curl-7624-140173653060016" Jul 15 21:48:37.157110 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:37.157101 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="17ee81a5-e6e5-4f90-89f2-af7caec18c24" containerName="test-curl-7624-140173653060016" Jul 15 21:48:37.159640 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:37.159623 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7624-140173654587312" Jul 15 21:48:37.165656 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:37.165629 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7624-140173654587312"] Jul 15 21:48:37.181313 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:37.170077 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btjgq\" (UniqueName: \"kubernetes.io/projected/17ee81a5-e6e5-4f90-89f2-af7caec18c24-kube-api-access-btjgq\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:48:37.271324 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:37.271246 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h9pv\" (UniqueName: \"kubernetes.io/projected/86c7371f-e563-4387-b47e-0d615a5ae621-kube-api-access-2h9pv\") pod \"test-curl-7624-140173654587312\" (UID: \"86c7371f-e563-4387-b47e-0d615a5ae621\") " pod="opendatahub/test-curl-7624-140173654587312" Jul 15 21:48:37.372630 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:37.372590 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h9pv\" (UniqueName: \"kubernetes.io/projected/86c7371f-e563-4387-b47e-0d615a5ae621-kube-api-access-2h9pv\") pod \"test-curl-7624-140173654587312\" (UID: \"86c7371f-e563-4387-b47e-0d615a5ae621\") " pod="opendatahub/test-curl-7624-140173654587312" Jul 15 21:48:37.380904 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:37.380868 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h9pv\" (UniqueName: \"kubernetes.io/projected/86c7371f-e563-4387-b47e-0d615a5ae621-kube-api-access-2h9pv\") pod \"test-curl-7624-140173654587312\" (UID: \"86c7371f-e563-4387-b47e-0d615a5ae621\") " pod="opendatahub/test-curl-7624-140173654587312" Jul 15 21:48:37.471133 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:37.471099 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7624-140173654587312" Jul 15 21:48:37.814740 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:37.814706 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7624-140173654587312"] Jul 15 21:48:37.815188 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:48:37.815162 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod86c7371f_e563_4387_b47e_0d615a5ae621.slice/crio-376cfc18c08c1011e55da278b8d18bd46df39881ea73269467b51415d145eab1 WatchSource:0}: Error finding container 376cfc18c08c1011e55da278b8d18bd46df39881ea73269467b51415d145eab1: Status 404 returned error can't find the container with id 376cfc18c08c1011e55da278b8d18bd46df39881ea73269467b51415d145eab1 Jul 15 21:48:37.822986 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:37.822960 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7624-140173654587312" event={"ID":"86c7371f-e563-4387-b47e-0d615a5ae621","Type":"ContainerStarted","Data":"376cfc18c08c1011e55da278b8d18bd46df39881ea73269467b51415d145eab1"} Jul 15 21:48:37.824270 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:37.824248 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a5092ce54a909eb474201a0ef178e061f4e031b1f1ffab54cd78061cfc7f98d" Jul 15 21:48:37.824270 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:37.824263 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7624-140173653060016" Jul 15 21:48:37.834870 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:48:37.834846 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7624-140173653060016\" is forbidden: User \"system:node:ip-10-0-131-113.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-113.ec2.internal' and this object" podUID="17ee81a5-e6e5-4f90-89f2-af7caec18c24" pod="opendatahub/test-curl-7624-140173653060016" Jul 15 21:48:38.589252 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:48:38.589219 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7624-140173653060016\" is forbidden: User \"system:node:ip-10-0-131-113.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-113.ec2.internal' and this object" podUID="17ee81a5-e6e5-4f90-89f2-af7caec18c24" pod="opendatahub/test-curl-7624-140173653060016" Jul 15 21:48:38.590502 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:38.590483 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17ee81a5-e6e5-4f90-89f2-af7caec18c24" path="/var/lib/kubelet/pods/17ee81a5-e6e5-4f90-89f2-af7caec18c24/volumes" Jul 15 21:48:38.832750 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:38.832715 2570 generic.go:356] "Generic (PLEG): container finished" podID="86c7371f-e563-4387-b47e-0d615a5ae621" containerID="8159f5ab40b148bd3516fa503f32c992251a55b653664243cf7db7a404f35a3d" exitCode=0 Jul 15 21:48:38.832939 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:38.832800 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7624-140173654587312" event={"ID":"86c7371f-e563-4387-b47e-0d615a5ae621","Type":"ContainerDied","Data":"8159f5ab40b148bd3516fa503f32c992251a55b653664243cf7db7a404f35a3d"} Jul 15 21:48:39.993733 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:39.993707 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7624-140173654587312" Jul 15 21:48:40.012564 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:40.012527 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7624-140173654587312_86c7371f-e563-4387-b47e-0d615a5ae621/test-curl-7624-140173654587312/0.log" Jul 15 21:48:40.038795 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:40.038760 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7624-140173654587312"] Jul 15 21:48:40.042548 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:40.042518 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7624-140173654587312"] Jul 15 21:48:40.097636 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:40.097556 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2h9pv\" (UniqueName: \"kubernetes.io/projected/86c7371f-e563-4387-b47e-0d615a5ae621-kube-api-access-2h9pv\") pod \"86c7371f-e563-4387-b47e-0d615a5ae621\" (UID: \"86c7371f-e563-4387-b47e-0d615a5ae621\") " Jul 15 21:48:40.099669 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:40.099641 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86c7371f-e563-4387-b47e-0d615a5ae621-kube-api-access-2h9pv" (OuterVolumeSpecName: "kube-api-access-2h9pv") pod "86c7371f-e563-4387-b47e-0d615a5ae621" (UID: "86c7371f-e563-4387-b47e-0d615a5ae621"). InnerVolumeSpecName "kube-api-access-2h9pv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:48:40.198829 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:40.198793 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2h9pv\" (UniqueName: \"kubernetes.io/projected/86c7371f-e563-4387-b47e-0d615a5ae621-kube-api-access-2h9pv\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:48:40.222480 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:40.222445 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7624-140173653929248"] Jul 15 21:48:40.222980 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:40.222965 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86c7371f-e563-4387-b47e-0d615a5ae621" containerName="test-curl-7624-140173654587312" Jul 15 21:48:40.223028 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:40.222981 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="86c7371f-e563-4387-b47e-0d615a5ae621" containerName="test-curl-7624-140173654587312" Jul 15 21:48:40.223089 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:40.223079 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="86c7371f-e563-4387-b47e-0d615a5ae621" containerName="test-curl-7624-140173654587312" Jul 15 21:48:40.225408 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:40.225392 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7624-140173653929248" Jul 15 21:48:40.235227 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:40.235196 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7624-140173653929248"] Jul 15 21:48:40.299709 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:40.299672 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf7qz\" (UniqueName: \"kubernetes.io/projected/275da6fa-1b90-4a2d-9a61-e93e00f04a4d-kube-api-access-xf7qz\") pod \"test-curl-7624-140173653929248\" (UID: \"275da6fa-1b90-4a2d-9a61-e93e00f04a4d\") " pod="opendatahub/test-curl-7624-140173653929248" Jul 15 21:48:40.401071 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:40.400979 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf7qz\" (UniqueName: \"kubernetes.io/projected/275da6fa-1b90-4a2d-9a61-e93e00f04a4d-kube-api-access-xf7qz\") pod \"test-curl-7624-140173653929248\" (UID: \"275da6fa-1b90-4a2d-9a61-e93e00f04a4d\") " pod="opendatahub/test-curl-7624-140173653929248" Jul 15 21:48:40.408937 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:40.408913 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf7qz\" (UniqueName: \"kubernetes.io/projected/275da6fa-1b90-4a2d-9a61-e93e00f04a4d-kube-api-access-xf7qz\") pod \"test-curl-7624-140173653929248\" (UID: \"275da6fa-1b90-4a2d-9a61-e93e00f04a4d\") " pod="opendatahub/test-curl-7624-140173653929248" Jul 15 21:48:40.546930 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:40.546894 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7624-140173653929248" Jul 15 21:48:40.590552 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:40.590518 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86c7371f-e563-4387-b47e-0d615a5ae621" path="/var/lib/kubelet/pods/86c7371f-e563-4387-b47e-0d615a5ae621/volumes" Jul 15 21:48:40.689645 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:40.689590 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7624-140173653929248"] Jul 15 21:48:40.691928 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:48:40.691902 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod275da6fa_1b90_4a2d_9a61_e93e00f04a4d.slice/crio-26cf26d11b5d612b097b8fd5a6ac4c69685abab48f6a7cdbf1d216bbe86c1677 WatchSource:0}: Error finding container 26cf26d11b5d612b097b8fd5a6ac4c69685abab48f6a7cdbf1d216bbe86c1677: Status 404 returned error can't find the container with id 26cf26d11b5d612b097b8fd5a6ac4c69685abab48f6a7cdbf1d216bbe86c1677 Jul 15 21:48:40.847857 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:40.847829 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7624-140173654587312" Jul 15 21:48:40.847857 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:40.847857 2570 scope.go:117] "RemoveContainer" containerID="8159f5ab40b148bd3516fa503f32c992251a55b653664243cf7db7a404f35a3d" Jul 15 21:48:40.849486 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:40.849455 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7624-140173653929248" event={"ID":"275da6fa-1b90-4a2d-9a61-e93e00f04a4d","Type":"ContainerStarted","Data":"26cf26d11b5d612b097b8fd5a6ac4c69685abab48f6a7cdbf1d216bbe86c1677"} Jul 15 21:48:41.857388 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:41.857354 2570 generic.go:356] "Generic (PLEG): container finished" podID="275da6fa-1b90-4a2d-9a61-e93e00f04a4d" containerID="4b8739ead9e2f1a023b34777b4e18ed78e57b5b73def184a050950659173b3f0" exitCode=0 Jul 15 21:48:41.857854 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:41.857450 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7624-140173653929248" event={"ID":"275da6fa-1b90-4a2d-9a61-e93e00f04a4d","Type":"ContainerDied","Data":"4b8739ead9e2f1a023b34777b4e18ed78e57b5b73def184a050950659173b3f0"} Jul 15 21:48:43.027021 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:43.026994 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7624-140173653929248" Jul 15 21:48:43.049344 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:43.049315 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7624-140173653929248_275da6fa-1b90-4a2d-9a61-e93e00f04a4d/test-curl-7624-140173653929248/0.log" Jul 15 21:48:43.079385 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:43.079353 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7624-140173653929248"] Jul 15 21:48:43.083058 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:43.083034 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7624-140173653929248"] Jul 15 21:48:43.130198 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:43.130110 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xf7qz\" (UniqueName: \"kubernetes.io/projected/275da6fa-1b90-4a2d-9a61-e93e00f04a4d-kube-api-access-xf7qz\") pod \"275da6fa-1b90-4a2d-9a61-e93e00f04a4d\" (UID: \"275da6fa-1b90-4a2d-9a61-e93e00f04a4d\") " Jul 15 21:48:43.132258 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:43.132228 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/275da6fa-1b90-4a2d-9a61-e93e00f04a4d-kube-api-access-xf7qz" (OuterVolumeSpecName: "kube-api-access-xf7qz") pod "275da6fa-1b90-4a2d-9a61-e93e00f04a4d" (UID: "275da6fa-1b90-4a2d-9a61-e93e00f04a4d"). InnerVolumeSpecName "kube-api-access-xf7qz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:48:43.209104 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:43.209065 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7624-140173653929248"] Jul 15 21:48:43.209686 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:43.209668 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="275da6fa-1b90-4a2d-9a61-e93e00f04a4d" containerName="test-curl-7624-140173653929248" Jul 15 21:48:43.209686 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:43.209686 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="275da6fa-1b90-4a2d-9a61-e93e00f04a4d" containerName="test-curl-7624-140173653929248" Jul 15 21:48:43.209866 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:43.209789 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="275da6fa-1b90-4a2d-9a61-e93e00f04a4d" containerName="test-curl-7624-140173653929248" Jul 15 21:48:43.212869 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:43.212846 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7624-140173653929248" Jul 15 21:48:43.218227 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:43.218204 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7624-140173653929248"] Jul 15 21:48:43.231982 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:43.231951 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xf7qz\" (UniqueName: \"kubernetes.io/projected/275da6fa-1b90-4a2d-9a61-e93e00f04a4d-kube-api-access-xf7qz\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:48:43.333232 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:43.333195 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6fld\" (UniqueName: \"kubernetes.io/projected/c19df3cf-ce7b-4557-9aa4-824f598d77cf-kube-api-access-r6fld\") pod \"test-curl-7624-140173653929248\" (UID: \"c19df3cf-ce7b-4557-9aa4-824f598d77cf\") " pod="opendatahub/test-curl-7624-140173653929248" Jul 15 21:48:43.434877 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:43.434785 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6fld\" (UniqueName: \"kubernetes.io/projected/c19df3cf-ce7b-4557-9aa4-824f598d77cf-kube-api-access-r6fld\") pod \"test-curl-7624-140173653929248\" (UID: \"c19df3cf-ce7b-4557-9aa4-824f598d77cf\") " pod="opendatahub/test-curl-7624-140173653929248" Jul 15 21:48:43.443184 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:43.443157 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6fld\" (UniqueName: \"kubernetes.io/projected/c19df3cf-ce7b-4557-9aa4-824f598d77cf-kube-api-access-r6fld\") pod \"test-curl-7624-140173653929248\" (UID: \"c19df3cf-ce7b-4557-9aa4-824f598d77cf\") " pod="opendatahub/test-curl-7624-140173653929248" Jul 15 21:48:43.522993 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:43.522956 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7624-140173653929248" Jul 15 21:48:43.662238 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:43.662212 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7624-140173653929248"] Jul 15 21:48:43.663935 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:48:43.663906 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc19df3cf_ce7b_4557_9aa4_824f598d77cf.slice/crio-e2b1fe743eb6e4735b7d3fc689bb8485456a40844c766a64f14367b5d75304ae WatchSource:0}: Error finding container e2b1fe743eb6e4735b7d3fc689bb8485456a40844c766a64f14367b5d75304ae: Status 404 returned error can't find the container with id e2b1fe743eb6e4735b7d3fc689bb8485456a40844c766a64f14367b5d75304ae Jul 15 21:48:43.872800 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:43.872771 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7624-140173653929248" Jul 15 21:48:43.872989 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:43.872823 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="26cf26d11b5d612b097b8fd5a6ac4c69685abab48f6a7cdbf1d216bbe86c1677" Jul 15 21:48:43.874092 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:43.874064 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7624-140173653929248" event={"ID":"c19df3cf-ce7b-4557-9aa4-824f598d77cf","Type":"ContainerStarted","Data":"e2b1fe743eb6e4735b7d3fc689bb8485456a40844c766a64f14367b5d75304ae"} Jul 15 21:48:43.892854 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:43.892817 2570 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7624-140173653929248" oldPodUID="275da6fa-1b90-4a2d-9a61-e93e00f04a4d" podUID="c19df3cf-ce7b-4557-9aa4-824f598d77cf" Jul 15 21:48:44.589862 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:44.589829 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="275da6fa-1b90-4a2d-9a61-e93e00f04a4d" path="/var/lib/kubelet/pods/275da6fa-1b90-4a2d-9a61-e93e00f04a4d/volumes" Jul 15 21:48:44.881812 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:44.881724 2570 generic.go:356] "Generic (PLEG): container finished" podID="c19df3cf-ce7b-4557-9aa4-824f598d77cf" containerID="c7023a466647f318868e91c322401e2d0a05a0011f0385a3a0aa9a88232cf19e" exitCode=0 Jul 15 21:48:44.881965 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:44.881812 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7624-140173653929248" event={"ID":"c19df3cf-ce7b-4557-9aa4-824f598d77cf","Type":"ContainerDied","Data":"c7023a466647f318868e91c322401e2d0a05a0011f0385a3a0aa9a88232cf19e"} Jul 15 21:48:46.035742 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:46.035720 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7624-140173653929248" Jul 15 21:48:46.055428 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:46.055405 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7624-140173653929248_c19df3cf-ce7b-4557-9aa4-824f598d77cf/test-curl-7624-140173653929248/0.log" Jul 15 21:48:46.081542 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:46.081499 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7624-140173653929248"] Jul 15 21:48:46.084467 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:46.084439 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7624-140173653929248"] Jul 15 21:48:46.163694 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:46.163588 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6fld\" (UniqueName: \"kubernetes.io/projected/c19df3cf-ce7b-4557-9aa4-824f598d77cf-kube-api-access-r6fld\") pod \"c19df3cf-ce7b-4557-9aa4-824f598d77cf\" (UID: \"c19df3cf-ce7b-4557-9aa4-824f598d77cf\") " Jul 15 21:48:46.165706 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:46.165671 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c19df3cf-ce7b-4557-9aa4-824f598d77cf-kube-api-access-r6fld" (OuterVolumeSpecName: "kube-api-access-r6fld") pod "c19df3cf-ce7b-4557-9aa4-824f598d77cf" (UID: "c19df3cf-ce7b-4557-9aa4-824f598d77cf"). InnerVolumeSpecName "kube-api-access-r6fld". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:48:46.211114 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:46.211081 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7624-140173648990544"] Jul 15 21:48:46.211689 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:46.211671 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c19df3cf-ce7b-4557-9aa4-824f598d77cf" containerName="test-curl-7624-140173653929248" Jul 15 21:48:46.211799 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:46.211690 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c19df3cf-ce7b-4557-9aa4-824f598d77cf" containerName="test-curl-7624-140173653929248" Jul 15 21:48:46.211859 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:46.211827 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c19df3cf-ce7b-4557-9aa4-824f598d77cf" containerName="test-curl-7624-140173653929248" Jul 15 21:48:46.214977 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:46.214956 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7624-140173648990544" Jul 15 21:48:46.219747 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:46.219724 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7624-140173648990544"] Jul 15 21:48:46.264648 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:46.264613 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mpxx\" (UniqueName: \"kubernetes.io/projected/a8bbf942-9fdb-40f8-a76e-4715623aee7b-kube-api-access-9mpxx\") pod \"test-curl-7624-140173648990544\" (UID: \"a8bbf942-9fdb-40f8-a76e-4715623aee7b\") " pod="opendatahub/test-curl-7624-140173648990544" Jul 15 21:48:46.264810 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:46.264725 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6fld\" (UniqueName: \"kubernetes.io/projected/c19df3cf-ce7b-4557-9aa4-824f598d77cf-kube-api-access-r6fld\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:48:46.365312 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:46.365259 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mpxx\" (UniqueName: \"kubernetes.io/projected/a8bbf942-9fdb-40f8-a76e-4715623aee7b-kube-api-access-9mpxx\") pod \"test-curl-7624-140173648990544\" (UID: \"a8bbf942-9fdb-40f8-a76e-4715623aee7b\") " pod="opendatahub/test-curl-7624-140173648990544" Jul 15 21:48:46.373434 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:46.373404 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mpxx\" (UniqueName: \"kubernetes.io/projected/a8bbf942-9fdb-40f8-a76e-4715623aee7b-kube-api-access-9mpxx\") pod \"test-curl-7624-140173648990544\" (UID: \"a8bbf942-9fdb-40f8-a76e-4715623aee7b\") " pod="opendatahub/test-curl-7624-140173648990544" Jul 15 21:48:46.526090 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:46.526001 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7624-140173648990544" Jul 15 21:48:46.593701 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:46.593671 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c19df3cf-ce7b-4557-9aa4-824f598d77cf" path="/var/lib/kubelet/pods/c19df3cf-ce7b-4557-9aa4-824f598d77cf/volumes" Jul 15 21:48:46.671898 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:48:46.671872 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8bbf942_9fdb_40f8_a76e_4715623aee7b.slice/crio-8041f77b1049bca22d7bd710d39a68019bb9171551908fdcc9691aab8ec7eb83 WatchSource:0}: Error finding container 8041f77b1049bca22d7bd710d39a68019bb9171551908fdcc9691aab8ec7eb83: Status 404 returned error can't find the container with id 8041f77b1049bca22d7bd710d39a68019bb9171551908fdcc9691aab8ec7eb83 Jul 15 21:48:46.672983 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:46.672950 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7624-140173648990544"] Jul 15 21:48:46.896824 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:46.896793 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7624-140173653929248" Jul 15 21:48:46.897026 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:46.896835 2570 scope.go:117] "RemoveContainer" containerID="c7023a466647f318868e91c322401e2d0a05a0011f0385a3a0aa9a88232cf19e" Jul 15 21:48:46.898195 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:46.898178 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7624-140173648990544" event={"ID":"a8bbf942-9fdb-40f8-a76e-4715623aee7b","Type":"ContainerStarted","Data":"8041f77b1049bca22d7bd710d39a68019bb9171551908fdcc9691aab8ec7eb83"} Jul 15 21:48:47.906659 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:47.906620 2570 generic.go:356] "Generic (PLEG): container finished" podID="a8bbf942-9fdb-40f8-a76e-4715623aee7b" containerID="cbcc123fa545f751a097e5cb7b6394e8ad3e5b882617d4b1c3699da6ac9364bd" exitCode=0 Jul 15 21:48:47.907040 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:47.906710 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7624-140173648990544" event={"ID":"a8bbf942-9fdb-40f8-a76e-4715623aee7b","Type":"ContainerDied","Data":"cbcc123fa545f751a097e5cb7b6394e8ad3e5b882617d4b1c3699da6ac9364bd"} Jul 15 21:48:49.066529 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:49.066502 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7624-140173648990544" Jul 15 21:48:49.086224 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:49.086177 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7624-140173648990544_a8bbf942-9fdb-40f8-a76e-4715623aee7b/test-curl-7624-140173648990544/0.log" Jul 15 21:48:49.112098 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:49.112061 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7624-140173648990544"] Jul 15 21:48:49.115791 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:49.115763 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7624-140173648990544"] Jul 15 21:48:49.192962 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:49.192864 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9mpxx\" (UniqueName: \"kubernetes.io/projected/a8bbf942-9fdb-40f8-a76e-4715623aee7b-kube-api-access-9mpxx\") pod \"a8bbf942-9fdb-40f8-a76e-4715623aee7b\" (UID: \"a8bbf942-9fdb-40f8-a76e-4715623aee7b\") " Jul 15 21:48:49.194955 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:49.194932 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8bbf942-9fdb-40f8-a76e-4715623aee7b-kube-api-access-9mpxx" (OuterVolumeSpecName: "kube-api-access-9mpxx") pod "a8bbf942-9fdb-40f8-a76e-4715623aee7b" (UID: "a8bbf942-9fdb-40f8-a76e-4715623aee7b"). InnerVolumeSpecName "kube-api-access-9mpxx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:48:49.293859 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:49.293822 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mpxx\" (UniqueName: \"kubernetes.io/projected/a8bbf942-9fdb-40f8-a76e-4715623aee7b-kube-api-access-9mpxx\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:48:49.922279 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:49.922254 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7624-140173648990544" Jul 15 21:48:49.922279 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:49.922303 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8041f77b1049bca22d7bd710d39a68019bb9171551908fdcc9691aab8ec7eb83" Jul 15 21:48:49.932061 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:48:49.932028 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7624-140173648990544\" is forbidden: User \"system:node:ip-10-0-131-113.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-113.ec2.internal' and this object" podUID="a8bbf942-9fdb-40f8-a76e-4715623aee7b" pod="opendatahub/test-curl-7624-140173648990544" Jul 15 21:48:50.590491 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:50.590462 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8bbf942-9fdb-40f8-a76e-4715623aee7b" path="/var/lib/kubelet/pods/a8bbf942-9fdb-40f8-a76e-4715623aee7b/volumes" Jul 15 21:48:59.399800 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:59.399769 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh"] Jul 15 21:48:59.400254 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:48:59.399968 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" podUID="7f49a35b-41c9-4a3c-85e0-6efe0329f3b6" containerName="istio-proxy" containerID="cri-o://8ab0413ee1182ec1aa2122e0ae22f3391e2bec3c1242aedd4b52e15bc7faac67" gracePeriod=30 Jul 15 21:49:04.666440 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:04.666371 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" Jul 15 21:49:04.856314 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:04.856268 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-workload-socket\") pod \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\" (UID: \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\") " Jul 15 21:49:04.856536 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:04.856345 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-istio-podinfo\") pod \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\" (UID: \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\") " Jul 15 21:49:04.856536 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:04.856399 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-istio-envoy\") pod \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\" (UID: \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\") " Jul 15 21:49:04.856536 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:04.856444 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-istio-data\") pod \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\" (UID: \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\") " Jul 15 21:49:04.856536 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:04.856469 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-credential-socket\") pod \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\" (UID: \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\") " Jul 15 21:49:04.856536 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:04.856511 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9srm\" (UniqueName: \"kubernetes.io/projected/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-kube-api-access-f9srm\") pod \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\" (UID: \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\") " Jul 15 21:49:04.856819 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:04.856549 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-istio-token\") pod \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\" (UID: \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\") " Jul 15 21:49:04.856819 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:04.856553 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7f49a35b-41c9-4a3c-85e0-6efe0329f3b6" (UID: "7f49a35b-41c9-4a3c-85e0-6efe0329f3b6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:49:04.856819 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:04.856577 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-istiod-ca-cert\") pod \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\" (UID: \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\") " Jul 15 21:49:04.856819 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:04.856601 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-workload-certs\") pod \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\" (UID: \"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6\") " Jul 15 21:49:04.857041 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:04.856824 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7f49a35b-41c9-4a3c-85e0-6efe0329f3b6" (UID: "7f49a35b-41c9-4a3c-85e0-6efe0329f3b6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:49:04.857041 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:04.856960 2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-credential-socket\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:49:04.857041 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:04.856985 2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-workload-socket\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:49:04.857041 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:04.857006 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7f49a35b-41c9-4a3c-85e0-6efe0329f3b6" (UID: "7f49a35b-41c9-4a3c-85e0-6efe0329f3b6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:49:04.857041 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:04.857019 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7f49a35b-41c9-4a3c-85e0-6efe0329f3b6" (UID: "7f49a35b-41c9-4a3c-85e0-6efe0329f3b6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:49:04.857543 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:04.857517 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-istio-data" (OuterVolumeSpecName: "istio-data") pod "7f49a35b-41c9-4a3c-85e0-6efe0329f3b6" (UID: "7f49a35b-41c9-4a3c-85e0-6efe0329f3b6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:49:04.858768 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:04.858741 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7f49a35b-41c9-4a3c-85e0-6efe0329f3b6" (UID: "7f49a35b-41c9-4a3c-85e0-6efe0329f3b6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 21:49:04.858889 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:04.858747 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-kube-api-access-f9srm" (OuterVolumeSpecName: "kube-api-access-f9srm") pod "7f49a35b-41c9-4a3c-85e0-6efe0329f3b6" (UID: "7f49a35b-41c9-4a3c-85e0-6efe0329f3b6"). InnerVolumeSpecName "kube-api-access-f9srm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:49:04.858889 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:04.858801 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7f49a35b-41c9-4a3c-85e0-6efe0329f3b6" (UID: "7f49a35b-41c9-4a3c-85e0-6efe0329f3b6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:49:04.858889 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:04.858839 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-istio-token" (OuterVolumeSpecName: "istio-token") pod "7f49a35b-41c9-4a3c-85e0-6efe0329f3b6" (UID: "7f49a35b-41c9-4a3c-85e0-6efe0329f3b6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:49:04.958430 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:04.958350 2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-istio-data\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:49:04.958430 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:04.958401 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9srm\" (UniqueName: \"kubernetes.io/projected/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-kube-api-access-f9srm\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:49:04.958430 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:04.958411 2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-istio-token\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:49:04.958430 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:04.958420 2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-istiod-ca-cert\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:49:04.958430 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:04.958428 2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-workload-certs\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:49:04.958430 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:04.958435 2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-istio-podinfo\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:49:04.958806 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:04.958442 2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6-istio-envoy\") on node \"ip-10-0-131-113.ec2.internal\" DevicePath \"\"" Jul 15 21:49:05.029698 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:05.029663 2570 generic.go:356] "Generic (PLEG): container finished" podID="7f49a35b-41c9-4a3c-85e0-6efe0329f3b6" containerID="8ab0413ee1182ec1aa2122e0ae22f3391e2bec3c1242aedd4b52e15bc7faac67" exitCode=0 Jul 15 21:49:05.029877 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:05.029726 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" Jul 15 21:49:05.029877 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:05.029750 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" event={"ID":"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6","Type":"ContainerDied","Data":"8ab0413ee1182ec1aa2122e0ae22f3391e2bec3c1242aedd4b52e15bc7faac67"} Jul 15 21:49:05.029877 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:05.029810 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh" event={"ID":"7f49a35b-41c9-4a3c-85e0-6efe0329f3b6","Type":"ContainerDied","Data":"bb576a7ba39ed5f6af23bd6c2c1ce935258fbb388d9dcec49742fc19ea79705d"} Jul 15 21:49:05.029877 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:05.029833 2570 scope.go:117] "RemoveContainer" containerID="8ab0413ee1182ec1aa2122e0ae22f3391e2bec3c1242aedd4b52e15bc7faac67" Jul 15 21:49:05.040374 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:05.040357 2570 scope.go:117] "RemoveContainer" containerID="1c519c8f13519ca2d1df5f74dc4ca7e4ade6a2b26740fd4d4a2d8081fbd30a2a" Jul 15 21:49:05.052530 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:05.052514 2570 scope.go:117] "RemoveContainer" containerID="8ab0413ee1182ec1aa2122e0ae22f3391e2bec3c1242aedd4b52e15bc7faac67" Jul 15 21:49:05.052790 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:49:05.052767 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ab0413ee1182ec1aa2122e0ae22f3391e2bec3c1242aedd4b52e15bc7faac67\": container with ID starting with 8ab0413ee1182ec1aa2122e0ae22f3391e2bec3c1242aedd4b52e15bc7faac67 not found: ID does not exist" containerID="8ab0413ee1182ec1aa2122e0ae22f3391e2bec3c1242aedd4b52e15bc7faac67" Jul 15 21:49:05.052894 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:05.052794 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ab0413ee1182ec1aa2122e0ae22f3391e2bec3c1242aedd4b52e15bc7faac67"} err="failed to get container status \"8ab0413ee1182ec1aa2122e0ae22f3391e2bec3c1242aedd4b52e15bc7faac67\": rpc error: code = NotFound desc = could not find container \"8ab0413ee1182ec1aa2122e0ae22f3391e2bec3c1242aedd4b52e15bc7faac67\": container with ID starting with 8ab0413ee1182ec1aa2122e0ae22f3391e2bec3c1242aedd4b52e15bc7faac67 not found: ID does not exist" Jul 15 21:49:05.052894 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:05.052809 2570 scope.go:117] "RemoveContainer" containerID="1c519c8f13519ca2d1df5f74dc4ca7e4ade6a2b26740fd4d4a2d8081fbd30a2a" Jul 15 21:49:05.053063 ip-10-0-131-113 kubenswrapper[2570]: E0715 21:49:05.053043 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c519c8f13519ca2d1df5f74dc4ca7e4ade6a2b26740fd4d4a2d8081fbd30a2a\": container with ID starting with 1c519c8f13519ca2d1df5f74dc4ca7e4ade6a2b26740fd4d4a2d8081fbd30a2a not found: ID does not exist" containerID="1c519c8f13519ca2d1df5f74dc4ca7e4ade6a2b26740fd4d4a2d8081fbd30a2a" Jul 15 21:49:05.053136 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:05.053075 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c519c8f13519ca2d1df5f74dc4ca7e4ade6a2b26740fd4d4a2d8081fbd30a2a"} err="failed to get container status \"1c519c8f13519ca2d1df5f74dc4ca7e4ade6a2b26740fd4d4a2d8081fbd30a2a\": rpc error: code = NotFound desc = could not find container \"1c519c8f13519ca2d1df5f74dc4ca7e4ade6a2b26740fd4d4a2d8081fbd30a2a\": container with ID starting with 1c519c8f13519ca2d1df5f74dc4ca7e4ade6a2b26740fd4d4a2d8081fbd30a2a not found: ID does not exist" Jul 15 21:49:05.054513 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:05.054490 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh"] Jul 15 21:49:05.057390 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:05.057368 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-c664d0-openshift-default-74ddcbbd95-sctqh"] Jul 15 21:49:06.589902 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:06.589869 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f49a35b-41c9-4a3c-85e0-6efe0329f3b6" path="/var/lib/kubelet/pods/7f49a35b-41c9-4a3c-85e0-6efe0329f3b6/volumes" Jul 15 21:49:07.072931 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:07.072901 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5bfd94b979-5lx6x_40bca165-8520-427d-8da9-1a0bf7776819/authorino/0.log" Jul 15 21:49:12.762285 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:12.762254 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-76phf_745fbddc-5ba4-47bc-82ec-5d2459817186/manager/0.log" Jul 15 21:49:12.891701 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:12.891668 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-plf56_9e5c5696-4755-4ff0-80cd-8353cd79ed37/manager/0.log" Jul 15 21:49:13.032771 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:13.032693 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-d79b5d84b-h7tmp_68aedec3-4453-455c-985a-5ad03f8fca5f/manager/0.log" Jul 15 21:49:13.150340 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:13.150313 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-69s79_e6a40d93-34b1-4cf6-93af-ec693a017d18/server/0.log" Jul 15 21:49:13.277139 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:13.277107 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-x7ftv_fb2d27e1-d593-477a-9312-1f56a7c3d795/manager/0.log" Jul 15 21:49:13.390929 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:13.390894 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d5d77c45b-6zkfh_81822492-d2d6-475e-b44f-7dda6d558b4f/copy-manifests/0.log" Jul 15 21:49:13.409724 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:13.409693 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d5d77c45b-6zkfh_81822492-d2d6-475e-b44f-7dda6d558b4f/manager/0.log" Jul 15 21:49:14.061616 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:14.061572 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6fd778c595-klfg6_1b353c4b-7d91-401d-b34d-f80399b2a8ea/maas-api/0.log" Jul 15 21:49:14.555341 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:14.555304 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-derive-86b85e98-67f6f6f65d-tlhr2_cb44c334-6dd7-4e30-ad2b-f289bc5486a1/maas-api/0.log" Jul 15 21:49:15.599427 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:15.599400 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735865-tc5ds_c92baa17-cd07-40e5-81f6-60911f3bbf93/cleanup/0.log" Jul 15 21:49:15.720089 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:15.720059 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-ait-d8b57005-29735865-xpdbf_79eadbb8-3991-459c-89ef-525b30e1bfce/cleanup/0.log" Jul 15 21:49:15.840476 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:15.840443 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-api-a-599e95-29735865-q9lbd_9432dd1c-089d-448d-9252-d3b7bd514b3d/cleanup/0.log" Jul 15 21:49:15.956069 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:15.955986 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-api-b-d3a40f-29735865-mgtbr_94bc3837-1aca-4a00-a796-48463fa0b868/cleanup/0.log" Jul 15 21:49:16.073145 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:16.073102 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-derive-86b85e98-29735865-v872x_5808607a-4523-4434-935a-e59857259654/cleanup/0.log" Jul 15 21:49:16.193496 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:16.193461 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-inf-a-4ec9ec-29735865-rgnbz_54e00cf7-d349-4216-bf96-900cded7eb8c/cleanup/0.log" Jul 15 21:49:16.308672 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:16.308600 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-inf-b-a5309f-29735865-frzz7_19ec0c66-45ff-4cb1-a6d0-7e849996c5d7/cleanup/0.log" Jul 15 21:49:16.433389 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:16.433364 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-migrate-620eb2f1-29735865-xtt8n_fe664183-a069-4b51-8c9d-9af93ebcca27/cleanup/0.log" Jul 15 21:49:16.552697 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:16.552669 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-mt-c2c3a008-29735865-pvdw5_71d31fc0-463a-4808-a369-23852315612e/cleanup/0.log" Jul 15 21:49:16.670026 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:16.669992 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-shared-a-c664d0-29735865-2nbfn_7f023c97-319c-4d72-b4fa-1990243d3c1e/cleanup/0.log" Jul 15 21:49:16.908906 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:16.908873 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-f2x8l_a018028b-8a6d-40e9-897e-3f58baba9edb/postgres/0.log" Jul 15 21:49:17.759038 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:17.759006 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599qdrm_3552a72a-0c17-4ca6-851a-dbfa12c23d49/util/0.log" Jul 15 21:49:17.765640 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:17.765617 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599qdrm_3552a72a-0c17-4ca6-851a-dbfa12c23d49/pull/0.log" Jul 15 21:49:17.771930 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:17.771908 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599qdrm_3552a72a-0c17-4ca6-851a-dbfa12c23d49/extract/0.log" Jul 15 21:49:17.902980 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:17.902955 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sb6zf_c7fc4b88-50e3-40b3-83fe-a67d05d56b78/pull/0.log" Jul 15 21:49:17.909787 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:17.909764 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sb6zf_c7fc4b88-50e3-40b3-83fe-a67d05d56b78/extract/0.log" Jul 15 21:49:17.916673 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:17.916651 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sb6zf_c7fc4b88-50e3-40b3-83fe-a67d05d56b78/util/0.log" Jul 15 21:49:18.033561 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:18.033472 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zlq4c_667c7c4e-0ab4-4034-9d8a-19dae1b6c79c/util/0.log" Jul 15 21:49:18.040824 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:18.040794 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zlq4c_667c7c4e-0ab4-4034-9d8a-19dae1b6c79c/pull/0.log" Jul 15 21:49:18.048802 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:18.048776 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zlq4c_667c7c4e-0ab4-4034-9d8a-19dae1b6c79c/extract/0.log" Jul 15 21:49:18.173049 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:18.173016 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pt4lv_05082e89-deef-4c9c-b3a4-f158b5831bef/util/0.log" Jul 15 21:49:18.180502 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:18.180480 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pt4lv_05082e89-deef-4c9c-b3a4-f158b5831bef/pull/0.log" Jul 15 21:49:18.187362 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:18.187341 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pt4lv_05082e89-deef-4c9c-b3a4-f158b5831bef/extract/0.log" Jul 15 21:49:18.319699 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:18.319623 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5bfd94b979-5lx6x_40bca165-8520-427d-8da9-1a0bf7776819/authorino/0.log" Jul 15 21:49:18.457154 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:18.457114 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-whr49_887411a9-6b6e-4c38-a047-6893b81ae21e/manager/0.log" Jul 15 21:49:18.576803 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:18.576748 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-mq6m4_1aa5b479-d659-48d8-9213-c56af45414e6/manager/0.log" Jul 15 21:49:18.848097 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:18.848013 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-ph8sr_590a0719-fcfa-459c-b855-a3ba5bf6d502/registry-server/0.log" Jul 15 21:49:19.277330 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:19.277224 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-ls7jm_c8a76546-f5ec-4b7c-809c-9ea015561752/manager/0.log" Jul 15 21:49:19.696538 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:19.696507 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4tp4th_114cde3d-fb10-4a66-a029-152d6e5b54c7/istio-proxy/0.log" Jul 15 21:49:19.969280 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:19.969191 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cbf464cb7-8mjpx_1da9bba7-0ba9-4ab6-91b7-2dcf2893e401/kube-auth-proxy/0.log" Jul 15 21:49:20.227518 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:20.227397 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hnfjp_4b11aee3-8b5c-4517-925c-b5c6c0932fdb/istio-proxy/1.log" Jul 15 21:49:20.360316 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:20.360239 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-54x66_af428720-6e24-4733-9a1a-0133212d6969/payload-pre-processing/0.log" Jul 15 21:49:20.501198 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:20.501120 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-ftvt9_30b77070-2603-4f74-ad7e-9308ac085dd8/payload-processing/0.log" Jul 15 21:49:20.627673 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:20.627645 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59ff8f8888-cmlk2_6c4352ba-2395-4d2c-b984-1af71646d3ae/router/0.log" Jul 15 21:49:21.006884 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:21.006850 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-pbj2m_b666c954-b4a7-46f1-ac05-eb1bfdb29ea6/main/0.log" Jul 15 21:49:21.506474 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:21.506442 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-bb8w5_d3b097db-ec9e-4d58-84c3-168bdbb96524/main/0.log" Jul 15 21:49:27.617725 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:27.617692 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8hvsf/must-gather-5vqhg"] Jul 15 21:49:27.618199 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:27.618185 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f49a35b-41c9-4a3c-85e0-6efe0329f3b6" containerName="istio-proxy" Jul 15 21:49:27.618245 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:27.618202 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f49a35b-41c9-4a3c-85e0-6efe0329f3b6" containerName="istio-proxy" Jul 15 21:49:27.618245 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:27.618225 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8bbf942-9fdb-40f8-a76e-4715623aee7b" containerName="test-curl-7624-140173648990544" Jul 15 21:49:27.618245 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:27.618235 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8bbf942-9fdb-40f8-a76e-4715623aee7b" containerName="test-curl-7624-140173648990544" Jul 15 21:49:27.618447 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:27.618250 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f49a35b-41c9-4a3c-85e0-6efe0329f3b6" containerName="istio-proxy" Jul 15 21:49:27.618447 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:27.618257 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f49a35b-41c9-4a3c-85e0-6efe0329f3b6" containerName="istio-proxy" Jul 15 21:49:27.618447 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:27.618395 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f49a35b-41c9-4a3c-85e0-6efe0329f3b6" containerName="istio-proxy" Jul 15 21:49:27.618447 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:27.618419 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8bbf942-9fdb-40f8-a76e-4715623aee7b" containerName="test-curl-7624-140173648990544" Jul 15 21:49:27.618693 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:27.618635 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f49a35b-41c9-4a3c-85e0-6efe0329f3b6" containerName="istio-proxy" Jul 15 21:49:27.622091 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:27.622073 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8hvsf/must-gather-5vqhg" Jul 15 21:49:27.625485 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:27.625465 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8hvsf\"/\"openshift-service-ca.crt\"" Jul 15 21:49:27.626170 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:27.626147 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8hvsf\"/\"kube-root-ca.crt\"" Jul 15 21:49:27.626255 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:27.626147 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8hvsf\"/\"default-dockercfg-vhb5k\"" Jul 15 21:49:27.634493 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:27.634473 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8hvsf/must-gather-5vqhg"] Jul 15 21:49:27.687629 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:27.687598 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f67ea68d-72ae-4b98-a389-dfdd53c1479d-must-gather-output\") pod \"must-gather-5vqhg\" (UID: \"f67ea68d-72ae-4b98-a389-dfdd53c1479d\") " pod="openshift-must-gather-8hvsf/must-gather-5vqhg" Jul 15 21:49:27.687781 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:27.687677 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w22h8\" (UniqueName: \"kubernetes.io/projected/f67ea68d-72ae-4b98-a389-dfdd53c1479d-kube-api-access-w22h8\") pod \"must-gather-5vqhg\" (UID: \"f67ea68d-72ae-4b98-a389-dfdd53c1479d\") " pod="openshift-must-gather-8hvsf/must-gather-5vqhg" Jul 15 21:49:27.789037 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:27.789002 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w22h8\" (UniqueName: \"kubernetes.io/projected/f67ea68d-72ae-4b98-a389-dfdd53c1479d-kube-api-access-w22h8\") pod \"must-gather-5vqhg\" (UID: \"f67ea68d-72ae-4b98-a389-dfdd53c1479d\") " pod="openshift-must-gather-8hvsf/must-gather-5vqhg" Jul 15 21:49:27.789236 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:27.789132 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f67ea68d-72ae-4b98-a389-dfdd53c1479d-must-gather-output\") pod \"must-gather-5vqhg\" (UID: \"f67ea68d-72ae-4b98-a389-dfdd53c1479d\") " pod="openshift-must-gather-8hvsf/must-gather-5vqhg" Jul 15 21:49:27.789500 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:27.789482 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f67ea68d-72ae-4b98-a389-dfdd53c1479d-must-gather-output\") pod \"must-gather-5vqhg\" (UID: \"f67ea68d-72ae-4b98-a389-dfdd53c1479d\") " pod="openshift-must-gather-8hvsf/must-gather-5vqhg" Jul 15 21:49:27.798265 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:27.798237 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w22h8\" (UniqueName: \"kubernetes.io/projected/f67ea68d-72ae-4b98-a389-dfdd53c1479d-kube-api-access-w22h8\") pod \"must-gather-5vqhg\" (UID: \"f67ea68d-72ae-4b98-a389-dfdd53c1479d\") " pod="openshift-must-gather-8hvsf/must-gather-5vqhg" Jul 15 21:49:27.932359 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:27.932248 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8hvsf/must-gather-5vqhg" Jul 15 21:49:28.114848 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:28.114816 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8hvsf/must-gather-5vqhg"] Jul 15 21:49:28.115001 ip-10-0-131-113 kubenswrapper[2570]: W0715 21:49:28.114870 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf67ea68d_72ae_4b98_a389_dfdd53c1479d.slice/crio-f7f3c185e666773c56d5d921fa16779dbb62c62808362f7c1bbe01007231dcf2 WatchSource:0}: Error finding container f7f3c185e666773c56d5d921fa16779dbb62c62808362f7c1bbe01007231dcf2: Status 404 returned error can't find the container with id f7f3c185e666773c56d5d921fa16779dbb62c62808362f7c1bbe01007231dcf2 Jul 15 21:49:28.183580 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:28.183492 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8hvsf/must-gather-5vqhg" event={"ID":"f67ea68d-72ae-4b98-a389-dfdd53c1479d","Type":"ContainerStarted","Data":"f7f3c185e666773c56d5d921fa16779dbb62c62808362f7c1bbe01007231dcf2"} Jul 15 21:49:29.192369 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:29.192337 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8hvsf/must-gather-5vqhg" event={"ID":"f67ea68d-72ae-4b98-a389-dfdd53c1479d","Type":"ContainerStarted","Data":"65508fe15eb0e068e83e6d4c01d68eb7eb08cab524416dc63551d3a7f629c00a"} Jul 15 21:49:30.203474 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:30.203434 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8hvsf/must-gather-5vqhg" event={"ID":"f67ea68d-72ae-4b98-a389-dfdd53c1479d","Type":"ContainerStarted","Data":"2b3f45ccebbfad544d02ce42cd9a4e83eea1d28acd4eb5055dfdc54107bbb924"} Jul 15 21:49:30.220017 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:30.219942 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8hvsf/must-gather-5vqhg" podStartSLOduration=2.351048489 podStartE2EDuration="3.219922957s" totalImagesPullingTime="868.874468ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:49:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:49:30.21885073 +0000 UTC m=+2392.113254795" watchObservedRunningTime="2026-07-15 21:49:30.219922957 +0000 UTC m=+2392.114327023" Jul 15 21:49:30.607353 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:30.607264 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8c5ks_14f84a19-c09e-4724-892e-46796e611bd9/global-pull-secret-syncer/0.log" Jul 15 21:49:30.813465 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:30.813428 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-t6sjg_7adb30c9-2d57-4688-a7cd-0bbb70fcd152/konnectivity-agent/0.log" Jul 15 21:49:30.837683 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:30.837645 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-113.ec2.internal_b6cd2e073ae6c0ce5cef35d9bfb6314d/haproxy/0.log" Jul 15 21:49:35.659786 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:35.659746 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599qdrm_3552a72a-0c17-4ca6-851a-dbfa12c23d49/extract/0.log" Jul 15 21:49:35.684324 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:35.684239 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599qdrm_3552a72a-0c17-4ca6-851a-dbfa12c23d49/util/0.log" Jul 15 21:49:35.711943 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:35.711915 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599qdrm_3552a72a-0c17-4ca6-851a-dbfa12c23d49/pull/0.log" Jul 15 21:49:35.751959 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:35.751679 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sb6zf_c7fc4b88-50e3-40b3-83fe-a67d05d56b78/extract/0.log" Jul 15 21:49:35.791718 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:35.791687 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sb6zf_c7fc4b88-50e3-40b3-83fe-a67d05d56b78/util/0.log" Jul 15 21:49:35.818400 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:35.818366 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sb6zf_c7fc4b88-50e3-40b3-83fe-a67d05d56b78/pull/0.log" Jul 15 21:49:35.875139 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:35.875110 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zlq4c_667c7c4e-0ab4-4034-9d8a-19dae1b6c79c/extract/0.log" Jul 15 21:49:35.901252 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:35.901226 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zlq4c_667c7c4e-0ab4-4034-9d8a-19dae1b6c79c/util/0.log" Jul 15 21:49:35.926803 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:35.926713 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zlq4c_667c7c4e-0ab4-4034-9d8a-19dae1b6c79c/pull/0.log" Jul 15 21:49:35.953438 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:35.953408 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pt4lv_05082e89-deef-4c9c-b3a4-f158b5831bef/extract/0.log" Jul 15 21:49:35.976513 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:35.976482 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pt4lv_05082e89-deef-4c9c-b3a4-f158b5831bef/util/0.log" Jul 15 21:49:35.996882 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:35.996848 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pt4lv_05082e89-deef-4c9c-b3a4-f158b5831bef/pull/0.log" Jul 15 21:49:36.543049 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:36.541850 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5bfd94b979-5lx6x_40bca165-8520-427d-8da9-1a0bf7776819/authorino/0.log" Jul 15 21:49:36.574530 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:36.574370 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-whr49_887411a9-6b6e-4c38-a047-6893b81ae21e/manager/0.log" Jul 15 21:49:36.599210 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:36.599121 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-mq6m4_1aa5b479-d659-48d8-9213-c56af45414e6/manager/0.log" Jul 15 21:49:36.668620 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:36.668585 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-ph8sr_590a0719-fcfa-459c-b855-a3ba5bf6d502/registry-server/0.log" Jul 15 21:49:36.901948 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:36.901911 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-ls7jm_c8a76546-f5ec-4b7c-809c-9ea015561752/manager/0.log" Jul 15 21:49:38.594155 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:38.594126 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_56145ec8-9dab-444d-879e-84a06571d7e0/alertmanager/0.log" Jul 15 21:49:38.619232 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:38.619173 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_56145ec8-9dab-444d-879e-84a06571d7e0/config-reloader/0.log" Jul 15 21:49:38.644255 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:38.644157 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_56145ec8-9dab-444d-879e-84a06571d7e0/kube-rbac-proxy-web/0.log" Jul 15 21:49:38.667546 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:38.667517 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_56145ec8-9dab-444d-879e-84a06571d7e0/kube-rbac-proxy/0.log" Jul 15 21:49:38.695253 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:38.695170 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_56145ec8-9dab-444d-879e-84a06571d7e0/kube-rbac-proxy-metric/0.log" Jul 15 21:49:38.717284 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:38.717256 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_56145ec8-9dab-444d-879e-84a06571d7e0/prom-label-proxy/0.log" Jul 15 21:49:38.753526 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:38.751694 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_56145ec8-9dab-444d-879e-84a06571d7e0/init-config-reloader/0.log" Jul 15 21:49:38.802877 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:38.802845 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-qfckd_e7f566a4-c5c1-43ce-a62b-fc01ed526059/cluster-monitoring-operator/0.log" Jul 15 21:49:38.815700 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:38.815666 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c5zg9_50d11f79-1eac-4ad4-8151-9b5dd54cd284/console-operator/1.log" Jul 15 21:49:38.825792 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:38.825765 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c5zg9_50d11f79-1eac-4ad4-8151-9b5dd54cd284/console-operator/1.log" Jul 15 21:49:38.826060 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:38.826039 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nhzkw_beb5b136-86fb-4e57-9b27-3fc1079a9af3/ovn-acl-logging/0.log" Jul 15 21:49:38.835791 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:38.835768 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nhzkw_beb5b136-86fb-4e57-9b27-3fc1079a9af3/ovn-acl-logging/0.log" Jul 15 21:49:38.949976 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:38.949936 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-24jkr_d406ed2e-c831-4cc7-b75c-ee0d77e14001/monitoring-plugin/0.log" Jul 15 21:49:38.978581 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:38.978549 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9nxsl_7ec004af-c7f8-4b94-b119-80ceadcd191e/node-exporter/0.log" Jul 15 21:49:38.997133 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:38.997101 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9nxsl_7ec004af-c7f8-4b94-b119-80ceadcd191e/kube-rbac-proxy/0.log" Jul 15 21:49:39.018346 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:39.018318 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9nxsl_7ec004af-c7f8-4b94-b119-80ceadcd191e/init-textfile/0.log" Jul 15 21:49:39.183139 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:39.183055 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-2nm8d_08da11a5-939f-4b2d-b706-9e497c9b0b12/kube-rbac-proxy-main/0.log" Jul 15 21:49:39.202308 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:39.202258 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-2nm8d_08da11a5-939f-4b2d-b706-9e497c9b0b12/kube-rbac-proxy-self/0.log" Jul 15 21:49:39.222749 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:39.222709 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-2nm8d_08da11a5-939f-4b2d-b706-9e497c9b0b12/openshift-state-metrics/0.log" Jul 15 21:49:39.426337 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:39.426308 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-4d4dd_1f2a470a-da11-4c99-b7ce-1c54dfb287ca/prometheus-operator/0.log" Jul 15 21:49:39.444384 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:39.444308 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-4d4dd_1f2a470a-da11-4c99-b7ce-1c54dfb287ca/kube-rbac-proxy/0.log" Jul 15 21:49:39.563197 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:39.563171 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b47559bdf-cgv8n_3269cef9-f9ab-41d1-b81a-9f9d177c4f43/thanos-query/0.log" Jul 15 21:49:39.583591 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:39.583560 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b47559bdf-cgv8n_3269cef9-f9ab-41d1-b81a-9f9d177c4f43/kube-rbac-proxy-web/0.log" Jul 15 21:49:39.606472 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:39.606444 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b47559bdf-cgv8n_3269cef9-f9ab-41d1-b81a-9f9d177c4f43/kube-rbac-proxy/0.log" Jul 15 21:49:39.626863 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:39.626833 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b47559bdf-cgv8n_3269cef9-f9ab-41d1-b81a-9f9d177c4f43/prom-label-proxy/0.log" Jul 15 21:49:39.659098 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:39.659066 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b47559bdf-cgv8n_3269cef9-f9ab-41d1-b81a-9f9d177c4f43/kube-rbac-proxy-rules/0.log" Jul 15 21:49:39.682266 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:39.682233 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b47559bdf-cgv8n_3269cef9-f9ab-41d1-b81a-9f9d177c4f43/kube-rbac-proxy-metrics/0.log" Jul 15 21:49:40.848740 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:40.848706 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8hvsf/perf-node-gather-daemonset-2f5v8"] Jul 15 21:49:40.849236 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:40.848781 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-bk2j8_f62c3a7f-e7e4-4185-bd8a-2bd81b8b37f2/networking-console-plugin/0.log" Jul 15 21:49:40.858477 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:40.858442 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-2f5v8" Jul 15 21:49:40.859618 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:40.859588 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8hvsf/perf-node-gather-daemonset-2f5v8"] Jul 15 21:49:40.960273 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:40.959505 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4f99b832-56ef-4680-bf88-33c6b54deb16-podres\") pod \"perf-node-gather-daemonset-2f5v8\" (UID: \"4f99b832-56ef-4680-bf88-33c6b54deb16\") " pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-2f5v8" Jul 15 21:49:40.960273 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:40.959663 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f99b832-56ef-4680-bf88-33c6b54deb16-sys\") pod \"perf-node-gather-daemonset-2f5v8\" (UID: \"4f99b832-56ef-4680-bf88-33c6b54deb16\") " pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-2f5v8" Jul 15 21:49:40.960273 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:40.959713 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4f99b832-56ef-4680-bf88-33c6b54deb16-proc\") pod \"perf-node-gather-daemonset-2f5v8\" (UID: \"4f99b832-56ef-4680-bf88-33c6b54deb16\") " pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-2f5v8" Jul 15 21:49:40.960273 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:40.959771 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4f99b832-56ef-4680-bf88-33c6b54deb16-lib-modules\") pod \"perf-node-gather-daemonset-2f5v8\" (UID: \"4f99b832-56ef-4680-bf88-33c6b54deb16\") " pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-2f5v8" Jul 15 21:49:40.960273 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:40.959824 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmw49\" (UniqueName: \"kubernetes.io/projected/4f99b832-56ef-4680-bf88-33c6b54deb16-kube-api-access-cmw49\") pod \"perf-node-gather-daemonset-2f5v8\" (UID: \"4f99b832-56ef-4680-bf88-33c6b54deb16\") " pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-2f5v8" Jul 15 21:49:41.060601 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:41.060570 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4f99b832-56ef-4680-bf88-33c6b54deb16-podres\") pod \"perf-node-gather-daemonset-2f5v8\" (UID: \"4f99b832-56ef-4680-bf88-33c6b54deb16\") " pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-2f5v8" Jul 15 21:49:41.060786 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:41.060654 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f99b832-56ef-4680-bf88-33c6b54deb16-sys\") pod \"perf-node-gather-daemonset-2f5v8\" (UID: \"4f99b832-56ef-4680-bf88-33c6b54deb16\") " pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-2f5v8" Jul 15 21:49:41.060786 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:41.060680 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4f99b832-56ef-4680-bf88-33c6b54deb16-proc\") pod \"perf-node-gather-daemonset-2f5v8\" (UID: \"4f99b832-56ef-4680-bf88-33c6b54deb16\") " pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-2f5v8" Jul 15 21:49:41.060786 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:41.060722 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4f99b832-56ef-4680-bf88-33c6b54deb16-lib-modules\") pod \"perf-node-gather-daemonset-2f5v8\" (UID: \"4f99b832-56ef-4680-bf88-33c6b54deb16\") " pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-2f5v8" Jul 15 21:49:41.060786 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:41.060758 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmw49\" (UniqueName: \"kubernetes.io/projected/4f99b832-56ef-4680-bf88-33c6b54deb16-kube-api-access-cmw49\") pod \"perf-node-gather-daemonset-2f5v8\" (UID: \"4f99b832-56ef-4680-bf88-33c6b54deb16\") " pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-2f5v8" Jul 15 21:49:41.060786 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:41.060761 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4f99b832-56ef-4680-bf88-33c6b54deb16-podres\") pod \"perf-node-gather-daemonset-2f5v8\" (UID: \"4f99b832-56ef-4680-bf88-33c6b54deb16\") " pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-2f5v8" Jul 15 21:49:41.060786 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:41.060766 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f99b832-56ef-4680-bf88-33c6b54deb16-sys\") pod \"perf-node-gather-daemonset-2f5v8\" (UID: \"4f99b832-56ef-4680-bf88-33c6b54deb16\") " pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-2f5v8" Jul 15 21:49:41.061113 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:41.060819 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4f99b832-56ef-4680-bf88-33c6b54deb16-proc\") pod \"perf-node-gather-daemonset-2f5v8\" (UID: \"4f99b832-56ef-4680-bf88-33c6b54deb16\") " pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-2f5v8" Jul 15 21:49:41.061113 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:41.060937 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4f99b832-56ef-4680-bf88-33c6b54deb16-lib-modules\") pod \"perf-node-gather-daemonset-2f5v8\" (UID: \"4f99b832-56ef-4680-bf88-33c6b54deb16\") " pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-2f5v8" Jul 15 21:49:41.068584 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:41.068555 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmw49\" (UniqueName: \"kubernetes.io/projected/4f99b832-56ef-4680-bf88-33c6b54deb16-kube-api-access-cmw49\") pod \"perf-node-gather-daemonset-2f5v8\" (UID: \"4f99b832-56ef-4680-bf88-33c6b54deb16\") " pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-2f5v8" Jul 15 21:49:41.183057 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:41.182763 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-2f5v8" Jul 15 21:49:41.395642 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:41.395614 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8hvsf/perf-node-gather-daemonset-2f5v8"] Jul 15 21:49:41.558597 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:41.558554 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c5zg9_50d11f79-1eac-4ad4-8151-9b5dd54cd284/console-operator/1.log" Jul 15 21:49:41.566918 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:41.566889 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c5zg9_50d11f79-1eac-4ad4-8151-9b5dd54cd284/console-operator/2.log" Jul 15 21:49:42.065331 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:42.065273 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5c67c8865f-bsbp8_7e5c603e-252b-4d49-b40a-50fc67c79c01/console/0.log" Jul 15 21:49:42.341337 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:42.341268 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-2f5v8" event={"ID":"4f99b832-56ef-4680-bf88-33c6b54deb16","Type":"ContainerStarted","Data":"a09caf0b6c9d3888351e4ca996679e3abdbf4c3ad92daedcb27b8b797d5f85fb"} Jul 15 21:49:42.341534 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:42.341357 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-2f5v8" event={"ID":"4f99b832-56ef-4680-bf88-33c6b54deb16","Type":"ContainerStarted","Data":"f9daecee1dad5a2a18675301fe1fbcc404900f47f1fbe11977ba067a0042b6fa"} Jul 15 21:49:42.341534 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:42.341426 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-2f5v8" Jul 15 21:49:42.359036 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:42.358990 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-2f5v8" podStartSLOduration=2.358975732 podStartE2EDuration="2.358975732s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:49:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:49:42.356033642 +0000 UTC m=+2404.250437706" watchObservedRunningTime="2026-07-15 21:49:42.358975732 +0000 UTC m=+2404.253379797" Jul 15 21:49:42.703324 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:42.703205 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-vk5n4_53febc71-9f61-4c4b-9001-64dc254e3188/volume-data-source-validator/0.log" Jul 15 21:49:43.767329 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:43.767280 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lr4hr_e8c2a4fd-b530-4bac-b9fa-6682ab28dde1/dns/0.log" Jul 15 21:49:43.787542 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:43.787514 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lr4hr_e8c2a4fd-b530-4bac-b9fa-6682ab28dde1/kube-rbac-proxy/0.log" Jul 15 21:49:43.905043 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:43.904997 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pxkxm_835fb8bf-2d1b-47f8-b6ef-25d16a2cc774/dns-node-resolver/0.log" Jul 15 21:49:44.486043 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:44.485991 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lkgf2_654026cc-fb99-41cc-b6c4-6fbc09801960/node-ca/0.log" Jul 15 21:49:45.429302 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:45.429258 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4tp4th_114cde3d-fb10-4a66-a029-152d6e5b54c7/istio-proxy/0.log" Jul 15 21:49:45.547276 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:45.547250 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cbf464cb7-8mjpx_1da9bba7-0ba9-4ab6-91b7-2dcf2893e401/kube-auth-proxy/0.log" Jul 15 21:49:45.601987 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:45.601954 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hnfjp_4b11aee3-8b5c-4517-925c-b5c6c0932fdb/istio-proxy/0.log" Jul 15 21:49:45.665967 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:45.665931 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hnfjp_4b11aee3-8b5c-4517-925c-b5c6c0932fdb/istio-proxy/1.log" Jul 15 21:49:45.703617 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:45.703507 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-54x66_af428720-6e24-4733-9a1a-0133212d6969/payload-pre-processing/0.log" Jul 15 21:49:45.748035 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:45.747998 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-ftvt9_30b77070-2603-4f74-ad7e-9308ac085dd8/payload-processing/0.log" Jul 15 21:49:45.772264 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:45.772205 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59ff8f8888-cmlk2_6c4352ba-2395-4d2c-b984-1af71646d3ae/router/0.log" Jul 15 21:49:46.427608 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:46.427548 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8pvn9_004e0571-8f51-4fb2-b25b-8946eaf65f05/serve-healthcheck-canary/0.log" Jul 15 21:49:46.954439 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:46.954406 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-ghgrt_e7e943fc-fff4-4503-b81e-a56f9f640700/insights-operator/1.log" Jul 15 21:49:46.954979 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:46.954955 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-ghgrt_e7e943fc-fff4-4503-b81e-a56f9f640700/insights-operator/0.log" Jul 15 21:49:47.043307 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:47.043272 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cpztv_c74a5d7d-85ae-4321-8b64-803a463e0284/kube-rbac-proxy/0.log" Jul 15 21:49:47.072265 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:47.072231 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cpztv_c74a5d7d-85ae-4321-8b64-803a463e0284/exporter/0.log" Jul 15 21:49:47.095859 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:47.095830 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cpztv_c74a5d7d-85ae-4321-8b64-803a463e0284/extractor/0.log" Jul 15 21:49:48.361957 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:48.361929 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8hvsf/perf-node-gather-daemonset-2f5v8" Jul 15 21:49:49.428064 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:49.428034 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-76phf_745fbddc-5ba4-47bc-82ec-5d2459817186/manager/0.log" Jul 15 21:49:49.668710 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:49.668681 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-plf56_9e5c5696-4755-4ff0-80cd-8353cd79ed37/manager/0.log" Jul 15 21:49:49.831992 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:49.831327 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-d79b5d84b-h7tmp_68aedec3-4453-455c-985a-5ad03f8fca5f/manager/0.log" Jul 15 21:49:49.853670 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:49.853634 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-69s79_e6a40d93-34b1-4cf6-93af-ec693a017d18/server/0.log" Jul 15 21:49:49.974107 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:49.974057 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-x7ftv_fb2d27e1-d593-477a-9312-1f56a7c3d795/manager/0.log" Jul 15 21:49:50.088657 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:50.088329 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d5d77c45b-6zkfh_81822492-d2d6-475e-b44f-7dda6d558b4f/manager/0.log" Jul 15 21:49:50.106063 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:50.106037 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d5d77c45b-6zkfh_81822492-d2d6-475e-b44f-7dda6d558b4f/copy-manifests/0.log" Jul 15 21:49:51.335896 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:51.335856 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4tp4th_114cde3d-fb10-4a66-a029-152d6e5b54c7/istio-proxy/0.log" Jul 15 21:49:51.442068 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:51.442038 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cbf464cb7-8mjpx_1da9bba7-0ba9-4ab6-91b7-2dcf2893e401/kube-auth-proxy/0.log" Jul 15 21:49:51.475343 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:51.475260 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hnfjp_4b11aee3-8b5c-4517-925c-b5c6c0932fdb/istio-proxy/0.log" Jul 15 21:49:51.557778 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:51.557738 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hnfjp_4b11aee3-8b5c-4517-925c-b5c6c0932fdb/istio-proxy/1.log" Jul 15 21:49:51.587258 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:51.587179 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-54x66_af428720-6e24-4733-9a1a-0133212d6969/payload-pre-processing/0.log" Jul 15 21:49:51.604589 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:51.604554 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-9hd6s_f1023110-f2cb-477c-a7e5-8f06998ee99a/openshift-lws-operator/0.log" Jul 15 21:49:51.618695 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:51.618664 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-ftvt9_30b77070-2603-4f74-ad7e-9308ac085dd8/payload-processing/0.log" Jul 15 21:49:51.637330 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:51.637304 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59ff8f8888-cmlk2_6c4352ba-2395-4d2c-b984-1af71646d3ae/router/0.log" Jul 15 21:49:52.890070 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:52.890035 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4tp4th_114cde3d-fb10-4a66-a029-152d6e5b54c7/istio-proxy/0.log" Jul 15 21:49:52.986899 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:52.986808 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cbf464cb7-8mjpx_1da9bba7-0ba9-4ab6-91b7-2dcf2893e401/kube-auth-proxy/0.log" Jul 15 21:49:53.030143 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:53.030110 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hnfjp_4b11aee3-8b5c-4517-925c-b5c6c0932fdb/istio-proxy/0.log" Jul 15 21:49:53.097861 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:53.097833 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hnfjp_4b11aee3-8b5c-4517-925c-b5c6c0932fdb/istio-proxy/1.log" Jul 15 21:49:53.128896 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:53.128855 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-54x66_af428720-6e24-4733-9a1a-0133212d6969/payload-pre-processing/0.log" Jul 15 21:49:53.162283 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:53.162254 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-ftvt9_30b77070-2603-4f74-ad7e-9308ac085dd8/payload-processing/0.log" Jul 15 21:49:53.176676 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:53.176640 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59ff8f8888-cmlk2_6c4352ba-2395-4d2c-b984-1af71646d3ae/router/0.log" Jul 15 21:49:56.824776 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:56.824740 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-txm4n_4498916d-507d-4f9a-94d3-b9fb0b68c4aa/kube-storage-version-migrator-operator/1.log" Jul 15 21:49:56.826579 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:56.826555 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-txm4n_4498916d-507d-4f9a-94d3-b9fb0b68c4aa/kube-storage-version-migrator-operator/0.log" Jul 15 21:49:57.931321 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:57.931271 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k25xr_e89cab18-de44-40e2-9486-0446676f8942/kube-multus-additional-cni-plugins/0.log" Jul 15 21:49:57.950629 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:57.950601 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k25xr_e89cab18-de44-40e2-9486-0446676f8942/egress-router-binary-copy/0.log" Jul 15 21:49:57.969402 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:57.969371 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k25xr_e89cab18-de44-40e2-9486-0446676f8942/cni-plugins/0.log" Jul 15 21:49:57.988944 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:57.988921 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k25xr_e89cab18-de44-40e2-9486-0446676f8942/bond-cni-plugin/0.log" Jul 15 21:49:58.008009 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:58.007979 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k25xr_e89cab18-de44-40e2-9486-0446676f8942/routeoverride-cni/0.log" Jul 15 21:49:58.026546 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:58.026520 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k25xr_e89cab18-de44-40e2-9486-0446676f8942/whereabouts-cni-bincopy/0.log" Jul 15 21:49:58.047179 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:58.047151 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k25xr_e89cab18-de44-40e2-9486-0446676f8942/whereabouts-cni/0.log" Jul 15 21:49:58.254381 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:58.254279 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-hmhs5_e8745d68-cd07-41f9-9c84-b0d1f12fa0c9/kube-multus/0.log" Jul 15 21:49:58.378158 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:58.378125 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-89vwd_e9154423-994b-45e7-9cad-813087e03e31/network-metrics-daemon/0.log" Jul 15 21:49:58.394663 ip-10-0-131-113 kubenswrapper[2570]: I0715 21:49:58.394634 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-89vwd_e9154423-994b-45e7-9cad-813087e03e31/kube-rbac-proxy/0.log"